system

The system addresses inefficiencies in architectural design and construction by integrating user input, simulation, negotiation, and 3D printing to automate the process, resulting in reduced time and costs.

JP2026062288APending Publication Date: 2026-04-09SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-09-30
Publication Date
2026-04-09

AI Technical Summary

Technical Problem

The conventional architectural design and construction process is inefficient due to complex interactions for reflecting user requirements, lack of an integrated system for simulations, estimates, negotiations, and construction, leading to difficulties in cost and time management.

Method used

A system that provides an interface for user input, generates designs considering sunlight and pedestrian traffic flow, calculates construction costs, automatically negotiates, orders materials, and constructs using a 3D printer, integrating design, estimation, negotiation, and construction processes.

Benefits of technology

The system automates the construction process, reducing time and costs by efficiently generating optimal building designs and constructions based on user requirements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026062288000001_ABST
    Figure 2026062288000001_ABST
Patent Text Reader

Abstract

We provide the system. [Solution] A means of providing an interface for users to input the address and requirements for construction, A means for generating a design based on the aforementioned address and requirements, and for performing simulations that take into account sunlight and pedestrian traffic flow, A means of calculating an estimate of construction costs based on the generated design plan and notifying the user, A means of automatically negotiating with users and proposing the optimal construction plan, A method for automatically ordering necessary parts from the cheapest supplier, A system that includes means for automatically constructing buildings using architectural 3D printers.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0003]

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional architectural design process, the interaction for reflecting user requirements is complex and time-consuming. There is also a lack of an integrated system for efficiently performing simulations, estimates, negotiations, ordering of members, and construction to create an optimal design plan. As a result, the entire architectural process is inefficient, and problems such as difficulty in cost and time management have occurred.

Means for Solving the Problems

[0005] To solve the above-mentioned problems, the present invention provides the following configuration: a system including means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing a simulation that takes into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; and means for automatically constructing using a 3D printer for construction. This system enables an efficient construction process based on the user's requirements.

[0006] A "user" refers to an individual or legal entity that uses the system to request processes such as architectural design, estimation, ordering, and construction.

[0007] An "interface" refers to a software or hardware component that provides a means for a user to input information into a system and operate it.

[0008] "Design" refers to the process of creating a building plan based on user requests and conditions, and the data generated as a result.

[0009] "Simulation" refers to a calculation and analysis method used in architectural design to virtually reproduce conditions such as sunlight and pedestrian traffic flow, and to select the optimal plan.

[0010] "Estimate" refers to the process of calculating construction costs based on the design and providing this information to the user, as well as the resulting data.

[0011] "Negotiation" refers to the process by which the user and the system mutually adjust conditions regarding the estimate results and design plan to determine the optimal construction plan.

[0012] "Components" refer to the materials and parts necessary for constructing a building.

[0013] "Placing an order" refers to the process of selecting the necessary components and ordering those materials or parts from the supplier.

[0014] "Supplier" refers to the companies or organizations that provide the materials necessary for construction.

[0015] A "3D printer for construction" refers to a device equipped with 3D printing technology that can physically construct buildings based on digital design data.

[0016] A "system" refers to the entire set of technical components that automate and integrally manage the design, estimation, negotiation, ordering, and construction processes based on user requirements. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10]Shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described according to the accompanying drawings.

[0019] First, the language used in the following description will be explained.

[0020] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0021] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. Specific embodiments for carrying out this invention are described below.

[0039] 1. User Input and Interface

[0040] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users can enter detailed requirements regarding the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance).

[0041] Specific example:

[0042] The user enters the address "1-2-3, Shibuya-ku, Tokyo" and their requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[0043] 2. Design and Simulation

[0044] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[0045] Specific example:

[0046] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[0047] 3. Quotation and Negotiation

[0048] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user enters their budget limits and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[0049] Specific example:

[0050] The server creates an estimate and notifies the user of a construction cost of 50 million yen. The user sets a budget limit of 45 million yen, and the server proposes a new plan within that budget and negotiates.

[0051] 4. Automated ordering

[0052] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. The server monitors the order status in real time and makes reorders or adjustments as needed.

[0053] Specific example:

[0054] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[0055] 5. Construction Phase

[0056] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. After construction is complete, a final inspection of the building is conducted.

[0057] Specific example:

[0058] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[0059] Based on the above configuration, the system of the present invention can efficiently design and construct optimal buildings according to the user's requirements. This system automates the entire construction process, leading to expected cost and time reductions.

[0060] The following describes the processing flow.

[0061] Step 1:

[0062] The user logs into the device. They enter the required authentication information and access the system.

[0063] Step 2:

[0064] The device retrieves user information and displays an input form for the building. The user enters the address where they want to build, the type of building, the floor plan, and the necessary functions (e.g., Wi-Fi or facial recognition entrance).

[0065] Step 3:

[0066] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[0067] Step 4:

[0068] The server analyzes the received data. Design parameters are set based on user requests and address information.

[0069] Step 5:

[0070] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[0071] Step 6:

[0072] The server simulates sunlight and pedestrian traffic patterns based on the generated design plan. It determines the optimal placement of windows and rooms.

[0073] Step 7:

[0074] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[0075] Step 8:

[0076] Based on the finalized design plan, the server estimates the construction costs. It calculates the necessary materials and labor costs to determine the total construction cost.

[0077] Step 9:

[0078] The server notifies the user of the estimate result. The user reviews the estimate and enters their budget and other requirements.

[0079] Step 10:

[0080] The user sends budget limits and changes to the server. The server receives the data and performs a re-evaluation.

[0081] Step 11:

[0082] The server generates a new design plan based on the re-evaluated data and proposes it to the user again. It then automatically negotiates with the user to determine the optimal construction plan.

[0083] Step 12:

[0084] After the final design plan is confirmed, the server generates a list of necessary components. This includes a detailed list of items such as window panes, lumber, and hardware.

[0085] Step 13:

[0086] The server retrieves price information for each component from a market database and selects the supplier with the lowest price. It then creates an order list.

[0087] Step 14:

[0088] The server automatically orders the parts. It sends the order to the supplier and confirms the delivery date.

[0089] Step 15:

[0090] The server monitors the order status in real time. Reorders and adjustments are made as needed.

[0091] Step 16:

[0092] The server installs a 3D printer for construction at the construction site and transmits the design data. It then instructs the 3D printer to begin construction.

[0093] Step 17:

[0094] The 3D printer automatically constructs the structure based on the design data. A server monitors the progress in real time and makes corrections and adjustments if problems occur.

[0095] Step 18:

[0096] After construction is complete, the server performs a final inspection of the building. The inspection results are reported to the user, and any necessary corrections are made.

[0097] Step 19:

[0098] Once all processes are complete, the server provides a final report to the user.

[0099] (Example 1)

[0100] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0101] Modern construction processes rely heavily on manual labor, posing challenges to efficiency and accuracy. In particular, the lack of a consistent workflow across the stages of design, estimation, negotiation, ordering, and construction, based on user requirements, leads to increased time and costs. Furthermore, optimizing resource utilization and maintaining quality are difficult.

[0102] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0103] In this invention, the server includes means for the user to input the address and requirements for construction; means for generating a design that takes into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs and notifying the user; means for conducting automated negotiations with the user; means for ordering necessary materials; means for carrying out construction using construction equipment; means for user login and authentication; means for analyzing user data and storing it in an internal data store; means for transmitting design data to construction equipment and instructing the start of construction; means for monitoring and adjusting the progress of construction; and means for conducting a final inspection. This automates the entire construction process, enabling efficient and accurate building design and construction.

[0104] An "interface" is a means for users to input the address and requirements for the building they wish to construct.

[0105] "Design software" is a program that a server uses to generate designs based on the user's address and requirements.

[0106] "Simulation" refers to calculation and analysis methods used to consider factors such as sunlight and pedestrian traffic flow based on the generated design plan.

[0107] "Estimate" refers to the total construction cost calculated based on the design plan generated by the server.

[0108] "Negotiation" is the process by which the server proposes a new construction plan based on the user's requests and budget, and then automatically adjusts and agrees to it.

[0109] "Components" is a term that refers to the materials and equipment necessary for the construction process.

[0110] "Suppliers" refers to the companies that provide the necessary components and the market database.

[0111] "Construction equipment" refers to mechanical equipment and devices that automatically carry out construction based on design data, and in particular includes construction 3D printers.

[0112] "Login and authentication" is the process of verifying a user's identity when they access a device.

[0113] "Data analysis" is the process of analyzing information entered by users and saving the necessary data to an internal data store.

[0114] "Design data" refers to data that includes construction drawings and specification information generated based on user requests.

[0115] "Monitoring progress" is the process of ensuring that construction is proceeding according to plan and making corrections or adjustments as necessary.

[0116] "Final inspection" refers to the quality check and verification process conducted after construction is completed.

[0117] This invention is a system aimed at automating the construction process. The system takes user inputs the address and specific requirements for construction, and then automatically performs the entire process from design and estimation to negotiation, ordering, and construction based on that information. This document details the system's features.

[0118] First, the user logs into the system using a terminal. After logging in, they input the address where they want to build and specific requirements (e.g., floor plan, sunlight exposure, pedestrian flow, communication functions, etc.) through the interface. The user interface is easy to use, and the input fields are designed to be intuitive.

[0119] For example, a user might enter an address such as "1-2-3, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[0120] The server receives data sent from users and performs analysis. This analysis includes standardizing address data and classifying requests.

[0121] Next, based on the analyzed data, the server uses design software (such as AutoCAD) to generate an initial building plan. The generated plan is then subjected to simulations that take into account sunlight and pedestrian traffic flow, and is optimized. If necessary, the placement of communication functions (such as Wi-Fi and facial recognition entrances) is also incorporated into the design.

[0122] Once a plan is generated, the server estimates the construction costs. This estimate includes listing materials and obtaining price information from the market. The user is notified of the estimate and provides feedback on their budget. If the estimate does not fit the user's budget, the user enters budget limits and changes, and the server proposes a new plan accordingly. This negotiation is automated and conducted via email or chatbot.

[0123] Once the user approves the plan and quote, the server generates a list of materials and selects the cheapest supplier from the market database. An automated order is then placed, and the order status is monitored in real time.

[0124] Once the construction phase begins, the server deploys construction equipment, such as 3D printers, to the construction site, transmits design data to the equipment, and starts construction. The progress is monitored by the server, and adjustments are made as needed. After construction is complete, a final inspection of the building is conducted.

[0125] This system automates the entire construction process, resulting in reduced time and costs. It also enables quick responses to specific user requests, allowing for the efficient delivery of high-quality buildings.

[0126] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0127] Step 1: User Login

[0128] Enter: Username and password

[0129] Output: Authentication result (success / failure)

[0130] Description: Users log in to the system via their device. The device provides a UI for entering a username and password, which the user enters and submits. The server receives the authentication information and verifies it using the authentication server and database. If authentication is successful, a session is started.

[0131] Step 2: Inputting User Needs

[0132] Input: Desired address and requirements for construction (e.g., "1-2-3, Shibuya-ku, Tokyo", "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance")

[0133] Output: User request data (JSON format)

[0134] Description: Users use a terminal to input their specific building requirements. The interface includes input fields for address, floor plan, sunlight exposure, and communication features. When the user enters information into these fields and presses the submit button, the data is sent to the server. The server converts the data into JSON format and stores it in its internal data store.

[0135] Step 3: Data Analysis

[0136] Input: User request data (JSON format)

[0137] Output: Analyzed data (address information, request classification information)

[0138] Description: The server analyzes the user request data it receives. Data processing is performed to standardize address data and classify requests. Specifically, the given address is converted to a standard format using a Geographic Information System (GIS), and the requests are classified into preset categories (e.g., floor plan, communication functions, etc.). The analysis results are stored in an internal database.

[0139] Step 4: Generating a design plan

[0140] Input: Analyzed data

[0141] Output: Initial architectural design plan (CAD data)

[0142] Description: The server launches design software (e.g., AutoCAD) based on the analyzed data and generates an initial architectural design plan. A script calls the design software's API to create drawings that reflect the user's requirements based on standard design templates. The generated CAD data is stored on the server.

[0143] Step 5: Simulation and Optimization

[0144] Input: Initial architectural design plan (CAD data)

[0145] Output: Optimized design plan (CAD data)

[0146] Description: The server optimizes the generated design plan by running it through simulation tools (e.g., sunlight simulation, traffic flow simulation). Specifically, it automatically corrects areas where improvements are needed in the building's layout and structure based on the simulation results. The optimized design plan is saved on the server.

[0147] Step 6: Generate an estimate

[0148] Input: Optimized design plan (CAD data)

[0149] Output: Estimate results (total amount, breakdown)

[0150] Description: The server estimates construction costs based on an optimized design plan. It extracts a list of necessary materials from the design data, obtains market price information, and calculates the total cost. Using an API, it retrieves material price information and labor costs from the internet to calculate the estimate. The estimate results are stored in an internal database in JSON format and notified to the user.

[0151] Step 7: Notifying and providing feedback to the user

[0152] Input: Estimate Result

[0153] Output: User feedback (budget limits and changes)

[0154] Description: The server notifies the user of the estimate result. The user reviews the estimate result on their terminal and re-enters feedback according to their budget. This feedback includes budget limits and design changes. The user's feedback data is sent to the server for analysis and adjustments.

[0155] Step 8: Negotiation and re-estimation

[0156] Input: User feedback

[0157] Output: New estimate results and design plan

[0158] Description: The server receives feedback from the user and generates a new design plan and estimate. It incorporates design changes, performs simulations and optimizations again, and recalculates the cost. Based on this, it notifies the user of the new design plan and estimate. This process is performed automatically and via email or chatbot.

[0159] Step 9: Generate parts list and place order

[0160] Input: Finalized design plan (CAD data), market database

[0161] Output: Order status of components

[0162] Description: The server generates a list of necessary components based on the finalized design plan. It extracts the type and quantity of materials from the design data and selects the cheapest supplier. It retrieves real-time price information from the market database using an API, selects the optimal supplier, and places an order. The order status is monitored in real time.

[0163] Step 10: Start of Construction

[0164] Input: Finalized design plan (CAD data)

[0165] Output: Construction progress

[0166] Description: The server deploys a 3D printer for construction to the construction site, sends design data to the 3D printer, and starts construction. Specifically, the server uploads data using printer control software and starts the construction process. The progress of construction is monitored in real time.

[0167] Step 11: Monitoring and adjusting progress

[0168] Input: Construction progress data

[0169] Output: Adjustment instructions, correction data

[0170] Description: The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It checks the construction status in real time via sensors and cameras and sends instructions to correct the printer's operation if there are any malfunctions.

[0171] Step 12: Final Inspection

[0172] Input: Completed building

[0173] Output: Inspection result (pass / fail), correction instructions

[0174] Description: After construction is complete, the server performs a final inspection of the building. It uses drones and sensors to check the building structure and for any defects. If any corrections are needed based on the inspection results, it will also issue instructions.

[0175] (Application Example 1)

[0176] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0177] Traditional construction processes have been plagued by challenges such as requiring a great deal of manual work and adjustments, resulting in significant time and cost. In particular, the design and simulation, estimation, ordering of materials, and construction processes required to meet user specifications are complex and inefficient. Therefore, the need for automated systems is increasing.

[0178] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0179] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for receiving input from the user via a smartphone or tablet; means for managing material production and construction processes within the factory in cooperation with multiple factory robots; and means for automatically performing construction using a building 3D printer. As a result, the design and construction of the optimal building according to the user's requirements can be carried out efficiently, making it possible to significantly reduce the cost and time of the entire construction process.

[0180] A "user" is an individual or legal entity that uses the system to request construction process services.

[0181] "Address" refers to the specific location information of the land on which construction is to be carried out.

[0182] "Requests" refer to detailed requirements regarding the specifications and functions of a building that the user desires.

[0183] An "interface" is the user interface provided by a system for inputting information.

[0184] "Design" refers to a plan of a building generated based on information entered by the user.

[0185] "Sunlight exposure" refers to the amount of sunlight a building receives and the effects of that sunlight on it.

[0186] "Human flow" refers to design elements that optimize the routes and movements of people inside and outside a building.

[0187] A "simulation" is a process of conducting a virtual verification based on a design plan, taking into account factors such as sunlight and pedestrian traffic flow.

[0188] An "estimate" is a rough estimate of the construction costs calculated based on the design plan.

[0189] "Notification" refers to the act of informing a user of the quotation results or other important information.

[0190] "Negotiation" is the process by which the user and the system exchange opinions on the optimal construction plan.

[0191] A "proposal" is the optimal construction plan presented by the system to the user.

[0192] "Components" refer to the various materials necessary to construct a building.

[0193] "Supplier" refers to the company or supplier that provides the components.

[0194] "Placing an order" is the act of ordering necessary materials from a supplier.

[0195] A "smartphone" is a mobile phone equipped with internet and software application capabilities.

[0196] A "tablet" is a small, portable computer that is primarily operated using a touchscreen.

[0197] A "factory robot" is an automated control device that performs material production and assembly tasks within a factory.

[0198] A "3D printer" is a machine that uses computer control to generate three-dimensional objects based on design data.

[0199] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on information entered by the user, such as the address and requirements for construction. This system is particularly specialized for inputting information via smartphones or tablets and for integrating with multiple factory robots to automate material production and construction processes within the factory.

[0200] User input and interface

[0201] Users access the system using a smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). The information entered by the user is sent to the server.

[0202] Design and Simulation

[0203] Based on the received address and requirements, the server generates an initial building plan using design software (e.g., AutoCAD). Next, the server simulates sunlight and pedestrian traffic patterns to optimize the plan. It also incorporates the placement of communication features (Wi-Fi and facial recognition entrances) into the design. During this process, it collaborates with multiple factory robots to simultaneously plan material production within the factory.

[0204] Estimate and negotiation

[0205] The server estimates construction costs based on the generated design plan. The user is notified of the estimate, and if it does not fit the user's budget, the user enters their budget limit and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[0206] Automatic ordering

[0207] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. It also monitors the order status in real time and makes reorders or adjustments as needed.

[0208] Construction phase

[0209] The server monitors 3D printers installed in factories or construction sites, sends design data to the printers, and initiates construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[0210] Specific example

[0211] For example, a user enters an address such as "1-2-3, Shibuya-ku, Tokyo" and their requirements such as "prioritizing sunlight, open kitchen, 3LDK, Wi-Fi, and facial recognition entrance" on their smartphone. If the estimate is approved at 45 million yen or less, the server automatically orders window glass, lumber, and other materials from the most suitable suppliers and begins construction using a 3D printer at the factory.

[0212] Example of a prompt

[0213] Address: 1-2-3 XX, Shibuya-ku, Tokyo

[0214] Requirements: Prioritize sunlight, open kitchen, 3 bedrooms, Wi-Fi, facial recognition entrance.

[0215] Please provide an estimate for a building plan based on these requirements.

[0216] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0217] Step 1:

[0218] Users access the system via smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). This data is then sent to the server.

[0219] Input: Address and building requirements data

[0220] Output: User data sent to the server

[0221] Step 2:

[0222] Based on the user data received by the server, an initial architectural plan is generated using design software (e.g., AutoCAD). Next, a simulation is performed that takes into account sunlight and pedestrian traffic flow to optimize the plan. The placement of communication functions is also considered simultaneously.

[0223] Input: User data, design software (such as AutoCAD)

[0224] Data processing: Simulation of sunlight and traffic flow

[0225] Output: Optimized design plan

[0226] Step 3:

[0227] The server calculates an estimate of construction costs based on the optimized design plan and notifies the user. The notification is sent via smartphone or tablet. If the user enters budget limits or changes, the server will propose a new construction plan.

[0228] Input: Optimized design plan, budget information

[0229] Data processing: Quotation calculation, automated negotiation system

[0230] Output: Estimate results, new construction plan

[0231] Step 4:

[0232] The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. It selects the cheapest supplier and automatically places orders for the components. The order status is monitored in real time, and reorders or adjustments are made as needed.

[0233] Input: Finalized design plan, supplier database

[0234] Data processing: Material list generation, price comparison

[0235] Output: Order list, order status monitoring

[0236] Step 5:

[0237] The server monitors the 3D printer installed at the construction site, sends the design data to the printer, and starts construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[0238] Input: Design data, 3D printer information

[0239] Data processing: Monitoring the progress of construction processes, problem-solving algorithms.

[0240] Output: Construction progress, final inspection results

[0241] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0242] The present invention is a system that automates a series of processes from design, estimation, negotiation, ordering, and construction based on information entered by the user, including the address and requirements for construction. It incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments based on those emotions. Specific embodiments for carrying out the present invention are described below.

[0243] 1. User Input and Interface

[0244] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users enter detailed requests regarding the address, type of building, floor plan, and necessary features (e.g., Wi-Fi and facial recognition entrance). The interface also incorporates an emotion engine that analyzes the user's voice and facial expressions in real time to recognize their emotions.

[0245] Specific example:

[0246] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from the user's facial expressions.

[0247] 2. Design and Simulation

[0248] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[0249] Specific example:

[0250] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[0251] 3. Quotation and Negotiation

[0252] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user inputs budget limits and desired changes. Furthermore, the emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server makes appropriate suggestions. Based on this data, the server proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[0253] Specific example:

[0254] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[0255] 4. Automated ordering

[0256] The server generates a list of necessary materials (e.g., window glass, wood, etc.) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. It creates an order list. The server automatically orders the materials and sends the orders to the suppliers. It monitors the order status in real time and makes reorders or adjustments as needed.

[0257] Specific example:

[0258] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[0259] 5. Construction Phase

[0260] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It also monitors the user's emotional state during construction and enhances user confidence by notifying them of the progress as needed. After construction is complete, a final inspection of the building is conducted.

[0261] Specific example:

[0262] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[0263] Based on the above configuration, the system of the present invention can efficiently design and construct buildings that meet the user's needs. Furthermore, by incorporating user emotion recognition using an emotion engine, it is possible to improve the user experience and increase satisfaction.

[0264] The following describes the processing flow.

[0265] Step 1:

[0266] The user logs into the device. They enter the required authentication information to access the system.

[0267] Step 2:

[0268] The terminal displays the user's information and the necessary input forms. The user enters the address where they want to build, the type of building, the floor plan, and the required functions (e.g., Wi-Fi or facial recognition entrance).

[0269] Step 3:

[0270] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[0271] Step 4:

[0272] The server analyzes the received data. Design parameters are set based on user requests and address information.

[0273] Step 5:

[0274] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[0275] Step 6:

[0276] The server generates a design plan, which is then used to simulate sunlight exposure and pedestrian traffic flow. This determines the optimal placement of windows and rooms.

[0277] Step 7:

[0278] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[0279] Step 8:

[0280] Based on the finalized design plan, the server estimates the construction cost. It calculates the required materials and labor costs and determines the total construction cost.

[0281] Step 9:

[0282] The server notifies the user of the estimation results. The user checks the estimate and enters the budget and other requirements. [[ID=,13]]

[0283] Step 10:

[0284] The user sends the budget limits and change points to the server. The server receives the data and re-evaluates.

[0285] Step 11:

[0286] Based on the re-evaluated data, the server generates a new design plan and proposes it to the user again. It conducts an automatic negotiation with the user to determine the optimal construction plan.

[0287] Step 12:

[0288] The emotion engine monitors the user's emotional state in real-time. If stress or dissatisfaction is detected, the server makes corresponding proposals.

[0289] Step 13:

[0290] After the final design plan is finalized, the server generates a list of required components. It includes a detailed list such as window glass, wood, and fittings.

[0291] Step 14:

[0292] The server obtains the price information of each component from the market database and selects the supplier with the lowest price. It creates an order list.

[0293] Step 15:

[0294] The server automatically orders components. It sends an order to the supplier and checks the delivery date.

[0295] Step 16:

[0296] The server monitors the order status in real time. It re-orders or makes adjustments as necessary.

[0297] Step 17:

[0298] The server installs a 3D printer for construction at the construction site and sends the design data. It instructs the 3D printer to start construction.

[0299] Step 18:

[0300] The 3D printer automatically conducts construction based on the design data. The server monitors the progress in real time and makes corrections or adjustments if problems occur.

[0301] Step 19:

[0302] During construction, the server regularly notifies the user of the progress. This enhances the user's sense of security.

[0303] Step 20:

[0304] After construction is completed, the server conducts a final inspection of the building. It reports the inspection results to the user and makes necessary corrections.

[0305] Step 21:

[0306] After confirming that all processes are completed, the server makes a final report to the user.

[0307] (Example 2)

[0308] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0309] Traditional construction processes involve individual steps from user input to design, estimation, negotiation, ordering, and construction. This is time-consuming and labor-intensive, and makes it difficult to adequately reflect the user's feelings and requests. Furthermore, adjustments to enhance user satisfaction are made manually, which is inefficient. In addition, the lack of real-time monitoring and adjustment of construction progress makes it difficult to provide users with a sense of security.

[0310] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0311] In this invention, the server includes means for analyzing the user's voice and facial expressions in real time and recognizing their emotions, means for automatically negotiating with the user and proposing the optimal construction plan, and means for monitoring the progress of construction in real time, analyzing the user's emotional state, and notifying them of the progress. This makes it possible to efficiently and automatically advance the construction process while reflecting the user's emotions and requests in real time.

[0312] A "user" is an individual or group that uses the system to input their building requirements and to review the design and estimates.

[0313] An "interface" refers to the screen or input device that a user uses to enter information such as their address or requests into a system.

[0314] An "emotion engine" is a combination of software and hardware that analyzes a user's voice and facial expressions in real time and recognizes their emotional state.

[0315] "Design software" refers to computer programs and related tools used to generate architectural design plans.

[0316] "Simulation" is a process for optimizing design plans by virtually reproducing architectural elements such as sunlight and pedestrian traffic flow.

[0317] "Estimation" refers to calculating the costs required for construction based on the generated design plan.

[0318] "Negotiation" refers to the process in which the user and the system interact with each other to agree on the construction plan that best suits the user's budget and requirements.

[0319] "Components" refer to individual materials and parts necessary for construction.

[0320] "Ordering" refers to the process of ordering and procuring necessary materials from suppliers.

[0321] A "3D printer for construction" refers to a mechanical device that automatically constructs physical buildings based on architectural design data.

[0322] "Real-time" refers to events or operations that occur almost instantly, meaning there is virtually no delay.

[0323] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. This system incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments accordingly. Specific embodiments for carrying out this invention are described below.

[0324] 1. User Input and Interface

[0325] The system provides an interface where users log in to the device and input the address and requirements for the building they wish to construct. The interface includes fields where users can input detailed address information, building type, floor plan, and required functions (e.g., Wi-Fi, facial recognition entrance). The device has a built-in camera and microphone, and an emotion engine analyzes the user's facial expressions and voice in real time to recognize emotions.

[0326] Specific example:

[0327] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from his facial expressions.

[0328] 2. Design and Simulation

[0329] Based on the address and requirements received by the server, an initial building plan is generated using design software (e.g., AutoCAD). Next, the server optimizes the initial plan using sunlight simulation software (e.g., Solar Analysis tool) and tools that simulate pedestrian traffic flow. These simulations also take into account the placement of communication functions specified by the user, such as Wi-Fi and facial recognition entrances.

[0330] Specific example:

[0331] The server generates a plan using AutoCAD based on the address and requirements, and then uses the Solar Analysis tool to create the optimal design plan, taking into account sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[0332] 3. Quotation and Negotiation

[0333] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they can review it on their device. If the estimate does not fit the budget, the user can input budget limits and desired changes. The emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server proposes an alternative plan accordingly. Negotiations are conducted via automated email or chatbot.

[0334] Specific example:

[0335] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[0336] 4. Automated ordering

[0337] The server generates a list of necessary components based on the finalized design plan. The server retrieves price information from market and supplier databases, selects the cheapest supplier, and creates an order list. Orders are placed automatically and sent to suppliers. The order status is monitored in real time, and reorders or adjustments are made as needed.

[0338] Specific example:

[0339] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[0340] 5. Construction Phase

[0341] The server installs a 3D printer at the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and immediately corrects or adjusts any problems that arise. It also monitors the user's emotional state during construction and provides timely updates to enhance the user's sense of security. After construction is complete, the server conducts a final inspection of the building to check for any defects.

[0342] Specific example:

[0343] The server uses a 3D printer for construction to proceed with construction according to the design data, and monitors the progress. If a printer malfunction is detected, the server immediately issues a correction order. An inspection is conducted after construction is complete.

[0344] This system makes it possible to efficiently advance the construction process while reflecting user requests in real time. Furthermore, to make it easy for anyone to implement the invention, specific hardware and software usage examples are shown, including the use of AutoCAD, Solar Analysis tools, and sentiment analysis software.

[0345] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0346] Step 1:

[0347] The user logs into the device.

[0348] Specific operation: The user starts up the device and enters their user ID and password on the login screen. The device performs authentication using authentication software.

[0349] Input: User ID, Password

[0350] Output: Authentication result (success / failure)

[0351] Step 2:

[0352] The user enters the address and requirements for the building.

[0353] Specific operation: The user enters their address and detailed requests (floor plan, functions, etc.) into the interface. The terminal sends this data to the server.

[0354] Input: Address information, requests (e.g., floor plan, required functions)

[0355] Output: Notification of completion of input data transmission

[0356] Step 3:

[0357] The emotion engine recognizes the user's emotions.

[0358] Specific operation: The device uses its built-in camera and microphone to capture the user's facial expressions and voice, and emotion analysis software performs the analysis. The recognition results are sent to a server.

[0359] Input: User facial expression data, voice data

[0360] Output: Emotion recognition result (e.g. nervousness, excitement)

[0361] Step 4:

[0362] The server analyzes the received data.

[0363] Specific operation: The server analyzes the address and request data received from the user and extracts the information necessary for creating a design plan.

[0364] Input: Received data (address, request, emotion recognition result)

[0365] Output: Analysis results (information necessary for creating a design plan)

[0366] Step 5:

[0367] The server generates the plan using design software.

[0368] Specific operation: The server launches design software (e.g., AutoCAD) and generates an initial building plan based on the analysis results.

[0369] Input: Analysis results (information necessary for creating a design plan)

[0370] Output: Initial design plan

[0371] Step 6:

[0372] The server performs the simulation.

[0373] Specific operation: The server uses sunlight simulation software (e.g., Solar Analysis tool) and pedestrian flow simulation tools to optimize the generated design plan.

[0374] Input: Initial design plan

[0375] Output: Optimization design plan

[0376] Step 7:

[0377] The server generates the estimate.

[0378] Specific operation: The server estimates construction costs based on the optimized design plan. It uses estimation calculation software.

[0379] Input: Optimization design plan

[0380] Output: Construction cost estimate

[0381] Step 8:

[0382] Notify the user of the estimate result.

[0383] Specific operation: The server notifies the user of the estimate result. The notification is made via the terminal interface or email.

[0384] Input: Construction cost estimate

[0385] Output: Quotation Notification

[0386] Step 9:

[0387] The user enters the budget and changes.

[0388] Specific operation: The user reviews the notified estimate and enters the budget and any changes into the interface. The terminal then sends this information to the server.

[0389] Input: Budget, Changes

[0390] Output: Notification of completion of input data transmission

[0391] Step 10:

[0392] The emotion engine detects the user's emotions.

[0393] Specific operation: The server's emotion engine analyzes the user's emotional state and detects stress and dissatisfaction.

[0394] Input: User facial expression data, voice data

[0395] Output: Emotion recognition result (e.g., stress, dissatisfaction)

[0396] Step 11:

[0397] The server generates suggestions.

[0398] Specific operation: The server generates alternative plans and cost-saving plans based on the user's budget and emotional state, and proposes them to the user.

[0399] Input: Budget, changes, sentiment recognition results

[0400] Output: Alternative plan proposal

[0401] Step 12:

[0402] Automatic ordering

[0403] Specific operation: The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. The server selects the supplier with the lowest price and automatically places an order.

[0404] Input: Finalized design plan, price database

[0405] Output: Parts order list, order submission

[0406] Step 13:

[0407] Construction phase

[0408] Specific operation: The server installs a 3D printer for construction at the construction site, sends the final design plan to the printer, and starts construction. The server monitors the operation of the 3D printer and immediately corrects or adjusts any problems that occur.

[0409] Input: Final design plan

[0410] Output: Construction progress, final building

[0411] Step 14:

[0412] Progress notification

[0413] Specific operation: The server monitors the construction progress in real time and periodically notifies the user of the progress. This allows the user to monitor the process with peace of mind.

[0414] Input: Construction progress

[0415] Output: Progress notification

[0416] Step 15:

[0417] Final inspection

[0418] Specific operation: After construction is complete, the server performs a final inspection of the building and detects any defects. The inspection results are reported to the user, and corrections are made as needed.

[0419] Input: Building completion data

[0420] Output: Inspection results, correction instructions

[0421] (Application Example 2)

[0422] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0423] A major problem with architectural projects is the significant effort and stress involved when users manage the entire process themselves, from design and estimation to ordering and construction. Furthermore, the lack of consideration for users' emotional needs and the resulting uniform proposals risk decreased user satisfaction. This is particularly problematic for store owners designing and constructing their own stores, who often face stress due to their busy schedules and insufficient collection of specific design requirements.

[0424] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0425] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for automatically constructing using a 3D printer for construction; means for analyzing the user's emotions and adjusting the design and proposals based on the analysis results; means for processing input from a visual device worn by the store owner and collecting design requests for the store; and means for providing an interface using a head-mounted display or smartphone. This enables appropriate proposals that take into account the user's emotions, making it possible to design and construct physical stores efficiently and in a way that enhances user satisfaction.

[0426] A "user" refers to an individual or organization that uses the system to design, estimate, order, and construct architectural projects.

[0427] An "interface" refers to a screen or device that allows a user to input information into a system and for the system to provide information to the user.

[0428] "Design" refers to the process of planning the structure and layout of a building based on user requests, and creating specific drawings and plans.

[0429] "Simulation" is a method for virtually reproducing elements such as sunlight and pedestrian traffic flow based on a generated design plan, and then optimizing it.

[0430] "Estimate" refers to the process of calculating construction costs based on the design plan, and determining the amount to be notified to the user.

[0431] "Negotiation" refers to the process of reconciling the user's requests and budget with the system's proposals to determine the optimal construction plan for both parties.

[0432] "Components" refer to the materials and parts necessary to construct a building.

[0433] "Supplier" refers to the companies or contractors that provide the necessary materials for a construction project.

[0434] A "3D printer for construction" is a device that uses 3D printing technology to construct physical buildings based on digital design data.

[0435] "Methods for analyzing emotions" refers to technologies that recognize emotions from a user's voice and facial expressions and extract the analysis results.

[0436] "Visual devices" refer to devices that provide visual information to users, such as head-mounted displays and smartphones.

[0437] "Means of providing an interface" refers to technologies that provide functions for users to access and operate a system through visual devices.

[0438] This invention implements the system using the following procedure. First, an interface is provided for the user to input the address and requirements for the building they wish to construct. The user can use this interface to input details such as the type of building, floor plan, and necessary functions. The interface incorporates an emotion analysis function that analyzes the user's voice and facial expressions in real time. An emotion recognition library such as EmotionRecognizer is used for this analysis.

[0439] Next, the server generates a design based on the address and requirements entered by the user. This process integrates design software (e.g., AutoCAD). The server simulates sunlight and pedestrian traffic flow to generate an optimized design plan. Furthermore, communication features such as Wi-Fi and facial recognition entrances are incorporated into the design according to the user's requests.

[0440] Based on the generated design plan, the server calculates an estimate of the construction costs. For this purpose, an estimation module called Estimator is used. The estimate results are notified to the user for review. If the estimate does not fit the user's budget, the user re-enters budget limits and desired changes. Furthermore, an emotion analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, a new construction plan is proposed. This negotiation process is handled automatically by the server.

[0441] Next, the server automatically orders the necessary components from the cheapest supplier. The server retrieves price information from market and supplier databases and selects the optimal supplier. The order status is monitored in real time, and reorders and adjustments are made as needed.

[0442] During the construction phase, the server automatically carries out construction using a 3D printer. The server monitors the progress and makes corrections and adjustments if problems occur. To enhance user confidence, the progress of construction is notified periodically.

[0443] Finally, the system provides an interface that allows users to gain a more concrete understanding of and adjust the design of their physical stores using head-mounted displays or smartphones. This enables store owners to incorporate their requests in real time.

[0444] Specific example:

[0445] The store owner wears a head-mounted display and walks around the store, inputting information by voice, such as "1-2-3, Shibuya-ku, Tokyo; large checkout counter; three self-checkout registers; security cameras." The system analyzes the owner's emotions from their facial expressions and tone of voice, and if it determines that they are feeling stressed, it proposes several cost-reduction plans.

[0446] Example of a prompt:

[0447] Analyze the user's emotional state and generate architectural proposals based on that analysis. The user's address is "1-2-3, Shibuya-ku, Tokyo," and they desire a large checkout counter, three self-checkout machines, and security cameras. If the user is identified as experiencing stress, propose the best plan within their budget.

[0448] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0449] Step 1:

[0450] Users log in to the interface using a head-mounted display or smartphone and enter the address and requirements for the building they wish to construct. The entered information includes details such as the address, type of building, floor plan, and required functions. The interface analyzes the user's voice and facial expressions in real time to recognize their emotional state.

[0451] Input: User-entered address, building requirements, voice, and facial expressions.

[0452] Output: Analyzed emotional state, user request data

[0453] Step 2:

[0454] The server generates a design plan based on the address and requirements entered by the user. Using design software (e.g., AutoCAD), the server simulates sunlight and pedestrian traffic flow to create an optimized design plan. Furthermore, requirements such as communication functions (Wi-Fi and facial recognition entrance) are also included in the design.

[0455] Input: User request data, building requirements

[0456] Output: Initial design plan

[0457] Step 3:

[0458] The server calculates an estimate of construction costs based on the generated design plan. Using the Estimator module, the server performs a detailed cost assessment and notifies the user of the results.

[0459] Input: Initial design plan

[0460] Output: Estimate of construction costs

[0461] Step 4:

[0462] The user reviews the notified estimate and, if it doesn't fit their budget, enters budget limits or changes. The sentiment analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server will propose a new construction plan and readjust the design plan. This negotiation process is managed automatically by the server.

[0463] Input: User budget constraints, emotional state

[0464] Output: Adjusted design plan, optimal construction proposal

[0465] Step 5:

[0466] Based on the finalized design plan, the server automatically orders the necessary components from the cheapest suppliers. The server retrieves price information from market and supplier databases and creates an order list. The order status is monitored in real time, and reorders and adjustments are made as needed.

[0467] Input: Finalized design plan, material list

[0468] Output: Order list, Order status

[0469] Step 6:

[0470] The server automatically starts construction using a building 3D printer. The server sends design data to the 3D printer and monitors the progress of construction. If problems occur, it makes necessary corrections and adjustments. The server also notifies the user of the progress as it progresses, providing peace of mind. After construction is complete, a final inspection is performed.

[0471] Input: Design data, construction status data

[0472] Output: Construction progress, final building

[0473] Step 7:

[0474] Users can use head-mounted displays or smartphones to visually monitor the design and construction process and make adjustments in real time. This interface allows users to flexibly incorporate their specific requests.

[0475] Input: Real-time construction information, user's visual device operation

[0476] Output: User-adjusted design and progress

[0477] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0478] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0479] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0480] [Second Embodiment]

[0481] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0482] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0483] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0484] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0485] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0486] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0487] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0488] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0489] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0490] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0491] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0492] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0493] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. Specific embodiments for carrying out this invention are described below.

[0494] 1. User Input and Interface

[0495] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users can enter detailed requirements regarding the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance).

[0496] Specific example:

[0497] The user enters the address "1-2-3, Shibuya-ku, Tokyo" and their requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[0498] 2. Design and Simulation

[0499] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[0500] Specific example:

[0501] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[0502] 3. Quotation and Negotiation

[0503] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user enters their budget limits and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[0504] Specific example:

[0505] The server creates an estimate and notifies the user of a construction cost of 50 million yen. The user sets a budget limit of 45 million yen, and the server proposes a new plan within that budget and negotiates.

[0506] 4. Automated ordering

[0507] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. The server monitors the order status in real time and makes reorders or adjustments as needed.

[0508] Specific example:

[0509] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[0510] 5. Construction Phase

[0511] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. After construction is complete, a final inspection of the building is conducted.

[0512] Specific example:

[0513] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[0514] Based on the above configuration, the system of the present invention can efficiently design and construct optimal buildings according to the user's requirements. This system automates the entire construction process, leading to expected cost and time reductions.

[0515] The following describes the processing flow.

[0516] Step 1:

[0517] The user logs into the device. They enter the required authentication information and access the system.

[0518] Step 2:

[0519] The device retrieves user information and displays an input form for the building. The user enters the address where they want to build, the type of building, the floor plan, and the necessary functions (e.g., Wi-Fi or facial recognition entrance).

[0520] Step 3:

[0521] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[0522] Step 4:

[0523] The server analyzes the received data. Design parameters are set based on user requests and address information.

[0524] Step 5:

[0525] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[0526] Step 6:

[0527] The server simulates sunlight and pedestrian traffic patterns based on the generated design plan. It determines the optimal placement of windows and rooms.

[0528] Step 7:

[0529] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[0530] Step 8:

[0531] Based on the finalized design plan, the server estimates the construction costs. It calculates the necessary materials and labor costs to determine the total construction cost.

[0532] Step 9:

[0533] The server notifies the user of the estimate result. The user reviews the estimate and enters their budget and other requirements.

[0534] Step 10:

[0535] The user sends budget limits and changes to the server. The server receives the data and performs a re-evaluation.

[0536] Step 11:

[0537] The server generates a new design plan based on the re-evaluated data and proposes it to the user again. It then automatically negotiates with the user to determine the optimal construction plan.

[0538] Step 12:

[0539] After the final design plan is confirmed, the server generates a list of necessary components. This includes a detailed list of items such as window panes, lumber, and hardware.

[0540] Step 13:

[0541] The server retrieves price information for each component from a market database and selects the supplier with the lowest price. It then creates an order list.

[0542] Step 14:

[0543] The server automatically orders the parts. It sends the order to the supplier and confirms the delivery date.

[0544] Step 15:

[0545] The server monitors the order status in real time. Reorders and adjustments are made as needed.

[0546] Step 16:

[0547] The server installs a 3D printer for construction at the construction site and transmits the design data. It then instructs the 3D printer to begin construction.

[0548] Step 17:

[0549] The 3D printer automatically constructs the structure based on the design data. A server monitors the progress in real time and makes corrections and adjustments if problems occur.

[0550] Step 18:

[0551] After construction is complete, the server performs a final inspection of the building. The inspection results are reported to the user, and any necessary corrections are made.

[0552] Step 19:

[0553] Once all processes are complete, the server provides a final report to the user.

[0554] (Example 1)

[0555] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0556] Modern construction processes rely heavily on manual labor, posing challenges to efficiency and accuracy. In particular, the lack of a consistent workflow across the stages of design, estimation, negotiation, ordering, and construction, based on user requirements, leads to increased time and costs. Furthermore, optimizing resource utilization and maintaining quality are difficult.

[0557] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0558] In this invention, the server includes means for the user to input the address and requirements for construction; means for generating a design that takes into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs and notifying the user; means for conducting automated negotiations with the user; means for ordering necessary materials; means for carrying out construction using construction equipment; means for user login and authentication; means for analyzing user data and storing it in an internal data store; means for transmitting design data to construction equipment and instructing the start of construction; means for monitoring and adjusting the progress of construction; and means for conducting a final inspection. This automates the entire construction process, enabling efficient and accurate building design and construction.

[0559] An "interface" is a means for users to input the address and requirements for the building they wish to construct.

[0560] "Design software" is a program that a server uses to generate designs based on the user's address and requirements.

[0561] "Simulation" refers to calculation and analysis methods used to consider factors such as sunlight and pedestrian traffic flow based on the generated design plan.

[0562] "Estimate" refers to the total construction cost calculated based on the design plan generated by the server.

[0563] "Negotiation" is the process by which the server proposes a new construction plan based on the user's requests and budget, and then automatically adjusts and agrees to it.

[0564] "Components" is a term that refers to the materials and equipment necessary for the construction process.

[0565] "Suppliers" refers to the companies that provide the necessary components and the market database.

[0566] "Construction equipment" refers to mechanical equipment and devices that automatically carry out construction based on design data, and in particular includes construction 3D printers.

[0567] "Login and authentication" is the process of verifying a user's identity when they access a device.

[0568] "Data analysis" is the process of analyzing information entered by users and saving the necessary data to an internal data store.

[0569] "Design data" refers to data that includes construction drawings and specification information generated based on user requests.

[0570] "Monitoring progress" is the process of ensuring that construction is proceeding according to plan and making corrections or adjustments as necessary.

[0571] "Final inspection" refers to the quality check and verification process conducted after construction is completed.

[0572] This invention is a system aimed at automating the construction process. The system takes user inputs the address and specific requirements for construction, and then automatically performs the entire process from design and estimation to negotiation, ordering, and construction based on that information. This document details the system's features.

[0573] First, the user logs into the system using a terminal. After logging in, they input the address where they want to build and specific requirements (e.g., floor plan, sunlight exposure, pedestrian flow, communication functions, etc.) through the interface. The user interface is easy to use, and the input fields are designed to be intuitive.

[0574] For example, a user might enter an address such as "1-2-3, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[0575] The server receives data sent from users and performs analysis. This analysis includes standardizing address data and classifying requests.

[0576] Next, based on the analyzed data, the server uses design software (such as AutoCAD) to generate an initial building plan. The generated plan is then subjected to simulations that take into account sunlight and pedestrian traffic flow, and is optimized. If necessary, the placement of communication functions (such as Wi-Fi and facial recognition entrances) is also incorporated into the design.

[0577] Once a plan is generated, the server estimates the construction costs. This estimate includes listing materials and obtaining price information from the market. The user is notified of the estimate and provides feedback on their budget. If the estimate does not fit the user's budget, the user enters budget limits and changes, and the server proposes a new plan accordingly. This negotiation is automated and conducted via email or chatbot.

[0578] Once the user approves the plan and quote, the server generates a list of materials and selects the cheapest supplier from the market database. An automated order is then placed, and the order status is monitored in real time.

[0579] Once the construction phase begins, the server deploys construction equipment, such as 3D printers, to the construction site, transmits design data to the equipment, and starts construction. The progress is monitored by the server, and adjustments are made as needed. After construction is complete, a final inspection of the building is conducted.

[0580] This system automates the entire construction process, resulting in reduced time and costs. It also enables quick responses to specific user requests, allowing for the efficient delivery of high-quality buildings.

[0581] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0582] Step 1: User Login

[0583] Enter: Username and password

[0584] Output: Authentication result (success / failure)

[0585] Description: Users log in to the system via their device. The device provides a UI for entering a username and password, which the user enters and submits. The server receives the authentication information and verifies it using the authentication server and database. If authentication is successful, a session is started.

[0586] Step 2: Inputting User Needs

[0587] Input: Desired address and requirements for construction (e.g., "1-2-3, Shibuya-ku, Tokyo", "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance")

[0588] Output: User request data (JSON format)

[0589] Description: Users use a terminal to input their specific building requirements. The interface includes input fields for address, floor plan, sunlight exposure, and communication features. When the user enters information into these fields and presses the submit button, the data is sent to the server. The server converts the data into JSON format and stores it in its internal data store.

[0590] Step 3: Data Analysis

[0591] Input: User request data (JSON format)

[0592] Output: Analyzed data (address information, request classification information)

[0593] Description: The server analyzes the user request data it receives. Data processing is performed to standardize address data and classify requests. Specifically, the given address is converted to a standard format using a Geographic Information System (GIS), and the requests are classified into preset categories (e.g., floor plan, communication functions, etc.). The analysis results are stored in an internal database.

[0594] Step 4: Generating a design plan

[0595] Input: Analyzed data

[0596] Output: Initial architectural design plan (CAD data)

[0597] Description: The server launches design software (e.g., AutoCAD) based on the analyzed data and generates an initial architectural design plan. A script calls the design software's API to create drawings that reflect the user's requirements based on standard design templates. The generated CAD data is stored on the server.

[0598] Step 5: Simulation and Optimization

[0599] Input: Initial architectural design plan (CAD data)

[0600] Output: Optimized design plan (CAD data)

[0601] Description: The server optimizes the generated design plan by running it through simulation tools (e.g., sunlight simulation, traffic flow simulation). Specifically, it automatically corrects areas where improvements are needed in the building's layout and structure based on the simulation results. The optimized design plan is saved on the server.

[0602] Step 6: Generate an estimate

[0603] Input: Optimized design plan (CAD data)

[0604] Output: Estimate results (total amount, breakdown)

[0605] Description: The server estimates construction costs based on an optimized design plan. It extracts a list of necessary materials from the design data, obtains market price information, and calculates the total cost. Using an API, it retrieves material price information and labor costs from the internet to calculate the estimate. The estimate results are stored in an internal database in JSON format and notified to the user.

[0606] Step 7: Notifying and providing feedback to the user

[0607] Input: Estimate Result

[0608] Output: User feedback (budget limits and changes)

[0609] Description: The server notifies the user of the estimate result. The user reviews the estimate result on their terminal and re-enters feedback according to their budget. This feedback includes budget limits and design changes. The user's feedback data is sent to the server for analysis and adjustments.

[0610] Step 8: Negotiation and re-estimation

[0611] Input: User feedback

[0612] Output: New estimate results and design plan

[0613] Description: The server receives feedback from the user and generates a new design plan and estimate. It incorporates design changes, performs simulations and optimizations again, and recalculates the cost. Based on this, it notifies the user of the new design plan and estimate. This process is performed automatically and via email or chatbot.

[0614] Step 9: Generate parts list and place order

[0615] Input: Finalized design plan (CAD data), market database

[0616] Output: Order status of components

[0617] Description: The server generates a list of necessary components based on the finalized design plan. It extracts the type and quantity of materials from the design data and selects the cheapest supplier. It retrieves real-time price information from the market database using an API, selects the optimal supplier, and places an order. The order status is monitored in real time.

[0618] Step 10: Start of Construction

[0619] Input: Finalized design plan (CAD data)

[0620] Output: Construction progress

[0621] Description: The server deploys a 3D printer for construction to the construction site, sends design data to the 3D printer, and starts construction. Specifically, the server uploads data using printer control software and starts the construction process. The progress of construction is monitored in real time.

[0622] Step 11: Monitoring and adjusting progress

[0623] Input: Construction progress data

[0624] Output: Adjustment instructions, correction data

[0625] Description: The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It checks the construction status in real time via sensors and cameras and sends instructions to correct the printer's operation if there are any malfunctions.

[0626] Step 12: Final Inspection

[0627] Input: Completed building

[0628] Output: Inspection result (pass / fail), correction instructions

[0629] Description: After construction is complete, the server performs a final inspection of the building. It uses drones and sensors to check the building structure and for any defects. If any corrections are needed based on the inspection results, it will also issue instructions.

[0630] (Application Example 1)

[0631] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0632] Traditional construction processes have been plagued by challenges such as requiring a great deal of manual work and adjustments, resulting in significant time and cost. In particular, the design and simulation, estimation, ordering of materials, and construction processes required to meet user specifications are complex and inefficient. Therefore, the need for automated systems is increasing.

[0633] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0634] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for receiving input from the user via a smartphone or tablet; means for managing material production and construction processes within the factory in cooperation with multiple factory robots; and means for automatically performing construction using a building 3D printer. As a result, the design and construction of the optimal building according to the user's requirements can be carried out efficiently, making it possible to significantly reduce the cost and time of the entire construction process.

[0635] A "user" is an individual or legal entity that uses the system to request construction process services.

[0636] "Address" refers to the specific location information of the land on which construction is to be carried out.

[0637] "Requests" refer to detailed requirements regarding the specifications and functions of a building that the user desires.

[0638] An "interface" is the user interface provided by a system for inputting information.

[0639] "Design" refers to a plan of a building generated based on information entered by the user.

[0640] "Sunlight exposure" refers to the amount of sunlight a building receives and the effects of that sunlight on it.

[0641] "Human flow" refers to design elements that optimize the routes and movements of people inside and outside a building.

[0642] A "simulation" is a process of conducting a virtual verification based on a design plan, taking into account factors such as sunlight and pedestrian traffic flow.

[0643] An "estimate" is a rough estimate of the construction costs calculated based on the design plan.

[0644] "Notification" refers to the act of informing a user of the quotation results or other important information.

[0645] "Negotiation" is the process by which the user and the system exchange opinions on the optimal construction plan.

[0646] A "proposal" is the optimal construction plan presented by the system to the user.

[0647] "Components" refer to the various materials necessary to construct a building.

[0648] "Supplier" refers to the company or supplier that provides the components.

[0649] "Placing an order" is the act of ordering necessary materials from a supplier.

[0650] A "smartphone" is a mobile phone equipped with internet and software application capabilities.

[0651] A "tablet" is a small, portable computer that is primarily operated using a touchscreen.

[0652] A "factory robot" is an automated control device that performs material production and assembly tasks within a factory.

[0653] A "3D printer" is a machine that uses computer control to generate three-dimensional objects based on design data.

[0654] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on information entered by the user, such as the address and requirements for construction. This system is particularly specialized for inputting information via smartphones or tablets and for integrating with multiple factory robots to automate material production and construction processes within the factory.

[0655] User input and interface

[0656] Users access the system using a smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). The information entered by the user is sent to the server.

[0657] Design and Simulation

[0658] Based on the received address and requirements, the server generates an initial building plan using design software (e.g., AutoCAD). Next, the server simulates sunlight and pedestrian traffic patterns to optimize the plan. It also incorporates the placement of communication features (Wi-Fi and facial recognition entrances) into the design. During this process, it collaborates with multiple factory robots to simultaneously plan material production within the factory.

[0659] Estimate and negotiation

[0660] The server estimates construction costs based on the generated design plan. The user is notified of the estimate, and if it does not fit the user's budget, the user enters their budget limit and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[0661] Automatic ordering

[0662] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. It also monitors the order status in real time and makes reorders or adjustments as needed.

[0663] Construction phase

[0664] The server monitors 3D printers installed in factories or construction sites, sends design data to the printers, and initiates construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[0665] Specific example

[0666] For example, a user enters an address such as "1-2-3, Shibuya-ku, Tokyo" and their requirements such as "prioritizing sunlight, open kitchen, 3LDK, Wi-Fi, and facial recognition entrance" on their smartphone. If the estimate is approved at 45 million yen or less, the server automatically orders window glass, lumber, and other materials from the most suitable suppliers and begins construction using a 3D printer at the factory.

[0667] Example of a prompt

[0668] Address: 1-2-3 XX, Shibuya-ku, Tokyo

[0669] Requirements: Prioritize sunlight, open kitchen, 3 bedrooms, Wi-Fi, facial recognition entrance.

[0670] Please provide an estimate for a building plan based on these requirements.

[0671] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0672] Step 1:

[0673] Users access the system via smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). This data is then sent to the server.

[0674] Input: Address and building requirements data

[0675] Output: User data sent to the server

[0676] Step 2:

[0677] Based on the user data received by the server, an initial architectural plan is generated using design software (e.g., AutoCAD). Next, a simulation is performed that takes into account sunlight and pedestrian traffic flow to optimize the plan. The placement of communication functions is also considered simultaneously.

[0678] Input: User data, design software (such as AutoCAD)

[0679] Data processing: Simulation of sunlight and traffic flow

[0680] Output: Optimized design plan

[0681] Step 3:

[0682] The server calculates an estimate of construction costs based on the optimized design plan and notifies the user. The notification is sent via smartphone or tablet. If the user enters budget limits or changes, the server will propose a new construction plan.

[0683] Input: Optimized design plan, budget information

[0684] Data processing: Quotation calculation, automated negotiation system

[0685] Output: Estimate results, new construction plan

[0686] Step 4:

[0687] The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. It selects the cheapest supplier and automatically places orders for the components. The order status is monitored in real time, and reorders or adjustments are made as needed.

[0688] Input: Finalized design plan, supplier database

[0689] Data processing: Material list generation, price comparison

[0690] Output: Order list, order status monitoring

[0691] Step 5:

[0692] The server monitors the 3D printer installed at the construction site, sends the design data to the printer, and starts construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[0693] Input: Design data, 3D printer information

[0694] Data processing: Monitoring the progress of construction processes, problem-solving algorithms.

[0695] Output: Construction progress, final inspection results

[0696] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0697] The present invention is a system that automates a series of processes from design, estimation, negotiation, ordering, and construction based on information entered by the user, including the address and requirements for construction. It incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments based on those emotions. Specific embodiments for carrying out the present invention are described below.

[0698] 1. User Input and Interface

[0699] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users enter detailed requests regarding the address, type of building, floor plan, and necessary features (e.g., Wi-Fi and facial recognition entrance). The interface also incorporates an emotion engine that analyzes the user's voice and facial expressions in real time to recognize their emotions.

[0700] Specific example:

[0701] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from the user's facial expressions.

[0702] 2. Design and Simulation

[0703] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[0704] Specific example:

[0705] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[0706] 3. Quotation and Negotiation

[0707] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user inputs budget limits and desired changes. Furthermore, the emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server makes appropriate suggestions. Based on this data, the server proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[0708] Specific example:

[0709] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[0710] 4. Automated ordering

[0711] The server generates a list of necessary materials (e.g., window glass, wood, etc.) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. It creates an order list. The server automatically orders the materials and sends the orders to the suppliers. It monitors the order status in real time and makes reorders or adjustments as needed.

[0712] Specific example:

[0713] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[0714] 5. Construction Phase

[0715] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It also monitors the user's emotional state during construction and enhances user confidence by notifying them of the progress as needed. After construction is complete, a final inspection of the building is conducted.

[0716] Specific example:

[0717] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[0718] Based on the above configuration, the system of the present invention can efficiently design and construct buildings that meet the user's needs. Furthermore, by incorporating user emotion recognition using an emotion engine, it is possible to improve the user experience and increase satisfaction.

[0719] The following describes the processing flow.

[0720] Step 1:

[0721] The user logs into the device. They enter the required authentication information to access the system.

[0722] Step 2:

[0723] The terminal displays the user's information and the necessary input forms. The user enters the address where they want to build, the type of building, the floor plan, and the required functions (e.g., Wi-Fi or facial recognition entrance).

[0724] Step 3:

[0725] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[0726] Step 4:

[0727] The server analyzes the received data. Design parameters are set based on user requests and address information.

[0728] Step 5:

[0729] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[0730] Step 6:

[0731] The server generates a design plan, which is then used to simulate sunlight exposure and pedestrian traffic flow. This determines the optimal placement of windows and rooms.

[0732] Step 7:

[0733] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[0734] Step 8:

[0735] Based on the finalized design plan, the server estimates the construction costs. It calculates the necessary materials and labor costs to determine the total construction cost.

[0736] Step 9:

[0737] The server notifies the user of the estimate result. The user reviews the estimate and enters their budget and other requirements.

[0738] Step 10:

[0739] The user sends budget limits and changes to the server. The server receives the data and performs a re-evaluation.

[0740] Step 11:

[0741] The server generates a new design plan based on the re-evaluated data and proposes it to the user again. It then automatically negotiates with the user to determine the optimal construction plan.

[0742] Step 12:

[0743] The emotion engine monitors the user's emotional state in real time. If stress or dissatisfaction is detected, the server provides appropriate suggestions.

[0744] Step 13:

[0745] After the final design plan is confirmed, the server generates a list of necessary components. This includes a detailed list of items such as window panes, lumber, and hardware.

[0746] Step 14:

[0747] The server retrieves price information for each component from a market database and selects the supplier with the lowest price. It then creates an order list.

[0748] Step 15:

[0749] The server automatically orders the parts. It sends the order to the supplier and confirms the delivery date.

[0750] Step 16:

[0751] The server monitors the order status in real time. Reorders and adjustments are made as needed.

[0752] Step 17:

[0753] The server installs a 3D printer for construction at the construction site and transmits the design data. It then instructs the 3D printer to begin construction.

[0754] Step 18:

[0755] The 3D printer automatically constructs the structure based on the design data. A server monitors the progress in real time and makes corrections and adjustments if problems occur.

[0756] Step 19:

[0757] During construction, the server will periodically notify users of the progress, thereby increasing user confidence.

[0758] Step 20:

[0759] After construction is complete, the server performs a final inspection of the building. The inspection results are reported to the user, and any necessary corrections are made.

[0760] Step 21:

[0761] Once all processes are complete, the server provides a final report to the user.

[0762] (Example 2)

[0763] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0764] Traditional construction processes involve individual steps from user input to design, estimation, negotiation, ordering, and construction. This is time-consuming and labor-intensive, and makes it difficult to adequately reflect the user's feelings and requests. Furthermore, adjustments to enhance user satisfaction are made manually, which is inefficient. In addition, the lack of real-time monitoring and adjustment of construction progress makes it difficult to provide users with a sense of security.

[0765] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0766] In this invention, the server includes means for analyzing the user's voice and facial expressions in real time and recognizing their emotions, means for automatically negotiating with the user and proposing the optimal construction plan, and means for monitoring the progress of construction in real time, analyzing the user's emotional state, and notifying them of the progress. This makes it possible to efficiently and automatically advance the construction process while reflecting the user's emotions and requests in real time.

[0767] A "user" is an individual or group that uses the system to input their building requirements and to review the design and estimates.

[0768] An "interface" refers to the screen or input device that a user uses to enter information such as their address or requests into a system.

[0769] An "emotion engine" is a combination of software and hardware that analyzes a user's voice and facial expressions in real time and recognizes their emotional state.

[0770] "Design software" refers to computer programs and related tools used to generate architectural design plans.

[0771] "Simulation" is a process for optimizing design plans by virtually reproducing architectural elements such as sunlight and pedestrian traffic flow.

[0772] "Estimation" refers to calculating the costs required for construction based on the generated design plan.

[0773] "Negotiation" refers to the process in which the user and the system interact with each other to agree on the construction plan that best suits the user's budget and requirements.

[0774] "Components" refer to individual materials and parts necessary for construction.

[0775] "Ordering" refers to the process of ordering and procuring necessary materials from suppliers.

[0776] A "3D printer for construction" refers to a mechanical device that automatically constructs physical buildings based on architectural design data.

[0777] "Real-time" refers to events or operations that occur almost instantly, meaning there is virtually no delay.

[0778] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. This system incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments accordingly. Specific embodiments for carrying out this invention are described below.

[0779] 1. User Input and Interface

[0780] The system provides an interface where users log in to the device and input the address and requirements for the building they wish to construct. The interface includes fields where users can input detailed address information, building type, floor plan, and required functions (e.g., Wi-Fi, facial recognition entrance). The device has a built-in camera and microphone, and an emotion engine analyzes the user's facial expressions and voice in real time to recognize emotions.

[0781] Specific example:

[0782] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from his facial expressions.

[0783] 2. Design and Simulation

[0784] Based on the address and requirements received by the server, an initial building plan is generated using design software (e.g., AutoCAD). Next, the server optimizes the initial plan using sunlight simulation software (e.g., Solar Analysis tool) and tools that simulate pedestrian traffic flow. These simulations also take into account the placement of communication functions specified by the user, such as Wi-Fi and facial recognition entrances.

[0785] Specific example:

[0786] The server generates a plan using AutoCAD based on the address and requirements, and then uses the Solar Analysis tool to create the optimal design plan, taking into account sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[0787] 3. Quotation and Negotiation

[0788] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they can review it on their device. If the estimate does not fit the budget, the user can input budget limits and desired changes. The emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server proposes an alternative plan accordingly. Negotiations are conducted via automated email or chatbot.

[0789] Specific example:

[0790] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[0791] 4. Automated ordering

[0792] The server generates a list of necessary components based on the finalized design plan. The server retrieves price information from market and supplier databases, selects the cheapest supplier, and creates an order list. Orders are placed automatically and sent to suppliers. The order status is monitored in real time, and reorders or adjustments are made as needed.

[0793] Specific example:

[0794] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[0795] 5. Construction Phase

[0796] The server installs a 3D printer at the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and immediately corrects or adjusts any problems that arise. It also monitors the user's emotional state during construction and provides timely updates to enhance the user's sense of security. After construction is complete, the server conducts a final inspection of the building to check for any defects.

[0797] Specific example:

[0798] The server uses a 3D printer for construction to proceed with construction according to the design data, and monitors the progress. If a printer malfunction is detected, the server immediately issues a correction order. An inspection is conducted after construction is complete.

[0799] This system makes it possible to efficiently advance the construction process while reflecting user requests in real time. Furthermore, to make it easy for anyone to implement the invention, specific hardware and software usage examples are shown, including the use of AutoCAD, Solar Analysis tools, and sentiment analysis software.

[0800] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0801] Step 1:

[0802] The user logs into the device.

[0803] Specific operation: The user starts up the device and enters their user ID and password on the login screen. The device performs authentication using authentication software.

[0804] Input: User ID, Password

[0805] Output: Authentication result (success / failure)

[0806] Step 2:

[0807] The user enters the address and requirements for the building.

[0808] Specific operation: The user enters their address and detailed requests (floor plan, functions, etc.) into the interface. The terminal sends this data to the server.

[0809] Input: Address information, requests (e.g., floor plan, required functions)

[0810] Output: Notification of completion of input data transmission

[0811] Step 3:

[0812] The emotion engine recognizes the user's emotions.

[0813] Specific operation: The device uses its built-in camera and microphone to capture the user's facial expressions and voice, and emotion analysis software performs the analysis. The recognition results are sent to a server.

[0814] Input: User facial expression data, voice data

[0815] Output: Emotion recognition result (e.g. nervousness, excitement)

[0816] Step 4:

[0817] The server analyzes the received data.

[0818] Specific operation: The server analyzes the address and request data received from the user and extracts the information necessary for creating a design plan.

[0819] Input: Received data (address, request, emotion recognition result)

[0820] Output: Analysis results (information necessary for creating a design plan)

[0821] Step 5:

[0822] The server generates the plan using design software.

[0823] Specific operation: The server launches design software (e.g., AutoCAD) and generates an initial building plan based on the analysis results.

[0824] Input: Analysis results (information necessary for creating a design plan)

[0825] Output: Initial design plan

[0826] Step 6:

[0827] The server performs the simulation.

[0828] Specific operation: The server uses sunlight simulation software (e.g., Solar Analysis tool) and pedestrian flow simulation tools to optimize the generated design plan.

[0829] Input: Initial design plan

[0830] Output: Optimization design plan

[0831] Step 7:

[0832] The server generates the estimate.

[0833] Specific operation: The server estimates construction costs based on the optimized design plan. It uses estimation calculation software.

[0834] Input: Optimization design plan

[0835] Output: Construction cost estimate

[0836] Step 8:

[0837] Notify the user of the estimate result.

[0838] Specific operation: The server notifies the user of the estimate result. The notification is made via the terminal interface or email.

[0839] Input: Construction cost estimate

[0840] Output: Quotation Notification

[0841] Step 9:

[0842] The user enters the budget and changes.

[0843] Specific operation: The user reviews the notified estimate and enters the budget and any changes into the interface. The terminal then sends this information to the server.

[0844] Input: Budget, Changes

[0845] Output: Notification of completion of input data transmission

[0846] Step 10:

[0847] The emotion engine detects the user's emotions.

[0848] Specific operation: The server's emotion engine analyzes the user's emotional state and detects stress and dissatisfaction.

[0849] Input: User facial expression data, voice data

[0850] Output: Emotion recognition result (e.g., stress, dissatisfaction)

[0851] Step 11:

[0852] The server generates suggestions.

[0853] Specific operation: The server generates alternative plans and cost-saving plans based on the user's budget and emotional state, and proposes them to the user.

[0854] Input: Budget, changes, sentiment recognition results

[0855] Output: Alternative plan proposal

[0856] Step 12:

[0857] Automatic ordering

[0858] Specific operation: The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. The server selects the supplier with the lowest price and automatically places an order.

[0859] Input: Finalized design plan, price database

[0860] Output: Parts order list, order submission

[0861] Step 13:

[0862] Construction phase

[0863] Specific operation: The server installs a 3D printer for construction at the construction site, sends the final design plan to the printer, and starts construction. The server monitors the operation of the 3D printer and immediately corrects or adjusts any problems that occur.

[0864] Input: Final design plan

[0865] Output: Construction progress, final building

[0866] Step 14:

[0867] Progress notification

[0868] Specific operation: The server monitors the construction progress in real time and periodically notifies the user of the progress. This allows the user to monitor the process with peace of mind.

[0869] Input: Construction progress

[0870] Output: Progress notification

[0871] Step 15:

[0872] Final inspection

[0873] Specific operation: After construction is complete, the server performs a final inspection of the building and detects any defects. The inspection results are reported to the user, and corrections are made as needed.

[0874] Input: Building completion data

[0875] Output: Inspection results, correction instructions

[0876] (Application Example 2)

[0877] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0878] A major problem with architectural projects is the significant effort and stress involved when users manage the entire process themselves, from design and estimation to ordering and construction. Furthermore, the lack of consideration for users' emotional needs and the resulting uniform proposals risk decreased user satisfaction. This is particularly problematic for store owners designing and constructing their own stores, who often face stress due to their busy schedules and insufficient collection of specific design requirements.

[0879] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0880] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for automatically constructing using a 3D printer for construction; means for analyzing the user's emotions and adjusting the design and proposals based on the analysis results; means for processing input from a visual device worn by the store owner and collecting design requests for the store; and means for providing an interface using a head-mounted display or smartphone. This enables appropriate proposals that take into account the user's emotions, making it possible to design and construct physical stores efficiently and in a way that enhances user satisfaction.

[0881] A "user" refers to an individual or organization that uses the system to design, estimate, order, and construct architectural projects.

[0882] An "interface" refers to a screen or device that allows a user to input information into a system and for the system to provide information to the user.

[0883] "Design" refers to the process of planning the structure and layout of a building based on user requests, and creating specific drawings and plans.

[0884] "Simulation" is a method for virtually reproducing elements such as sunlight and pedestrian traffic flow based on a generated design plan, and then optimizing it.

[0885] "Estimate" refers to the process of calculating construction costs based on the design plan, and determining the amount to be notified to the user.

[0886] "Negotiation" refers to the process of reconciling the user's requests and budget with the system's proposals to determine the optimal construction plan for both parties.

[0887] "Components" refer to the materials and parts necessary to construct a building.

[0888] "Supplier" refers to the companies or contractors that provide the necessary materials for a construction project.

[0889] A "3D printer for construction" is a device that uses 3D printing technology to construct physical buildings based on digital design data.

[0890] "Methods for analyzing emotions" refers to technologies that recognize emotions from a user's voice and facial expressions and extract the analysis results.

[0891] "Visual devices" refer to devices that provide visual information to users, such as head-mounted displays and smartphones.

[0892] "Means of providing an interface" refers to technologies that provide functions for users to access and operate a system through visual devices.

[0893] This invention implements the system using the following procedure. First, an interface is provided for the user to input the address and requirements for the building they wish to construct. The user can use this interface to input details such as the type of building, floor plan, and necessary functions. The interface incorporates an emotion analysis function that analyzes the user's voice and facial expressions in real time. An emotion recognition library such as EmotionRecognizer is used for this analysis.

[0894] Next, the server generates a design based on the address and requirements entered by the user. This process integrates design software (e.g., AutoCAD). The server simulates sunlight and pedestrian traffic flow to generate an optimized design plan. Furthermore, communication features such as Wi-Fi and facial recognition entrances are incorporated into the design according to the user's requests.

[0895] Based on the generated design plan, the server calculates an estimate of the construction costs. For this purpose, an estimation module called Estimator is used. The estimate results are notified to the user for review. If the estimate does not fit the user's budget, the user re-enters budget limits and desired changes. Furthermore, an emotion analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, a new construction plan is proposed. This negotiation process is handled automatically by the server.

[0896] Next, the server automatically orders the necessary components from the cheapest supplier. The server retrieves price information from market and supplier databases and selects the optimal supplier. The order status is monitored in real time, and reorders and adjustments are made as needed.

[0897] During the construction phase, the server automatically carries out construction using a 3D printer. The server monitors the progress and makes corrections and adjustments if problems occur. To enhance user confidence, the progress of construction is notified periodically.

[0898] Finally, the system provides an interface that allows users to gain a more concrete understanding of and adjust the design of their physical stores using head-mounted displays or smartphones. This enables store owners to incorporate their requests in real time.

[0899] Specific example:

[0900] The store owner wears a head-mounted display and walks around the store, inputting information by voice, such as "1-2-3, Shibuya-ku, Tokyo; large checkout counter; three self-checkout registers; security cameras." The system analyzes the owner's emotions from their facial expressions and tone of voice, and if it determines that they are feeling stressed, it proposes several cost-reduction plans.

[0901] Example of a prompt:

[0902] Analyze the user's emotional state and generate architectural proposals based on that analysis. The user's address is "1-2-3, Shibuya-ku, Tokyo," and they desire a large checkout counter, three self-checkout machines, and security cameras. If the user is identified as experiencing stress, propose the best plan within their budget.

[0903] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0904] Step 1:

[0905] Users log in to the interface using a head-mounted display or smartphone and enter the address and requirements for the building they wish to construct. The entered information includes details such as the address, type of building, floor plan, and required functions. The interface analyzes the user's voice and facial expressions in real time to recognize their emotional state.

[0906] Input: User-entered address, building requirements, voice, and facial expressions.

[0907] Output: Analyzed emotional state, user request data

[0908] Step 2:

[0909] The server generates a design plan based on the address and requirements entered by the user. Using design software (e.g., AutoCAD), the server simulates sunlight and pedestrian traffic flow to create an optimized design plan. Furthermore, requirements such as communication functions (Wi-Fi and facial recognition entrance) are also included in the design.

[0910] Input: User request data, building requirements

[0911] Output: Initial design plan

[0912] Step 3:

[0913] The server calculates an estimate of construction costs based on the generated design plan. Using the Estimator module, the server performs a detailed cost assessment and notifies the user of the results.

[0914] Input: Initial design plan

[0915] Output: Estimate of construction costs

[0916] Step 4:

[0917] The user reviews the notified estimate and, if it doesn't fit their budget, enters budget limits or changes. The sentiment analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server will propose a new construction plan and readjust the design plan. This negotiation process is managed automatically by the server.

[0918] Input: User budget constraints, emotional state

[0919] Output: Adjusted design plan, optimal construction proposal

[0920] Step 5:

[0921] Based on the finalized design plan, the server automatically orders the necessary components from the cheapest suppliers. The server retrieves price information from market and supplier databases and creates an order list. The order status is monitored in real time, and reorders and adjustments are made as needed.

[0922] Input: Finalized design plan, material list

[0923] Output: Order list, Order status

[0924] Step 6:

[0925] The server automatically starts construction using a building 3D printer. The server sends design data to the 3D printer and monitors the progress of construction. If problems occur, it makes necessary corrections and adjustments. The server also notifies the user of the progress as it progresses, providing peace of mind. After construction is complete, a final inspection is performed.

[0926] Input: Design data, construction status data

[0927] Output: Construction progress, final building

[0928] Step 7:

[0929] Users can use head-mounted displays or smartphones to visually monitor the design and construction process and make adjustments in real time. This interface allows users to flexibly incorporate their specific requests.

[0930] Input: Real-time construction information, user's visual device operation

[0931] Output: User-adjusted design and progress

[0932] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0933] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0934] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0935] [Third Embodiment]

[0936] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0937] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0938] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0939] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0940] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0941] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0942] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0943] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0944] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0945] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0946] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0947] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0948] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. Specific embodiments for carrying out this invention are described below.

[0949] 1. User Input and Interface

[0950] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users can enter detailed requirements regarding the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance).

[0951] Specific example:

[0952] The user enters the address "1-2-3, Shibuya-ku, Tokyo" and their requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[0953] 2. Design and Simulation

[0954] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[0955] Specific example:

[0956] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[0957] 3. Quotation and Negotiation

[0958] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user enters their budget limits and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[0959] Specific example:

[0960] The server creates an estimate and notifies the user of a construction cost of 50 million yen. The user sets a budget limit of 45 million yen, and the server proposes a new plan within that budget and negotiates.

[0961] 4. Automated ordering

[0962] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. The server monitors the order status in real time and makes reorders or adjustments as needed.

[0963] Specific example:

[0964] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[0965] 5. Construction Phase

[0966] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. After construction is complete, a final inspection of the building is conducted.

[0967] Specific example:

[0968] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[0969] Based on the above configuration, the system of the present invention can efficiently design and construct optimal buildings according to the user's requirements. This system automates the entire construction process, leading to expected cost and time reductions.

[0970] The following describes the processing flow.

[0971] Step 1:

[0972] The user logs into the device. They enter the required authentication information and access the system.

[0973] Step 2:

[0974] The device retrieves user information and displays an input form for the building. The user enters the address where they want to build, the type of building, the floor plan, and the necessary functions (e.g., Wi-Fi or facial recognition entrance).

[0975] Step 3:

[0976] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[0977] Step 4:

[0978] The server analyzes the received data. Design parameters are set based on user requests and address information.

[0979] Step 5:

[0980] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[0981] Step 6:

[0982] The server simulates sunlight and pedestrian traffic patterns based on the generated design plan. It determines the optimal placement of windows and rooms.

[0983] Step 7:

[0984] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[0985] Step 8:

[0986] Based on the finalized design plan, the server estimates the construction costs. It calculates the necessary materials and labor costs to determine the total construction cost.

[0987] Step 9:

[0988] The server notifies the user of the estimate result. The user reviews the estimate and enters their budget and other requirements.

[0989] Step 10:

[0990] The user sends budget limits and changes to the server. The server receives the data and performs a re-evaluation.

[0991] Step 11:

[0992] The server generates a new design plan based on the re-evaluated data and proposes it to the user again. It then automatically negotiates with the user to determine the optimal construction plan.

[0993] Step 12:

[0994] After the final design plan is confirmed, the server generates a list of necessary components. This includes a detailed list of items such as window panes, lumber, and hardware.

[0995] Step 13:

[0996] The server retrieves price information for each component from a market database and selects the supplier with the lowest price. It then creates an order list.

[0997] Step 14:

[0998] The server automatically orders the parts. It sends the order to the supplier and confirms the delivery date.

[0999] Step 15:

[1000] The server monitors the order status in real time. Reorders and adjustments are made as needed.

[1001] Step 16:

[1002] The server installs a 3D printer for construction at the construction site and transmits the design data. It then instructs the 3D printer to begin construction.

[1003] Step 17:

[1004] The 3D printer automatically constructs the structure based on the design data. A server monitors the progress in real time and makes corrections and adjustments if problems occur.

[1005] Step 18:

[1006] After construction is complete, the server performs a final inspection of the building. The inspection results are reported to the user, and any necessary corrections are made.

[1007] Step 19:

[1008] Once all processes are complete, the server provides a final report to the user.

[1009] (Example 1)

[1010] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1011] Modern construction processes rely heavily on manual labor, posing challenges to efficiency and accuracy. In particular, the lack of a consistent workflow across the stages of design, estimation, negotiation, ordering, and construction, based on user requirements, leads to increased time and costs. Furthermore, optimizing resource utilization and maintaining quality are difficult.

[1012] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1013] In this invention, the server includes means for the user to input the address and requirements for construction; means for generating a design that takes into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs and notifying the user; means for conducting automated negotiations with the user; means for ordering necessary materials; means for carrying out construction using construction equipment; means for user login and authentication; means for analyzing user data and storing it in an internal data store; means for transmitting design data to construction equipment and instructing the start of construction; means for monitoring and adjusting the progress of construction; and means for conducting a final inspection. This automates the entire construction process, enabling efficient and accurate building design and construction.

[1014] An "interface" is a means for users to input the address and requirements for the building they wish to construct.

[1015] "Design software" is a program that a server uses to generate designs based on the user's address and requirements.

[1016] "Simulation" refers to calculation and analysis methods used to consider factors such as sunlight and pedestrian traffic flow based on the generated design plan.

[1017] "Estimate" refers to the total construction cost calculated based on the design plan generated by the server.

[1018] "Negotiation" is the process by which the server proposes a new construction plan based on the user's requests and budget, and then automatically adjusts and agrees to it.

[1019] "Components" is a term that refers to the materials and equipment necessary for the construction process.

[1020] "Suppliers" refers to the companies that provide the necessary components and the market database.

[1021] "Construction equipment" refers to mechanical equipment and devices that automatically carry out construction based on design data, and in particular includes construction 3D printers.

[1022] "Login and authentication" is the process of verifying a user's identity when they access a device.

[1023] "Data analysis" is the process of analyzing information entered by users and saving the necessary data to an internal data store.

[1024] "Design data" refers to data that includes construction drawings and specification information generated based on user requests.

[1025] "Monitoring progress" is the process of ensuring that construction is proceeding according to plan and making corrections or adjustments as necessary.

[1026] "Final inspection" refers to the quality check and verification process conducted after construction is completed.

[1027] This invention is a system aimed at automating the construction process. The system takes user inputs the address and specific requirements for construction, and then automatically performs the entire process from design and estimation to negotiation, ordering, and construction based on that information. This document details the system's features.

[1028] First, the user logs into the system using a terminal. After logging in, they input the address where they want to build and specific requirements (e.g., floor plan, sunlight exposure, pedestrian flow, communication functions, etc.) through the interface. The user interface is easy to use, and the input fields are designed to be intuitive.

[1029] For example, a user might enter an address such as "1-2-3, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[1030] The server receives data sent from users and performs analysis. This analysis includes standardizing address data and classifying requests.

[1031] Next, based on the analyzed data, the server uses design software (such as AutoCAD) to generate an initial building plan. The generated plan is then subjected to simulations that take into account sunlight and pedestrian traffic flow, and is optimized. If necessary, the placement of communication functions (such as Wi-Fi and facial recognition entrances) is also incorporated into the design.

[1032] Once a plan is generated, the server estimates the construction costs. This estimate includes listing materials and obtaining price information from the market. The user is notified of the estimate and provides feedback on their budget. If the estimate does not fit the user's budget, the user enters budget limits and changes, and the server proposes a new plan accordingly. This negotiation is automated and conducted via email or chatbot.

[1033] Once the user approves the plan and quote, the server generates a list of materials and selects the cheapest supplier from the market database. An automated order is then placed, and the order status is monitored in real time.

[1034] Once the construction phase begins, the server deploys construction equipment, such as 3D printers, to the construction site, transmits design data to the equipment, and starts construction. The progress is monitored by the server, and adjustments are made as needed. After construction is complete, a final inspection of the building is conducted.

[1035] This system automates the entire construction process, resulting in reduced time and costs. It also enables quick responses to specific user requests, allowing for the efficient delivery of high-quality buildings.

[1036] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1037] Step 1: User Login

[1038] Enter: Username and password

[1039] Output: Authentication result (success / failure)

[1040] Description: Users log in to the system via their device. The device provides a UI for entering a username and password, which the user enters and submits. The server receives the authentication information and verifies it using the authentication server and database. If authentication is successful, a session is started.

[1041] Step 2: Inputting User Needs

[1042] Input: Desired address and requirements for construction (e.g., "1-2-3, Shibuya-ku, Tokyo", "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance")

[1043] Output: User request data (JSON format)

[1044] Description: Users use a terminal to input their specific building requirements. The interface includes input fields for address, floor plan, sunlight exposure, and communication features. When the user enters information into these fields and presses the submit button, the data is sent to the server. The server converts the data into JSON format and stores it in its internal data store.

[1045] Step 3: Data Analysis

[1046] Input: User request data (JSON format)

[1047] Output: Analyzed data (address information, request classification information)

[1048] Description: The server analyzes the user request data it receives. Data processing is performed to standardize address data and classify requests. Specifically, the given address is converted to a standard format using a Geographic Information System (GIS), and the requests are classified into preset categories (e.g., floor plan, communication functions, etc.). The analysis results are stored in an internal database.

[1049] Step 4: Generating a design plan

[1050] Input: Analyzed data

[1051] Output: Initial architectural design plan (CAD data)

[1052] Description: The server launches design software (e.g., AutoCAD) based on the analyzed data and generates an initial architectural design plan. A script calls the design software's API to create drawings that reflect the user's requirements based on standard design templates. The generated CAD data is stored on the server.

[1053] Step 5: Simulation and Optimization

[1054] Input: Initial architectural design plan (CAD data)

[1055] Output: Optimized design plan (CAD data)

[1056] Description: The server optimizes the generated design plan by running it through simulation tools (e.g., sunlight simulation, traffic flow simulation). Specifically, it automatically corrects areas where improvements are needed in the building's layout and structure based on the simulation results. The optimized design plan is saved on the server.

[1057] Step 6: Generate an estimate

[1058] Input: Optimized design plan (CAD data)

[1059] Output: Estimate results (total amount, breakdown)

[1060] Description: The server estimates construction costs based on an optimized design plan. It extracts a list of necessary materials from the design data, obtains market price information, and calculates the total cost. Using an API, it retrieves material price information and labor costs from the internet to calculate the estimate. The estimate results are stored in an internal database in JSON format and notified to the user.

[1061] Step 7: Notifying and providing feedback to the user

[1062] Input: Estimate Result

[1063] Output: User feedback (budget limits and changes)

[1064] Description: The server notifies the user of the estimate result. The user reviews the estimate result on their terminal and re-enters feedback according to their budget. This feedback includes budget limits and design changes. The user's feedback data is sent to the server for analysis and adjustments.

[1065] Step 8: Negotiation and re-estimation

[1066] Input: User feedback

[1067] Output: New estimate results and design plan

[1068] Description: The server receives feedback from the user and generates a new design plan and estimate. It incorporates design changes, performs simulations and optimizations again, and recalculates the cost. Based on this, it notifies the user of the new design plan and estimate. This process is performed automatically and via email or chatbot.

[1069] Step 9: Generate parts list and place order

[1070] Input: Finalized design plan (CAD data), market database

[1071] Output: Order status of components

[1072] Description: The server generates a list of necessary components based on the finalized design plan. It extracts the type and quantity of materials from the design data and selects the cheapest supplier. It retrieves real-time price information from the market database using an API, selects the optimal supplier, and places an order. The order status is monitored in real time.

[1073] Step 10: Start of Construction

[1074] Input: Finalized design plan (CAD data)

[1075] Output: Construction progress

[1076] Description: The server deploys a 3D printer for construction to the construction site, sends design data to the 3D printer, and starts construction. Specifically, the server uploads data using printer control software and starts the construction process. The progress of construction is monitored in real time.

[1077] Step 11: Monitoring and adjusting progress

[1078] Input: Construction progress data

[1079] Output: Adjustment instructions, correction data

[1080] Description: The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It checks the construction status in real time via sensors and cameras and sends instructions to correct the printer's operation if there are any malfunctions.

[1081] Step 12: Final Inspection

[1082] Input: Completed building

[1083] Output: Inspection result (pass / fail), correction instructions

[1084] Description: After construction is complete, the server performs a final inspection of the building. It uses drones and sensors to check the building structure and for any defects. If any corrections are needed based on the inspection results, it will also issue instructions.

[1085] (Application Example 1)

[1086] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1087] Traditional construction processes have been plagued by challenges such as requiring a great deal of manual work and adjustments, resulting in significant time and cost. In particular, the design and simulation, estimation, ordering of materials, and construction processes required to meet user specifications are complex and inefficient. Therefore, the need for automated systems is increasing.

[1088] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1089] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for receiving input from the user via a smartphone or tablet; means for managing material production and construction processes within the factory in cooperation with multiple factory robots; and means for automatically performing construction using a building 3D printer. As a result, the design and construction of the optimal building according to the user's requirements can be carried out efficiently, making it possible to significantly reduce the cost and time of the entire construction process.

[1090] A "user" is an individual or legal entity that uses the system to request construction process services.

[1091] "Address" refers to the specific location information of the land on which construction is to be carried out.

[1092] "Requests" refer to detailed requirements regarding the specifications and functions of a building that the user desires.

[1093] An "interface" is the user interface provided by a system for inputting information.

[1094] "Design" refers to a plan of a building generated based on information entered by the user.

[1095] "Sunlight exposure" refers to the amount of sunlight a building receives and the effects of that sunlight on it.

[1096] "Human flow" refers to design elements that optimize the routes and movements of people inside and outside a building.

[1097] A "simulation" is a process of conducting a virtual verification based on a design plan, taking into account factors such as sunlight and pedestrian traffic flow.

[1098] An "estimate" is a rough estimate of the construction costs calculated based on the design plan.

[1099] "Notification" refers to the act of informing a user of the quotation results or other important information.

[1100] "Negotiation" is the process by which the user and the system exchange opinions on the optimal construction plan.

[1101] A "proposal" is the optimal construction plan presented by the system to the user.

[1102] "Components" refer to the various materials necessary to construct a building.

[1103] "Supplier" refers to the company or supplier that provides the components.

[1104] "Placing an order" is the act of ordering necessary materials from a supplier.

[1105] A "smartphone" is a mobile phone equipped with internet and software application capabilities.

[1106] A "tablet" is a small, portable computer that is primarily operated using a touchscreen.

[1107] A "factory robot" is an automated control device that performs material production and assembly tasks within a factory.

[1108] A "3D printer" is a machine that uses computer control to generate three-dimensional objects based on design data.

[1109] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on information entered by the user, such as the address and requirements for construction. This system is particularly specialized for inputting information via smartphones or tablets and for integrating with multiple factory robots to automate material production and construction processes within the factory.

[1110] User input and interface

[1111] Users access the system using a smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). The information entered by the user is sent to the server.

[1112] Design and Simulation

[1113] Based on the received address and requirements, the server generates an initial building plan using design software (e.g., AutoCAD). Next, the server simulates sunlight and pedestrian traffic patterns to optimize the plan. It also incorporates the placement of communication features (Wi-Fi and facial recognition entrances) into the design. During this process, it collaborates with multiple factory robots to simultaneously plan material production within the factory.

[1114] Estimate and negotiation

[1115] The server estimates construction costs based on the generated design plan. The user is notified of the estimate, and if it does not fit the user's budget, the user enters their budget limit and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[1116] Automatic ordering

[1117] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. It also monitors the order status in real time and makes reorders or adjustments as needed.

[1118] Construction phase

[1119] The server monitors 3D printers installed in factories or construction sites, sends design data to the printers, and initiates construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[1120] Specific example

[1121] For example, a user enters an address such as "1-2-3, Shibuya-ku, Tokyo" and their requirements such as "prioritizing sunlight, open kitchen, 3LDK, Wi-Fi, and facial recognition entrance" on their smartphone. If the estimate is approved at 45 million yen or less, the server automatically orders window glass, lumber, and other materials from the most suitable suppliers and begins construction using a 3D printer at the factory.

[1122] Example of a prompt

[1123] Address: 1-2-3 XX, Shibuya-ku, Tokyo

[1124] Requirements: Prioritize sunlight, open kitchen, 3 bedrooms, Wi-Fi, facial recognition entrance.

[1125] Please provide an estimate for a building plan based on these requirements.

[1126] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1127] Step 1:

[1128] Users access the system via smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). This data is then sent to the server.

[1129] Input: Address and building requirements data

[1130] Output: User data sent to the server

[1131] Step 2:

[1132] Based on the user data received by the server, an initial architectural plan is generated using design software (e.g., AutoCAD). Next, a simulation is performed that takes into account sunlight and pedestrian traffic flow to optimize the plan. The placement of communication functions is also considered simultaneously.

[1133] Input: User data, design software (such as AutoCAD)

[1134] Data processing: Simulation of sunlight and traffic flow

[1135] Output: Optimized design plan

[1136] Step 3:

[1137] The server calculates an estimate of construction costs based on the optimized design plan and notifies the user. The notification is sent via smartphone or tablet. If the user enters budget limits or changes, the server will propose a new construction plan.

[1138] Input: Optimized design plan, budget information

[1139] Data processing: Quotation calculation, automated negotiation system

[1140] Output: Estimate results, new construction plan

[1141] Step 4:

[1142] The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. It selects the cheapest supplier and automatically places orders for the components. The order status is monitored in real time, and reorders or adjustments are made as needed.

[1143] Input: Finalized design plan, supplier database

[1144] Data processing: Material list generation, price comparison

[1145] Output: Order list, order status monitoring

[1146] Step 5:

[1147] The server monitors the 3D printer installed at the construction site, sends the design data to the printer, and starts construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[1148] Input: Design data, 3D printer information

[1149] Data processing: Monitoring the progress of construction processes, problem-solving algorithms.

[1150] Output: Construction progress, final inspection results

[1151] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1152] The present invention is a system that automates a series of processes from design, estimation, negotiation, ordering, and construction based on information entered by the user, including the address and requirements for construction. It incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments based on those emotions. Specific embodiments for carrying out the present invention are described below.

[1153] 1. User Input and Interface

[1154] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users enter detailed requests regarding the address, type of building, floor plan, and necessary features (e.g., Wi-Fi and facial recognition entrance). The interface also incorporates an emotion engine that analyzes the user's voice and facial expressions in real time to recognize their emotions.

[1155] Specific example:

[1156] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from the user's facial expressions.

[1157] 2. Design and Simulation

[1158] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[1159] Specific example:

[1160] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[1161] 3. Quotation and Negotiation

[1162] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user inputs budget limits and desired changes. Furthermore, the emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server makes appropriate suggestions. Based on this data, the server proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[1163] Specific example:

[1164] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[1165] 4. Automated ordering

[1166] The server generates a list of necessary materials (e.g., window glass, wood, etc.) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. It creates an order list. The server automatically orders the materials and sends the orders to the suppliers. It monitors the order status in real time and makes reorders or adjustments as needed.

[1167] Specific example:

[1168] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[1169] 5. Construction Phase

[1170] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It also monitors the user's emotional state during construction and enhances user confidence by notifying them of the progress as needed. After construction is complete, a final inspection of the building is conducted.

[1171] Specific example:

[1172] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[1173] Based on the above configuration, the system of the present invention can efficiently design and construct buildings that meet the user's needs. Furthermore, by incorporating user emotion recognition using an emotion engine, it is possible to improve the user experience and increase satisfaction.

[1174] The following describes the processing flow.

[1175] Step 1:

[1176] The user logs into the device. They enter the required authentication information to access the system.

[1177] Step 2:

[1178] The terminal displays the user's information and the necessary input forms. The user enters the address where they want to build, the type of building, the floor plan, and the required functions (e.g., Wi-Fi or facial recognition entrance).

[1179] Step 3:

[1180] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[1181] Step 4:

[1182] The server analyzes the received data. Design parameters are set based on user requests and address information.

[1183] Step 5:

[1184] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[1185] Step 6:

[1186] The server generates a design plan, which is then used to simulate sunlight exposure and pedestrian traffic flow. This determines the optimal placement of windows and rooms.

[1187] Step 7:

[1188] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[1189] Step 8:

[1190] Based on the finalized design plan, the server estimates the construction costs. It calculates the necessary materials and labor costs to determine the total construction cost.

[1191] Step 9:

[1192] The server notifies the user of the estimate result. The user reviews the estimate and enters their budget and other requirements.

[1193] Step 10:

[1194] The user sends budget limits and changes to the server. The server receives the data and performs a re-evaluation.

[1195] Step 11:

[1196] The server generates a new design plan based on the re-evaluated data and proposes it to the user again. It then automatically negotiates with the user to determine the optimal construction plan.

[1197] Step 12:

[1198] The emotion engine monitors the user's emotional state in real time. If stress or dissatisfaction is detected, the server provides appropriate suggestions.

[1199] Step 13:

[1200] After the final design plan is confirmed, the server generates a list of necessary components. This includes a detailed list of items such as window panes, lumber, and hardware.

[1201] Step 14:

[1202] The server retrieves price information for each component from a market database and selects the supplier with the lowest price. It then creates an order list.

[1203] Step 15:

[1204] The server automatically orders the parts. It sends the order to the supplier and confirms the delivery date.

[1205] Step 16:

[1206] The server monitors the order status in real time. Reorders and adjustments are made as needed.

[1207] Step 17:

[1208] The server installs a 3D printer for construction at the construction site and transmits the design data. It then instructs the 3D printer to begin construction.

[1209] Step 18:

[1210] The 3D printer automatically constructs the structure based on the design data. A server monitors the progress in real time and makes corrections and adjustments if problems occur.

[1211] Step 19:

[1212] During construction, the server will periodically notify users of the progress, thereby increasing user confidence.

[1213] Step 20:

[1214] After construction is complete, the server performs a final inspection of the building. The inspection results are reported to the user, and any necessary corrections are made.

[1215] Step 21:

[1216] Once all processes are complete, the server provides a final report to the user.

[1217] (Example 2)

[1218] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1219] Traditional construction processes involve individual steps from user input to design, estimation, negotiation, ordering, and construction. This is time-consuming and labor-intensive, and makes it difficult to adequately reflect the user's feelings and requests. Furthermore, adjustments to enhance user satisfaction are made manually, which is inefficient. In addition, the lack of real-time monitoring and adjustment of construction progress makes it difficult to provide users with a sense of security.

[1220] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1221] In this invention, the server includes means for analyzing the user's voice and facial expressions in real time and recognizing their emotions, means for automatically negotiating with the user and proposing the optimal construction plan, and means for monitoring the progress of construction in real time, analyzing the user's emotional state, and notifying them of the progress. This makes it possible to efficiently and automatically advance the construction process while reflecting the user's emotions and requests in real time.

[1222] A "user" is an individual or group that uses the system to input their building requirements and to review the design and estimates.

[1223] An "interface" refers to the screen or input device that a user uses to enter information such as their address or requests into a system.

[1224] An "emotion engine" is a combination of software and hardware that analyzes a user's voice and facial expressions in real time and recognizes their emotional state.

[1225] "Design software" refers to computer programs and related tools used to generate architectural design plans.

[1226] "Simulation" is a process for optimizing design plans by virtually reproducing architectural elements such as sunlight and pedestrian traffic flow.

[1227] "Estimation" refers to calculating the costs required for construction based on the generated design plan.

[1228] "Negotiation" refers to the process in which the user and the system interact with each other to agree on the construction plan that best suits the user's budget and requirements.

[1229] "Components" refer to individual materials and parts necessary for construction.

[1230] "Ordering" refers to the process of ordering and procuring necessary materials from suppliers.

[1231] A "3D printer for construction" refers to a mechanical device that automatically constructs physical buildings based on architectural design data.

[1232] "Real-time" refers to events or operations that occur almost instantly, meaning there is virtually no delay.

[1233] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. This system incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments accordingly. Specific embodiments for carrying out this invention are described below.

[1234] 1. User Input and Interface

[1235] The system provides an interface where users log in to the device and input the address and requirements for the building they wish to construct. The interface includes fields where users can input detailed address information, building type, floor plan, and required functions (e.g., Wi-Fi, facial recognition entrance). The device has a built-in camera and microphone, and an emotion engine analyzes the user's facial expressions and voice in real time to recognize emotions.

[1236] Specific example:

[1237] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from his facial expressions.

[1238] 2. Design and Simulation

[1239] Based on the address and requirements received by the server, an initial building plan is generated using design software (e.g., AutoCAD). Next, the server optimizes the initial plan using sunlight simulation software (e.g., Solar Analysis tool) and tools that simulate pedestrian traffic flow. These simulations also take into account the placement of communication functions specified by the user, such as Wi-Fi and facial recognition entrances.

[1240] Specific example:

[1241] The server generates a plan using AutoCAD based on the address and requirements, and then uses the Solar Analysis tool to create the optimal design plan, taking into account sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[1242] 3. Quotation and Negotiation

[1243] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they can review it on their device. If the estimate does not fit the budget, the user can input budget limits and desired changes. The emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server proposes an alternative plan accordingly. Negotiations are conducted via automated email or chatbot.

[1244] Specific example:

[1245] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[1246] 4. Automated ordering

[1247] The server generates a list of necessary components based on the finalized design plan. The server retrieves price information from market and supplier databases, selects the cheapest supplier, and creates an order list. Orders are placed automatically and sent to suppliers. The order status is monitored in real time, and reorders or adjustments are made as needed.

[1248] Specific example:

[1249] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[1250] 5. Construction Phase

[1251] The server installs a 3D printer at the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and immediately corrects or adjusts any problems that arise. It also monitors the user's emotional state during construction and provides timely updates to enhance the user's sense of security. After construction is complete, the server conducts a final inspection of the building to check for any defects.

[1252] Specific example:

[1253] The server uses a 3D printer for construction to proceed with construction according to the design data, and monitors the progress. If a printer malfunction is detected, the server immediately issues a correction order. An inspection is conducted after construction is complete.

[1254] This system makes it possible to efficiently advance the construction process while reflecting user requests in real time. Furthermore, to make it easy for anyone to implement the invention, specific hardware and software usage examples are shown, including the use of AutoCAD, Solar Analysis tools, and sentiment analysis software.

[1255] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1256] Step 1:

[1257] The user logs into the device.

[1258] Specific operation: The user starts up the device and enters their user ID and password on the login screen. The device performs authentication using authentication software.

[1259] Input: User ID, Password

[1260] Output: Authentication result (success / failure)

[1261] Step 2:

[1262] The user enters the address and requirements for the building.

[1263] Specific operation: The user enters their address and detailed requests (floor plan, functions, etc.) into the interface. The terminal sends this data to the server.

[1264] Input: Address information, requests (e.g., floor plan, required functions)

[1265] Output: Notification of completion of input data transmission

[1266] Step 3:

[1267] The emotion engine recognizes the user's emotions.

[1268] Specific operation: The device uses its built-in camera and microphone to capture the user's facial expressions and voice, and emotion analysis software performs the analysis. The recognition results are sent to a server.

[1269] Input: User facial expression data, voice data

[1270] Output: Emotion recognition result (e.g. nervousness, excitement)

[1271] Step 4:

[1272] The server analyzes the received data.

[1273] Specific operation: The server analyzes the address and request data received from the user and extracts the information necessary for creating a design plan.

[1274] Input: Received data (address, request, emotion recognition result)

[1275] Output: Analysis results (information necessary for creating a design plan)

[1276] Step 5:

[1277] The server generates the plan using design software.

[1278] Specific operation: The server launches design software (e.g., AutoCAD) and generates an initial building plan based on the analysis results.

[1279] Input: Analysis results (information necessary for creating a design plan)

[1280] Output: Initial design plan

[1281] Step 6:

[1282] The server performs the simulation.

[1283] Specific operation: The server uses sunlight simulation software (e.g., Solar Analysis tool) and pedestrian flow simulation tools to optimize the generated design plan.

[1284] Input: Initial design plan

[1285] Output: Optimization design plan

[1286] Step 7:

[1287] The server generates the estimate.

[1288] Specific operation: The server estimates construction costs based on the optimized design plan. It uses estimation calculation software.

[1289] Input: Optimization design plan

[1290] Output: Construction cost estimate

[1291] Step 8:

[1292] Notify the user of the estimate result.

[1293] Specific operation: The server notifies the user of the estimate result. The notification is made via the terminal interface or email.

[1294] Input: Construction cost estimate

[1295] Output: Quotation Notification

[1296] Step 9:

[1297] The user enters the budget and changes.

[1298] Specific operation: The user reviews the notified estimate and enters the budget and any changes into the interface. The terminal then sends this information to the server.

[1299] Input: Budget, Changes

[1300] Output: Notification of completion of input data transmission

[1301] Step 10:

[1302] The emotion engine detects the user's emotions.

[1303] Specific operation: The server's emotion engine analyzes the user's emotional state and detects stress and dissatisfaction.

[1304] Input: User facial expression data, voice data

[1305] Output: Emotion recognition result (e.g., stress, dissatisfaction)

[1306] Step 11:

[1307] The server generates suggestions.

[1308] Specific operation: The server generates alternative plans and cost-saving plans based on the user's budget and emotional state, and proposes them to the user.

[1309] Input: Budget, changes, sentiment recognition results

[1310] Output: Alternative plan proposal

[1311] Step 12:

[1312] Automatic ordering

[1313] Specific operation: The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. The server selects the supplier with the lowest price and automatically places an order.

[1314] Input: Finalized design plan, price database

[1315] Output: Parts order list, order submission

[1316] Step 13:

[1317] Construction phase

[1318] Specific operation: The server installs a 3D printer for construction at the construction site, sends the final design plan to the printer, and starts construction. The server monitors the operation of the 3D printer and immediately corrects or adjusts any problems that occur.

[1319] Input: Final design plan

[1320] Output: Construction progress, final building

[1321] Step 14:

[1322] Progress notification

[1323] Specific operation: The server monitors the construction progress in real time and periodically notifies the user of the progress. This allows the user to monitor the process with peace of mind.

[1324] Input: Construction progress

[1325] Output: Progress notification

[1326] Step 15:

[1327] Final inspection

[1328] Specific operation: After construction is complete, the server performs a final inspection of the building and detects any defects. The inspection results are reported to the user, and corrections are made as needed.

[1329] Input: Building completion data

[1330] Output: Inspection results, correction instructions

[1331] (Application Example 2)

[1332] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1333] A major problem with architectural projects is the significant effort and stress involved when users manage the entire process themselves, from design and estimation to ordering and construction. Furthermore, the lack of consideration for users' emotional needs and the resulting uniform proposals risk decreased user satisfaction. This is particularly problematic for store owners designing and constructing their own stores, who often face stress due to their busy schedules and insufficient collection of specific design requirements.

[1334] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1335] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for automatically constructing using a 3D printer for construction; means for analyzing the user's emotions and adjusting the design and proposals based on the analysis results; means for processing input from a visual device worn by the store owner and collecting design requests for the store; and means for providing an interface using a head-mounted display or smartphone. This enables appropriate proposals that take into account the user's emotions, making it possible to design and construct physical stores efficiently and in a way that enhances user satisfaction.

[1336] A "user" refers to an individual or organization that uses the system to design, estimate, order, and construct architectural projects.

[1337] An "interface" refers to a screen or device that allows a user to input information into a system and for the system to provide information to the user.

[1338] "Design" refers to the process of planning the structure and layout of a building based on user requests, and creating specific drawings and plans.

[1339] "Simulation" is a method for virtually reproducing elements such as sunlight and pedestrian traffic flow based on a generated design plan, and then optimizing it.

[1340] "Estimate" refers to the process of calculating construction costs based on the design plan, and determining the amount to be notified to the user.

[1341] "Negotiation" refers to the process of reconciling the user's requests and budget with the system's proposals to determine the optimal construction plan for both parties.

[1342] "Components" refer to the materials and parts necessary to construct a building.

[1343] "Supplier" refers to the companies or contractors that provide the necessary materials for a construction project.

[1344] A "3D printer for construction" is a device that uses 3D printing technology to construct physical buildings based on digital design data.

[1345] "Methods for analyzing emotions" refers to technologies that recognize emotions from a user's voice and facial expressions and extract the analysis results.

[1346] "Visual devices" refer to devices that provide visual information to users, such as head-mounted displays and smartphones.

[1347] "Means of providing an interface" refers to technologies that provide functions for users to access and operate a system through visual devices.

[1348] This invention implements the system using the following procedure. First, an interface is provided for the user to input the address and requirements for the building they wish to construct. The user can use this interface to input details such as the type of building, floor plan, and necessary functions. The interface incorporates an emotion analysis function that analyzes the user's voice and facial expressions in real time. An emotion recognition library such as EmotionRecognizer is used for this analysis.

[1349] Next, the server generates a design based on the address and requirements entered by the user. This process integrates design software (e.g., AutoCAD). The server simulates sunlight and pedestrian traffic flow to generate an optimized design plan. Furthermore, communication features such as Wi-Fi and facial recognition entrances are incorporated into the design according to the user's requests.

[1350] Based on the generated design plan, the server calculates an estimate of the construction costs. For this purpose, an estimation module called Estimator is used. The estimate results are notified to the user for review. If the estimate does not fit the user's budget, the user re-enters budget limits and desired changes. Furthermore, an emotion analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, a new construction plan is proposed. This negotiation process is handled automatically by the server.

[1351] Next, the server automatically orders the necessary components from the cheapest supplier. The server retrieves price information from market and supplier databases and selects the optimal supplier. The order status is monitored in real time, and reorders and adjustments are made as needed.

[1352] During the construction phase, the server automatically carries out construction using a 3D printer. The server monitors the progress and makes corrections and adjustments if problems occur. To enhance user confidence, the progress of construction is notified periodically.

[1353] Finally, the system provides an interface that allows users to gain a more concrete understanding of and adjust the design of their physical stores using head-mounted displays or smartphones. This enables store owners to incorporate their requests in real time.

[1354] Specific example:

[1355] The store owner wears a head-mounted display and walks around the store, inputting information by voice, such as "1-2-3, Shibuya-ku, Tokyo; large checkout counter; three self-checkout registers; security cameras." The system analyzes the owner's emotions from their facial expressions and tone of voice, and if it determines that they are feeling stressed, it proposes several cost-reduction plans.

[1356] Example of a prompt:

[1357] Analyze the user's emotional state and generate architectural proposals based on that analysis. The user's address is "1-2-3, Shibuya-ku, Tokyo," and they desire a large checkout counter, three self-checkout machines, and security cameras. If the user is identified as experiencing stress, propose the best plan within their budget.

[1358] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1359] Step 1:

[1360] Users log in to the interface using a head-mounted display or smartphone and enter the address and requirements for the building they wish to construct. The entered information includes details such as the address, type of building, floor plan, and required functions. The interface analyzes the user's voice and facial expressions in real time to recognize their emotional state.

[1361] Input: User-entered address, building requirements, voice, and facial expressions.

[1362] Output: Analyzed emotional state, user request data

[1363] Step 2:

[1364] The server generates a design plan based on the address and requirements entered by the user. Using design software (e.g., AutoCAD), the server simulates sunlight and pedestrian traffic flow to create an optimized design plan. Furthermore, requirements such as communication functions (Wi-Fi and facial recognition entrance) are also included in the design.

[1365] Input: User request data, building requirements

[1366] Output: Initial design plan

[1367] Step 3:

[1368] The server calculates an estimate of construction costs based on the generated design plan. Using the Estimator module, the server performs a detailed cost assessment and notifies the user of the results.

[1369] Input: Initial design plan

[1370] Output: Estimate of construction costs

[1371] Step 4:

[1372] The user reviews the notified estimate and, if it doesn't fit their budget, enters budget limits or changes. The sentiment analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server will propose a new construction plan and readjust the design plan. This negotiation process is managed automatically by the server.

[1373] Input: User budget constraints, emotional state

[1374] Output: Adjusted design plan, optimal construction proposal

[1375] Step 5:

[1376] Based on the finalized design plan, the server automatically orders the necessary components from the cheapest suppliers. The server retrieves price information from market and supplier databases and creates an order list. The order status is monitored in real time, and reorders and adjustments are made as needed.

[1377] Input: Finalized design plan, material list

[1378] Output: Order list, Order status

[1379] Step 6:

[1380] The server automatically starts construction using a building 3D printer. The server sends design data to the 3D printer and monitors the progress of construction. If problems occur, it makes necessary corrections and adjustments. The server also notifies the user of the progress as it progresses, providing peace of mind. After construction is complete, a final inspection is performed.

[1381] Input: Design data, construction status data

[1382] Output: Construction progress, final building

[1383] Step 7:

[1384] Users can use head-mounted displays or smartphones to visually monitor the design and construction process and make adjustments in real time. This interface allows users to flexibly incorporate their specific requests.

[1385] Input: Real-time construction information, user's visual device operation

[1386] Output: User-adjusted design and progress

[1387] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1388] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1389] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1390] [Fourth Embodiment]

[1391] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1392] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1393] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1394] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1395] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1396] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1397] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1398] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1399] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1400] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1401] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1402] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1403] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1404] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. Specific embodiments for carrying out this invention are described below.

[1405] 1. User Input and Interface

[1406] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users can enter detailed requirements regarding the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance).

[1407] Specific example:

[1408] The user enters the address "1-2-3, Shibuya-ku, Tokyo" and their requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[1409] 2. Design and Simulation

[1410] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[1411] Specific example:

[1412] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[1413] 3. Quotation and Negotiation

[1414] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user enters their budget limits and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[1415] Specific example:

[1416] The server creates an estimate and notifies the user of a construction cost of 50 million yen. The user sets a budget limit of 45 million yen, and the server proposes a new plan within that budget and negotiates.

[1417] 4. Automated ordering

[1418] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. The server monitors the order status in real time and makes reorders or adjustments as needed.

[1419] Specific example:

[1420] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[1421] 5. Construction Phase

[1422] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. After construction is complete, a final inspection of the building is conducted.

[1423] Specific example:

[1424] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[1425] Based on the above configuration, the system of the present invention can efficiently design and construct optimal buildings according to the user's requirements. This system automates the entire construction process, leading to expected cost and time reductions.

[1426] The following describes the processing flow.

[1427] Step 1:

[1428] The user logs into the device. They enter the required authentication information and access the system.

[1429] Step 2:

[1430] The device retrieves user information and displays an input form for the building. The user enters the address where they want to build, the type of building, the floor plan, and the necessary functions (e.g., Wi-Fi or facial recognition entrance).

[1431] Step 3:

[1432] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[1433] Step 4:

[1434] The server analyzes the received data. Design parameters are set based on user requests and address information.

[1435] Step 5:

[1436] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[1437] Step 6:

[1438] The server simulates sunlight and pedestrian traffic patterns based on the generated design plan. It determines the optimal placement of windows and rooms.

[1439] Step 7:

[1440] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[1441] Step 8:

[1442] Based on the finalized design plan, the server estimates the construction costs. It calculates the necessary materials and labor costs to determine the total construction cost.

[1443] Step 9:

[1444] The server notifies the user of the estimate result. The user reviews the estimate and enters their budget and other requirements.

[1445] Step 10:

[1446] The user sends budget limits and changes to the server. The server receives the data and performs a re-evaluation.

[1447] Step 11:

[1448] The server generates a new design plan based on the re-evaluated data and proposes it to the user again. It then automatically negotiates with the user to determine the optimal construction plan.

[1449] Step 12:

[1450] After the final design plan is confirmed, the server generates a list of necessary components. This includes a detailed list of items such as window panes, lumber, and hardware.

[1451] Step 13:

[1452] The server retrieves price information for each component from a market database and selects the supplier with the lowest price. It then creates an order list.

[1453] Step 14:

[1454] The server automatically orders the parts. It sends the order to the supplier and confirms the delivery date.

[1455] Step 15:

[1456] The server monitors the order status in real time. Reorders and adjustments are made as needed.

[1457] Step 16:

[1458] The server installs a 3D printer for construction at the construction site and transmits the design data. It then instructs the 3D printer to begin construction.

[1459] Step 17:

[1460] The 3D printer automatically constructs the structure based on the design data. A server monitors the progress in real time and makes corrections and adjustments if problems occur.

[1461] Step 18:

[1462] After construction is complete, the server performs a final inspection of the building. The inspection results are reported to the user, and any necessary corrections are made.

[1463] Step 19:

[1464] Once all processes are complete, the server provides a final report to the user.

[1465] (Example 1)

[1466] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1467] Modern construction processes rely heavily on manual labor, posing challenges to efficiency and accuracy. In particular, the lack of a consistent workflow across the stages of design, estimation, negotiation, ordering, and construction, based on user requirements, leads to increased time and costs. Furthermore, optimizing resource utilization and maintaining quality are difficult.

[1468] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1469] In this invention, the server includes means for the user to input the address and requirements for construction; means for generating a design that takes into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs and notifying the user; means for conducting automated negotiations with the user; means for ordering necessary materials; means for carrying out construction using construction equipment; means for user login and authentication; means for analyzing user data and storing it in an internal data store; means for transmitting design data to construction equipment and instructing the start of construction; means for monitoring and adjusting the progress of construction; and means for conducting a final inspection. This automates the entire construction process, enabling efficient and accurate building design and construction.

[1470] An "interface" is a means for users to input the address and requirements for the building they wish to construct.

[1471] "Design software" is a program that a server uses to generate designs based on the user's address and requirements.

[1472] "Simulation" refers to calculation and analysis methods used to consider factors such as sunlight and pedestrian traffic flow based on the generated design plan.

[1473] "Estimate" refers to the total construction cost calculated based on the design plan generated by the server.

[1474] "Negotiation" is the process by which the server proposes a new construction plan based on the user's requests and budget, and then automatically adjusts and agrees to it.

[1475] "Components" is a term that refers to the materials and equipment necessary for the construction process.

[1476] "Suppliers" refers to the companies that provide the necessary components and the market database.

[1477] "Construction equipment" refers to mechanical equipment and devices that automatically carry out construction based on design data, and in particular includes construction 3D printers.

[1478] "Login and authentication" is the process of verifying a user's identity when they access a device.

[1479] "Data analysis" is the process of analyzing information entered by users and saving the necessary data to an internal data store.

[1480] "Design data" refers to data that includes construction drawings and specification information generated based on user requests.

[1481] "Monitoring progress" is the process of ensuring that construction is proceeding according to plan and making corrections or adjustments as necessary.

[1482] "Final inspection" refers to the quality check and verification process conducted after construction is completed.

[1483] This invention is a system aimed at automating the construction process. The system takes user inputs the address and specific requirements for construction, and then automatically performs the entire process from design and estimation to negotiation, ordering, and construction based on that information. This document details the system's features.

[1484] First, the user logs into the system using a terminal. After logging in, they input the address where they want to build and specific requirements (e.g., floor plan, sunlight exposure, pedestrian flow, communication functions, etc.) through the interface. The user interface is easy to use, and the input fields are designed to be intuitive.

[1485] For example, a user might enter an address such as "1-2-3, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance."

[1486] The server receives data sent from users and performs analysis. This analysis includes standardizing address data and classifying requests.

[1487] Next, based on the analyzed data, the server uses design software (such as AutoCAD) to generate an initial building plan. The generated plan is then subjected to simulations that take into account sunlight and pedestrian traffic flow, and is optimized. If necessary, the placement of communication functions (such as Wi-Fi and facial recognition entrances) is also incorporated into the design.

[1488] Once a plan is generated, the server estimates the construction costs. This estimate includes listing materials and obtaining price information from the market. The user is notified of the estimate and provides feedback on their budget. If the estimate does not fit the user's budget, the user enters budget limits and changes, and the server proposes a new plan accordingly. This negotiation is automated and conducted via email or chatbot.

[1489] Once the user approves the plan and quote, the server generates a list of materials and selects the cheapest supplier from the market database. An automated order is then placed, and the order status is monitored in real time.

[1490] Once the construction phase begins, the server deploys construction equipment, such as 3D printers, to the construction site, transmits design data to the equipment, and starts construction. The progress is monitored by the server, and adjustments are made as needed. After construction is complete, a final inspection of the building is conducted.

[1491] This system automates the entire construction process, resulting in reduced time and costs. It also enables quick responses to specific user requests, allowing for the efficient delivery of high-quality buildings.

[1492] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1493] Step 1: User Login

[1494] Enter: Username and password

[1495] Output: Authentication result (success / failure)

[1496] Description: Users log in to the system via their device. The device provides a UI for entering a username and password, which the user enters and submits. The server receives the authentication information and verifies it using the authentication server and database. If authentication is successful, a session is started.

[1497] Step 2: Inputting User Needs

[1498] Input: Desired address and requirements for construction (e.g., "1-2-3, Shibuya-ku, Tokyo", "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance")

[1499] Output: User request data (JSON format)

[1500] Description: Users use a terminal to input their specific building requirements. The interface includes input fields for address, floor plan, sunlight exposure, and communication features. When the user enters information into these fields and presses the submit button, the data is sent to the server. The server converts the data into JSON format and stores it in its internal data store.

[1501] Step 3: Data Analysis

[1502] Input: User request data (JSON format)

[1503] Output: Analyzed data (address information, request classification information)

[1504] Description: The server analyzes the user request data it receives. Data processing is performed to standardize address data and classify requests. Specifically, the given address is converted to a standard format using a Geographic Information System (GIS), and the requests are classified into preset categories (e.g., floor plan, communication functions, etc.). The analysis results are stored in an internal database.

[1505] Step 4: Generating a design plan

[1506] Input: Analyzed data

[1507] Output: Initial architectural design plan (CAD data)

[1508] Description: The server launches design software (e.g., AutoCAD) based on the analyzed data and generates an initial architectural design plan. A script calls the design software's API to create drawings that reflect the user's requirements based on standard design templates. The generated CAD data is stored on the server.

[1509] Step 5: Simulation and Optimization

[1510] Input: Initial architectural design plan (CAD data)

[1511] Output: Optimized design plan (CAD data)

[1512] Description: The server optimizes the generated design plan by running it through simulation tools (e.g., sunlight simulation, traffic flow simulation). Specifically, it automatically corrects areas where improvements are needed in the building's layout and structure based on the simulation results. The optimized design plan is saved on the server.

[1513] Step 6: Generate an estimate

[1514] Input: Optimized design plan (CAD data)

[1515] Output: Estimate results (total amount, breakdown)

[1516] Description: The server estimates construction costs based on an optimized design plan. It extracts a list of necessary materials from the design data, obtains market price information, and calculates the total cost. Using an API, it retrieves material price information and labor costs from the internet to calculate the estimate. The estimate results are stored in an internal database in JSON format and notified to the user.

[1517] Step 7: Notifying and providing feedback to the user

[1518] Input: Estimate Result

[1519] Output: User feedback (budget limits and changes)

[1520] Description: The server notifies the user of the estimate result. The user reviews the estimate result on their terminal and re-enters feedback according to their budget. This feedback includes budget limits and design changes. The user's feedback data is sent to the server for analysis and adjustments.

[1521] Step 8: Negotiation and re-estimation

[1522] Input: User feedback

[1523] Output: New estimate results and design plan

[1524] Description: The server receives feedback from the user and generates a new design plan and estimate. It incorporates design changes, performs simulations and optimizations again, and recalculates the cost. Based on this, it notifies the user of the new design plan and estimate. This process is performed automatically and via email or chatbot.

[1525] Step 9: Generate parts list and place order

[1526] Input: Finalized design plan (CAD data), market database

[1527] Output: Order status of components

[1528] Description: The server generates a list of necessary components based on the finalized design plan. It extracts the type and quantity of materials from the design data and selects the cheapest supplier. It retrieves real-time price information from the market database using an API, selects the optimal supplier, and places an order. The order status is monitored in real time.

[1529] Step 10: Start of Construction

[1530] Input: Finalized design plan (CAD data)

[1531] Output: Construction progress

[1532] Description: The server deploys a 3D printer for construction to the construction site, sends design data to the 3D printer, and starts construction. Specifically, the server uploads data using printer control software and starts the construction process. The progress of construction is monitored in real time.

[1533] Step 11: Monitoring and adjusting progress

[1534] Input: Construction progress data

[1535] Output: Adjustment instructions, correction data

[1536] Description: The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It checks the construction status in real time via sensors and cameras and sends instructions to correct the printer's operation if there are any malfunctions.

[1537] Step 12: Final Inspection

[1538] Input: Completed building

[1539] Output: Inspection result (pass / fail), correction instructions

[1540] Description: After construction is complete, the server performs a final inspection of the building. It uses drones and sensors to check the building structure and for any defects. If any corrections are needed based on the inspection results, it will also issue instructions.

[1541] (Application Example 1)

[1542] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1543] Traditional construction processes have been plagued by challenges such as requiring a great deal of manual work and adjustments, resulting in significant time and cost. In particular, the design and simulation, estimation, ordering of materials, and construction processes required to meet user specifications are complex and inefficient. Therefore, the need for automated systems is increasing.

[1544] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1545] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for receiving input from the user via a smartphone or tablet; means for managing material production and construction processes within the factory in cooperation with multiple factory robots; and means for automatically performing construction using a building 3D printer. As a result, the design and construction of the optimal building according to the user's requirements can be carried out efficiently, making it possible to significantly reduce the cost and time of the entire construction process.

[1546] A "user" is an individual or legal entity that uses the system to request construction process services.

[1547] "Address" refers to the specific location information of the land on which construction is to be carried out.

[1548] "Requests" refer to detailed requirements regarding the specifications and functions of a building that the user desires.

[1549] An "interface" is the user interface provided by a system for inputting information.

[1550] "Design" refers to a plan of a building generated based on information entered by the user.

[1551] "Sunlight exposure" refers to the amount of sunlight a building receives and the effects of that sunlight on it.

[1552] "Human flow" refers to design elements that optimize the routes and movements of people inside and outside a building.

[1553] A "simulation" is a process of conducting a virtual verification based on a design plan, taking into account factors such as sunlight and pedestrian traffic flow.

[1554] An "estimate" is a rough estimate of the construction costs calculated based on the design plan.

[1555] "Notification" refers to the act of informing a user of the quotation results or other important information.

[1556] "Negotiation" is the process by which the user and the system exchange opinions on the optimal construction plan.

[1557] A "proposal" is the optimal construction plan presented by the system to the user.

[1558] "Components" refer to the various materials necessary to construct a building.

[1559] "Supplier" refers to the company or supplier that provides the components.

[1560] "Placing an order" is the act of ordering necessary materials from a supplier.

[1561] A "smartphone" is a mobile phone equipped with internet and software application capabilities.

[1562] A "tablet" is a small, portable computer that is primarily operated using a touchscreen.

[1563] A "factory robot" is an automated control device that performs material production and assembly tasks within a factory.

[1564] A "3D printer" is a machine that uses computer control to generate three-dimensional objects based on design data.

[1565] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on information entered by the user, such as the address and requirements for construction. This system is particularly specialized for inputting information via smartphones or tablets and for integrating with multiple factory robots to automate material production and construction processes within the factory.

[1566] User input and interface

[1567] Users access the system using a smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). The information entered by the user is sent to the server.

[1568] Design and Simulation

[1569] Based on the received address and requirements, the server generates an initial building plan using design software (e.g., AutoCAD). Next, the server simulates sunlight and pedestrian traffic patterns to optimize the plan. It also incorporates the placement of communication features (Wi-Fi and facial recognition entrances) into the design. During this process, it collaborates with multiple factory robots to simultaneously plan material production within the factory.

[1570] Estimate and negotiation

[1571] The server estimates construction costs based on the generated design plan. The user is notified of the estimate, and if it does not fit the user's budget, the user enters their budget limit and desired changes. The server then proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[1572] Automatic ordering

[1573] The server generates a list of necessary materials (such as window panes and lumber) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. Then, it automatically places orders for these materials. It also monitors the order status in real time and makes reorders or adjustments as needed.

[1574] Construction phase

[1575] The server monitors 3D printers installed in factories or construction sites, sends design data to the printers, and initiates construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[1576] Specific example

[1577] For example, a user enters an address such as "1-2-3, Shibuya-ku, Tokyo" and their requirements such as "prioritizing sunlight, open kitchen, 3LDK, Wi-Fi, and facial recognition entrance" on their smartphone. If the estimate is approved at 45 million yen or less, the server automatically orders window glass, lumber, and other materials from the most suitable suppliers and begins construction using a 3D printer at the factory.

[1578] Example of a prompt

[1579] Address: 1-2-3 XX, Shibuya-ku, Tokyo

[1580] Requirements: Prioritize sunlight, open kitchen, 3 bedrooms, Wi-Fi, facial recognition entrance.

[1581] Please provide an estimate for a building plan based on these requirements.

[1582] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1583] Step 1:

[1584] Users access the system via smartphone or tablet and enter the address and requirements for the building they wish to construct. This includes the address, purpose of construction, floor plan, sunlight exposure, pedestrian traffic flow, and communication features (such as Wi-Fi and facial recognition entrance). This data is then sent to the server.

[1585] Input: Address and building requirements data

[1586] Output: User data sent to the server

[1587] Step 2:

[1588] Based on the user data received by the server, an initial architectural plan is generated using design software (e.g., AutoCAD). Next, a simulation is performed that takes into account sunlight and pedestrian traffic flow to optimize the plan. The placement of communication functions is also considered simultaneously.

[1589] Input: User data, design software (such as AutoCAD)

[1590] Data processing: Simulation of sunlight and traffic flow

[1591] Output: Optimized design plan

[1592] Step 3:

[1593] The server calculates an estimate of construction costs based on the optimized design plan and notifies the user. The notification is sent via smartphone or tablet. If the user enters budget limits or changes, the server will propose a new construction plan.

[1594] Input: Optimized design plan, budget information

[1595] Data processing: Quotation calculation, automated negotiation system

[1596] Output: Estimate results, new construction plan

[1597] Step 4:

[1598] The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. It selects the cheapest supplier and automatically places orders for the components. The order status is monitored in real time, and reorders or adjustments are made as needed.

[1599] Input: Finalized design plan, supplier database

[1600] Data processing: Material list generation, price comparison

[1601] Output: Order list, order status monitoring

[1602] Step 5:

[1603] The server monitors the 3D printer installed at the construction site, sends the design data to the printer, and starts construction. Progress is monitored in real time, and any problems that arise are corrected or adjusted. After construction is complete, a final inspection of the building is conducted.

[1604] Input: Design data, 3D printer information

[1605] Data processing: Monitoring the progress of construction processes, problem-solving algorithms.

[1606] Output: Construction progress, final inspection results

[1607] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1608] The present invention is a system that automates a series of processes from design, estimation, negotiation, ordering, and construction based on information entered by the user, including the address and requirements for construction. It incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments based on those emotions. Specific embodiments for carrying out the present invention are described below.

[1609] 1. User Input and Interface

[1610] The system provides an interface for users to log in to their device and enter the address and requirements for the building they wish to construct. Users enter detailed requests regarding the address, type of building, floor plan, and necessary features (e.g., Wi-Fi and facial recognition entrance). The interface also incorporates an emotion engine that analyzes the user's voice and facial expressions in real time to recognize their emotions.

[1611] Specific example:

[1612] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from the user's facial expressions.

[1613] 2. Design and Simulation

[1614] Based on the address and requirements received by the server, an initial building plan is generated using design software (such as AutoCAD). Next, the server simulates sunlight and pedestrian traffic flow to optimize the plan. It also incorporates the placement of communication functions (such as Wi-Fi and facial recognition entrances) into the design.

[1615] Specific example:

[1616] The server generates a plan using AutoCAD based on the address and requirements, creating an optimal design plan that takes into account factors such as sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[1617] 3. Quotation and Negotiation

[1618] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they review it. If the estimate does not fit the user's budget, the user inputs budget limits and desired changes. Furthermore, the emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server makes appropriate suggestions. Based on this data, the server proposes a new construction plan and automatically negotiates with the user via email or chatbot.

[1619] Specific example:

[1620] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[1621] 4. Automated ordering

[1622] The server generates a list of necessary materials (e.g., window glass, wood, etc.) based on the finalized design plan. The server retrieves price information from market and supplier databases and selects the cheapest supplier. It creates an order list. The server automatically orders the materials and sends the orders to the suppliers. It monitors the order status in real time and makes reorders or adjustments as needed.

[1623] Specific example:

[1624] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[1625] 5. Construction Phase

[1626] The server deploys a 3D printer to the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and makes corrections or adjustments if problems occur. It also monitors the user's emotional state during construction and enhances user confidence by notifying them of the progress as needed. After construction is complete, a final inspection of the building is conducted.

[1627] Specific example:

[1628] The server installs the 3D printer at the construction site, sends the design data, and instructs the start of construction. It monitors the progress and adjusts the printer's operation as needed. An inspection is conducted after construction is complete.

[1629] Based on the above configuration, the system of the present invention can efficiently design and construct buildings that meet the user's needs. Furthermore, by incorporating user emotion recognition using an emotion engine, it is possible to improve the user experience and increase satisfaction.

[1630] The following describes the processing flow.

[1631] Step 1:

[1632] The user logs into the device. They enter the required authentication information to access the system.

[1633] Step 2:

[1634] The terminal displays the user's information and the necessary input forms. The user enters the address where they want to build, the type of building, the floor plan, and the required functions (e.g., Wi-Fi or facial recognition entrance).

[1635] Step 3:

[1636] The terminal sends the entered data to the server. This data includes address information, building requirements, floor plan, and functional details.

[1637] Step 4:

[1638] The server analyzes the received data. Design parameters are set based on user requests and address information.

[1639] Step 5:

[1640] The server launches the design software and generates an initial design plan based on the specified conditions. Design software such as AutoCAD is used.

[1641] Step 6:

[1642] The server generates a design plan, which is then used to simulate sunlight exposure and pedestrian traffic flow. This determines the optimal placement of windows and rooms.

[1643] Step 7:

[1644] The server integrates user communication function requests and optimizes the placement of communication equipment such as Wi-Fi and facial recognition entrances. It also finalizes the overall design plan.

[1645] Step 8:

[1646] Based on the finalized design plan, the server estimates the construction costs. It calculates the necessary materials and labor costs to determine the total construction cost.

[1647] Step 9:

[1648] The server notifies the user of the estimate result. The user reviews the estimate and enters their budget and other requirements.

[1649] Step 10:

[1650] The user sends budget limits and changes to the server. The server receives the data and performs a re-evaluation.

[1651] Step 11:

[1652] The server generates a new design plan based on the re-evaluated data and proposes it to the user again. It then automatically negotiates with the user to determine the optimal construction plan.

[1653] Step 12:

[1654] The emotion engine monitors the user's emotional state in real time. If stress or dissatisfaction is detected, the server provides appropriate suggestions.

[1655] Step 13:

[1656] After the final design plan is confirmed, the server generates a list of necessary components. This includes a detailed list of items such as window panes, lumber, and hardware.

[1657] Step 14:

[1658] The server retrieves price information for each component from a market database and selects the supplier with the lowest price. It then creates an order list.

[1659] Step 15:

[1660] The server automatically orders the parts. It sends the order to the supplier and confirms the delivery date.

[1661] Step 16:

[1662] The server monitors the order status in real time. Reorders and adjustments are made as needed.

[1663] Step 17:

[1664] The server installs a 3D printer for construction at the construction site and transmits the design data. It then instructs the 3D printer to begin construction.

[1665] Step 18:

[1666] The 3D printer automatically constructs the structure based on the design data. A server monitors the progress in real time and makes corrections and adjustments if problems occur.

[1667] Step 19:

[1668] During construction, the server will periodically notify users of the progress, thereby increasing user confidence.

[1669] Step 20:

[1670] After construction is complete, the server performs a final inspection of the building. The inspection results are reported to the user, and any necessary corrections are made.

[1671] Step 21:

[1672] Once all processes are complete, the server provides a final report to the user.

[1673] (Example 2)

[1674] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1675] Traditional construction processes involve individual steps from user input to design, estimation, negotiation, ordering, and construction. This is time-consuming and labor-intensive, and makes it difficult to adequately reflect the user's feelings and requests. Furthermore, adjustments to enhance user satisfaction are made manually, which is inefficient. In addition, the lack of real-time monitoring and adjustment of construction progress makes it difficult to provide users with a sense of security.

[1676] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1677] In this invention, the server includes means for analyzing the user's voice and facial expressions in real time and recognizing their emotions, means for automatically negotiating with the user and proposing the optimal construction plan, and means for monitoring the progress of construction in real time, analyzing the user's emotional state, and notifying them of the progress. This makes it possible to efficiently and automatically advance the construction process while reflecting the user's emotions and requests in real time.

[1678] A "user" is an individual or group that uses the system to input their building requirements and to review the design and estimates.

[1679] An "interface" refers to the screen or input device that a user uses to enter information such as their address or requests into a system.

[1680] An "emotion engine" is a combination of software and hardware that analyzes a user's voice and facial expressions in real time and recognizes their emotional state.

[1681] "Design software" refers to computer programs and related tools used to generate architectural design plans.

[1682] "Simulation" is a process for optimizing design plans by virtually reproducing architectural elements such as sunlight and pedestrian traffic flow.

[1683] "Estimation" refers to calculating the costs required for construction based on the generated design plan.

[1684] "Negotiation" refers to the process in which the user and the system interact with each other to agree on the construction plan that best suits the user's budget and requirements.

[1685] "Components" refer to individual materials and parts necessary for construction.

[1686] "Ordering" refers to the process of ordering and procuring necessary materials from suppliers.

[1687] A "3D printer for construction" refers to a mechanical device that automatically constructs physical buildings based on architectural design data.

[1688] "Real-time" refers to events or operations that occur almost instantly, meaning there is virtually no delay.

[1689] This invention is a system that automates a series of processes, from design, estimation, negotiation, ordering, and construction, based on the user's input of the address and requirements for construction. This system incorporates an emotion engine that recognizes the user's emotions and makes suggestions and adjustments accordingly. Specific embodiments for carrying out this invention are described below.

[1690] 1. User Input and Interface

[1691] The system provides an interface where users log in to the device and input the address and requirements for the building they wish to construct. The interface includes fields where users can input detailed address information, building type, floor plan, and required functions (e.g., Wi-Fi, facial recognition entrance). The device has a built-in camera and microphone, and an emotion engine analyzes the user's facial expressions and voice in real time to recognize emotions.

[1692] Specific example:

[1693] The user enters an address such as "1-2-3 XX, Shibuya-ku, Tokyo" and requests such as "Prioritize sunlight, open kitchen, 3LDK, Wi-Fi, facial recognition entrance," and the emotion engine recognizes emotions such as tension or excitement from his facial expressions.

[1694] 2. Design and Simulation

[1695] Based on the address and requirements received by the server, an initial building plan is generated using design software (e.g., AutoCAD). Next, the server optimizes the initial plan using sunlight simulation software (e.g., Solar Analysis tool) and tools that simulate pedestrian traffic flow. These simulations also take into account the placement of communication functions specified by the user, such as Wi-Fi and facial recognition entrances.

[1696] Specific example:

[1697] The server generates a plan using AutoCAD based on the address and requirements, and then uses the Solar Analysis tool to create the optimal design plan, taking into account sunlight, traffic flow, Wi-Fi placement, and the installation of a facial recognition entrance.

[1698] 3. Quotation and Negotiation

[1699] The server generates a design plan and then estimates the construction costs. The user is notified of the estimate, and they can review it on their device. If the estimate does not fit the budget, the user can input budget limits and desired changes. The emotion engine analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server proposes an alternative plan accordingly. Negotiations are conducted via automated email or chatbot.

[1700] Specific example:

[1701] The server creates an estimate and notifies the user of a construction cost of 50 million yen. If the user sets a budget limit of 45 million yen and the emotion engine recognizes that the user is feeling stressed, the server proposes an alternative, lower-cost plan and negotiates with the user.

[1702] 4. Automated ordering

[1703] The server generates a list of necessary components based on the finalized design plan. The server retrieves price information from market and supplier databases, selects the cheapest supplier, and creates an order list. Orders are placed automatically and sent to suppliers. The order status is monitored in real time, and reorders or adjustments are made as needed.

[1704] Specific example:

[1705] The system calculates that the server needs 100 window panes and 2000 pieces of wood, and automatically places orders with the cheapest suppliers. The order status is monitored in real time.

[1706] 5. Construction Phase

[1707] The server installs a 3D printer at the construction site, sends the design data to the printer, and begins construction. The server monitors the progress of the 3D printer and immediately corrects or adjusts any problems that arise. It also monitors the user's emotional state during construction and provides timely updates to enhance the user's sense of security. After construction is complete, the server conducts a final inspection of the building to check for any defects.

[1708] Specific example:

[1709] The server uses a 3D printer for construction to proceed with construction according to the design data, and monitors the progress. If a printer malfunction is detected, the server immediately issues a correction order. An inspection is conducted after construction is complete.

[1710] This system makes it possible to efficiently advance the construction process while reflecting user requests in real time. Furthermore, to make it easy for anyone to implement the invention, specific hardware and software usage examples are shown, including the use of AutoCAD, Solar Analysis tools, and sentiment analysis software.

[1711] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1712] Step 1:

[1713] The user logs into the device.

[1714] Specific operation: The user starts up the device and enters their user ID and password on the login screen. The device performs authentication using authentication software.

[1715] Input: User ID, Password

[1716] Output: Authentication result (success / failure)

[1717] Step 2:

[1718] The user enters the address and requirements for the building.

[1719] Specific operation: The user enters their address and detailed requests (floor plan, functions, etc.) into the interface. The terminal sends this data to the server.

[1720] Input: Address information, requests (e.g., floor plan, required functions)

[1721] Output: Notification of completion of input data transmission

[1722] Step 3:

[1723] The emotion engine recognizes the user's emotions.

[1724] Specific operation: The device uses its built-in camera and microphone to capture the user's facial expressions and voice, and emotion analysis software performs the analysis. The recognition results are sent to a server.

[1725] Input: User facial expression data, voice data

[1726] Output: Emotion recognition result (e.g. nervousness, excitement)

[1727] Step 4:

[1728] The server analyzes the received data.

[1729] Specific operation: The server analyzes the address and request data received from the user and extracts the information necessary for creating a design plan.

[1730] Input: Received data (address, request, emotion recognition result)

[1731] Output: Analysis results (information necessary for creating a design plan)

[1732] Step 5:

[1733] The server generates the plan using design software.

[1734] Specific operation: The server launches design software (e.g., AutoCAD) and generates an initial building plan based on the analysis results.

[1735] Input: Analysis results (information necessary for creating a design plan)

[1736] Output: Initial design plan

[1737] Step 6:

[1738] The server performs the simulation.

[1739] Specific operation: The server uses sunlight simulation software (e.g., Solar Analysis tool) and pedestrian flow simulation tools to optimize the generated design plan.

[1740] Input: Initial design plan

[1741] Output: Optimization design plan

[1742] Step 7:

[1743] The server generates the estimate.

[1744] Specific operation: The server estimates construction costs based on the optimized design plan. It uses estimation calculation software.

[1745] Input: Optimization design plan

[1746] Output: Construction cost estimate

[1747] Step 8:

[1748] Notify the user of the estimate result.

[1749] Specific operation: The server notifies the user of the estimate result. The notification is made via the terminal interface or email.

[1750] Input: Construction cost estimate

[1751] Output: Quotation Notification

[1752] Step 9:

[1753] The user enters the budget and changes.

[1754] Specific operation: The user reviews the notified estimate and enters the budget and any changes into the interface. The terminal then sends this information to the server.

[1755] Input: Budget, Changes

[1756] Output: Notification of completion of input data transmission

[1757] Step 10:

[1758] The emotion engine detects the user's emotions.

[1759] Specific operation: The server's emotion engine analyzes the user's emotional state and detects stress and dissatisfaction.

[1760] Input: User facial expression data, voice data

[1761] Output: Emotion recognition result (e.g., stress, dissatisfaction)

[1762] Step 11:

[1763] The server generates suggestions.

[1764] Specific operation: The server generates alternative plans and cost-saving plans based on the user's budget and emotional state, and proposes them to the user.

[1765] Input: Budget, changes, sentiment recognition results

[1766] Output: Alternative plan proposal

[1767] Step 12:

[1768] Automatic ordering

[1769] Specific operation: The server generates a list of necessary components based on the finalized design plan and retrieves price information from market and supplier databases. The server selects the supplier with the lowest price and automatically places an order.

[1770] Input: Finalized design plan, price database

[1771] Output: Parts order list, order submission

[1772] Step 13:

[1773] Construction phase

[1774] Specific operation: The server installs a 3D printer for construction at the construction site, sends the final design plan to the printer, and starts construction. The server monitors the operation of the 3D printer and immediately corrects or adjusts any problems that occur.

[1775] Input: Final design plan

[1776] Output: Construction progress, final building

[1777] Step 14:

[1778] Progress notification

[1779] Specific operation: The server monitors the construction progress in real time and periodically notifies the user of the progress. This allows the user to monitor the process with peace of mind.

[1780] Input: Construction progress

[1781] Output: Progress notification

[1782] Step 15:

[1783] Final inspection

[1784] Specific operation: After construction is complete, the server performs a final inspection of the building and detects any defects. The inspection results are reported to the user, and corrections are made as needed.

[1785] Input: Building completion data

[1786] Output: Inspection results, correction instructions

[1787] (Application Example 2)

[1788] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1789] A major problem with architectural projects is the significant effort and stress involved when users manage the entire process themselves, from design and estimation to ordering and construction. Furthermore, the lack of consideration for users' emotional needs and the resulting uniform proposals risk decreased user satisfaction. This is particularly problematic for store owners designing and constructing their own stores, who often face stress due to their busy schedules and insufficient collection of specific design requirements.

[1790] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1791] In this invention, the server includes means for providing an interface for the user to input the address and requirements for construction; means for generating a design based on the address and requirements and performing simulations that take into account sunlight and pedestrian traffic flow; means for calculating an estimate of construction costs based on the generated design plan and notifying the user; means for automatically negotiating with the user and proposing the optimal construction plan; means for automatically ordering necessary materials from the cheapest supplier; means for automatically constructing using a 3D printer for construction; means for analyzing the user's emotions and adjusting the design and proposals based on the analysis results; means for processing input from a visual device worn by the store owner and collecting design requests for the store; and means for providing an interface using a head-mounted display or smartphone. This enables appropriate proposals that take into account the user's emotions, making it possible to design and construct physical stores efficiently and in a way that enhances user satisfaction.

[1792] A "user" refers to an individual or organization that uses the system to design, estimate, order, and construct architectural projects.

[1793] An "interface" refers to a screen or device that allows a user to input information into a system and for the system to provide information to the user.

[1794] "Design" refers to the process of planning the structure and layout of a building based on user requests, and creating specific drawings and plans.

[1795] "Simulation" is a method for virtually reproducing elements such as sunlight and pedestrian traffic flow based on a generated design plan, and then optimizing it.

[1796] "Estimate" refers to the process of calculating construction costs based on the design plan, and determining the amount to be notified to the user.

[1797] "Negotiation" refers to the process of reconciling the user's requests and budget with the system's proposals to determine the optimal construction plan for both parties.

[1798] "Components" refer to the materials and parts necessary to construct a building.

[1799] "Supplier" refers to the companies or contractors that provide the necessary materials for a construction project.

[1800] A "3D printer for construction" is a device that uses 3D printing technology to construct physical buildings based on digital design data.

[1801] "Methods for analyzing emotions" refers to technologies that recognize emotions from a user's voice and facial expressions and extract the analysis results.

[1802] "Visual devices" refer to devices that provide visual information to users, such as head-mounted displays and smartphones.

[1803] "Means of providing an interface" refers to technologies that provide functions for users to access and operate a system through visual devices.

[1804] This invention implements the system using the following procedure. First, an interface is provided for the user to input the address and requirements for the building they wish to construct. The user can use this interface to input details such as the type of building, floor plan, and necessary functions. The interface incorporates an emotion analysis function that analyzes the user's voice and facial expressions in real time. An emotion recognition library such as EmotionRecognizer is used for this analysis.

[1805] Next, the server generates a design based on the address and requirements entered by the user. This process integrates design software (e.g., AutoCAD). The server simulates sunlight and pedestrian traffic flow to generate an optimized design plan. Furthermore, communication features such as Wi-Fi and facial recognition entrances are incorporated into the design according to the user's requests.

[1806] Based on the generated design plan, the server calculates an estimate of the construction costs. For this purpose, an estimation module called Estimator is used. The estimate results are notified to the user for review. If the estimate does not fit the user's budget, the user re-enters budget limits and desired changes. Furthermore, an emotion analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, a new construction plan is proposed. This negotiation process is handled automatically by the server.

[1807] Next, the server automatically orders the necessary components from the cheapest supplier. The server retrieves price information from market and supplier databases and selects the optimal supplier. The order status is monitored in real time, and reorders and adjustments are made as needed.

[1808] During the construction phase, the server automatically carries out construction using a 3D printer. The server monitors the progress and makes corrections and adjustments if problems occur. To enhance user confidence, the progress of construction is notified periodically.

[1809] Finally, the system provides an interface that allows users to gain a more concrete understanding of and adjust the design of their physical stores using head-mounted displays or smartphones. This enables store owners to incorporate their requests in real time.

[1810] Specific example:

[1811] The store owner wears a head-mounted display and walks around the store, inputting information by voice, such as "1-2-3, Shibuya-ku, Tokyo; large checkout counter; three self-checkout registers; security cameras." The system analyzes the owner's emotions from their facial expressions and tone of voice, and if it determines that they are feeling stressed, it proposes several cost-reduction plans.

[1812] Example of a prompt:

[1813] Analyze the user's emotional state and generate architectural proposals based on that analysis. The user's address is "1-2-3, Shibuya-ku, Tokyo," and they desire a large checkout counter, three self-checkout machines, and security cameras. If the user is identified as experiencing stress, propose the best plan within their budget.

[1814] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1815] Step 1:

[1816] Users log in to the interface using a head-mounted display or smartphone and enter the address and requirements for the building they wish to construct. The entered information includes details such as the address, type of building, floor plan, and required functions. The interface analyzes the user's voice and facial expressions in real time to recognize their emotional state.

[1817] Input: User-entered address, building requirements, voice, and facial expressions.

[1818] Output: Analyzed emotional state, user request data

[1819] Step 2:

[1820] The server generates a design plan based on the address and requirements entered by the user. Using design software (e.g., AutoCAD), the server simulates sunlight and pedestrian traffic flow to create an optimized design plan. Furthermore, requirements such as communication functions (Wi-Fi and facial recognition entrance) are also included in the design.

[1821] Input: User request data, building requirements

[1822] Output: Initial design plan

[1823] Step 3:

[1824] The server calculates an estimate of construction costs based on the generated design plan. Using the Estimator module, the server performs a detailed cost assessment and notifies the user of the results.

[1825] Input: Initial design plan

[1826] Output: Estimate of construction costs

[1827] Step 4:

[1828] The user reviews the notified estimate and, if it doesn't fit their budget, enters budget limits or changes. The sentiment analysis function analyzes the user's emotional state, and if stress or dissatisfaction is detected, the server will propose a new construction plan and readjust the design plan. This negotiation process is managed automatically by the server.

[1829] Input: User budget constraints, emotional state

[1830] Output: Adjusted design plan, optimal construction proposal

[1831] Step 5:

[1832] Based on the finalized design plan, the server automatically orders the necessary components from the cheapest suppliers. The server retrieves price information from market and supplier databases and creates an order list. The order status is monitored in real time, and reorders and adjustments are made as needed.

[1833] Input: Finalized design plan, material list

[1834] Output: Order list, Order status

[1835] Step 6:

[1836] The server automatically starts construction using a building 3D printer. The server sends design data to the 3D printer and monitors the progress of construction. If problems occur, it makes necessary corrections and adjustments. The server also notifies the user of the progress as it progresses, providing peace of mind. After construction is complete, a final inspection is performed.

[1837] Input: Design data, construction status data

[1838] Output: Construction progress, final building

[1839] Step 7:

[1840] Users can use head-mounted displays or smartphones to visually monitor the design and construction process and make adjustments in real time. This interface allows users to flexibly incorporate their specific requests.

[1841] Input: Real-time construction information, user's visual device operation

[1842] Output: User-adjusted design and progress

[1843] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1844] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1845] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1846] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1847] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1848] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1849] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1850] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1851] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1852] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1853] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1854] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1855] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1856] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1857] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1858] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1859] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1860] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1861] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1862] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1863] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1864] The following is further disclosed regarding the embodiments described above.

[1865] (Claim 1)

[1866] A means of providing an interface for users to input the address and requirements for construction,

[1867] A means ...

Claims

1. A means of providing an interface for users to input the address and requirements for construction, A means for generating a design based on the aforementioned address and requirements, and for performing simulations that take into account sunlight and pedestrian traffic flow, A means of calculating an estimate of construction costs based on the generated design plan and notifying the user, A means of automatically negotiating with users and proposing the optimal construction plan, A method for automatically ordering necessary parts from the cheapest supplier, A system that includes means for automatically constructing buildings using architectural 3D printers.

2. The system according to claim 1, characterized in that the means for generating the design is integrated with design software.

3. The system according to claim 1, characterized in that the means for automatically performing construction monitors the progress in real time and makes adjustments as necessary.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A