System

Abstract

To provide a system which enables a user to confirm concrete exterior design in real time and generate an optimum plan while making necessary corrections.SOLUTION: The method includes a means for inputting a desire of an exterior structure by a user, a means for analyzing input data from the user by a server, a means for generating a 3D simulation image based on the analyzed data by the server, a means for displaying the simulation image and detailed information on a user terminal by the server, a means for requesting a change of the simulation result by the user, a means for receiving the change request by the server and updating the design data, and a means for generating a proposal to a construction company based on the final design data and transmitting the proposal by the server.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Many homebuyers lack knowledge about exterior construction, making it difficult to understand what type of exterior construction is best suited to their land and home. It is also difficult for exterior construction companies and subcontractors to accurately grasp the client's image, making it difficult to make appropriate proposals. As a result, the finished product often ends up being "different from what was expected." The purpose of this invention is to solve these problems and provide a method to increase consumer satisfaction. [Means for solving the problem]

[0005] The present invention is a system including: a means for a user to input their exterior design preferences; a means for a server to analyze the input data from the user; a means for the server to generate an exterior design based on the analyzed data; a means for the server to generate a 3D simulation image based on the exterior design; a means for the server to send the generated simulation image, total cost, and construction schedule to a user terminal; a means for the terminal to display the simulation image and detailed information to the user; a means for the user to request changes to the simulation results; a means for the server to receive the change request and update the design data; and a means for the server to generate a proposal to a construction company based on the final design data and send the proposal.

[0006] This system allows users to check the actual exterior design in real time, making necessary corrections to create the optimal plan. It also enables effective communication with contractors, eliminating the gap between the image of the finished exterior construction and the reality.

[0007] "User" refers to an individual who uses the system to input their desired exterior design and check and modify the simulation results.

[0008] "Server" refers to the equipment or system that analyzes input data from users and generates and transmits exterior design and simulation images.

[0009] A "terminal" is a device operated by a user, and refers to a device that displays user input and simulation results.

[0010] "Exterior" refers to the area surrounding a house, including land, facilities, gardens, parking lots, fences, and other architectural structures.

[0011] "Simulation image" refers to a 3D image that visually represents the exterior design generated based on user input data.

[0012] "Total cost" refers to the total cost of materials, labor, and other related expenses required for exterior construction work.

[0013] "Construction schedule" refers to the schedule and period required to complete exterior construction work.

[0014] A "change request" refers to an operation in which a user requests correction or adjustment of a simulation result.

[0015] A "proposal" refers to construction instructions and estimates to be sent to a construction company that are prepared based on the final design data.

[0016] "Contractor" refers to the professional craftsmen and companies that carry out exterior construction work. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The exterior design simulation system according to the present invention is composed of the elements of a user, a terminal, and a server. A specific embodiment of this system and program processing will be described below.

[0039] System configuration

[0040] 1. User Device:

[0041] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[0042] The input contents are sent to the server and the received simulation results are displayed.

[0043] 2. Server:

[0044] Receives input data from the user terminal and analyzes it.

[0045] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[0046] The simulation image, total cost and construction schedule are sent to the user terminal.

[0047] Receives change requests from users and updates design data.

[0048] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[0049] Generate and send proposals to contractors based on the final design data.

[0050] Program processing

[0051] User:

[0052] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[0053] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[0054] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[0055] Device:

[0056] 4. The entered information is analyzed and sent to the server.

[0057] server:

[0058] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[0059] 2. Generate a 3D simulation image based on the design data.

[0060] 3. Calculate the total cost and schedule the work.

[0061] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[0062] Device:

[0063] 5. Display the simulation image and detailed information to the user.

[0064] 6. The user reviews the simulation results and inputs any necessary changes.

[0065] server:

[0066] 7. Receive change requests from users and update the design data.

[0067] 8. Generate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[0068] 9. Send the new design data to the user terminal.

[0069] Device:

[0070] 10. Redisplay updated simulation results and details to the user.

[0071] 11. If the user is satisfied with the final design, he or she approves the design.

[0072] server:

[0073] 12. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[0074] 13. Send proposal to contractor.

[0075] Specific examples

[0076] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these requests into the terminal. The terminal analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the terminal. The user can check the simulation results and re-enter changes if necessary. The server reflects the changes and resends the new simulation. Through this process, the user can check the specific exterior design in real time and create an optimal plan.

[0077] This allows for smooth communication between users and contractors, eliminating the gap between the image of the finished exterior construction work and the reality.

[0078] The processing flow will be explained below.

[0079] Step 1:

[0080] The user accesses the system from a terminal and enters login information (user ID, password).

[0081] Step 2:

[0082] The terminal transmits the user's input information to the server.

[0083] Step 3:

[0084] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[0085] Step 4:

[0086] A user starts a new project and inputs the lot shape, size, and home layout.

[0087] Step 5:

[0088] The terminal analyzes the user's input information and sends it to the server.

[0089] Step 6:

[0090] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[0091] Step 7:

[0092] The terminal analyzes the input data and sends it to the server.

[0093] Step 8:

[0094] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the land information, home layout, and site elements.

[0095] Step 9:

[0096] The server generates a 3D simulation image based on the design data.

[0097] Step 10:

[0098] The server calculates the total cost and schedules the construction.

[0099] Step 11:

[0100] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[0101] Step 12:

[0102] The terminal displays the simulation image and detailed information to the user.

[0103] Step 13:

[0104] The user checks the simulation results and inputs any necessary changes.

[0105] Step 14:

[0106] The terminal analyzes the change information and sends it to the server.

[0107] Step 15:

[0108] The server receives change requests from users and updates the design data.

[0109] Step 16:

[0110] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[0111] Step 17:

[0112] The server transmits the new design data to the user terminal.

[0113] Step 18:

[0114] The terminal redisplays the updated simulation results and detailed information to the user.

[0115] Step 19:

[0116] If the user is satisfied with the final design, he approves the design.

[0117] Step 20:

[0118] The terminal sends the authorization information to the server.

[0119] Step 21:

[0120] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[0121] Step 22:

[0122] The server sends the proposal to the contractor.

[0123] Example 1

[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0125] In the traditional exterior design process, it was difficult for users to check design changes in real time as they proceeded, which often led to gaps between the design and construction. Furthermore, poor communication with the construction company led to construction delays and budget overruns. As a result, it was difficult to create an exterior design that accurately reflected the user's wishes.

[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0127] In this invention, the server includes a means for analyzing data input from the user, a means for generating exterior site designs, and a means for generating 3D simulation images. This allows for real-time design changes and confirmations. It also facilitates budget and schedule management by accurately calculating total costs and construction schedules and then recalculating based on updated design data. After the user approves the final design, a proposal for the contractor is automatically generated, facilitating smooth communication and execution of the plan.

[0128] "User" is any person or entity that uses the system to enter information about a site design and to review and modify the results.

[0129] A "terminal" is a device operated by a user, which transmits input data and displays simulation results.

[0130] A "server" is a computer system that analyzes data sent from users, generates exterior design, and provides simulation results.

[0131] "Input data" refers to information such as the desired exterior design, the shape and size of the land, and the layout of the house that the user provides to the system from their terminal.

[0132] "Analysis" refers to the process in which the server performs calculations and processing based on input data received from the user to generate a site design.

[0133] "Exterior design" refers to the layout and blueprints of gardens, parking lots, fences, etc., generated based on the user's wishes and input data.

[0134] "Generation" refers to the process in which the server analyzes the input data and creates the exterior design and 3D simulation images.

[0135] "Simulation image" refers to an image or video that visually displays the generated exterior design as a 3D model.

[0136] "Total cost" refers to the result of calculating all costs required to carry out the exterior design.

[0137] The "construction schedule" refers to the calculated period from the start to the completion of exterior construction work.

[0138] A "change request" refers to the act of a user inputting corrections or additions that they would like to make to the results of the initial simulation.

[0139] A "proposal" is a document that is generated based on the final design data and that contains detailed information such as a design plan, costs, and construction schedule, which is presented to a construction company.

[0140] The exterior design simulation system of the present invention is composed of a terminal operated by the user, a server that analyzes data and generates designs, and a network that communicates between them. This system generates exterior designs that reflect the user's wishes in real time and allows the user to visually confirm them.

[0141] System configuration

[0142] User terminal: A device operated by the user, such as a PC, tablet, or smartphone. The user inputs their wishes and requests for changes to the exterior of the building through the terminal and sends this information to the server. The terminal also displays the simulation results and design data received from the server.

[0143] Server: Receives data sent from the user's device, performs analysis, and generates a site design. The server creates a 3D simulation image based on the design data and calculates the total cost and construction schedule. The generated information is sent back to the user's device, allowing the user to confirm and modify the design. The server also generates and sends a proposal to the construction company based on the final design data.

[0144] Hardware and software used

[0145] Hardware: User devices can be general-purpose PCs, tablets, or smartphones. Servers require a high-performance processor and sufficient memory.

[0146] Software: The server generates the exterior design using a generative AI model (e.g., a CAD engine). 3D simulation images are likely to be generated using a real-time rendering engine such as Unity or Unreal Engine.

[0147] Specific examples

[0148] For example, a specific example will be given in which the user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden."

[0149] The user enters "Parking lot: 20 square meters, Lawn: 50 square meters, Flower bed: Roses and tulips" into the project creation screen on the device and clicks the "Send" button. The device analyzes the entered data and sends it to the server in JSON format.

[0150] The server receives the data and generates the exterior design using a generative AI model (e.g., a CAD engine). It then renders a 3D simulation image using Unity or Unreal Engine. The server also calculates the total cost (e.g., ¥1,200,000) and construction schedule (e.g., 10 days) and sends this information to the user's device.

[0151] The terminal displays the simulation results to the user, who then checks the results and inputs changes, such as "Please expand the parking lot by another 5 square meters." The server reflects the changes, recalculates the new design, simulation images, total cost, and construction schedule, and retransmits them.

[0152] In this way, through interaction between the user and the system, the details of the exterior design are fleshed out and an optimal plan is created in real time.

[0153] Prompt Sentence Examples

[0154] "I would like the parking lot at my house to be enlarged and a lawn and flower beds installed in the garden. The parking lot should be large enough for three cars, the lawn should be 50 square meters, and the flower beds should be mainly roses and tulips. Also, please let me know the total budget and construction time."

[0155] By entering a prompt like the one above, the generative AI model will create a site design in real time, and the user can review and modify the results as they go.

[0156] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0157] Step 1:

[0158] The user accesses the system from a terminal and enters login information (user ID, password). The user clicks the "Login" button to log in to the system. The input is the user ID and password, and the output is the authentication result (success or failure).

[0159] Step 2:

[0160] The user clicks the "Start a new project" button and proceeds to the project information entry screen. Here, the user enters the shape, size, and layout of the land. The input is data related to the shape, size, and layout of the land, and the output is the initial setting data for the project.

[0161] Step 3:

[0162] The user inputs specific exterior requirements, such as parking, garden, and fence installation, and clicks the "Submit" button. The input is the user's wishes and requests regarding the exterior, and the output is organized exterior data.

[0163] Step 4:

[0164] The terminal parses and formats the input data from the user. The input is the initial settings and desired exterior data entered by the user, and the output is the formatted data sent to the server. This process also includes data validation.

[0165] Step 5:

[0166] The terminal sends the formatted data to the server. The input is the organized exterior data, and the output is a transmission request to the server. This communication is performed in the form of an HTTP request.

[0167] Step 6:

[0168] The server analyzes the data received from the terminal and checks for missing information. The input is organized exterior data, and the output is the analysis results and basic data for the exterior design.

[0169] Step 7:

[0170] The server uses a generative AI model (e.g., a CAD engine) to generate the exterior design. It creates 2D and 3D blueprints based on user input data. The input is the analyzed exterior data, and the output is the generated exterior design.

[0171] Step 8:

[0172] The server generates 3D simulation images based on the design data. This process uses a 3D simulation engine (such as Unity or Unreal Engine). The input is the design data, and the output is a high-quality 3D simulation image.

[0173] Step 9:

[0174] The server calculates the total cost based on the design data, including factors such as material and labor costs. The input is the design data, and the output is the total cost estimate.

[0175] Step 10:

[0176] The server calculates the construction schedule, scheduling the period from the start date to the completion date. The input is the design data and total cost, and the output is the construction schedule.

[0177] Step 11:

[0178] The server sends the generated 3D simulation image, total cost, and construction schedule to the user terminal. The input is the 3D simulation image, total cost, and construction schedule, and the output is a transmission request to the user terminal.

[0179] Step 12:

[0180] The terminal displays the received information to the user. The user checks the simulation results and inputs change requests if necessary. The input is the simulation results from the server, and the output is the display to the user and the user's change requests.

[0181] Step 13:

[0182] The user checks the simulation results and inputs a change request, such as "Please expand the parking lot by another 5 square meters," and clicks the "Submit" button. The input is a change request, and the output is a submission request.

[0183] Step 14:

[0184] The terminal receives the user's change request and sends it to the server. The input is the change request data, and the output is a transmission request to the server.

[0185] Step 15:

[0186] The server receives the change request, updates the design data, analyzes it again, and generates the changed design. The input is the change request data, and the output is the updated design data.

[0187] Step 16:

[0188] The server recalculates new 3D simulation images, total costs, and construction schedules based on the updated design data, and sends them to the user's terminal again. The input is the updated design data, and the output is the recalculated simulation results, total costs, and construction schedules.

[0189] Step 17:

[0190] The terminal again displays the received information to the user. If the user is satisfied with the final design, he / she clicks the "Approve" button to confirm the final design. The input is the recalculated simulation results, and the output is the display and approval operation for the user.

[0191] Step 18:

[0192] The server receives final approval from the user, generates a proposal to the contractor based on the final design data, and sends it. The proposal includes detailed design drawings, total costs, and construction schedules. The input is the final design data and approval information, and the output is the proposal sent to the contractor.

[0193] (Application example 1)

[0194] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0195] Currently, the layout design and product placement of physical stores are often done manually, which is inefficient. It is also difficult to quickly obtain detailed information, including simulation results, budgets, and construction schedules. Furthermore, re-simulating in response to user requests for changes is also time-consuming. For these reasons, there is a demand for fast and efficient layout design and simulation.

[0196] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0197] In this invention, the server includes: a means for a user to input layout preferences; a means for the server to analyze the input data from the user; a means for the server to generate a layout design based on the analyzed data; a means for the server to generate a 3D simulation image based on the layout design; a means for the server to transmit the generated simulation image, total cost, and construction schedule to a user terminal; a means for the terminal to display the simulation image and detailed information to the user; a means for the user to request changes to the simulation results; a means for the server to receive the change request and update the design data; a means for the server to generate a proposal based on the final design data and send the proposal to a contractor; and a means for generating simulation data based on prompt statements using a generative AI model. This allows users to efficiently design the layout of physical stores and quickly obtain simulation results and detailed information. Furthermore, re-simulations can be smoothly performed to accommodate change requests.

[0198] A "user" is an end user who uses the store layout design system to input layout preferences and change requests.

[0199] "Layout preference" refers to the specific details of the user's desire for the layout and design of the store.

[0200] The "server" is a device that analyzes data sent by users and generates store layout designs and 3D simulation images.

[0201] "Input data" refers to information such as store shape, size, and product placement that the user inputs into the layout design system.

[0202] "Analyzed data" refers to data generated as a result of processing and analyzing input data received by the server from the user.

[0203] "Layout design" is a layout diagram of the store generated by the server based on the analyzed data.

[0204] A "3D simulation image" is a three-dimensional simulation image displayed in real time based on a layout design generated by the server.

[0205] "Total cost" refers to all costs, including material costs and labor costs, required for layout design and construction.

[0206] "Construction schedule" refers to the total period required for layout design and construction work.

[0207] A "user terminal" is a device that allows a user to access the store layout design system.

[0208] "Detailed information" refers to detailed data such as 3D simulation images, total costs, and construction schedules.

[0209] A "change request" is a request from a user for correction or modification based on the simulation results.

[0210] "Design data" refers to the latest layout design information generated by the server after analysis and modification.

[0211] The "proposal" is a store layout proposal document that the server creates based on the final design data and sends to the construction company.

[0212] A "generative AI model" is an artificial intelligence algorithm that generates simulation data based on a prompt sentence.

[0213] A "prompt statement" is an instruction statement for creating simulation data that the user inputs to the generated AI model.

[0214] MODE FOR CARRYING OUT THE INVENTION

[0215] The store layout design system according to the present invention is an integrated system including a user terminal, a server, and a generative AI model. Each component of the system and program processing will be described in detail below.

[0216] System configuration

[0217] 1. User Device

[0218] The user terminal is a device that allows users to input their store layout preferences and change requests. Examples include smartphones and tablets. Users can access the system from these terminals and input their desired layout and changes. The terminal sends this data to the server, which then displays 3D simulation images and other detailed information received from the server.

[0219] 2. Server

[0220] The server is a device that receives and analyzes data sent by users. Specifically, it performs the following processes:

[0221] Analyzes store shape and product placement data entered by the user.

[0222] A layout design is generated based on the analyzed data.

[0223] A 3D simulation image is created based on the generated layout design.

[0224] Calculate total costs and construction schedule.

[0225] Simulation images, total costs, and construction schedules are sent to the user's device.

[0226] Receive change requests from users and update design data.

[0227] Generate proposals based on the final design data and send them to the contractor.

[0228] A generative AI model is used to generate simulation data based on prompt statements.

[0229] 3. Generative AI Models

[0230] A generative AI model is an artificial intelligence algorithm that generates simulation data based on prompts. This model allows users to obtain detailed simulation data simply by entering simple instructions.

[0231] Program processing description

[0232] The program communicates between the user device, the server, and the generative AI model, and performs data analysis and simulation. The specific process is as follows:

[0233] User device:

[0234] The user terminal provides an interface for users to input their layout preferences and change requests. This data is sent to the server. The user terminal also displays detailed information received from the server, such as 3D simulation images, total costs, and construction schedules.

[0235] server:

[0236] The server receives and analyzes data sent from the user's device. The main software used for this is Flask (a web application framework). A dedicated simulation library (the specific library name has not been specified) is also used to generate 3D simulation images. The server also generates simulation data based on prompt statements using a generative AI model.

[0237] Generative AI models:

[0238] The generative AI model generates simulation data based on the prompt text entered by the user, which is then sent back to the server and finally displayed on the user's device.

[0239] Adding specific examples

[0240] As an example, consider the following prompt sentence input to a generative AI model:

[0241] Example prompt sentence:

[0242] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[0243] The generative AI model analyzes the prompt sentences and generates 3D simulation data based on the specified conditions. This data is sent back to the server and displayed in real time on the user's device, allowing the user to make further changes.

[0244] As described above, the system of the present invention can efficiently and easily provide users with layout designs for physical stores, quickly obtain detailed information, and flexibly respond to changes requested by users.

[0245] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0246] Program processing flow

[0247] Step 1: User inputs layout preference

[0248] The user inputs their desired layout from the terminal, including the store's shape, area, product placement, etc. The terminal then sends this input data to the server.

[0249] Specific behavior:

[0250] Input: The user enters the desired layout (store shape, area, product placement).

[0251] Data processing: The terminal converts the input data into JSON format.

[0252] Output: Sends input data to the server.

[0253] Step 2: The server parses the input data

[0254] The server analyzes the input data received from the user terminal and generates a layout design. The analysis is performed based on data such as the store shape and product placement.

[0255] Specific behavior:

[0256] Input: Input data sent from the terminal.

[0257] Data processing: The server analyzes the input data and generates layout design data.

[0258] Output: Holds the generated layout design data.

[0259] Step 3: The server generates the 3D simulation image

[0260] The server generates a 3D simulation image based on the generated layout design data, using a 3D simulation library.

[0261] Specific behavior:

[0262] Input: Layout design data.

[0263] Data calculation: Generate 3D simulation images using the 3D simulation library.

[0264] Output: Keeps the generated 3D simulation image.

[0265] Step 4: The server calculates the total cost and construction schedule.

[0266] The server calculates the total cost and construction schedule based on the layout design, including material costs, labor costs, and work schedules.

[0267] Specific behavior:

[0268] Input: Layout design data.

[0269] Data calculation: Calculate total costs and construction schedule.

[0270] Output: Holds the calculation results (total cost and construction schedule).

[0271] Step 5: Server sends more information

[0272] The server transmits the generated 3D simulation image, total cost, and construction schedule information to the user terminal.

[0273] Specific behavior:

[0274] Input: 3D simulation image, total cost, construction schedule.

[0275] Data processing: Packaging the data to be sent.

[0276] Output: Sends data to the user's terminal.

[0277] Step 6: The device displays the simulation image

[0278] The terminal displays the received 3D simulation image and detailed information to the user.

[0279] Specific behavior:

[0280] Input: The data received from the server.

[0281] Data processing: Converting images and detailed information into a display format.

[0282] Output: Shows the simulation image and detailed information to the user.

[0283] Step 7: User enters change request

[0284] The user checks the displayed simulation results and inputs any necessary changes. This data is then sent back to the server.

[0285] Specific behavior:

[0286] Input: The user's change request.

[0287] Data processing: Convert the change request into JSON format.

[0288] Output: Submits a change request to the server.

[0289] Step 8: Server parses and updates the change request

[0290] The server receives change requests from users, updates the layout design data, and then generates new 3D simulation images and performs recalculation.

[0291] Specific behavior:

[0292] Input: Change Request.

[0293] Data calculation: Update design data and regenerate 3D simulation images.

[0294] Output: New 3D simulation images, total cost, and construction schedule are resent to the user's device.

[0295] Step 9: The server generates a proposal based on the final design data

[0296] After the user approves the final design, the server generates a proposal based on this data and sends it to the contractor.

[0297] Specific behavior:

[0298] Input: Final design data.

[0299] Data Computing: Proposal Generation.

[0300] Output: Send proposal to contractor.

[0301] Data generation based on prompt sentences using the generative AI model is performed appropriately at each step. For example, specific actions can be performed using the following prompt sentences:

[0302] Example prompt sentence:

[0303] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[0304] This allows the entire system to work together organically, enabling users' requests to be responded to quickly and accurately.

[0305] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0306] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[0307] System configuration

[0308] 1. User Device:

[0309] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[0310] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[0311] 2. Server:

[0312] Receives input data from the user terminal and analyzes it.

[0313] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[0314] The simulation image, total cost and construction schedule are sent to the user terminal.

[0315] Receives change requests from users and updates design data.

[0316] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[0317] Generate and send proposals to contractors based on the final design data.

[0318] 3. Emotion Engine:

[0319] It recognizes the user's emotions and sends the analysis results to the server.

[0320] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[0321] Provide feedback to improve user satisfaction.

[0322] Program processing

[0323] User:

[0324] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[0325] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[0326] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[0327] Device:

[0328] 4. The entered information is analyzed and sent to the server.

[0329] server:

[0330] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[0331] 2. Generate a 3D simulation image based on the design data.

[0332] 3. Calculate the total cost and schedule the work.

[0333] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[0334] Device:

[0335] 5. Display the simulation image and detailed information to the user.

[0336] 6. The emotion engine recognizes the user's emotions and collects emotion data while the user is checking the simulation results.

[0337] Emotion Engine:

[0338] 7. Analyze the user's emotions and send the results to the server.

[0339] 8. Based on the user's emotions, appropriate exterior design suggestions are fed back to the server.

[0340] server:

[0341] 9. Adjust and regenerate design data based on feedback from the emotion engine.

[0342] 10. Updated design data and simulation images are sent to the user's terminal.

[0343] Device:

[0344] 11. The simulation results are displayed to the user again, and information reflecting the suggestions based on the sentiment analysis is provided.

[0345] 12. If the user wishes to input a change request for the simulation results, the change request is made again.

[0346] server:

[0347] 13. Receive user change requests and update design data.

[0348] 14. Regenerate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[0349] 15. Send the new design data to the user terminal.

[0350] Device:

[0351] 16. Redisplay updated simulation results and details to the user.

[0352] 17. If the user is satisfied with the final design, he or she approves the design.

[0353] server:

[0354] 18. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[0355] 19. Send proposal to contractor.

[0356] Specific examples

[0357] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these preferences into the device. The device analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the device. As the user checks the simulation results, the emotion engine collects emotional data. The emotion engine then sends the analysis results to the server and adjusts the proposal to propose an exterior design that best suits the user's preferences. Through this process, the user can view specific exterior designs in real time and create an optimal plan.

[0358] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[0359] The processing flow will be explained below.

[0360] Step 1:

[0361] The user accesses the system from a terminal and enters login information (user ID, password).

[0362] Step 2:

[0363] The terminal transmits the user's input information to the server.

[0364] Step 3:

[0365] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[0366] Step 4:

[0367] A user starts a new project and inputs the lot shape, size, and home layout.

[0368] Step 5:

[0369] The terminal analyzes the user's input information and sends it to the server.

[0370] Step 6:

[0371] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[0372] Step 7:

[0373] The terminal analyzes the input data and sends it to the server.

[0374] Step 8:

[0375] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the user-entered land information, home layout, and site elements.

[0376] Step 9:

[0377] The server generates a 3D simulation image based on the design data.

[0378] Step 10:

[0379] The server calculates the total cost and schedules the construction.

[0380] Step 11:

[0381] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[0382] Step 12:

[0383] The terminal displays the simulation image and detailed information to the user.

[0384] Step 13:

[0385] The emotion engine recognizes the user's emotions and collects that data.

[0386] Step 14:

[0387] The emotion engine analyzes the collected emotion data and sends the results to the server.

[0388] Step 15:

[0389] The server adjusts and regenerates the design data based on feedback from the emotion engine.

[0390] Step 16:

[0391] The server transmits the updated design data and simulation images to the user terminal.

[0392] Step 17:

[0393] The terminal again displays the simulation results and suggestions based on the emotion analysis to the user.

[0394] Step 18:

[0395] The user checks the simulation results and inputs any necessary changes.

[0396] Step 19:

[0397] The terminal analyzes the change information and sends it to the server.

[0398] Step 20:

[0399] The server receives change requests from users and updates the design data.

[0400] Step 20:

[0401] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[0402] Step 21:

[0403] The server transmits the new design data to the user terminal.

[0404] Step 22:

[0405] The terminal redisplays the updated simulation results and detailed information to the user.

[0406] Step 23:

[0407] If the user is satisfied with the final design, he approves the design.

[0408] Step 24:

[0409] The terminal sends the authorization information to the server.

[0410] Step 25:

[0411] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[0412] Step 26:

[0413] The server sends the proposal to the contractor.

[0414] Example 2

[0415] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0416] Conventional exterior design systems have difficulty quickly and accurately reflecting users' wishes and change requests, making it impossible to increase user satisfaction in the design process. Furthermore, few systems incorporate emotion analysis, making it impossible to adjust the design taking into account the user's emotions. As a result, a gap often exists between the actual construction and the user's expectations.

[0417] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0418] In this invention, the server includes a means for analyzing data input from the user, a means for generating a site design based on the analyzed data, and a means for generating a 3D simulation image based on the site design. This allows the server to quickly and accurately reflect the user's wishes and requests for changes, and furthermore, it is possible to analyze the user's emotions using an emotion engine and adjust the design based on that feedback. This increases user satisfaction and eliminates any gaps after construction.

[0419] A "user" is a user who operates the system and inputs their wishes and requests for changes to the exterior.

[0420] A "terminal" is a device or equipment that analyzes data entered by a user, transmits it to a server, and displays information received from a server.

[0421] The "server" is a computer that receives input data from users, analyzes it, generates exterior design data, and creates 3D simulation images.

[0422] An "emotion engine" is software or hardware that recognizes the user's emotions and provides feedback to the server on design adjustments based on the analysis results.

[0423] "Exterior design" is a design drawing that includes the layout and elements of the exterior desired by the user.

[0424] A "3D simulation image" is a three-dimensional image that allows you to visually check the generated exterior design.

[0425] "Total cost" is the overall cost calculated based on the exterior design.

[0426] The "construction schedule" is the schedule from the start to the end of the construction work.

[0427] A "proposal" is a document containing a construction plan that is sent to a construction company based on the final design data.

[0428] A "change request" is a request made by a user to modify or add to the simulation results.

[0429] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[0430] System configuration

[0431] 1. User Device:

[0432] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[0433] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[0434] 2. Server:

[0435] Receives input data from the user terminal and analyzes it.

[0436] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[0437] The simulation image, total cost and construction schedule are sent to the user terminal.

[0438] Receives change requests from users and updates design data.

[0439] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[0440] Generate and send proposals to contractors based on the final design data.

[0441] 3. Emotion Engine:

[0442] It recognizes the user's emotions and sends the analysis results to the server.

[0443] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[0444] Provide feedback to improve user satisfaction.

[0445] The specific hardware and software used

[0446] Hardware:

[0447] User devices (e.g., personal computers, tablets, smartphones, etc.)

[0448] Servers (e.g. cloud servers, physical servers)

[0449] software:

[0450] Design software (e.g., Autodesk AutoCAD)

[0451] 3D rendering software (e.g. Blender)

[0452] Sentiment analysis tools (e.g. IBM Watson)

[0453] Estimation Software

[0454] Specific examples of program processing

[0455] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these wishes into the terminal. An example of a prompt sentence is as follows:

[0456] Example prompt sentence:

[0457] User: "I would like to enlarge the parking space at my house and add a lawn and flower beds to my yard. I would like to know the cost and construction time."

[0458] The terminal analyzes the input data and sends it to the server. The server receives this data and generates an exterior design, including the layout of the parking lot, the garden lawn, and the placement of flower beds. It then uses Blender to create a 3D simulation image. It then uses estimation software to calculate the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this information to the terminal. The terminal then displays the simulation results and detailed information to the user.

[0459] During this process, the emotion engine analyzes the user's facial expressions and voice to collect emotional data. The analysis results are sent to the server, which then readjusts the exterior design based on the emotional data. The regenerated design data and simulation images are sent back to the user's device and displayed to the user. This allows the user to check the specific exterior design in real time and create an optimal plan.

[0460] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[0461] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0462] Step 1:

[0463] The user enters their login information.

[0464] Input: User ID, Password

[0465] Specific operation: The user enters their user ID and password into the login screen of the terminal to access the system. The terminal receives this and sends it to the server.

[0466] Output: Login information sent to the server

[0467] Step 2:

[0468] The user enters the project information.

[0469] Input: Data on the shape, size, and layout of the land

[0470] Specific operation: The user inputs the shape, size, and layout of the land for a new project, and then inputs their wishes and requests for changes to the exterior (e.g., expanding the parking lot, installing grass and flower beds in the garden) into the terminal. The terminal then sends the input data to the server.

[0471] Output: Project information and site requirements sent to the server

[0472] Step 3:

[0473] The terminal analyzes the input data and sends it to the server.

[0474] Input: User-entered project information and site preferences

[0475] Specific operation: The terminal analyzes the user's input data and sends the formatted data to the server.

[0476] Output: Parsed data sent to the server

[0477] Step 4:

[0478] The server analyzes the received data and generates a design.

[0479] Input: Analyzed data (project information, desired exterior data)

[0480] Specific operation: The server analyzes the data sent by the user using automated design software (e.g., AutoCAD) and generates exterior design drawings (2D and 3D) based on the shape of the land, the layout of the house, and exterior elements.

[0481] Output: Generated site plan

[0482] Step 5:

[0483] The server generates a 3D simulation image.

[0484] Input: Exterior design drawing

[0485] Specific operation: The server uses 3D rendering software (e.g. Blender) to create a 3D simulation image based on the generated design drawing.

[0486] Output: Generated 3D simulation image

[0487] Step 6:

[0488] The server calculates the total cost and construction schedule.

[0489] Input: Exterior design data

[0490] What it does: The server uses the estimating software to calculate the total cost of the design and also calculates the required construction schedule.

[0491] Output: Total cost, construction schedule

[0492] Step 7:

[0493] The server transmits the simulation results to the terminal.

[0494] Input: 3D simulation image, total cost, construction schedule

[0495] Specific operation: The server transmits the generated data to the user terminal.

[0496] Output: Simulation results sent to the user's terminal

[0497] Step 8:

[0498] The terminal displays the simulation results.

[0499] Input: Simulation results sent from the server (3D simulation image, total cost, construction schedule)

[0500] Specific operation: The device displays the received data to the user, who can visually check the 3D simulation image and detailed information.

[0501] Output: Simulation results displayed to the user

[0502] Step 9:

[0503] The emotion engine recognizes the user's emotions and collects data.

[0504] Input: User's facial expression and voice data

[0505] Specific operation: The emotion engine recognizes emotions from the user's facial expressions and voice, and collects emotion data while checking the simulation results.

[0506] Output: Collected emotion data

[0507] Step 10:

[0508] The emotion engine sends the emotion data to the server.

[0509] Input: Collected emotion data

[0510] Specific operation: The emotion engine analyzes the collected emotion data and sends the results to the server.

[0511] Output: Emotion data sent to the server

[0512] Step 11:

[0513] The server regenerates the design based on the emotional feedback.

[0514] Input: Emotion data

[0515] Specific operation: The server readjusts the exterior design based on the emotion data. The design data is adjusted and regenerated using automated design software (e.g., AutoCAD).

[0516] Output: Regenerated design data and 3D simulation images

[0517] Step 12:

[0518] The server transmits the updated design data to the terminal.

[0519] Input: Regenerated design data, 3D simulation images

[0520] Specific operation: The server sends the updated design data and new 3D simulation images to the user terminal.

[0521] Output: Updated design data and simulation images sent to the terminal

[0522] Step 13:

[0523] The terminal is regenerated and the simulation results are displayed.

[0524] Input: Updated design data and simulation images sent from the server

[0525] Specific operation: The terminal redisplays the updated simulation results to the user, who then checks the new 3D simulation image and detailed information.

[0526] Output: Simulation results displayed to the user

[0527] Step 14:

[0528] A user enters a change request.

[0529] Input: New Change Request

[0530] Specific operation: After the user checks the simulation results, they input new change requests into the terminal as necessary. The terminal then resends the change requests to the server.

[0531] Output: The change request sent to the server

[0532] Step 15:

[0533] The server receives the change request and updates the design data.

[0534] Input: Change Request Data

[0535] Specific operation: The server receives a change request from the user and updates the design data in the automated design software.

[0536] Output: Updated design data

[0537] Step 16:

[0538] The server resends the updated design data.

[0539] Input: Updated design data, 3D simulation images, total cost, construction schedule

[0540] Specific operation: The server regenerates updated design data, new 3D simulation images, total costs, and construction schedules, and sends them to the terminal.

[0541] Output: Updated design data and simulation results sent to the terminal

[0542] Step 17:

[0543] The device will display the updated simulation results.

[0544] Input: Updated design data and simulation results sent from the server

[0545] Specific operation: The terminal displays the updated simulation results and detailed information to the user again. The user confirms the new simulation results.

[0546] Output: Updated simulation results displayed to the user

[0547] Step 18:

[0548] The user approves the final design.

[0549] Input: Approval of final design data

[0550] Specific Actions: If the user is satisfied with the final design, he / she clicks the "Approve" button to approve the design.

[0551] Output: Approved final design data

[0552] Step 19:

[0553] The server sends the final design data to the contractor as a proposal.

[0554] Input: Approved final design data

[0555] Specific operation: The server generates a proposal for the construction company based on the final design data approved by the user and sends it to the construction company.

[0556] Output: Proposal sent to contractor

[0557] (Application example 2)

[0558] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0559] Conventional exterior design simulation systems have difficulty in proposing designs that take the user's emotions into account, and users are often dissatisfied with the simulation results. This creates dissatisfaction in communication between the user and the construction company, making it difficult to smoothly progress the project. Furthermore, there is a demand for proposals that reflect the user's emotions in real time when designing the exterior and interior layout of a store, but current systems are unable to meet this demand.

[0560] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0561] In this invention, the server includes: means for a user to input their exterior site preferences; means for the server to analyze the input data from the user; means for the server to generate an exterior site design based on the analyzed data; means for the server to generate a 3D simulation image based on the exterior site design; means for the server to send the generated simulation image, total cost, and construction schedule to a user terminal; means for the terminal to display the simulation image and detailed information to the user; means for the user to request changes to the simulation results; means for the server to receive the change request and update the design data; means for the server to generate a proposal to a contractor based on the final design data and send the proposal; means for the server to recognize the user's emotions on the terminal; and means for analyzing the emotions and adjusting the exterior site design based on the analysis results. This enables real-time feedback based on the user's emotions, achieving high user satisfaction and providing a smooth design process.

[0562] A "user terminal" is a device used by a user to send input data to the system and display simulation results and detailed information.

[0563] The "server" is a central processing unit that analyzes input data sent by the user, generates an exterior design, and generates a 3D simulation image and sends it to the user's terminal.

[0564] "Exterior design" refers to the external structures and spatial layouts that are designed based on the user's wishes and site conditions.

[0565] A "3D simulation image" is an image that visualizes the exterior design in three dimensions and is used by users to get a concrete idea of ​​the design.

[0566] "Total cost" refers to the total cost of designing and constructing the exterior structure.

[0567] "Construction schedule" refers to the overall schedule until the exterior design is completed.

[0568] An "emotion engine" is a combination of software and hardware for recognizing and analyzing a user's emotions.

[0569] A "proposal" is a design proposal document to a construction company that is generated based on the final design data.

[0570] "Change request" refers to a request for corrections or additions that a user desires based on the simulation results.

[0571] "Emotion analysis" is the process of collecting and analyzing user emotion data.

[0572] "Real-time feedback" refers to instantly adjusting simulation results and design proposals based on user input and sentiment analysis results.

[0573] MODE FOR CARRYING OUT THE INVENTION

[0574] This invention is a system for simulating the layout of the exterior and interior of a physical store based on the user's wishes and emotions. The system includes a user terminal, a server, and an emotion engine. Specific embodiments of this system and program processing are described below.

[0575] System configuration

[0576] 1. User Device:

[0577] The user operates a user terminal such as a smartphone or tablet and inputs their desired exterior and interior design.

[0578] At the user terminal, it is possible to describe the desired layout in the form of a prompt sentence.

[0579] Hardware used: smartphone, tablet

[0580] Software used: HTTP / HTTPS protocol

[0581] 2. Server:

[0582] Receives and analyzes input data sent from the user terminal.

[0583] The server uses Python, Node.js, etc. to generate exterior designs and interior layouts based on user input data.

[0584] Based on the setting data, a simulation image is generated using 3D design software such as Blender or Autodesk Revit.

[0585] The total cost and construction schedule are calculated as simulation results and sent to the user's terminal.

[0586] Hardware used: Cloud server equipped with a high-performance GPU (e.g., AWS EC2 instance)

[0587] Software used: Python, Node.js, Blender, Autodesk Revit

[0588] 3. Emotion Engine:

[0589] The camera and sensors on the user's device are used to recognize the user's emotions and collect data.

[0590] The collected emotion data is analyzed using OpenCV, TensorFlow, etc. and sent to the server.

[0591] Adjust design data based on the results of sentiment analysis.

[0592] Hardware used: camera and sensors on the user device

[0593] Software used: OpenCV, TensorFlow

[0594] Program processing

[0595] 1. User enters their preference:

[0596] Users use a smartphone or tablet to input their desired exterior and interior design in the form of prompt sentences.

[0597] Examples:

[0598] "I would like to have benches installed near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[0599] 2. Data transmission and analysis:

[0600] The user device sends input data to the server, which then analyzes it using Python or Node.js, sometimes using GIS data or CAD drawings.

[0601] 3. Design and simulation generation:

[0602] The server creates a design based on the input data, generates a 3D simulation image using Blender, Autodesk Revit, etc., and then calculates the total cost and construction schedule.

[0603] 4. Emotion analysis:

[0604] The user device uses a camera to capture the facial expressions and reactions of the user checking the simulation results, and performs emotion analysis using OpenCV and TensorFlow. The emotion analysis results are then sent to the server.

[0605] 5. Rework and new proposals:

[0606] The server updates the design data based on the results of the emotion analysis and creates a new design. This data is then simulated again and sent to the user's device. By repeating this process, the system can create an exterior and interior layout that best suits the user's wishes and emotions.

[0607] In this way, real-time feedback based on the user's emotions becomes possible, achieving high levels of user satisfaction and providing a smooth design process.

[0608] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0609] Step 1:

[0610] The user operates a smartphone or tablet and inputs their desired exterior and interior design in the form of prompt statements.

[0611] Example: "I would like to have a bench near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[0612] The entered data is temporarily stored in the user terminal and prepared for later transmission to the server.

[0613] Step 2:

[0614] The user terminal transmits the input data to the server.

[0615] The submitted data is sent to the server using the HTTP / HTTPS protocol.

[0616] The server analyzes the received data and checks the requirements specified by the user.

[0617] Technologies used: HTTP / HTTPS protocol, Python, Node.js

[0618] Step 3:

[0619] The server generates an exterior design or interior layout based on the analyzed data.

[0620] At this time, a specific layout is created using Geographic Information System (GIS) data and Computer Aided Design (CAD) drawings.

[0621] The generated design data is saved as 2D and 3D models.

[0622] Technologies used: Python, GIS, CAD

[0623] Step 4:

[0624] The server generates a 3D simulation image based on the design data.

[0625] Simulation images are generated using 3D design software such as Blender and Autodesk Revit, allowing users to see a concrete image.

[0626] Technologies used: Blender, Autodesk Revit

[0627] Step 5:

[0628] The server generates a 3D simulation image and then calculates the total cost and construction schedule.

[0629] The calculation results are sent to the user terminal along with the simulation image.

[0630] Technologies used: Python, computational algorithms

[0631] Step 6:

[0632] The user terminal displays the 3D simulation image, total cost, and construction schedule received from the server to the user.

[0633] The user checks the simulation results, and the emotion engine collects the user's facial expressions and reactions via camera.

[0634] The collected data is temporarily stored on the user's device.

[0635] Technology used: Cameras and sensors on smartphones and tablets

[0636] Step 7:

[0637] The user device analyzes the emotion data using OpenCV and TensorFlow and sends the results to the server.

[0638] The transmitted data includes emotion analysis results based on the user's facial expressions and reactions.

[0639] Technologies used: OpenCV, TensorFlow

[0640] Step 8:

[0641] The server adjusts the design data based on the emotion analysis results and generates new design data.

[0642] Using the new design data, a 3D simulation image is generated again, and the total cost and construction schedule are also recalculated.

[0643] Technologies used: Python, Blender, Autodesk Revit

[0644] Step 9:

[0645] The server transmits the regenerated 3D simulation image, total cost and construction schedule to the user terminal.

[0646] The user terminal displays the received update information to the user, who then checks it again.

[0647] Technologies used: HTTP / HTTPS protocol, Python

[0648] Step 10:

[0649] If the user is satisfied with the final design, he sends his approval to the server.

[0650] The server generates a proposal for the construction company based on the final design data and sends the proposal to the construction company.

[0651] Technologies used: Python, documentation generation tools

[0652] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0653] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0654] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0655] [Second embodiment]

[0656] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0657] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0658] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0659] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0660] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0661] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0662] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0663] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0664] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0665] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0666] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0667] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0668] The exterior design simulation system according to the present invention is composed of the elements of a user, a terminal, and a server. A specific embodiment of this system and program processing will be described below.

[0669] System configuration

[0670] 1. User Device:

[0671] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[0672] The input contents are sent to the server and the received simulation results are displayed.

[0673] 2. Server:

[0674] Receives input data from the user terminal and analyzes it.

[0675] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[0676] The simulation image, total cost and construction schedule are sent to the user terminal.

[0677] Receives change requests from users and updates design data.

[0678] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[0679] Generate and send proposals to contractors based on the final design data.

[0680] Program processing

[0681] User:

[0682] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[0683] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[0684] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[0685] Device:

[0686] 4. The entered information is analyzed and sent to the server.

[0687] server:

[0688] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[0689] 2. Generate a 3D simulation image based on the design data.

[0690] 3. Calculate the total cost and schedule the work.

[0691] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[0692] Device:

[0693] 5. Display the simulation image and detailed information to the user.

[0694] 6. The user reviews the simulation results and inputs any necessary changes.

[0695] server:

[0696] 7. Receive change requests from users and update the design data.

[0697] 8. Generate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[0698] 9. Send the new design data to the user terminal.

[0699] Device:

[0700] 10. Redisplay updated simulation results and details to the user.

[0701] 11. If the user is satisfied with the final design, he or she approves the design.

[0702] server:

[0703] 12. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[0704] 13. Send proposal to contractor.

[0705] Specific examples

[0706] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these requests into the terminal. The terminal analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the terminal. The user can check the simulation results and re-enter changes if necessary. The server reflects the changes and resends the new simulation. Through this process, the user can check the specific exterior design in real time and create an optimal plan.

[0707] This allows for smooth communication between users and contractors, eliminating the gap between the image of the finished exterior construction work and the reality.

[0708] The processing flow will be explained below.

[0709] Step 1:

[0710] The user accesses the system from a terminal and enters login information (user ID, password).

[0711] Step 2:

[0712] The terminal transmits the user's input information to the server.

[0713] Step 3:

[0714] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[0715] Step 4:

[0716] A user starts a new project and inputs the lot shape, size, and home layout.

[0717] Step 5:

[0718] The terminal analyzes the user's input information and sends it to the server.

[0719] Step 6:

[0720] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[0721] Step 7:

[0722] The terminal analyzes the input data and sends it to the server.

[0723] Step 8:

[0724] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the land information, home layout, and site elements.

[0725] Step 9:

[0726] The server generates a 3D simulation image based on the design data.

[0727] Step 10:

[0728] The server calculates the total cost and schedules the construction.

[0729] Step 11:

[0730] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[0731] Step 12:

[0732] The terminal displays the simulation image and detailed information to the user.

[0733] Step 13:

[0734] The user checks the simulation results and inputs any necessary changes.

[0735] Step 14:

[0736] The terminal analyzes the change information and sends it to the server.

[0737] Step 15:

[0738] The server receives change requests from users and updates the design data.

[0739] Step 16:

[0740] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[0741] Step 17:

[0742] The server transmits the new design data to the user terminal.

[0743] Step 18:

[0744] The terminal redisplays the updated simulation results and detailed information to the user.

[0745] Step 19:

[0746] If the user is satisfied with the final design, he approves the design.

[0747] Step 20:

[0748] The terminal sends the authorization information to the server.

[0749] Step 21:

[0750] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[0751] Step 22:

[0752] The server sends the proposal to the contractor.

[0753] Example 1

[0754] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0755] In the traditional exterior design process, it was difficult for users to check design changes in real time as they proceeded, which often led to gaps between the design and construction. Furthermore, poor communication with the construction company led to construction delays and budget overruns. As a result, it was difficult to create an exterior design that accurately reflected the user's wishes.

[0756] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0757] In this invention, the server includes a means for analyzing data input from the user, a means for generating exterior site designs, and a means for generating 3D simulation images. This allows for real-time design changes and confirmations. It also facilitates budget and schedule management by accurately calculating total costs and construction schedules and then recalculating based on updated design data. After the user approves the final design, a proposal for the contractor is automatically generated, facilitating smooth communication and execution of the plan.

[0758] "User" is any person or entity that uses the system to enter information about a site design and to review and modify the results.

[0759] A "terminal" is a device operated by a user, which transmits input data and displays simulation results.

[0760] A "server" is a computer system that analyzes data sent from users, generates exterior design, and provides simulation results.

[0761] "Input data" refers to information such as the desired exterior design, the shape and size of the land, and the layout of the house that the user provides to the system from their terminal.

[0762] "Analysis" refers to the process in which the server performs calculations and processing based on input data received from the user to generate a site design.

[0763] "Exterior design" refers to the layout and blueprints of gardens, parking lots, fences, etc., generated based on the user's wishes and input data.

[0764] "Generation" refers to the process in which the server analyzes the input data and creates the exterior design and 3D simulation images.

[0765] "Simulation image" refers to an image or video that visually displays the generated exterior design as a 3D model.

[0766] "Total cost" refers to the result of calculating all costs required to carry out the exterior design.

[0767] The "construction schedule" refers to the calculated period from the start to the completion of exterior construction work.

[0768] A "change request" refers to the act of a user inputting corrections or additions that they would like to make to the results of the initial simulation.

[0769] A "proposal" is a document that is generated based on the final design data and that contains detailed information such as a design plan, costs, and construction schedule, which is presented to a construction company.

[0770] The exterior design simulation system of the present invention is composed of a terminal operated by the user, a server that analyzes data and generates designs, and a network that communicates between them. This system generates exterior designs that reflect the user's wishes in real time and allows the user to visually confirm them.

[0771] System configuration

[0772] User terminal: A device operated by the user, such as a PC, tablet, or smartphone. The user inputs their wishes and requests for changes to the exterior of the building through the terminal and sends this information to the server. The terminal also displays the simulation results and design data received from the server.

[0773] Server: Receives data sent from the user's device, performs analysis, and generates a site design. The server creates a 3D simulation image based on the design data and calculates the total cost and construction schedule. The generated information is sent back to the user's device, allowing the user to confirm and modify the design. The server also generates and sends a proposal to the construction company based on the final design data.

[0774] Hardware and software used

[0775] Hardware: User devices can be general-purpose PCs, tablets, or smartphones. Servers require a high-performance processor and sufficient memory.

[0776] Software: The server generates the exterior design using a generative AI model (e.g., a CAD engine). 3D simulation images are likely to be generated using a real-time rendering engine such as Unity or Unreal Engine.

[0777] Specific examples

[0778] For example, a specific example will be given in which the user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden."

[0779] The user enters "Parking lot: 20 square meters, Lawn: 50 square meters, Flower bed: Roses and tulips" into the project creation screen on the device and clicks the "Send" button. The device analyzes the entered data and sends it to the server in JSON format.

[0780] The server receives the data and generates the exterior design using a generative AI model (e.g., a CAD engine). It then renders a 3D simulation image using Unity or Unreal Engine. The server also calculates the total cost (e.g., ¥1,200,000) and construction schedule (e.g., 10 days) and sends this information to the user's device.

[0781] The terminal displays the simulation results to the user, who then checks the results and inputs changes, such as "Please expand the parking lot by another 5 square meters." The server reflects the changes, recalculates the new design, simulation images, total cost, and construction schedule, and retransmits them.

[0782] In this way, through interaction between the user and the system, the details of the exterior design are fleshed out and an optimal plan is created in real time.

[0783] Prompt Sentence Examples

[0784] "I would like the parking lot at my house to be enlarged and a lawn and flower beds installed in the garden. The parking lot should be large enough for three cars, the lawn should be 50 square meters, and the flower beds should be mainly roses and tulips. Also, please let me know the total budget and construction time."

[0785] By entering a prompt like the one above, the generative AI model will create a site design in real time, and the user can review and modify the results as they go.

[0786] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0787] Step 1:

[0788] The user accesses the system from a terminal and enters login information (user ID, password). The user clicks the "Login" button to log in to the system. The input is the user ID and password, and the output is the authentication result (success or failure).

[0789] Step 2:

[0790] The user clicks the "Start a new project" button and proceeds to the project information entry screen. Here, the user enters the shape, size, and layout of the land. The input is data related to the shape, size, and layout of the land, and the output is the initial setting data for the project.

[0791] Step 3:

[0792] The user inputs specific exterior requirements, such as parking, garden, and fence installation, and clicks the "Submit" button. The input is the user's wishes and requests regarding the exterior, and the output is organized exterior data.

[0793] Step 4:

[0794] The terminal parses and formats the input data from the user. The input is the initial settings and desired exterior data entered by the user, and the output is the formatted data sent to the server. This process also includes data validation.

[0795] Step 5:

[0796] The terminal sends the formatted data to the server. The input is the organized exterior data, and the output is a transmission request to the server. This communication is performed in the form of an HTTP request.

[0797] Step 6:

[0798] The server analyzes the data received from the terminal and checks for missing information. The input is organized exterior data, and the output is the analysis results and basic data for the exterior design.

[0799] Step 7:

[0800] The server uses a generative AI model (e.g., a CAD engine) to generate the exterior design. It creates 2D and 3D blueprints based on user input data. The input is the analyzed exterior data, and the output is the generated exterior design.

[0801] Step 8:

[0802] The server generates 3D simulation images based on the design data. This process uses a 3D simulation engine (such as Unity or Unreal Engine). The input is the design data, and the output is a high-quality 3D simulation image.

[0803] Step 9:

[0804] The server calculates the total cost based on the design data, including factors such as material and labor costs. The input is the design data, and the output is the total cost estimate.

[0805] Step 10:

[0806] The server calculates the construction schedule, scheduling the period from the start date to the completion date. The input is the design data and total cost, and the output is the construction schedule.

[0807] Step 11:

[0808] The server sends the generated 3D simulation image, total cost, and construction schedule to the user terminal. The input is the 3D simulation image, total cost, and construction schedule, and the output is a transmission request to the user terminal.

[0809] Step 12:

[0810] The terminal displays the received information to the user. The user checks the simulation results and inputs change requests if necessary. The input is the simulation results from the server, and the output is the display to the user and the user's change requests.

[0811] Step 13:

[0812] The user checks the simulation results and inputs a change request, such as "Please expand the parking lot by another 5 square meters," and clicks the "Submit" button. The input is a change request, and the output is a submission request.

[0813] Step 14:

[0814] The terminal receives the user's change request and sends it to the server. The input is the change request data, and the output is a transmission request to the server.

[0815] Step 15:

[0816] The server receives the change request, updates the design data, analyzes it again, and generates the changed design. The input is the change request data, and the output is the updated design data.

[0817] Step 16:

[0818] The server recalculates new 3D simulation images, total costs, and construction schedules based on the updated design data, and sends them to the user's terminal again. The input is the updated design data, and the output is the recalculated simulation results, total costs, and construction schedules.

[0819] Step 17:

[0820] The terminal again displays the received information to the user. If the user is satisfied with the final design, he / she clicks the "Approve" button to confirm the final design. The input is the recalculated simulation results, and the output is the display and approval operation for the user.

[0821] Step 18:

[0822] The server receives final approval from the user, generates a proposal to the contractor based on the final design data, and sends it. The proposal includes detailed design drawings, total costs, and construction schedules. The input is the final design data and approval information, and the output is the proposal sent to the contractor.

[0823] (Application example 1)

[0824] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0825] Currently, the layout design and product placement of physical stores are often done manually, which is inefficient. It is also difficult to quickly obtain detailed information, including simulation results, budgets, and construction schedules. Furthermore, re-simulating in response to user requests for changes is also time-consuming. For these reasons, there is a demand for fast and efficient layout design and simulation.

[0826] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0827] In this invention, the server includes: a means for a user to input layout preferences; a means for the server to analyze the input data from the user; a means for the server to generate a layout design based on the analyzed data; a means for the server to generate a 3D simulation image based on the layout design; a means for the server to transmit the generated simulation image, total cost, and construction schedule to a user terminal; a means for the terminal to display the simulation image and detailed information to the user; a means for the user to request changes to the simulation results; a means for the server to receive the change request and update the design data; a means for the server to generate a proposal based on the final design data and send the proposal to a contractor; and a means for generating simulation data based on prompt statements using a generative AI model. This allows users to efficiently design the layout of physical stores and quickly obtain simulation results and detailed information. Furthermore, re-simulations can be smoothly performed to accommodate change requests.

[0828] A "user" is an end user who uses the store layout design system to input layout preferences and change requests.

[0829] "Layout preference" refers to the specific details of the user's desire for the layout and design of the store.

[0830] The "server" is a device that analyzes data sent by users and generates store layout designs and 3D simulation images.

[0831] "Input data" refers to information such as store shape, size, and product placement that the user inputs into the layout design system.

[0832] "Analyzed data" refers to data generated as a result of processing and analyzing input data received by the server from the user.

[0833] "Layout design" is a layout diagram of the store generated by the server based on the analyzed data.

[0834] A "3D simulation image" is a three-dimensional simulation image displayed in real time based on a layout design generated by the server.

[0835] "Total cost" refers to all costs, including material costs and labor costs, required for layout design and construction.

[0836] "Construction schedule" refers to the total period required for layout design and construction work.

[0837] A "user terminal" is a device that allows a user to access the store layout design system.

[0838] "Detailed information" refers to detailed data such as 3D simulation images, total costs, and construction schedules.

[0839] A "change request" is a request from a user for correction or modification based on the simulation results.

[0840] "Design data" refers to the latest layout design information generated by the server after analysis and modification.

[0841] The "proposal" is a store layout proposal document that the server creates based on the final design data and sends to the construction company.

[0842] A "generative AI model" is an artificial intelligence algorithm that generates simulation data based on a prompt sentence.

[0843] A "prompt statement" is an instruction statement for creating simulation data that the user inputs to the generated AI model.

[0844] MODE FOR CARRYING OUT THE INVENTION

[0845] The store layout design system according to the present invention is an integrated system including a user terminal, a server, and a generative AI model. Each component of the system and program processing will be described in detail below.

[0846] System configuration

[0847] 1. User Device

[0848] The user terminal is a device that allows users to input their store layout preferences and change requests. Examples include smartphones and tablets. Users can access the system from these terminals and input their desired layout and changes. The terminal sends this data to the server, which then displays 3D simulation images and other detailed information received from the server.

[0849] 2. Server

[0850] The server is a device that receives and analyzes data sent by users. Specifically, it performs the following processes:

[0851] Analyzes store shape and product placement data entered by the user.

[0852] A layout design is generated based on the analyzed data.

[0853] A 3D simulation image is created based on the generated layout design.

[0854] Calculate total costs and construction schedule.

[0855] Simulation images, total costs, and construction schedules are sent to the user's device.

[0856] Receive change requests from users and update design data.

[0857] Generate proposals based on the final design data and send them to the contractor.

[0858] A generative AI model is used to generate simulation data based on prompt statements.

[0859] 3. Generative AI Models

[0860] A generative AI model is an artificial intelligence algorithm that generates simulation data based on prompts. This model allows users to obtain detailed simulation data simply by entering simple instructions.

[0861] Program processing description

[0862] The program communicates between the user device, the server, and the generative AI model, and performs data analysis and simulation. The specific process is as follows:

[0863] User device:

[0864] The user terminal provides an interface for users to input their layout preferences and change requests. This data is sent to the server. The user terminal also displays detailed information received from the server, such as 3D simulation images, total costs, and construction schedules.

[0865] server:

[0866] The server receives and analyzes data sent from the user's device. The main software used for this is Flask (a web application framework). A dedicated simulation library (the specific library name has not been specified) is also used to generate 3D simulation images. The server also generates simulation data based on prompt statements using a generative AI model.

[0867] Generative AI models:

[0868] The generative AI model generates simulation data based on the prompt text entered by the user, which is then sent back to the server and finally displayed on the user's device.

[0869] Adding specific examples

[0870] As an example, consider the following prompt sentence input to a generative AI model:

[0871] Example prompt sentence:

[0872] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[0873] The generative AI model analyzes the prompt sentences and generates 3D simulation data based on the specified conditions. This data is sent back to the server and displayed in real time on the user's device, allowing the user to make further changes.

[0874] As described above, the system of the present invention can efficiently and easily provide users with layout designs for physical stores, quickly obtain detailed information, and flexibly respond to changes requested by users.

[0875] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0876] Program processing flow

[0877] Step 1: User inputs layout preference

[0878] The user inputs their desired layout from the terminal, including the store's shape, area, product placement, etc. The terminal then sends this input data to the server.

[0879] Specific behavior:

[0880] Input: The user enters the desired layout (store shape, area, product placement).

[0881] Data processing: The terminal converts the input data into JSON format.

[0882] Output: Sends input data to the server.

[0883] Step 2: The server parses the input data

[0884] The server analyzes the input data received from the user terminal and generates a layout design. The analysis is performed based on data such as the store shape and product placement.

[0885] Specific behavior:

[0886] Input: Input data sent from the terminal.

[0887] Data processing: The server analyzes the input data and generates layout design data.

[0888] Output: Holds the generated layout design data.

[0889] Step 3: The server generates the 3D simulation image

[0890] The server generates a 3D simulation image based on the generated layout design data, using a 3D simulation library.

[0891] Specific behavior:

[0892] Input: Layout design data.

[0893] Data calculation: Generate 3D simulation images using the 3D simulation library.

[0894] Output: Keeps the generated 3D simulation image.

[0895] Step 4: The server calculates the total cost and construction schedule.

[0896] The server calculates the total cost and construction schedule based on the layout design, including material costs, labor costs, and work schedules.

[0897] Specific behavior:

[0898] Input: Layout design data.

[0899] Data calculation: Calculate total costs and construction schedule.

[0900] Output: Holds the calculation results (total cost and construction schedule).

[0901] Step 5: Server sends more information

[0902] The server transmits the generated 3D simulation image, total cost, and construction schedule information to the user terminal.

[0903] Specific behavior:

[0904] Input: 3D simulation image, total cost, construction schedule.

[0905] Data processing: Packaging the data to be sent.

[0906] Output: Sends data to the user's terminal.

[0907] Step 6: The device displays the simulation image

[0908] The terminal displays the received 3D simulation image and detailed information to the user.

[0909] Specific behavior:

[0910] Input: The data received from the server.

[0911] Data processing: Converting images and detailed information into a display format.

[0912] Output: Shows the simulation image and detailed information to the user.

[0913] Step 7: User enters change request

[0914] The user checks the displayed simulation results and inputs any necessary changes. This data is then sent back to the server.

[0915] Specific behavior:

[0916] Input: The user's change request.

[0917] Data processing: Convert the change request into JSON format.

[0918] Output: Submits a change request to the server.

[0919] Step 8: Server parses and updates the change request

[0920] The server receives change requests from users, updates the layout design data, and then generates new 3D simulation images and performs recalculation.

[0921] Specific behavior:

[0922] Input: Change Request.

[0923] Data calculation: Update design data and regenerate 3D simulation images.

[0924] Output: New 3D simulation images, total cost, and construction schedule are resent to the user's device.

[0925] Step 9: The server generates a proposal based on the final design data

[0926] After the user approves the final design, the server generates a proposal based on this data and sends it to the contractor.

[0927] Specific behavior:

[0928] Input: Final design data.

[0929] Data Computing: Proposal Generation.

[0930] Output: Send proposal to contractor.

[0931] Data generation based on prompt sentences using the generative AI model is performed appropriately at each step. For example, specific actions can be performed using the following prompt sentences:

[0932] Example prompt sentence:

[0933] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[0934] This allows the entire system to work together organically, enabling users' requests to be responded to quickly and accurately.

[0935] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0936] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[0937] System configuration

[0938] 1. User Device:

[0939] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[0940] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[0941] 2. Server:

[0942] Receives input data from the user terminal and analyzes it.

[0943] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[0944] The simulation image, total cost and construction schedule are sent to the user terminal.

[0945] Receives change requests from users and updates design data.

[0946] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[0947] Generate and send proposals to contractors based on the final design data.

[0948] 3. Emotion Engine:

[0949] It recognizes the user's emotions and sends the analysis results to the server.

[0950] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[0951] Provide feedback to improve user satisfaction.

[0952] Program processing

[0953] User:

[0954] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[0955] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[0956] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[0957] Device:

[0958] 4. The entered information is analyzed and sent to the server.

[0959] server:

[0960] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[0961] 2. Generate a 3D simulation image based on the design data.

[0962] 3. Calculate the total cost and schedule the work.

[0963] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[0964] Device:

[0965] 5. Display the simulation image and detailed information to the user.

[0966] 6. The emotion engine recognizes the user's emotions and collects emotion data while the user is checking the simulation results.

[0967] Emotion Engine:

[0968] 7. Analyze the user's emotions and send the results to the server.

[0969] 8. Based on the user's emotions, appropriate exterior design suggestions are fed back to the server.

[0970] server:

[0971] 9. Adjust and regenerate design data based on feedback from the emotion engine.

[0972] 10. Updated design data and simulation images are sent to the user's terminal.

[0973] Device:

[0974] 11. The simulation results are displayed to the user again, and information reflecting the suggestions based on the sentiment analysis is provided.

[0975] 12. If the user wishes to input a change request for the simulation results, the change request is made again.

[0976] server:

[0977] 13. Receive user change requests and update design data.

[0978] 14. Regenerate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[0979] 15. Send the new design data to the user terminal.

[0980] Device:

[0981] 16. Redisplay updated simulation results and details to the user.

[0982] 17. If the user is satisfied with the final design, he or she approves the design.

[0983] server:

[0984] 18. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[0985] 19. Send proposal to contractor.

[0986] Specific examples

[0987] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these preferences into the device. The device analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the device. As the user checks the simulation results, the emotion engine collects emotional data. The emotion engine then sends the analysis results to the server and adjusts the proposal to propose an exterior design that best suits the user's preferences. Through this process, the user can view specific exterior designs in real time and create an optimal plan.

[0988] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[0989] The processing flow will be explained below.

[0990] Step 1:

[0991] The user accesses the system from a terminal and enters login information (user ID, password).

[0992] Step 2:

[0993] The terminal transmits the user's input information to the server.

[0994] Step 3:

[0995] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[0996] Step 4:

[0997] A user starts a new project and inputs the lot shape, size, and home layout.

[0998] Step 5:

[0999] The terminal analyzes the user's input information and sends it to the server.

[1000] Step 6:

[1001] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[1002] Step 7:

[1003] The terminal analyzes the input data and sends it to the server.

[1004] Step 8:

[1005] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the user-entered land information, home layout, and site elements.

[1006] Step 9:

[1007] The server generates a 3D simulation image based on the design data.

[1008] Step 10:

[1009] The server calculates the total cost and schedules the construction.

[1010] Step 11:

[1011] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[1012] Step 12:

[1013] The terminal displays the simulation image and detailed information to the user.

[1014] Step 13:

[1015] The emotion engine recognizes the user's emotions and collects that data.

[1016] Step 14:

[1017] The emotion engine analyzes the collected emotion data and sends the results to the server.

[1018] Step 15:

[1019] The server adjusts and regenerates the design data based on feedback from the emotion engine.

[1020] Step 16:

[1021] The server transmits the updated design data and simulation images to the user terminal.

[1022] Step 17:

[1023] The terminal again displays the simulation results and suggestions based on the emotion analysis to the user.

[1024] Step 18:

[1025] The user checks the simulation results and inputs any necessary changes.

[1026] Step 19:

[1027] The terminal analyzes the change information and sends it to the server.

[1028] Step 20:

[1029] The server receives change requests from users and updates the design data.

[1030] Step 20:

[1031] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[1032] Step 21:

[1033] The server transmits the new design data to the user terminal.

[1034] Step 22:

[1035] The terminal redisplays the updated simulation results and detailed information to the user.

[1036] Step 23:

[1037] If the user is satisfied with the final design, he approves the design.

[1038] Step 24:

[1039] The terminal sends the authorization information to the server.

[1040] Step 25:

[1041] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[1042] Step 26:

[1043] The server sends the proposal to the contractor.

[1044] Example 2

[1045] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1046] Conventional exterior design systems have difficulty quickly and accurately reflecting users' wishes and change requests, making it impossible to increase user satisfaction in the design process. Furthermore, few systems incorporate emotion analysis, making it impossible to adjust the design taking into account the user's emotions. As a result, a gap often exists between the actual construction and the user's expectations.

[1047] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1048] In this invention, the server includes a means for analyzing data input from the user, a means for generating a site design based on the analyzed data, and a means for generating a 3D simulation image based on the site design. This allows the server to quickly and accurately reflect the user's wishes and requests for changes, and furthermore, it is possible to analyze the user's emotions using an emotion engine and adjust the design based on that feedback. This increases user satisfaction and eliminates any gaps after construction.

[1049] A "user" is a user who operates the system and inputs their wishes and requests for changes to the exterior.

[1050] A "terminal" is a device or equipment that analyzes data entered by a user, transmits it to a server, and displays information received from a server.

[1051] The "server" is a computer that receives input data from users, analyzes it, generates exterior design data, and creates 3D simulation images.

[1052] An "emotion engine" is software or hardware that recognizes the user's emotions and provides feedback to the server on design adjustments based on the analysis results.

[1053] "Exterior design" is a design drawing that includes the layout and elements of the exterior desired by the user.

[1054] A "3D simulation image" is a three-dimensional image that allows you to visually check the generated exterior design.

[1055] "Total cost" is the overall cost calculated based on the exterior design.

[1056] The "construction schedule" is the schedule from the start to the end of the construction work.

[1057] A "proposal" is a document containing a construction plan that is sent to a construction company based on the final design data.

[1058] A "change request" is a request made by a user to modify or add to the simulation results.

[1059] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[1060] System configuration

[1061] 1. User Device:

[1062] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[1063] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[1064] 2. Server:

[1065] Receives input data from the user terminal and analyzes it.

[1066] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[1067] The simulation image, total cost and construction schedule are sent to the user terminal.

[1068] Receives change requests from users and updates design data.

[1069] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[1070] Generate and send proposals to contractors based on the final design data.

[1071] 3. Emotion Engine:

[1072] It recognizes the user's emotions and sends the analysis results to the server.

[1073] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[1074] Provide feedback to improve user satisfaction.

[1075] The specific hardware and software used

[1076] Hardware:

[1077] User devices (e.g., personal computers, tablets, smartphones, etc.)

[1078] Servers (e.g. cloud servers, physical servers)

[1079] software:

[1080] Design software (e.g., Autodesk AutoCAD)

[1081] 3D rendering software (e.g. Blender)

[1082] Sentiment analysis tools (e.g. IBM Watson)

[1083] Estimation Software

[1084] Specific examples of program processing

[1085] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these wishes into the terminal. An example of a prompt sentence is as follows:

[1086] Example prompt sentence:

[1087] User: "I would like to enlarge the parking space at my house and add a lawn and flower beds to my yard. I would like to know the cost and construction time."

[1088] The terminal analyzes the input data and sends it to the server. The server receives this data and generates an exterior design, including the layout of the parking lot, the garden lawn, and the placement of flower beds. It then uses Blender to create a 3D simulation image. It then uses estimation software to calculate the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this information to the terminal. The terminal then displays the simulation results and detailed information to the user.

[1089] During this process, the emotion engine analyzes the user's facial expressions and voice to collect emotional data. The analysis results are sent to the server, which then readjusts the exterior design based on the emotional data. The regenerated design data and simulation images are sent back to the user's device and displayed to the user. This allows the user to check the specific exterior design in real time and create an optimal plan.

[1090] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[1091] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1092] Step 1:

[1093] The user enters their login information.

[1094] Input: User ID, Password

[1095] Specific operation: The user enters their user ID and password into the login screen of the terminal to access the system. The terminal receives this and sends it to the server.

[1096] Output: Login information sent to the server

[1097] Step 2:

[1098] The user enters the project information.

[1099] Input: Data on the shape, size, and layout of the land

[1100] Specific operation: The user inputs the shape, size, and layout of the land for a new project, and then inputs their wishes and requests for changes to the exterior (e.g., expanding the parking lot, installing grass and flower beds in the garden) into the terminal. The terminal then sends the input data to the server.

[1101] Output: Project information and site requirements sent to the server

[1102] Step 3:

[1103] The terminal analyzes the input data and sends it to the server.

[1104] Input: User-entered project information and site preferences

[1105] Specific operation: The terminal analyzes the user's input data and sends the formatted data to the server.

[1106] Output: Parsed data sent to the server

[1107] Step 4:

[1108] The server analyzes the received data and generates a design.

[1109] Input: Analyzed data (project information, desired exterior data)

[1110] Specific operation: The server analyzes the data sent by the user using automated design software (e.g., AutoCAD) and generates exterior design drawings (2D and 3D) based on the shape of the land, the layout of the house, and exterior elements.

[1111] Output: Generated site plan

[1112] Step 5:

[1113] The server generates a 3D simulation image.

[1114] Input: Exterior design drawing

[1115] Specific operation: The server uses 3D rendering software (e.g. Blender) to create a 3D simulation image based on the generated design drawing.

[1116] Output: Generated 3D simulation image

[1117] Step 6:

[1118] The server calculates the total cost and construction schedule.

[1119] Input: Exterior design data

[1120] What it does: The server uses the estimating software to calculate the total cost of the design and also calculates the required construction schedule.

[1121] Output: Total cost, construction schedule

[1122] Step 7:

[1123] The server transmits the simulation results to the terminal.

[1124] Input: 3D simulation image, total cost, construction schedule

[1125] Specific operation: The server transmits the generated data to the user terminal.

[1126] Output: Simulation results sent to the user's terminal

[1127] Step 8:

[1128] The terminal displays the simulation results.

[1129] Input: Simulation results sent from the server (3D simulation image, total cost, construction schedule)

[1130] Specific operation: The device displays the received data to the user, who can visually check the 3D simulation image and detailed information.

[1131] Output: Simulation results displayed to the user

[1132] Step 9:

[1133] The emotion engine recognizes the user's emotions and collects data.

[1134] Input: User's facial expression and voice data

[1135] Specific operation: The emotion engine recognizes emotions from the user's facial expressions and voice, and collects emotion data while checking the simulation results.

[1136] Output: Collected emotion data

[1137] Step 10:

[1138] The emotion engine sends the emotion data to the server.

[1139] Input: Collected emotion data

[1140] Specific operation: The emotion engine analyzes the collected emotion data and sends the results to the server.

[1141] Output: Emotion data sent to the server

[1142] Step 11:

[1143] The server regenerates the design based on the emotional feedback.

[1144] Input: Emotion data

[1145] Specific operation: The server readjusts the exterior design based on the emotion data. The design data is adjusted and regenerated using automated design software (e.g., AutoCAD).

[1146] Output: Regenerated design data and 3D simulation images

[1147] Step 12:

[1148] The server transmits the updated design data to the terminal.

[1149] Input: Regenerated design data, 3D simulation images

[1150] Specific operation: The server sends the updated design data and new 3D simulation images to the user terminal.

[1151] Output: Updated design data and simulation images sent to the terminal

[1152] Step 13:

[1153] The terminal is regenerated and the simulation results are displayed.

[1154] Input: Updated design data and simulation images sent from the server

[1155] Specific operation: The terminal redisplays the updated simulation results to the user, who then checks the new 3D simulation image and detailed information.

[1156] Output: Simulation results displayed to the user

[1157] Step 14:

[1158] A user enters a change request.

[1159] Input: New Change Request

[1160] Specific operation: After the user checks the simulation results, they input new change requests into the terminal as necessary. The terminal then resends the change requests to the server.

[1161] Output: The change request sent to the server

[1162] Step 15:

[1163] The server receives the change request and updates the design data.

[1164] Input: Change Request Data

[1165] Specific operation: The server receives a change request from the user and updates the design data in the automated design software.

[1166] Output: Updated design data

[1167] Step 16:

[1168] The server resends the updated design data.

[1169] Input: Updated design data, 3D simulation images, total cost, construction schedule

[1170] Specific operation: The server regenerates updated design data, new 3D simulation images, total costs, and construction schedules, and sends them to the terminal.

[1171] Output: Updated design data and simulation results sent to the terminal

[1172] Step 17:

[1173] The device will display the updated simulation results.

[1174] Input: Updated design data and simulation results sent from the server

[1175] Specific operation: The terminal displays the updated simulation results and detailed information to the user again. The user confirms the new simulation results.

[1176] Output: Updated simulation results displayed to the user

[1177] Step 18:

[1178] The user approves the final design.

[1179] Input: Approval of final design data

[1180] Specific Actions: If the user is satisfied with the final design, he / she clicks the "Approve" button to approve the design.

[1181] Output: Approved final design data

[1182] Step 19:

[1183] The server sends the final design data to the contractor as a proposal.

[1184] Input: Approved final design data

[1185] Specific operation: The server generates a proposal for the construction company based on the final design data approved by the user and sends it to the construction company.

[1186] Output: Proposal sent to contractor

[1187] (Application example 2)

[1188] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1189] Conventional exterior design simulation systems have difficulty in proposing designs that take the user's emotions into account, and users are often dissatisfied with the simulation results. This creates dissatisfaction in communication between the user and the construction company, making it difficult to smoothly progress the project. Furthermore, there is a demand for proposals that reflect the user's emotions in real time when designing the exterior and interior layout of a store, but current systems are unable to meet this demand.

[1190] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1191] In this invention, the server includes: means for a user to input their exterior site preferences; means for the server to analyze the input data from the user; means for the server to generate an exterior site design based on the analyzed data; means for the server to generate a 3D simulation image based on the exterior site design; means for the server to send the generated simulation image, total cost, and construction schedule to a user terminal; means for the terminal to display the simulation image and detailed information to the user; means for the user to request changes to the simulation results; means for the server to receive the change request and update the design data; means for the server to generate a proposal to a contractor based on the final design data and send the proposal; means for the server to recognize the user's emotions on the terminal; and means for analyzing the emotions and adjusting the exterior site design based on the analysis results. This enables real-time feedback based on the user's emotions, achieving high user satisfaction and providing a smooth design process.

[1192] A "user terminal" is a device used by a user to send input data to the system and display simulation results and detailed information.

[1193] The "server" is a central processing unit that analyzes input data sent by the user, generates an exterior design, and generates a 3D simulation image and sends it to the user's terminal.

[1194] "Exterior design" refers to the external structures and spatial layouts that are designed based on the user's wishes and site conditions.

[1195] A "3D simulation image" is an image that visualizes the exterior design in three dimensions and is used by users to get a concrete idea of ​​the design.

[1196] "Total cost" refers to the total cost of designing and constructing the exterior structure.

[1197] "Construction schedule" refers to the overall schedule until the exterior design is completed.

[1198] An "emotion engine" is a combination of software and hardware for recognizing and analyzing a user's emotions.

[1199] A "proposal" is a design proposal document to a construction company that is generated based on the final design data.

[1200] "Change request" refers to a request for corrections or additions that a user desires based on the simulation results.

[1201] "Emotion analysis" is the process of collecting and analyzing user emotion data.

[1202] "Real-time feedback" refers to instantly adjusting simulation results and design proposals based on user input and sentiment analysis results.

[1203] MODE FOR CARRYING OUT THE INVENTION

[1204] This invention is a system for simulating the layout of the exterior and interior of a physical store based on the user's wishes and emotions. The system includes a user terminal, a server, and an emotion engine. Specific embodiments of this system and program processing are described below.

[1205] System configuration

[1206] 1. User Device:

[1207] The user operates a user terminal such as a smartphone or tablet and inputs their desired exterior and interior design.

[1208] At the user terminal, it is possible to describe the desired layout in the form of a prompt sentence.

[1209] Hardware used: smartphone, tablet

[1210] Software used: HTTP / HTTPS protocol

[1211] 2. Server:

[1212] Receives and analyzes input data sent from the user terminal.

[1213] The server uses Python, Node.js, etc. to generate exterior designs and interior layouts based on user input data.

[1214] Based on the setting data, a simulation image is generated using 3D design software such as Blender or Autodesk Revit.

[1215] The total cost and construction schedule are calculated as simulation results and sent to the user's terminal.

[1216] Hardware used: Cloud server equipped with a high-performance GPU (e.g., AWS EC2 instance)

[1217] Software used: Python, Node.js, Blender, Autodesk Revit

[1218] 3. Emotion Engine:

[1219] The camera and sensors on the user's device are used to recognize the user's emotions and collect data.

[1220] The collected emotion data is analyzed using OpenCV, TensorFlow, etc. and sent to the server.

[1221] Adjust design data based on the results of sentiment analysis.

[1222] Hardware used: camera and sensors on the user device

[1223] Software used: OpenCV, TensorFlow

[1224] Program processing

[1225] 1. User enters their preference:

[1226] Users use a smartphone or tablet to input their desired exterior and interior design in the form of prompt sentences.

[1227] Examples:

[1228] "I would like to have benches installed near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[1229] 2. Data transmission and analysis:

[1230] The user device sends input data to the server, which then analyzes it using Python or Node.js, sometimes using GIS data or CAD drawings.

[1231] 3. Design and simulation generation:

[1232] The server creates a design based on the input data, generates a 3D simulation image using Blender, Autodesk Revit, etc., and then calculates the total cost and construction schedule.

[1233] 4. Emotion analysis:

[1234] The user device uses a camera to capture the facial expressions and reactions of the user checking the simulation results, and performs emotion analysis using OpenCV and TensorFlow. The emotion analysis results are then sent to the server.

[1235] 5. Rework and new proposals:

[1236] The server updates the design data based on the results of the emotion analysis and creates a new design. This data is then simulated again and sent to the user's device. By repeating this process, the system can create an exterior and interior layout that best suits the user's wishes and emotions.

[1237] In this way, real-time feedback based on the user's emotions becomes possible, achieving high levels of user satisfaction and providing a smooth design process.

[1238] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1239] Step 1:

[1240] The user operates a smartphone or tablet and inputs their desired exterior and interior design in the form of prompt statements.

[1241] Example: "I would like to have a bench near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[1242] The entered data is temporarily stored in the user terminal and prepared for later transmission to the server.

[1243] Step 2:

[1244] The user terminal transmits the input data to the server.

[1245] The submitted data is sent to the server using the HTTP / HTTPS protocol.

[1246] The server analyzes the received data and checks the requirements specified by the user.

[1247] Technologies used: HTTP / HTTPS protocol, Python, Node.js

[1248] Step 3:

[1249] The server generates an exterior design or interior layout based on the analyzed data.

[1250] At this time, a specific layout is created using Geographic Information System (GIS) data and Computer Aided Design (CAD) drawings.

[1251] The generated design data is saved as 2D and 3D models.

[1252] Technologies used: Python, GIS, CAD

[1253] Step 4:

[1254] The server generates a 3D simulation image based on the design data.

[1255] Simulation images are generated using 3D design software such as Blender and Autodesk Revit, allowing users to see a concrete image.

[1256] Technologies used: Blender, Autodesk Revit

[1257] Step 5:

[1258] The server generates a 3D simulation image and then calculates the total cost and construction schedule.

[1259] The calculation results are sent to the user terminal along with the simulation image.

[1260] Technologies used: Python, computational algorithms

[1261] Step 6:

[1262] The user terminal displays the 3D simulation image, total cost, and construction schedule received from the server to the user.

[1263] The user checks the simulation results, and the emotion engine collects the user's facial expressions and reactions via camera.

[1264] The collected data is temporarily stored on the user's device.

[1265] Technology used: Cameras and sensors on smartphones and tablets

[1266] Step 7:

[1267] The user device analyzes the emotion data using OpenCV and TensorFlow and sends the results to the server.

[1268] The transmitted data includes emotion analysis results based on the user's facial expressions and reactions.

[1269] Technologies used: OpenCV, TensorFlow

[1270] Step 8:

[1271] The server adjusts the design data based on the emotion analysis results and generates new design data.

[1272] Using the new design data, a 3D simulation image is generated again, and the total cost and construction schedule are also recalculated.

[1273] Technologies used: Python, Blender, Autodesk Revit

[1274] Step 9:

[1275] The server transmits the regenerated 3D simulation image, total cost and construction schedule to the user terminal.

[1276] The user terminal displays the received update information to the user, who then checks it again.

[1277] Technologies used: HTTP / HTTPS protocol, Python

[1278] Step 10:

[1279] If the user is satisfied with the final design, he sends his approval to the server.

[1280] The server generates a proposal for the construction company based on the final design data and sends the proposal to the construction company.

[1281] Technologies used: Python, documentation generation tools

[1282] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1283] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1284] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1285] [Third embodiment]

[1286] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1287] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1288] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1289] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1290] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1291] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1292] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1293] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1294] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1295] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1296] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1297] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1298] The exterior design simulation system according to the present invention is composed of the elements of a user, a terminal, and a server. A specific embodiment of this system and program processing will be described below.

[1299] System configuration

[1300] 1. User Device:

[1301] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[1302] The input contents are sent to the server and the received simulation results are displayed.

[1303] 2. Server:

[1304] Receives input data from the user terminal and analyzes it.

[1305] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[1306] The simulation image, total cost and construction schedule are sent to the user terminal.

[1307] Receives change requests from users and updates design data.

[1308] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[1309] Generate and send proposals to contractors based on the final design data.

[1310] Program processing

[1311] User:

[1312] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[1313] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[1314] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[1315] Device:

[1316] 4. The entered information is analyzed and sent to the server.

[1317] server:

[1318] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[1319] 2. Generate a 3D simulation image based on the design data.

[1320] 3. Calculate the total cost and schedule the work.

[1321] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[1322] Device:

[1323] 5. Display the simulation image and detailed information to the user.

[1324] 6. The user reviews the simulation results and inputs any necessary changes.

[1325] server:

[1326] 7. Receive change requests from users and update the design data.

[1327] 8. Generate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[1328] 9. Send the new design data to the user terminal.

[1329] Device:

[1330] 10. Redisplay updated simulation results and details to the user.

[1331] 11. If the user is satisfied with the final design, he or she approves the design.

[1332] server:

[1333] 12. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[1334] 13. Send proposal to contractor.

[1335] Specific examples

[1336] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these requests into the terminal. The terminal analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the terminal. The user can check the simulation results and re-enter changes if necessary. The server reflects the changes and resends the new simulation. Through this process, the user can check the specific exterior design in real time and create an optimal plan.

[1337] This allows for smooth communication between users and contractors, eliminating the gap between the image of the finished exterior construction work and the reality.

[1338] The processing flow will be explained below.

[1339] Step 1:

[1340] The user accesses the system from a terminal and enters login information (user ID, password).

[1341] Step 2:

[1342] The terminal transmits the user's input information to the server.

[1343] Step 3:

[1344] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[1345] Step 4:

[1346] A user starts a new project and inputs the lot shape, size, and home layout.

[1347] Step 5:

[1348] The terminal analyzes the user's input information and sends it to the server.

[1349] Step 6:

[1350] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[1351] Step 7:

[1352] The terminal analyzes the input data and sends it to the server.

[1353] Step 8:

[1354] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the land information, home layout, and site elements.

[1355] Step 9:

[1356] The server generates a 3D simulation image based on the design data.

[1357] Step 10:

[1358] The server calculates the total cost and schedules the construction.

[1359] Step 11:

[1360] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[1361] Step 12:

[1362] The terminal displays the simulation image and detailed information to the user.

[1363] Step 13:

[1364] The user checks the simulation results and inputs any necessary changes.

[1365] Step 14:

[1366] The terminal analyzes the change information and sends it to the server.

[1367] Step 15:

[1368] The server receives change requests from users and updates the design data.

[1369] Step 16:

[1370] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[1371] Step 17:

[1372] The server transmits the new design data to the user terminal.

[1373] Step 18:

[1374] The terminal redisplays the updated simulation results and detailed information to the user.

[1375] Step 19:

[1376] If the user is satisfied with the final design, he approves the design.

[1377] Step 20:

[1378] The terminal sends the authorization information to the server.

[1379] Step 21:

[1380] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[1381] Step 22:

[1382] The server sends the proposal to the contractor.

[1383] Example 1

[1384] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1385] In the traditional exterior design process, it was difficult for users to check design changes in real time as they proceeded, which often led to gaps between the design and construction. Furthermore, poor communication with the construction company led to construction delays and budget overruns. As a result, it was difficult to create an exterior design that accurately reflected the user's wishes.

[1386] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1387] In this invention, the server includes a means for analyzing data input from the user, a means for generating exterior site designs, and a means for generating 3D simulation images. This allows for real-time design changes and confirmations. It also facilitates budget and schedule management by accurately calculating total costs and construction schedules and then recalculating based on updated design data. After the user approves the final design, a proposal for the contractor is automatically generated, facilitating smooth communication and execution of the plan.

[1388] "User" is any person or entity that uses the system to enter information about a site design and to review and modify the results.

[1389] A "terminal" is a device operated by a user, which transmits input data and displays simulation results.

[1390] A "server" is a computer system that analyzes data sent from users, generates exterior design, and provides simulation results.

[1391] "Input data" refers to information such as the desired exterior design, the shape and size of the land, and the layout of the house that the user provides to the system from their terminal.

[1392] "Analysis" refers to the process in which the server performs calculations and processing based on input data received from the user to generate a site design.

[1393] "Exterior design" refers to the layout and blueprints of gardens, parking lots, fences, etc., generated based on the user's wishes and input data.

[1394] "Generation" refers to the process in which the server analyzes the input data and creates the exterior design and 3D simulation images.

[1395] "Simulation image" refers to an image or video that visually displays the generated exterior design as a 3D model.

[1396] "Total cost" refers to the result of calculating all costs required to carry out the exterior design.

[1397] The "construction schedule" refers to the calculated period from the start to the completion of exterior construction work.

[1398] A "change request" refers to the act of a user inputting corrections or additions that they would like to make to the results of the initial simulation.

[1399] A "proposal" is a document that is generated based on the final design data and that contains detailed information such as a design plan, costs, and construction schedule, which is presented to a construction company.

[1400] The exterior design simulation system of the present invention is composed of a terminal operated by the user, a server that analyzes data and generates designs, and a network that communicates between them. This system generates exterior designs that reflect the user's wishes in real time and allows the user to visually confirm them.

[1401] System configuration

[1402] User terminal: A device operated by the user, such as a PC, tablet, or smartphone. The user inputs their wishes and requests for changes to the exterior of the building through the terminal and sends this information to the server. The terminal also displays the simulation results and design data received from the server.

[1403] Server: Receives data sent from the user's device, performs analysis, and generates a site design. The server creates a 3D simulation image based on the design data and calculates the total cost and construction schedule. The generated information is sent back to the user's device, allowing the user to confirm and modify the design. The server also generates and sends a proposal to the construction company based on the final design data.

[1404] Hardware and software used

[1405] Hardware: User devices can be general-purpose PCs, tablets, or smartphones. Servers require a high-performance processor and sufficient memory.

[1406] Software: The server generates the exterior design using a generative AI model (e.g., a CAD engine). 3D simulation images are likely to be generated using a real-time rendering engine such as Unity or Unreal Engine.

[1407] Specific examples

[1408] For example, a specific example will be given in which the user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden."

[1409] The user enters "Parking lot: 20 square meters, Lawn: 50 square meters, Flower bed: Roses and tulips" into the project creation screen on the device and clicks the "Send" button. The device analyzes the entered data and sends it to the server in JSON format.

[1410] The server receives the data and generates the exterior design using a generative AI model (e.g., a CAD engine). It then renders a 3D simulation image using Unity or Unreal Engine. The server also calculates the total cost (e.g., ¥1,200,000) and construction schedule (e.g., 10 days) and sends this information to the user's device.

[1411] The terminal displays the simulation results to the user, who then checks the results and inputs changes, such as "Please expand the parking lot by another 5 square meters." The server reflects the changes, recalculates the new design, simulation images, total cost, and construction schedule, and retransmits them.

[1412] In this way, through interaction between the user and the system, the details of the exterior design are fleshed out and an optimal plan is created in real time.

[1413] Prompt Sentence Examples

[1414] "I would like the parking lot at my house to be enlarged and a lawn and flower beds installed in the garden. The parking lot should be large enough for three cars, the lawn should be 50 square meters, and the flower beds should be mainly roses and tulips. Also, please let me know the total budget and construction time."

[1415] By entering a prompt like the one above, the generative AI model will create a site design in real time, and the user can review and modify the results as they go.

[1416] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1417] Step 1:

[1418] The user accesses the system from a terminal and enters login information (user ID, password). The user clicks the "Login" button to log in to the system. The input is the user ID and password, and the output is the authentication result (success or failure).

[1419] Step 2:

[1420] The user clicks the "Start a new project" button and proceeds to the project information entry screen. Here, the user enters the shape, size, and layout of the land. The input is data related to the shape, size, and layout of the land, and the output is the initial setting data for the project.

[1421] Step 3:

[1422] The user inputs specific exterior requirements, such as parking, garden, and fence installation, and clicks the "Submit" button. The input is the user's wishes and requests regarding the exterior, and the output is organized exterior data.

[1423] Step 4:

[1424] The terminal parses and formats the input data from the user. The input is the initial settings and desired exterior data entered by the user, and the output is the formatted data sent to the server. This process also includes data validation.

[1425] Step 5:

[1426] The terminal sends the formatted data to the server. The input is the organized exterior data, and the output is a transmission request to the server. This communication is performed in the form of an HTTP request.

[1427] Step 6:

[1428] The server analyzes the data received from the terminal and checks for missing information. The input is organized exterior data, and the output is the analysis results and basic data for the exterior design.

[1429] Step 7:

[1430] The server uses a generative AI model (e.g., a CAD engine) to generate the exterior design. It creates 2D and 3D blueprints based on user input data. The input is the analyzed exterior data, and the output is the generated exterior design.

[1431] Step 8:

[1432] The server generates 3D simulation images based on the design data. This process uses a 3D simulation engine (such as Unity or Unreal Engine). The input is the design data, and the output is a high-quality 3D simulation image.

[1433] Step 9:

[1434] The server calculates the total cost based on the design data, including factors such as material and labor costs. The input is the design data, and the output is the total cost estimate.

[1435] Step 10:

[1436] The server calculates the construction schedule, scheduling the period from the start date to the completion date. The input is the design data and total cost, and the output is the construction schedule.

[1437] Step 11:

[1438] The server sends the generated 3D simulation image, total cost, and construction schedule to the user terminal. The input is the 3D simulation image, total cost, and construction schedule, and the output is a transmission request to the user terminal.

[1439] Step 12:

[1440] The terminal displays the received information to the user. The user checks the simulation results and inputs change requests if necessary. The input is the simulation results from the server, and the output is the display to the user and the user's change requests.

[1441] Step 13:

[1442] The user checks the simulation results and inputs a change request, such as "Please expand the parking lot by another 5 square meters," and clicks the "Submit" button. The input is a change request, and the output is a submission request.

[1443] Step 14:

[1444] The terminal receives the user's change request and sends it to the server. The input is the change request data, and the output is a transmission request to the server.

[1445] Step 15:

[1446] The server receives the change request, updates the design data, analyzes it again, and generates the changed design. The input is the change request data, and the output is the updated design data.

[1447] Step 16:

[1448] The server recalculates new 3D simulation images, total costs, and construction schedules based on the updated design data, and sends them to the user's terminal again. The input is the updated design data, and the output is the recalculated simulation results, total costs, and construction schedules.

[1449] Step 17:

[1450] The terminal again displays the received information to the user. If the user is satisfied with the final design, he / she clicks the "Approve" button to confirm the final design. The input is the recalculated simulation results, and the output is the display and approval operation for the user.

[1451] Step 18:

[1452] The server receives final approval from the user, generates a proposal to the contractor based on the final design data, and sends it. The proposal includes detailed design drawings, total costs, and construction schedules. The input is the final design data and approval information, and the output is the proposal sent to the contractor.

[1453] (Application example 1)

[1454] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1455] Currently, the layout design and product placement of physical stores are often done manually, which is inefficient. It is also difficult to quickly obtain detailed information, including simulation results, budgets, and construction schedules. Furthermore, re-simulating in response to user requests for changes is also time-consuming. For these reasons, there is a demand for fast and efficient layout design and simulation.

[1456] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1457] In this invention, the server includes: a means for a user to input layout preferences; a means for the server to analyze the input data from the user; a means for the server to generate a layout design based on the analyzed data; a means for the server to generate a 3D simulation image based on the layout design; a means for the server to transmit the generated simulation image, total cost, and construction schedule to a user terminal; a means for the terminal to display the simulation image and detailed information to the user; a means for the user to request changes to the simulation results; a means for the server to receive the change request and update the design data; a means for the server to generate a proposal based on the final design data and send the proposal to a contractor; and a means for generating simulation data based on prompt statements using a generative AI model. This allows users to efficiently design the layout of physical stores and quickly obtain simulation results and detailed information. Furthermore, re-simulations can be smoothly performed to accommodate change requests.

[1458] A "user" is an end user who uses the store layout design system to input layout preferences and change requests.

[1459] "Layout preference" refers to the specific details of the user's desire for the layout and design of the store.

[1460] The "server" is a device that analyzes data sent by users and generates store layout designs and 3D simulation images.

[1461] "Input data" refers to information such as store shape, size, and product placement that the user inputs into the layout design system.

[1462] "Analyzed data" refers to data generated as a result of processing and analyzing input data received by the server from the user.

[1463] "Layout design" is a layout diagram of the store generated by the server based on the analyzed data.

[1464] A "3D simulation image" is a three-dimensional simulation image displayed in real time based on a layout design generated by the server.

[1465] "Total cost" refers to all costs, including material costs and labor costs, required for layout design and construction.

[1466] "Construction schedule" refers to the total period required for layout design and construction work.

[1467] A "user terminal" is a device that allows a user to access the store layout design system.

[1468] "Detailed information" refers to detailed data such as 3D simulation images, total costs, and construction schedules.

[1469] A "change request" is a request from a user for correction or modification based on the simulation results.

[1470] "Design data" refers to the latest layout design information generated by the server after analysis and modification.

[1471] The "proposal" is a store layout proposal document that the server creates based on the final design data and sends to the construction company.

[1472] A "generative AI model" is an artificial intelligence algorithm that generates simulation data based on a prompt sentence.

[1473] A "prompt statement" is an instruction statement for creating simulation data that the user inputs to the generated AI model.

[1474] MODE FOR CARRYING OUT THE INVENTION

[1475] The store layout design system according to the present invention is an integrated system including a user terminal, a server, and a generative AI model. Each component of the system and program processing will be described in detail below.

[1476] System configuration

[1477] 1. User Device

[1478] The user terminal is a device that allows users to input their store layout preferences and change requests. Examples include smartphones and tablets. Users can access the system from these terminals and input their desired layout and changes. The terminal sends this data to the server, which then displays 3D simulation images and other detailed information received from the server.

[1479] 2. Server

[1480] The server is a device that receives and analyzes data sent by users. Specifically, it performs the following processes:

[1481] Analyzes store shape and product placement data entered by the user.

[1482] A layout design is generated based on the analyzed data.

[1483] A 3D simulation image is created based on the generated layout design.

[1484] Calculate total costs and construction schedule.

[1485] Simulation images, total costs, and construction schedules are sent to the user's device.

[1486] Receive change requests from users and update design data.

[1487] Generate proposals based on the final design data and send them to the contractor.

[1488] A generative AI model is used to generate simulation data based on prompt statements.

[1489] 3. Generative AI Models

[1490] A generative AI model is an artificial intelligence algorithm that generates simulation data based on prompts. This model allows users to obtain detailed simulation data simply by entering simple instructions.

[1491] Program processing description

[1492] The program communicates between the user device, the server, and the generative AI model, and performs data analysis and simulation. The specific process is as follows:

[1493] User device:

[1494] The user terminal provides an interface for users to input their layout preferences and change requests. This data is sent to the server. The user terminal also displays detailed information received from the server, such as 3D simulation images, total costs, and construction schedules.

[1495] server:

[1496] The server receives and analyzes data sent from the user's device. The main software used for this is Flask (a web application framework). A dedicated simulation library (the specific library name has not been specified) is also used to generate 3D simulation images. The server also generates simulation data based on prompt statements using a generative AI model.

[1497] Generative AI models:

[1498] The generative AI model generates simulation data based on the prompt text entered by the user, which is then sent back to the server and finally displayed on the user's device.

[1499] Adding specific examples

[1500] As an example, consider the following prompt sentence input to a generative AI model:

[1501] Example prompt sentence:

[1502] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[1503] The generative AI model analyzes the prompt sentences and generates 3D simulation data based on the specified conditions. This data is sent back to the server and displayed in real time on the user's device, allowing the user to make further changes.

[1504] As described above, the system of the present invention can efficiently and easily provide users with layout designs for physical stores, quickly obtain detailed information, and flexibly respond to changes requested by users.

[1505] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1506] Program processing flow

[1507] Step 1: User inputs layout preference

[1508] The user inputs their desired layout from the terminal, including the store's shape, area, product placement, etc. The terminal then sends this input data to the server.

[1509] Specific behavior:

[1510] Input: The user enters the desired layout (store shape, area, product placement).

[1511] Data processing: The terminal converts the input data into JSON format.

[1512] Output: Sends input data to the server.

[1513] Step 2: The server parses the input data

[1514] The server analyzes the input data received from the user terminal and generates a layout design. The analysis is performed based on data such as the store shape and product placement.

[1515] Specific behavior:

[1516] Input: Input data sent from the terminal.

[1517] Data processing: The server analyzes the input data and generates layout design data.

[1518] Output: Holds the generated layout design data.

[1519] Step 3: The server generates the 3D simulation image

[1520] The server generates a 3D simulation image based on the generated layout design data, using a 3D simulation library.

[1521] Specific behavior:

[1522] Input: Layout design data.

[1523] Data calculation: Generate 3D simulation images using the 3D simulation library.

[1524] Output: Keeps the generated 3D simulation image.

[1525] Step 4: The server calculates the total cost and construction schedule.

[1526] The server calculates the total cost and construction schedule based on the layout design, including material costs, labor costs, and work schedules.

[1527] Specific behavior:

[1528] Input: Layout design data.

[1529] Data calculation: Calculate total costs and construction schedule.

[1530] Output: Holds the calculation results (total cost and construction schedule).

[1531] Step 5: Server sends more information

[1532] The server transmits the generated 3D simulation image, total cost, and construction schedule information to the user terminal.

[1533] Specific behavior:

[1534] Input: 3D simulation image, total cost, construction schedule.

[1535] Data processing: Packaging the data to be sent.

[1536] Output: Sends data to the user's terminal.

[1537] Step 6: The device displays the simulation image

[1538] The terminal displays the received 3D simulation image and detailed information to the user.

[1539] Specific behavior:

[1540] Input: The data received from the server.

[1541] Data processing: Converting images and detailed information into a display format.

[1542] Output: Shows the simulation image and detailed information to the user.

[1543] Step 7: User enters change request

[1544] The user checks the displayed simulation results and inputs any necessary changes. This data is then sent back to the server.

[1545] Specific behavior:

[1546] Input: The user's change request.

[1547] Data processing: Convert the change request into JSON format.

[1548] Output: Submits a change request to the server.

[1549] Step 8: Server parses and updates the change request

[1550] The server receives change requests from users, updates the layout design data, and then generates new 3D simulation images and performs recalculation.

[1551] Specific behavior:

[1552] Input: Change Request.

[1553] Data calculation: Update design data and regenerate 3D simulation images.

[1554] Output: New 3D simulation images, total cost, and construction schedule are resent to the user's device.

[1555] Step 9: The server generates a proposal based on the final design data

[1556] After the user approves the final design, the server generates a proposal based on this data and sends it to the contractor.

[1557] Specific behavior:

[1558] Input: Final design data.

[1559] Data Computing: Proposal Generation.

[1560] Output: Send proposal to contractor.

[1561] Data generation based on prompt sentences using the generative AI model is performed appropriately at each step. For example, specific actions can be performed using the following prompt sentences:

[1562] Example prompt sentence:

[1563] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[1564] This allows the entire system to work together organically, enabling users' requests to be responded to quickly and accurately.

[1565] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1566] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[1567] System configuration

[1568] 1. User Device:

[1569] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[1570] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[1571] 2. Server:

[1572] Receives input data from the user terminal and analyzes it.

[1573] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[1574] The simulation image, total cost and construction schedule are sent to the user terminal.

[1575] Receives change requests from users and updates design data.

[1576] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[1577] Generate and send proposals to contractors based on the final design data.

[1578] 3. Emotion Engine:

[1579] It recognizes the user's emotions and sends the analysis results to the server.

[1580] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[1581] Provide feedback to improve user satisfaction.

[1582] Program processing

[1583] User:

[1584] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[1585] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[1586] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[1587] Device:

[1588] 4. The entered information is analyzed and sent to the server.

[1589] server:

[1590] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[1591] 2. Generate a 3D simulation image based on the design data.

[1592] 3. Calculate the total cost and schedule the work.

[1593] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[1594] Device:

[1595] 5. Display the simulation image and detailed information to the user.

[1596] 6. The emotion engine recognizes the user's emotions and collects emotion data while the user is checking the simulation results.

[1597] Emotion Engine:

[1598] 7. Analyze the user's emotions and send the results to the server.

[1599] 8. Based on the user's emotions, appropriate exterior design suggestions are fed back to the server.

[1600] server:

[1601] 9. Adjust and regenerate design data based on feedback from the emotion engine.

[1602] 10. Updated design data and simulation images are sent to the user's terminal.

[1603] Device:

[1604] 11. The simulation results are displayed to the user again, and information reflecting the suggestions based on the sentiment analysis is provided.

[1605] 12. If the user wishes to input a change request for the simulation results, the change request is made again.

[1606] server:

[1607] 13. Receive user change requests and update design data.

[1608] 14. Regenerate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[1609] 15. Send the new design data to the user terminal.

[1610] Device:

[1611] 16. Redisplay updated simulation results and details to the user.

[1612] 17. If the user is satisfied with the final design, he or she approves the design.

[1613] server:

[1614] 18. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[1615] 19. Send proposal to contractor.

[1616] Specific examples

[1617] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these preferences into the device. The device analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the device. As the user checks the simulation results, the emotion engine collects emotional data. The emotion engine then sends the analysis results to the server and adjusts the proposal to propose an exterior design that best suits the user's preferences. Through this process, the user can view specific exterior designs in real time and create an optimal plan.

[1618] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[1619] The processing flow will be explained below.

[1620] Step 1:

[1621] The user accesses the system from a terminal and enters login information (user ID, password).

[1622] Step 2:

[1623] The terminal transmits the user's input information to the server.

[1624] Step 3:

[1625] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[1626] Step 4:

[1627] A user starts a new project and inputs the lot shape, size, and home layout.

[1628] Step 5:

[1629] The terminal analyzes the user's input information and sends it to the server.

[1630] Step 6:

[1631] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[1632] Step 7:

[1633] The terminal analyzes the input data and sends it to the server.

[1634] Step 8:

[1635] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the user-entered land information, home layout, and site elements.

[1636] Step 9:

[1637] The server generates a 3D simulation image based on the design data.

[1638] Step 10:

[1639] The server calculates the total cost and schedules the construction.

[1640] Step 11:

[1641] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[1642] Step 12:

[1643] The terminal displays the simulation image and detailed information to the user.

[1644] Step 13:

[1645] The emotion engine recognizes the user's emotions and collects that data.

[1646] Step 14:

[1647] The emotion engine analyzes the collected emotion data and sends the results to the server.

[1648] Step 15:

[1649] The server adjusts and regenerates the design data based on feedback from the emotion engine.

[1650] Step 16:

[1651] The server transmits the updated design data and simulation images to the user terminal.

[1652] Step 17:

[1653] The terminal again displays the simulation results and suggestions based on the emotion analysis to the user.

[1654] Step 18:

[1655] The user checks the simulation results and inputs any necessary changes.

[1656] Step 19:

[1657] The terminal analyzes the change information and sends it to the server.

[1658] Step 20:

[1659] The server receives change requests from users and updates the design data.

[1660] Step 20:

[1661] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[1662] Step 21:

[1663] The server transmits the new design data to the user terminal.

[1664] Step 22:

[1665] The terminal redisplays the updated simulation results and detailed information to the user.

[1666] Step 23:

[1667] If the user is satisfied with the final design, he approves the design.

[1668] Step 24:

[1669] The terminal sends the authorization information to the server.

[1670] Step 25:

[1671] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[1672] Step 26:

[1673] The server sends the proposal to the contractor.

[1674] Example 2

[1675] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1676] Conventional exterior design systems have difficulty quickly and accurately reflecting users' wishes and change requests, making it impossible to increase user satisfaction in the design process. Furthermore, few systems incorporate emotion analysis, making it impossible to adjust the design taking into account the user's emotions. As a result, a gap often exists between the actual construction and the user's expectations.

[1677] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1678] In this invention, the server includes a means for analyzing data input from the user, a means for generating a site design based on the analyzed data, and a means for generating a 3D simulation image based on the site design. This allows the server to quickly and accurately reflect the user's wishes and requests for changes, and furthermore, it is possible to analyze the user's emotions using an emotion engine and adjust the design based on that feedback. This increases user satisfaction and eliminates any gaps after construction.

[1679] A "user" is a user who operates the system and inputs their wishes and requests for changes to the exterior.

[1680] A "terminal" is a device or equipment that analyzes data entered by a user, transmits it to a server, and displays information received from a server.

[1681] The "server" is a computer that receives input data from users, analyzes it, generates exterior design data, and creates 3D simulation images.

[1682] An "emotion engine" is software or hardware that recognizes the user's emotions and provides feedback to the server on design adjustments based on the analysis results.

[1683] "Exterior design" is a design drawing that includes the layout and elements of the exterior desired by the user.

[1684] A "3D simulation image" is a three-dimensional image that allows you to visually check the generated exterior design.

[1685] "Total cost" is the overall cost calculated based on the exterior design.

[1686] The "construction schedule" is the schedule from the start to the end of the construction work.

[1687] A "proposal" is a document containing a construction plan that is sent to a construction company based on the final design data.

[1688] A "change request" is a request made by a user to modify or add to the simulation results.

[1689] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[1690] System configuration

[1691] 1. User Device:

[1692] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[1693] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[1694] 2. Server:

[1695] Receives input data from the user terminal and analyzes it.

[1696] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[1697] The simulation image, total cost and construction schedule are sent to the user terminal.

[1698] Receives change requests from users and updates design data.

[1699] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[1700] Generate and send proposals to contractors based on the final design data.

[1701] 3. Emotion Engine:

[1702] It recognizes the user's emotions and sends the analysis results to the server.

[1703] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[1704] Provide feedback to improve user satisfaction.

[1705] The specific hardware and software used

[1706] Hardware:

[1707] User devices (e.g., personal computers, tablets, smartphones, etc.)

[1708] Servers (e.g. cloud servers, physical servers)

[1709] software:

[1710] Design software (e.g., Autodesk AutoCAD)

[1711] 3D rendering software (e.g. Blender)

[1712] Sentiment analysis tools (e.g. IBM Watson)

[1713] Estimation Software

[1714] Specific examples of program processing

[1715] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these wishes into the terminal. An example of a prompt sentence is as follows:

[1716] Example prompt sentence:

[1717] User: "I would like to enlarge the parking space at my house and add a lawn and flower beds to my yard. I would like to know the cost and construction time."

[1718] The terminal analyzes the input data and sends it to the server. The server receives this data and generates an exterior design, including the layout of the parking lot, the garden lawn, and the placement of flower beds. It then uses Blender to create a 3D simulation image. It then uses estimation software to calculate the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this information to the terminal. The terminal then displays the simulation results and detailed information to the user.

[1719] During this process, the emotion engine analyzes the user's facial expressions and voice to collect emotional data. The analysis results are sent to the server, which then readjusts the exterior design based on the emotional data. The regenerated design data and simulation images are sent back to the user's device and displayed to the user. This allows the user to check the specific exterior design in real time and create an optimal plan.

[1720] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[1721] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1722] Step 1:

[1723] The user enters their login information.

[1724] Input: User ID, Password

[1725] Specific operation: The user enters their user ID and password into the login screen of the terminal to access the system. The terminal receives this and sends it to the server.

[1726] Output: Login information sent to the server

[1727] Step 2:

[1728] The user enters the project information.

[1729] Input: Data on the shape, size, and layout of the land

[1730] Specific operation: The user inputs the shape, size, and layout of the land for a new project, and then inputs their wishes and requests for changes to the exterior (e.g., expanding the parking lot, installing grass and flower beds in the garden) into the terminal. The terminal then sends the input data to the server.

[1731] Output: Project information and site requirements sent to the server

[1732] Step 3:

[1733] The terminal analyzes the input data and sends it to the server.

[1734] Input: User-entered project information and site preferences

[1735] Specific operation: The terminal analyzes the user's input data and sends the formatted data to the server.

[1736] Output: Parsed data sent to the server

[1737] Step 4:

[1738] The server analyzes the received data and generates a design.

[1739] Input: Analyzed data (project information, desired exterior data)

[1740] Specific operation: The server analyzes the data sent by the user using automated design software (e.g., AutoCAD) and generates exterior design drawings (2D and 3D) based on the shape of the land, the layout of the house, and exterior elements.

[1741] Output: Generated site plan

[1742] Step 5:

[1743] The server generates a 3D simulation image.

[1744] Input: Exterior design drawing

[1745] Specific operation: The server uses 3D rendering software (e.g. Blender) to create a 3D simulation image based on the generated design drawing.

[1746] Output: Generated 3D simulation image

[1747] Step 6:

[1748] The server calculates the total cost and construction schedule.

[1749] Input: Exterior design data

[1750] What it does: The server uses the estimating software to calculate the total cost of the design and also calculates the required construction schedule.

[1751] Output: Total cost, construction schedule

[1752] Step 7:

[1753] The server transmits the simulation results to the terminal.

[1754] Input: 3D simulation image, total cost, construction schedule

[1755] Specific operation: The server transmits the generated data to the user terminal.

[1756] Output: Simulation results sent to the user's terminal

[1757] Step 8:

[1758] The terminal displays the simulation results.

[1759] Input: Simulation results sent from the server (3D simulation image, total cost, construction schedule)

[1760] Specific operation: The device displays the received data to the user, who can visually check the 3D simulation image and detailed information.

[1761] Output: Simulation results displayed to the user

[1762] Step 9:

[1763] The emotion engine recognizes the user's emotions and collects data.

[1764] Input: User's facial expression and voice data

[1765] Specific operation: The emotion engine recognizes emotions from the user's facial expressions and voice, and collects emotion data while checking the simulation results.

[1766] Output: Collected emotion data

[1767] Step 10:

[1768] The emotion engine sends the emotion data to the server.

[1769] Input: Collected emotion data

[1770] Specific operation: The emotion engine analyzes the collected emotion data and sends the results to the server.

[1771] Output: Emotion data sent to the server

[1772] Step 11:

[1773] The server regenerates the design based on the emotional feedback.

[1774] Input: Emotion data

[1775] Specific operation: The server readjusts the exterior design based on the emotion data. The design data is adjusted and regenerated using automated design software (e.g., AutoCAD).

[1776] Output: Regenerated design data and 3D simulation images

[1777] Step 12:

[1778] The server transmits the updated design data to the terminal.

[1779] Input: Regenerated design data, 3D simulation images

[1780] Specific operation: The server sends the updated design data and new 3D simulation images to the user terminal.

[1781] Output: Updated design data and simulation images sent to the terminal

[1782] Step 13:

[1783] The terminal is regenerated and the simulation results are displayed.

[1784] Input: Updated design data and simulation images sent from the server

[1785] Specific operation: The terminal redisplays the updated simulation results to the user, who then checks the new 3D simulation image and detailed information.

[1786] Output: Simulation results displayed to the user

[1787] Step 14:

[1788] A user enters a change request.

[1789] Input: New Change Request

[1790] Specific operation: After the user checks the simulation results, they input new change requests into the terminal as necessary. The terminal then resends the change requests to the server.

[1791] Output: The change request sent to the server

[1792] Step 15:

[1793] The server receives the change request and updates the design data.

[1794] Input: Change Request Data

[1795] Specific operation: The server receives a change request from the user and updates the design data in the automated design software.

[1796] Output: Updated design data

[1797] Step 16:

[1798] The server resends the updated design data.

[1799] Input: Updated design data, 3D simulation images, total cost, construction schedule

[1800] Specific operation: The server regenerates updated design data, new 3D simulation images, total costs, and construction schedules, and sends them to the terminal.

[1801] Output: Updated design data and simulation results sent to the terminal

[1802] Step 17:

[1803] The device will display the updated simulation results.

[1804] Input: Updated design data and simulation results sent from the server

[1805] Specific operation: The terminal displays the updated simulation results and detailed information to the user again. The user confirms the new simulation results.

[1806] Output: Updated simulation results displayed to the user

[1807] Step 18:

[1808] The user approves the final design.

[1809] Input: Approval of final design data

[1810] Specific Actions: If the user is satisfied with the final design, he / she clicks the "Approve" button to approve the design.

[1811] Output: Approved final design data

[1812] Step 19:

[1813] The server sends the final design data to the contractor as a proposal.

[1814] Input: Approved final design data

[1815] Specific operation: The server generates a proposal for the construction company based on the final design data approved by the user and sends it to the construction company.

[1816] Output: Proposal sent to contractor

[1817] (Application example 2)

[1818] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1819] Conventional exterior design simulation systems have difficulty in proposing designs that take the user's emotions into account, and users are often dissatisfied with the simulation results. This creates dissatisfaction in communication between the user and the construction company, making it difficult to smoothly progress the project. Furthermore, there is a demand for proposals that reflect the user's emotions in real time when designing the exterior and interior layout of a store, but current systems are unable to meet this demand.

[1820] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1821] In this invention, the server includes: means for a user to input their exterior site preferences; means for the server to analyze the input data from the user; means for the server to generate an exterior site design based on the analyzed data; means for the server to generate a 3D simulation image based on the exterior site design; means for the server to send the generated simulation image, total cost, and construction schedule to a user terminal; means for the terminal to display the simulation image and detailed information to the user; means for the user to request changes to the simulation results; means for the server to receive the change request and update the design data; means for the server to generate a proposal to a contractor based on the final design data and send the proposal; means for the server to recognize the user's emotions on the terminal; and means for analyzing the emotions and adjusting the exterior site design based on the analysis results. This enables real-time feedback based on the user's emotions, achieving high user satisfaction and providing a smooth design process.

[1822] A "user terminal" is a device used by a user to send input data to the system and display simulation results and detailed information.

[1823] The "server" is a central processing unit that analyzes input data sent by the user, generates an exterior design, and generates a 3D simulation image and sends it to the user's terminal.

[1824] "Exterior design" refers to the external structures and spatial layouts that are designed based on the user's wishes and site conditions.

[1825] A "3D simulation image" is an image that visualizes the exterior design in three dimensions and is used by users to get a concrete idea of ​​the design.

[1826] "Total cost" refers to the total cost of designing and constructing the exterior structure.

[1827] "Construction schedule" refers to the overall schedule until the exterior design is completed.

[1828] An "emotion engine" is a combination of software and hardware for recognizing and analyzing a user's emotions.

[1829] A "proposal" is a design proposal document to a construction company that is generated based on the final design data.

[1830] "Change request" refers to a request for corrections or additions that a user desires based on the simulation results.

[1831] "Emotion analysis" is the process of collecting and analyzing user emotion data.

[1832] "Real-time feedback" refers to instantly adjusting simulation results and design proposals based on user input and sentiment analysis results.

[1833] MODE FOR CARRYING OUT THE INVENTION

[1834] This invention is a system for simulating the layout of the exterior and interior of a physical store based on the user's wishes and emotions. The system includes a user terminal, a server, and an emotion engine. Specific embodiments of this system and program processing are described below.

[1835] System configuration

[1836] 1. User Device:

[1837] The user operates a user terminal such as a smartphone or tablet and inputs their desired exterior and interior design.

[1838] At the user terminal, it is possible to describe the desired layout in the form of a prompt sentence.

[1839] Hardware used: smartphone, tablet

[1840] Software used: HTTP / HTTPS protocol

[1841] 2. Server:

[1842] Receives and analyzes input data sent from the user terminal.

[1843] The server uses Python, Node.js, etc. to generate exterior designs and interior layouts based on user input data.

[1844] Based on the setting data, a simulation image is generated using 3D design software such as Blender or Autodesk Revit.

[1845] The total cost and construction schedule are calculated as simulation results and sent to the user's terminal.

[1846] Hardware used: Cloud server equipped with a high-performance GPU (e.g., AWS EC2 instance)

[1847] Software used: Python, Node.js, Blender, Autodesk Revit

[1848] 3. Emotion Engine:

[1849] The camera and sensors on the user's device are used to recognize the user's emotions and collect data.

[1850] The collected emotion data is analyzed using OpenCV, TensorFlow, etc. and sent to the server.

[1851] Adjust design data based on the results of sentiment analysis.

[1852] Hardware used: camera and sensors on the user device

[1853] Software used: OpenCV, TensorFlow

[1854] Program processing

[1855] 1. User enters their preference:

[1856] Users use a smartphone or tablet to input their desired exterior and interior design in the form of prompt sentences.

[1857] Examples:

[1858] "I would like to have benches installed near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[1859] 2. Data transmission and analysis:

[1860] The user device sends input data to the server, which then analyzes it using Python or Node.js, sometimes using GIS data or CAD drawings.

[1861] 3. Design and simulation generation:

[1862] The server creates a design based on the input data, generates a 3D simulation image using Blender, Autodesk Revit, etc., and then calculates the total cost and construction schedule.

[1863] 4. Emotion analysis:

[1864] The user device uses a camera to capture the facial expressions and reactions of the user checking the simulation results, and performs emotion analysis using OpenCV and TensorFlow. The emotion analysis results are then sent to the server.

[1865] 5. Rework and new proposals:

[1866] The server updates the design data based on the results of the emotion analysis and creates a new design. This data is then simulated again and sent to the user's device. By repeating this process, the system can create an exterior and interior layout that best suits the user's wishes and emotions.

[1867] In this way, real-time feedback based on the user's emotions becomes possible, achieving high levels of user satisfaction and providing a smooth design process.

[1868] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1869] Step 1:

[1870] The user operates a smartphone or tablet and inputs their desired exterior and interior design in the form of prompt statements.

[1871] Example: "I would like to have a bench near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[1872] The entered data is temporarily stored in the user terminal and prepared for later transmission to the server.

[1873] Step 2:

[1874] The user terminal transmits the input data to the server.

[1875] The submitted data is sent to the server using the HTTP / HTTPS protocol.

[1876] The server analyzes the received data and checks the requirements specified by the user.

[1877] Technologies used: HTTP / HTTPS protocol, Python, Node.js

[1878] Step 3:

[1879] The server generates an exterior design or interior layout based on the analyzed data.

[1880] At this time, a specific layout is created using Geographic Information System (GIS) data and Computer Aided Design (CAD) drawings.

[1881] The generated design data is saved as 2D and 3D models.

[1882] Technologies used: Python, GIS, CAD

[1883] Step 4:

[1884] The server generates a 3D simulation image based on the design data.

[1885] Simulation images are generated using 3D design software such as Blender and Autodesk Revit, allowing users to see a concrete image.

[1886] Technologies used: Blender, Autodesk Revit

[1887] Step 5:

[1888] The server generates a 3D simulation image and then calculates the total cost and construction schedule.

[1889] The calculation results are sent to the user terminal along with the simulation image.

[1890] Technologies used: Python, computational algorithms

[1891] Step 6:

[1892] The user terminal displays the 3D simulation image, total cost, and construction schedule received from the server to the user.

[1893] The user checks the simulation results, and the emotion engine collects the user's facial expressions and reactions via camera.

[1894] The collected data is temporarily stored on the user's device.

[1895] Technology used: Cameras and sensors on smartphones and tablets

[1896] Step 7:

[1897] The user device analyzes the emotion data using OpenCV and TensorFlow and sends the results to the server.

[1898] The transmitted data includes emotion analysis results based on the user's facial expressions and reactions.

[1899] Technologies used: OpenCV, TensorFlow

[1900] Step 8:

[1901] The server adjusts the design data based on the emotion analysis results and generates new design data.

[1902] Using the new design data, a 3D simulation image is generated again, and the total cost and construction schedule are also recalculated.

[1903] Technologies used: Python, Blender, Autodesk Revit

[1904] Step 9:

[1905] The server transmits the regenerated 3D simulation image, total cost and construction schedule to the user terminal.

[1906] The user terminal displays the received update information to the user, who then checks it again.

[1907] Technologies used: HTTP / HTTPS protocol, Python

[1908] Step 10:

[1909] If the user is satisfied with the final design, he sends his approval to the server.

[1910] The server generates a proposal for the construction company based on the final design data and sends the proposal to the construction company.

[1911] Technologies used: Python, documentation generation tools

[1912] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1913] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1914] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1915] [Fourth embodiment]

[1916] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1917] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1918] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1919] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1920] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1921] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1922] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1923] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1924] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1925] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1926] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1927] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1928] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1929] The exterior design simulation system according to the present invention is composed of the elements of a user, a terminal, and a server. A specific embodiment of this system and program processing will be described below.

[1930] System configuration

[1931] 1. User Device:

[1932] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[1933] The input contents are sent to the server and the received simulation results are displayed.

[1934] 2. Server:

[1935] Receives input data from the user terminal and analyzes it.

[1936] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[1937] The simulation image, total cost and construction schedule are sent to the user terminal.

[1938] Receives change requests from users and updates design data.

[1939] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[1940] Generate and send proposals to contractors based on the final design data.

[1941] Program processing

[1942] User:

[1943] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[1944] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[1945] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[1946] Device:

[1947] 4. The entered information is analyzed and sent to the server.

[1948] server:

[1949] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[1950] 2. Generate a 3D simulation image based on the design data.

[1951] 3. Calculate the total cost and schedule the work.

[1952] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[1953] Device:

[1954] 5. Display the simulation image and detailed information to the user.

[1955] 6. The user reviews the simulation results and inputs any necessary changes.

[1956] server:

[1957] 7. Receive change requests from users and update the design data.

[1958] 8. Generate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[1959] 9. Send the new design data to the user terminal.

[1960] Device:

[1961] 10. Redisplay updated simulation results and details to the user.

[1962] 11. If the user is satisfied with the final design, he or she approves the design.

[1963] server:

[1964] 12. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[1965] 13. Send proposal to contractor.

[1966] Specific examples

[1967] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these requests into the terminal. The terminal analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the terminal. The user can check the simulation results and re-enter changes if necessary. The server reflects the changes and resends the new simulation. Through this process, the user can check the specific exterior design in real time and create an optimal plan.

[1968] This allows for smooth communication between users and contractors, eliminating the gap between the image of the finished exterior construction work and the reality.

[1969] The processing flow will be explained below.

[1970] Step 1:

[1971] The user accesses the system from a terminal and enters login information (user ID, password).

[1972] Step 2:

[1973] The terminal transmits the user's input information to the server.

[1974] Step 3:

[1975] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[1976] Step 4:

[1977] A user starts a new project and inputs the lot shape, size, and home layout.

[1978] Step 5:

[1979] The terminal analyzes the user's input information and sends it to the server.

[1980] Step 6:

[1981] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[1982] Step 7:

[1983] The terminal analyzes the input data and sends it to the server.

[1984] Step 8:

[1985] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the land information, home layout, and site elements.

[1986] Step 9:

[1987] The server generates a 3D simulation image based on the design data.

[1988] Step 10:

[1989] The server calculates the total cost and schedules the construction.

[1990] Step 11:

[1991] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[1992] Step 12:

[1993] The terminal displays the simulation image and detailed information to the user.

[1994] Step 13:

[1995] The user checks the simulation results and inputs any necessary changes.

[1996] Step 14:

[1997] The terminal analyzes the change information and sends it to the server.

[1998] Step 15:

[1999] The server receives change requests from users and updates the design data.

[2000] Step 16:

[2001] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[2002] Step 17:

[2003] The server transmits the new design data to the user terminal.

[2004] Step 18:

[2005] The terminal redisplays the updated simulation results and detailed information to the user.

[2006] Step 19:

[2007] If the user is satisfied with the final design, he approves the design.

[2008] Step 20:

[2009] The terminal sends the authorization information to the server.

[2010] Step 21:

[2011] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[2012] Step 22:

[2013] The server sends the proposal to the contractor.

[2014] Example 1

[2015] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2016] In the traditional exterior design process, it was difficult for users to check design changes in real time as they proceeded, which often led to gaps between the design and construction. Furthermore, poor communication with the construction company led to construction delays and budget overruns. As a result, it was difficult to create an exterior design that accurately reflected the user's wishes.

[2017] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2018] In this invention, the server includes a means for analyzing data input from the user, a means for generating exterior site designs, and a means for generating 3D simulation images. This allows for real-time design changes and confirmations. It also facilitates budget and schedule management by accurately calculating total costs and construction schedules and then recalculating based on updated design data. After the user approves the final design, a proposal for the contractor is automatically generated, facilitating smooth communication and execution of the plan.

[2019] "User" is any person or entity that uses the system to enter information about a site design and to review and modify the results.

[2020] A "terminal" is a device operated by a user, which transmits input data and displays simulation results.

[2021] A "server" is a computer system that analyzes data sent from users, generates exterior design, and provides simulation results.

[2022] "Input data" refers to information such as the desired exterior design, the shape and size of the land, and the layout of the house that the user provides to the system from their terminal.

[2023] "Analysis" refers to the process in which the server performs calculations and processing based on input data received from the user to generate a site design.

[2024] "Exterior design" refers to the layout and blueprints of gardens, parking lots, fences, etc., generated based on the user's wishes and input data.

[2025] "Generation" refers to the process in which the server analyzes the input data and creates the exterior design and 3D simulation images.

[2026] "Simulation image" refers to an image or video that visually displays the generated exterior design as a 3D model.

[2027] "Total cost" refers to the result of calculating all costs required to carry out the exterior design.

[2028] The "construction schedule" refers to the calculated period from the start to the completion of exterior construction work.

[2029] A "change request" refers to the act of a user inputting corrections or additions that they would like to make to the results of the initial simulation.

[2030] A "proposal" is a document that is generated based on the final design data and that contains detailed information such as a design plan, costs, and construction schedule, which is presented to a construction company.

[2031] The exterior design simulation system of the present invention is composed of a terminal operated by the user, a server that analyzes data and generates designs, and a network that communicates between them. This system generates exterior designs that reflect the user's wishes in real time and allows the user to visually confirm them.

[2032] System configuration

[2033] User terminal: A device operated by the user, such as a PC, tablet, or smartphone. The user inputs their wishes and requests for changes to the exterior of the building through the terminal and sends this information to the server. The terminal also displays the simulation results and design data received from the server.

[2034] Server: Receives data sent from the user's device, performs analysis, and generates a site design. The server creates a 3D simulation image based on the design data and calculates the total cost and construction schedule. The generated information is sent back to the user's device, allowing the user to confirm and modify the design. The server also generates and sends a proposal to the construction company based on the final design data.

[2035] Hardware and software used

[2036] Hardware: User devices can be general-purpose PCs, tablets, or smartphones. Servers require a high-performance processor and sufficient memory.

[2037] Software: The server generates the exterior design using a generative AI model (e.g., a CAD engine). 3D simulation images are likely to be generated using a real-time rendering engine such as Unity or Unreal Engine.

[2038] Specific examples

[2039] For example, a specific example will be given in which the user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden."

[2040] The user enters "Parking lot: 20 square meters, Lawn: 50 square meters, Flower bed: Roses and tulips" into the project creation screen on the device and clicks the "Send" button. The device analyzes the entered data and sends it to the server in JSON format.

[2041] The server receives the data and generates the exterior design using a generative AI model (e.g., a CAD engine). It then renders a 3D simulation image using Unity or Unreal Engine. The server also calculates the total cost (e.g., ¥1,200,000) and construction schedule (e.g., 10 days) and sends this information to the user's device.

[2042] The terminal displays the simulation results to the user, who then checks the results and inputs changes, such as "Please expand the parking lot by another 5 square meters." The server reflects the changes, recalculates the new design, simulation images, total cost, and construction schedule, and retransmits them.

[2043] In this way, through interaction between the user and the system, the details of the exterior design are fleshed out and an optimal plan is created in real time.

[2044] Prompt Sentence Examples

[2045] "I would like the parking lot at my house to be enlarged and a lawn and flower beds installed in the garden. The parking lot should be large enough for three cars, the lawn should be 50 square meters, and the flower beds should be mainly roses and tulips. Also, please let me know the total budget and construction time."

[2046] By entering a prompt like the one above, the generative AI model will create a site design in real time, and the user can review and modify the results as they go.

[2047] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2048] Step 1:

[2049] The user accesses the system from a terminal and enters login information (user ID, password). The user clicks the "Login" button to log in to the system. The input is the user ID and password, and the output is the authentication result (success or failure).

[2050] Step 2:

[2051] The user clicks the "Start a new project" button and proceeds to the project information entry screen. Here, the user enters the shape, size, and layout of the land. The input is data related to the shape, size, and layout of the land, and the output is the initial setting data for the project.

[2052] Step 3:

[2053] The user inputs specific exterior requirements, such as parking, garden, and fence installation, and clicks the "Submit" button. The input is the user's wishes and requests regarding the exterior, and the output is organized exterior data.

[2054] Step 4:

[2055] The terminal parses and formats the input data from the user. The input is the initial settings and desired exterior data entered by the user, and the output is the formatted data sent to the server. This process also includes data validation.

[2056] Step 5:

[2057] The terminal sends the formatted data to the server. The input is the organized exterior data, and the output is a transmission request to the server. This communication is performed in the form of an HTTP request.

[2058] Step 6:

[2059] The server analyzes the data received from the terminal and checks for missing information. The input is organized exterior data, and the output is the analysis results and basic data for the exterior design.

[2060] Step 7:

[2061] The server uses a generative AI model (e.g., a CAD engine) to generate the exterior design. It creates 2D and 3D blueprints based on user input data. The input is the analyzed exterior data, and the output is the generated exterior design.

[2062] Step 8:

[2063] The server generates 3D simulation images based on the design data. This process uses a 3D simulation engine (such as Unity or Unreal Engine). The input is the design data, and the output is a high-quality 3D simulation image.

[2064] Step 9:

[2065] The server calculates the total cost based on the design data, including factors such as material and labor costs. The input is the design data, and the output is the total cost estimate.

[2066] Step 10:

[2067] The server calculates the construction schedule, scheduling the period from the start date to the completion date. The input is the design data and total cost, and the output is the construction schedule.

[2068] Step 11:

[2069] The server sends the generated 3D simulation image, total cost, and construction schedule to the user terminal. The input is the 3D simulation image, total cost, and construction schedule, and the output is a transmission request to the user terminal.

[2070] Step 12:

[2071] The terminal displays the received information to the user. The user checks the simulation results and inputs change requests if necessary. The input is the simulation results from the server, and the output is the display to the user and the user's change requests.

[2072] Step 13:

[2073] The user checks the simulation results and inputs a change request, such as "Please expand the parking lot by another 5 square meters," and clicks the "Submit" button. The input is a change request, and the output is a submission request.

[2074] Step 14:

[2075] The terminal receives the user's change request and sends it to the server. The input is the change request data, and the output is a transmission request to the server.

[2076] Step 15:

[2077] The server receives the change request, updates the design data, analyzes it again, and generates the changed design. The input is the change request data, and the output is the updated design data.

[2078] Step 16:

[2079] The server recalculates new 3D simulation images, total costs, and construction schedules based on the updated design data, and sends them to the user's terminal again. The input is the updated design data, and the output is the recalculated simulation results, total costs, and construction schedules.

[2080] Step 17:

[2081] The terminal again displays the received information to the user. If the user is satisfied with the final design, he / she clicks the "Approve" button to confirm the final design. The input is the recalculated simulation results, and the output is the display and approval operation for the user.

[2082] Step 18:

[2083] The server receives final approval from the user, generates a proposal to the contractor based on the final design data, and sends it. The proposal includes detailed design drawings, total costs, and construction schedules. The input is the final design data and approval information, and the output is the proposal sent to the contractor.

[2084] (Application example 1)

[2085] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2086] Currently, the layout design and product placement of physical stores are often done manually, which is inefficient. It is also difficult to quickly obtain detailed information, including simulation results, budgets, and construction schedules. Furthermore, re-simulating in response to user requests for changes is also time-consuming. For these reasons, there is a demand for fast and efficient layout design and simulation.

[2087] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2088] In this invention, the server includes: a means for a user to input layout preferences; a means for the server to analyze the input data from the user; a means for the server to generate a layout design based on the analyzed data; a means for the server to generate a 3D simulation image based on the layout design; a means for the server to transmit the generated simulation image, total cost, and construction schedule to a user terminal; a means for the terminal to display the simulation image and detailed information to the user; a means for the user to request changes to the simulation results; a means for the server to receive the change request and update the design data; a means for the server to generate a proposal based on the final design data and send the proposal to a contractor; and a means for generating simulation data based on prompt statements using a generative AI model. This allows users to efficiently design the layout of physical stores and quickly obtain simulation results and detailed information. Furthermore, re-simulations can be smoothly performed to accommodate change requests.

[2089] A "user" is an end user who uses the store layout design system to input layout preferences and change requests.

[2090] "Layout preference" refers to the specific details of the user's desire for the layout and design of the store.

[2091] The "server" is a device that analyzes data sent by users and generates store layout designs and 3D simulation images.

[2092] "Input data" refers to information such as store shape, size, and product placement that the user inputs into the layout design system.

[2093] "Analyzed data" refers to data generated as a result of processing and analyzing input data received by the server from the user.

[2094] "Layout design" is a layout diagram of the store generated by the server based on the analyzed data.

[2095] A "3D simulation image" is a three-dimensional simulation image displayed in real time based on a layout design generated by the server.

[2096] "Total cost" refers to all costs, including material costs and labor costs, required for layout design and construction.

[2097] "Construction schedule" refers to the total period required for layout design and construction work.

[2098] A "user terminal" is a device that allows a user to access the store layout design system.

[2099] "Detailed information" refers to detailed data such as 3D simulation images, total costs, and construction schedules.

[2100] A "change request" is a request from a user for correction or modification based on the simulation results.

[2101] "Design data" refers to the latest layout design information generated by the server after analysis and modification.

[2102] The "proposal" is a store layout proposal document that the server creates based on the final design data and sends to the construction company.

[2103] A "generative AI model" is an artificial intelligence algorithm that generates simulation data based on a prompt sentence.

[2104] A "prompt statement" is an instruction statement for creating simulation data that the user inputs to the generated AI model.

[2105] MODE FOR CARRYING OUT THE INVENTION

[2106] The store layout design system according to the present invention is an integrated system including a user terminal, a server, and a generative AI model. Each component of the system and program processing will be described in detail below.

[2107] System configuration

[2108] 1. User Device

[2109] The user terminal is a device that allows users to input their store layout preferences and change requests. Examples include smartphones and tablets. Users can access the system from these terminals and input their desired layout and changes. The terminal sends this data to the server, which then displays 3D simulation images and other detailed information received from the server.

[2110] 2. Server

[2111] The server is a device that receives and analyzes data sent by users. Specifically, it performs the following processes:

[2112] Analyzes store shape and product placement data entered by the user.

[2113] A layout design is generated based on the analyzed data.

[2114] A 3D simulation image is created based on the generated layout design.

[2115] Calculate total costs and construction schedule.

[2116] Simulation images, total costs, and construction schedules are sent to the user's device.

[2117] Receive change requests from users and update design data.

[2118] Generate proposals based on the final design data and send them to the contractor.

[2119] A generative AI model is used to generate simulation data based on prompt statements.

[2120] 3. Generative AI Models

[2121] A generative AI model is an artificial intelligence algorithm that generates simulation data based on prompts. This model allows users to obtain detailed simulation data simply by entering simple instructions.

[2122] Program processing description

[2123] The program communicates between the user device, the server, and the generative AI model, and performs data analysis and simulation. The specific process is as follows:

[2124] User device:

[2125] The user terminal provides an interface for users to input their layout preferences and change requests. This data is sent to the server. The user terminal also displays detailed information received from the server, such as 3D simulation images, total costs, and construction schedules.

[2126] server:

[2127] The server receives and analyzes data sent from the user's device. The main software used for this is Flask (a web application framework). A dedicated simulation library (the specific library name has not been specified) is also used to generate 3D simulation images. The server also generates simulation data based on prompt statements using a generative AI model.

[2128] Generative AI models:

[2129] The generative AI model generates simulation data based on the prompt text entered by the user, which is then sent back to the server and finally displayed on the user's device.

[2130] Adding specific examples

[2131] As an example, consider the following prompt sentence input to a generative AI model:

[2132] Example prompt sentence:

[2133] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[2134] The generative AI model analyzes the prompt sentences and generates 3D simulation data based on the specified conditions. This data is sent back to the server and displayed in real time on the user's device, allowing the user to make further changes.

[2135] As described above, the system of the present invention can efficiently and easily provide users with layout designs for physical stores, quickly obtain detailed information, and flexibly respond to changes requested by users.

[2136] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2137] Program processing flow

[2138] Step 1: User inputs layout preference

[2139] The user inputs their desired layout from the terminal, including the store's shape, area, product placement, etc. The terminal then sends this input data to the server.

[2140] Specific behavior:

[2141] Input: The user enters the desired layout (store shape, area, product placement).

[2142] Data processing: The terminal converts the input data into JSON format.

[2143] Output: Sends input data to the server.

[2144] Step 2: The server parses the input data

[2145] The server analyzes the input data received from the user terminal and generates a layout design. The analysis is performed based on data such as the store shape and product placement.

[2146] Specific behavior:

[2147] Input: Input data sent from the terminal.

[2148] Data processing: The server analyzes the input data and generates layout design data.

[2149] Output: Holds the generated layout design data.

[2150] Step 3: The server generates the 3D simulation image

[2151] The server generates a 3D simulation image based on the generated layout design data, using a 3D simulation library.

[2152] Specific behavior:

[2153] Input: Layout design data.

[2154] Data calculation: Generate 3D simulation images using the 3D simulation library.

[2155] Output: Keeps the generated 3D simulation image.

[2156] Step 4: The server calculates the total cost and construction schedule.

[2157] The server calculates the total cost and construction schedule based on the layout design, including material costs, labor costs, and work schedules.

[2158] Specific behavior:

[2159] Input: Layout design data.

[2160] Data calculation: Calculate total costs and construction schedule.

[2161] Output: Holds the calculation results (total cost and construction schedule).

[2162] Step 5: Server sends more information

[2163] The server transmits the generated 3D simulation image, total cost, and construction schedule information to the user terminal.

[2164] Specific behavior:

[2165] Input: 3D simulation image, total cost, construction schedule.

[2166] Data processing: Packaging the data to be sent.

[2167] Output: Sends data to the user's terminal.

[2168] Step 6: The device displays the simulation image

[2169] The terminal displays the received 3D simulation image and detailed information to the user.

[2170] Specific behavior:

[2171] Input: The data received from the server.

[2172] Data processing: Converting images and detailed information into a display format.

[2173] Output: Shows the simulation image and detailed information to the user.

[2174] Step 7: User enters change request

[2175] The user checks the displayed simulation results and inputs any necessary changes. This data is then sent back to the server.

[2176] Specific behavior:

[2177] Input: The user's change request.

[2178] Data processing: Convert the change request into JSON format.

[2179] Output: Submits a change request to the server.

[2180] Step 8: Server parses and updates the change request

[2181] The server receives change requests from users, updates the layout design data, and then generates new 3D simulation images and performs recalculation.

[2182] Specific behavior:

[2183] Input: Change Request.

[2184] Data calculation: Update design data and regenerate 3D simulation images.

[2185] Output: New 3D simulation images, total cost, and construction schedule are resent to the user's device.

[2186] Step 9: The server generates a proposal based on the final design data

[2187] After the user approves the final design, the server generates a proposal based on this data and sends it to the contractor.

[2188] Specific behavior:

[2189] Input: Final design data.

[2190] Data Computing: Proposal Generation.

[2191] Output: Send proposal to contractor.

[2192] Data generation based on prompt sentences using the generative AI model is performed appropriately at each step. For example, specific actions can be performed using the following prompt sentences:

[2193] Example prompt sentence:

[2194] The store is rectangular and has an area of ​​100 square meters. A large shelf is to be placed in the center, with smaller shelves along the walls. Please generate 3D simulation data based on this information.

[2195] This allows the entire system to work together organically, enabling users' requests to be responded to quickly and accurately.

[2196] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2197] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[2198] System configuration

[2199] 1. User Device:

[2200] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[2201] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[2202] 2. Server:

[2203] Receives input data from the user terminal and analyzes it.

[2204] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[2205] The simulation image, total cost and construction schedule are sent to the user terminal.

[2206] Receives change requests from users and updates design data.

[2207] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[2208] Generate and send proposals to contractors based on the final design data.

[2209] 3. Emotion Engine:

[2210] It recognizes the user's emotions and sends the analysis results to the server.

[2211] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[2212] Provide feedback to improve user satisfaction.

[2213] Program processing

[2214] User:

[2215] 1. The user accesses the system from a terminal and enters login information (user ID, password).

[2216] 2. The user starts a new project and inputs the lot shape, size, and home layout.

[2217] 3. Next, enter your specific exterior requirements (e.g., parking lot, garden, fence installation).

[2218] Device:

[2219] 4. The entered information is analyzed and sent to the server.

[2220] server:

[2221] 1. Analyze the received data and generate a site design. In this step, 2D and 3D design drawings are created based on the user-entered land information, home layout, and site elements.

[2222] 2. Generate a 3D simulation image based on the design data.

[2223] 3. Calculate the total cost and schedule the work.

[2224] 4. The simulation image, total cost, and construction schedule information are sent to the user's terminal.

[2225] Device:

[2226] 5. Display the simulation image and detailed information to the user.

[2227] 6. The emotion engine recognizes the user's emotions and collects emotion data while the user is checking the simulation results.

[2228] Emotion Engine:

[2229] 7. Analyze the user's emotions and send the results to the server.

[2230] 8. Based on the user's emotions, appropriate exterior design suggestions are fed back to the server.

[2231] server:

[2232] 9. Adjust and regenerate design data based on feedback from the emotion engine.

[2233] 10. Updated design data and simulation images are sent to the user's terminal.

[2234] Device:

[2235] 11. The simulation results are displayed to the user again, and information reflecting the suggestions based on the sentiment analysis is provided.

[2236] 12. If the user wishes to input a change request for the simulation results, the change request is made again.

[2237] server:

[2238] 13. Receive user change requests and update design data.

[2239] 14. Regenerate and calculate new simulation images, total costs, and construction schedules based on the updated design data.

[2240] 15. Send the new design data to the user terminal.

[2241] Device:

[2242] 16. Redisplay updated simulation results and details to the user.

[2243] 17. If the user is satisfied with the final design, he or she approves the design.

[2244] server:

[2245] 18. Receive final approval from the user and generate a proposal for the contractor based on the final design data.

[2246] 19. Send proposal to contractor.

[2247] Specific examples

[2248] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these preferences into the device. The device analyzes the input data and sends it to the server. The server receives this and generates an exterior design including the layout of the parking lot, the lawn in the garden, and the placement of the flower beds. It then creates a 3D simulation image, calculates the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this to the device. As the user checks the simulation results, the emotion engine collects emotional data. The emotion engine then sends the analysis results to the server and adjusts the proposal to propose an exterior design that best suits the user's preferences. Through this process, the user can view specific exterior designs in real time and create an optimal plan.

[2249] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[2250] The processing flow will be explained below.

[2251] Step 1:

[2252] The user accesses the system from a terminal and enters login information (user ID, password).

[2253] Step 2:

[2254] The terminal transmits the user's input information to the server.

[2255] Step 3:

[2256] The server authenticates the submitted login information and returns the user's authentication status to the terminal.

[2257] Step 4:

[2258] A user starts a new project and inputs the lot shape, size, and home layout.

[2259] Step 5:

[2260] The terminal analyzes the user's input information and sends it to the server.

[2261] Step 6:

[2262] The user inputs specific exterior requirements (e.g., parking lot, garden, fence installation).

[2263] Step 7:

[2264] The terminal analyzes the input data and sends it to the server.

[2265] Step 8:

[2266] The server analyzes the received data and generates a site design, specifically creating 2D and 3D blueprints based on the user-entered land information, home layout, and site elements.

[2267] Step 9:

[2268] The server generates a 3D simulation image based on the design data.

[2269] Step 10:

[2270] The server calculates the total cost and schedules the construction.

[2271] Step 11:

[2272] The server transmits the simulation image, total cost and construction schedule information to the user terminal.

[2273] Step 12:

[2274] The terminal displays the simulation image and detailed information to the user.

[2275] Step 13:

[2276] The emotion engine recognizes the user's emotions and collects that data.

[2277] Step 14:

[2278] The emotion engine analyzes the collected emotion data and sends the results to the server.

[2279] Step 15:

[2280] The server adjusts and regenerates the design data based on feedback from the emotion engine.

[2281] Step 16:

[2282] The server transmits the updated design data and simulation images to the user terminal.

[2283] Step 17:

[2284] The terminal again displays the simulation results and suggestions based on the emotion analysis to the user.

[2285] Step 18:

[2286] The user checks the simulation results and inputs any necessary changes.

[2287] Step 19:

[2288] The terminal analyzes the change information and sends it to the server.

[2289] Step 20:

[2290] The server receives change requests from users and updates the design data.

[2291] Step 20:

[2292] The server regenerates and calculates new simulation images, total costs and construction schedules based on the updated design data.

[2293] Step 21:

[2294] The server transmits the new design data to the user terminal.

[2295] Step 22:

[2296] The terminal redisplays the updated simulation results and detailed information to the user.

[2297] Step 23:

[2298] If the user is satisfied with the final design, he approves the design.

[2299] Step 24:

[2300] The terminal sends the authorization information to the server.

[2301] Step 25:

[2302] The server receives final approval from the user and generates a proposal for the contractor based on the final design data.

[2303] Step 26:

[2304] The server sends the proposal to the contractor.

[2305] Example 2

[2306] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2307] Conventional exterior design systems have difficulty quickly and accurately reflecting users' wishes and change requests, making it impossible to increase user satisfaction in the design process. Furthermore, few systems incorporate emotion analysis, making it impossible to adjust the design taking into account the user's emotions. As a result, a gap often exists between the actual construction and the user's expectations.

[2308] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2309] In this invention, the server includes a means for analyzing data input from the user, a means for generating a site design based on the analyzed data, and a means for generating a 3D simulation image based on the site design. This allows the server to quickly and accurately reflect the user's wishes and requests for changes, and furthermore, it is possible to analyze the user's emotions using an emotion engine and adjust the design based on that feedback. This increases user satisfaction and eliminates any gaps after construction.

[2310] A "user" is a user who operates the system and inputs their wishes and requests for changes to the exterior.

[2311] A "terminal" is a device or equipment that analyzes data entered by a user, transmits it to a server, and displays information received from a server.

[2312] The "server" is a computer that receives input data from users, analyzes it, generates exterior design data, and creates 3D simulation images.

[2313] An "emotion engine" is software or hardware that recognizes the user's emotions and provides feedback to the server on design adjustments based on the analysis results.

[2314] "Exterior design" is a design drawing that includes the layout and elements of the exterior desired by the user.

[2315] A "3D simulation image" is a three-dimensional image that allows you to visually check the generated exterior design.

[2316] "Total cost" is the overall cost calculated based on the exterior design.

[2317] The "construction schedule" is the schedule from the start to the end of the construction work.

[2318] A "proposal" is a document containing a construction plan that is sent to a construction company based on the final design data.

[2319] A "change request" is a request made by a user to modify or add to the simulation results.

[2320] The exterior design simulation system according to the present invention includes the following elements: a user, a terminal, a server, and an emotion engine. A specific embodiment of this system and program processing will be described below.

[2321] System configuration

[2322] 1. User Device:

[2323] This is a device operated by the user, and is used to input requests for exterior construction and changes.

[2324] The input content is sent to the server, and the received simulation results and emotion analysis results are displayed.

[2325] 2. Server:

[2326] Receives input data from the user terminal and analyzes it.

[2327] An exterior design is generated based on the analysis results and a 3D simulation image is created.

[2328] The simulation image, total cost and construction schedule are sent to the user terminal.

[2329] Receives change requests from users and updates design data.

[2330] Recalculation is performed based on the updated design data and transmitted again to the user terminal.

[2331] Generate and send proposals to contractors based on the final design data.

[2332] 3. Emotion Engine:

[2333] It recognizes the user's emotions and sends the analysis results to the server.

[2334] The proposed exterior design and simulation results are adjusted according to the user's emotions.

[2335] Provide feedback to improve user satisfaction.

[2336] The specific hardware and software used

[2337] Hardware:

[2338] User devices (e.g., personal computers, tablets, smartphones, etc.)

[2339] Servers (e.g. cloud servers, physical servers)

[2340] software:

[2341] Design software (e.g., Autodesk AutoCAD)

[2342] 3D rendering software (e.g. Blender)

[2343] Sentiment analysis tools (e.g. IBM Watson)

[2344] Estimation Software

[2345] Specific examples of program processing

[2346] For example, if a user wishes to "enlarge the parking lot and install a lawn and flower beds in the garden," the user inputs these wishes into the terminal. An example of a prompt sentence is as follows:

[2347] Example prompt sentence:

[2348] User: "I would like to enlarge the parking space at my house and add a lawn and flower beds to my yard. I would like to know the cost and construction time."

[2349] The terminal analyzes the input data and sends it to the server. The server receives this data and generates an exterior design, including the layout of the parking lot, the garden lawn, and the placement of flower beds. It then uses Blender to create a 3D simulation image. It then uses estimation software to calculate the total cost (e.g., 1,200,000 yen) and construction schedule (e.g., 10 days), and sends this information to the terminal. The terminal then displays the simulation results and detailed information to the user.

[2350] During this process, the emotion engine analyzes the user's facial expressions and voice to collect emotional data. The analysis results are sent to the server, which then readjusts the exterior design based on the emotional data. The regenerated design data and simulation images are sent back to the user's device and displayed to the user. This allows the user to check the specific exterior design in real time and create an optimal plan.

[2351] This allows smooth communication between the user and the contractor, eliminating the gap between the image of the finished exterior construction and the reality. Furthermore, adjustments based on the user's emotions will achieve even higher levels of satisfaction.

[2352] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2353] Step 1:

[2354] The user enters their login information.

[2355] Input: User ID, Password

[2356] Specific operation: The user enters their user ID and password into the login screen of the terminal to access the system. The terminal receives this and sends it to the server.

[2357] Output: Login information sent to the server

[2358] Step 2:

[2359] The user enters the project information.

[2360] Input: Data on the shape, size, and layout of the land

[2361] Specific operation: The user inputs the shape, size, and layout of the land for a new project, and then inputs their wishes and requests for changes to the exterior (e.g., expanding the parking lot, installing grass and flower beds in the garden) into the terminal. The terminal then sends the input data to the server.

[2362] Output: Project information and site requirements sent to the server

[2363] Step 3:

[2364] The terminal analyzes the input data and sends it to the server.

[2365] Input: User-entered project information and site preferences

[2366] Specific operation: The terminal analyzes the user's input data and sends the formatted data to the server.

[2367] Output: Parsed data sent to the server

[2368] Step 4:

[2369] The server analyzes the received data and generates a design.

[2370] Input: Analyzed data (project information, desired exterior data)

[2371] Specific operation: The server analyzes the data sent by the user using automated design software (e.g., AutoCAD) and generates exterior design drawings (2D and 3D) based on the shape of the land, the layout of the house, and exterior elements.

[2372] Output: Generated site plan

[2373] Step 5:

[2374] The server generates a 3D simulation image.

[2375] Input: Exterior design drawing

[2376] Specific operation: The server uses 3D rendering software (e.g. Blender) to create a 3D simulation image based on the generated design drawing.

[2377] Output: Generated 3D simulation image

[2378] Step 6:

[2379] The server calculates the total cost and construction schedule.

[2380] Input: Exterior design data

[2381] What it does: The server uses the estimating software to calculate the total cost of the design and also calculates the required construction schedule.

[2382] Output: Total cost, construction schedule

[2383] Step 7:

[2384] The server transmits the simulation results to the terminal.

[2385] Input: 3D simulation image, total cost, construction schedule

[2386] Specific operation: The server transmits the generated data to the user terminal.

[2387] Output: Simulation results sent to the user's terminal

[2388] Step 8:

[2389] The terminal displays the simulation results.

[2390] Input: Simulation results sent from the server (3D simulation image, total cost, construction schedule)

[2391] Specific operation: The device displays the received data to the user, who can visually check the 3D simulation image and detailed information.

[2392] Output: Simulation results displayed to the user

[2393] Step 9:

[2394] The emotion engine recognizes the user's emotions and collects data.

[2395] Input: User's facial expression and voice data

[2396] Specific operation: The emotion engine recognizes emotions from the user's facial expressions and voice, and collects emotion data while checking the simulation results.

[2397] Output: Collected emotion data

[2398] Step 10:

[2399] The emotion engine sends the emotion data to the server.

[2400] Input: Collected emotion data

[2401] Specific operation: The emotion engine analyzes the collected emotion data and sends the results to the server.

[2402] Output: Emotion data sent to the server

[2403] Step 11:

[2404] The server regenerates the design based on the emotional feedback.

[2405] Input: Emotion data

[2406] Specific operation: The server readjusts the exterior design based on the emotion data. The design data is adjusted and regenerated using automated design software (e.g., AutoCAD).

[2407] Output: Regenerated design data and 3D simulation images

[2408] Step 12:

[2409] The server transmits the updated design data to the terminal.

[2410] Input: Regenerated design data, 3D simulation images

[2411] Specific operation: The server sends the updated design data and new 3D simulation images to the user terminal.

[2412] Output: Updated design data and simulation images sent to the terminal

[2413] Step 13:

[2414] The terminal is regenerated and the simulation results are displayed.

[2415] Input: Updated design data and simulation images sent from the server

[2416] Specific operation: The terminal redisplays the updated simulation results to the user, who then checks the new 3D simulation image and detailed information.

[2417] Output: Simulation results displayed to the user

[2418] Step 14:

[2419] A user enters a change request.

[2420] Input: New Change Request

[2421] Specific operation: After the user checks the simulation results, they input new change requests into the terminal as necessary. The terminal then resends the change requests to the server.

[2422] Output: The change request sent to the server

[2423] Step 15:

[2424] The server receives the change request and updates the design data.

[2425] Input: Change Request Data

[2426] Specific operation: The server receives a change request from the user and updates the design data in the automated design software.

[2427] Output: Updated design data

[2428] Step 16:

[2429] The server resends the updated design data.

[2430] Input: Updated design data, 3D simulation images, total cost, construction schedule

[2431] Specific operation: The server regenerates updated design data, new 3D simulation images, total costs, and construction schedules, and sends them to the terminal.

[2432] Output: Updated design data and simulation results sent to the terminal

[2433] Step 17:

[2434] The device will display the updated simulation results.

[2435] Input: Updated design data and simulation results sent from the server

[2436] Specific operation: The terminal displays the updated simulation results and detailed information to the user again. The user confirms the new simulation results.

[2437] Output: Updated simulation results displayed to the user

[2438] Step 18:

[2439] The user approves the final design.

[2440] Input: Approval of final design data

[2441] Specific Actions: If the user is satisfied with the final design, he / she clicks the "Approve" button to approve the design.

[2442] Output: Approved final design data

[2443] Step 19:

[2444] The server sends the final design data to the contractor as a proposal.

[2445] Input: Approved final design data

[2446] Specific operation: The server generates a proposal for the construction company based on the final design data approved by the user and sends it to the construction company.

[2447] Output: Proposal sent to contractor

[2448] (Application example 2)

[2449] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2450] Conventional exterior design simulation systems have difficulty in proposing designs that take the user's emotions into account, and users are often dissatisfied with the simulation results. This creates dissatisfaction in communication between the user and the construction company, making it difficult to smoothly progress the project. Furthermore, there is a demand for proposals that reflect the user's emotions in real time when designing the exterior and interior layout of a store, but current systems are unable to meet this demand.

[2451] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2452] In this invention, the server includes: means for a user to input their exterior site preferences; means for the server to analyze the input data from the user; means for the server to generate an exterior site design based on the analyzed data; means for the server to generate a 3D simulation image based on the exterior site design; means for the server to send the generated simulation image, total cost, and construction schedule to a user terminal; means for the terminal to display the simulation image and detailed information to the user; means for the user to request changes to the simulation results; means for the server to receive the change request and update the design data; means for the server to generate a proposal to a contractor based on the final design data and send the proposal; means for the server to recognize the user's emotions on the terminal; and means for analyzing the emotions and adjusting the exterior site design based on the analysis results. This enables real-time feedback based on the user's emotions, achieving high user satisfaction and providing a smooth design process.

[2453] A "user terminal" is a device used by a user to send input data to the system and display simulation results and detailed information.

[2454] The "server" is a central processing unit that analyzes input data sent by the user, generates an exterior design, and generates a 3D simulation image and sends it to the user's terminal.

[2455] "Exterior design" refers to the external structures and spatial layouts that are designed based on the user's wishes and site conditions.

[2456] A "3D simulation image" is an image that visualizes the exterior design in three dimensions and is used by users to get a concrete idea of ​​the design.

[2457] "Total cost" refers to the total cost of designing and constructing the exterior structure.

[2458] "Construction schedule" refers to the overall schedule until the exterior design is completed.

[2459] An "emotion engine" is a combination of software and hardware for recognizing and analyzing a user's emotions.

[2460] A "proposal" is a design proposal document to a construction company that is generated based on the final design data.

[2461] "Change request" refers to a request for corrections or additions that a user desires based on the simulation results.

[2462] "Emotion analysis" is the process of collecting and analyzing user emotion data.

[2463] "Real-time feedback" refers to instantly adjusting simulation results and design proposals based on user input and sentiment analysis results.

[2464] MODE FOR CARRYING OUT THE INVENTION

[2465] This invention is a system for simulating the layout of the exterior and interior of a physical store based on the user's wishes and emotions. The system includes a user terminal, a server, and an emotion engine. Specific embodiments of this system and program processing are described below.

[2466] System configuration

[2467] 1. User Device:

[2468] The user operates a user terminal such as a smartphone or tablet and inputs their desired exterior and interior design.

[2469] At the user terminal, it is possible to describe the desired layout in the form of a prompt sentence.

[2470] Hardware used: smartphone, tablet

[2471] Software used: HTTP / HTTPS protocol

[2472] 2. Server:

[2473] Receives and analyzes input data sent from the user terminal.

[2474] The server uses Python, Node.js, etc. to generate exterior designs and interior layouts based on user input data.

[2475] Based on the setting data, a simulation image is generated using 3D design software such as Blender or Autodesk Revit.

[2476] The total cost and construction schedule are calculated as simulation results and sent to the user's terminal.

[2477] Hardware used: Cloud server equipped with a high-performance GPU (e.g., AWS EC2 instance)

[2478] Software used: Python, Node.js, Blender, Autodesk Revit

[2479] 3. Emotion Engine:

[2480] The camera and sensors on the user's device are used to recognize the user's emotions and collect data.

[2481] The collected emotion data is analyzed using OpenCV, TensorFlow, etc. and sent to the server.

[2482] Adjust design data based on the results of sentiment analysis.

[2483] Hardware used: camera and sensors on the user device

[2484] Software used: OpenCV, TensorFlow

[2485] Program processing

[2486] 1. User enters their preference:

[2487] Users use a smartphone or tablet to input their desired exterior and interior design in the form of prompt sentences.

[2488] Examples:

[2489] "I would like to have benches installed near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[2490] 2. Data transmission and analysis:

[2491] The user device sends input data to the server, which then analyzes it using Python or Node.js, sometimes using GIS data or CAD drawings.

[2492] 3. Design and simulation generation:

[2493] The server creates a design based on the input data, generates a 3D simulation image using Blender, Autodesk Revit, etc., and then calculates the total cost and construction schedule.

[2494] 4. Emotion analysis:

[2495] The user device uses a camera to capture the facial expressions and reactions of the user checking the simulation results, and performs emotion analysis using OpenCV and TensorFlow. The emotion analysis results are then sent to the server.

[2496] 5. Rework and new proposals:

[2497] The server updates the design data based on the results of the emotion analysis and creates a new design. This data is then simulated again and sent to the user's device. By repeating this process, the system can create an exterior and interior layout that best suits the user's wishes and emotions.

[2498] In this way, real-time feedback based on the user's emotions becomes possible, achieving high levels of user satisfaction and providing a smooth design process.

[2499] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2500] Step 1:

[2501] The user operates a smartphone or tablet and inputs their desired exterior and interior design in the form of prompt statements.

[2502] Example: "I would like to have a bench near the entrance to the store and a drinking fountain. I would like the exterior to have a modern style."

[2503] The entered data is temporarily stored in the user terminal and prepared for later transmission to the server.

[2504] Step 2:

[2505] The user terminal transmits the input data to the server.

[2506] The submitted data is sent to the server using the HTTP / HTTPS protocol.

[2507] The server analyzes the received data and checks the requirements specified by the user.

[2508] Technologies used: HTTP / HTTPS protocol, Python, Node.js

[2509] Step 3:

[2510] The server generates an exterior design or interior layout based on the analyzed data.

[2511] At this time, a specific layout is created using Geographic Information System (GIS) data and Computer Aided Design (CAD) drawings.

[2512] The generated design data is saved as 2D and 3D models.

[2513] Technologies used: Python, GIS, CAD

[2514] Step 4:

[2515] The server generates a 3D simulation image based on the design data.

[2516] Simulation images are generated using 3D design software such as Blender and Autodesk Revit, allowing users to see a concrete image.

[2517] Technologies used: Blender, Autodesk Revit

[2518] Step 5:

[2519] The server generates a 3D simulation image and then calculates the total cost and construction schedule.

[2520] The calculation results are sent to the user terminal along with the simulation image.

[2521] Technologies used: Python, computational algorithms

[2522] Step 6:

[2523] The user terminal displays the 3D simulation image, total cost, and construction schedule received from the server to the user.

[2524] The user checks the simulation results, and the emotion engine collects the user's facial expressions and reactions via camera.

[2525] The collected data is temporarily stored on the user's device.

[2526] Technology used: Cameras and sensors on smartphones and tablets

[2527] Step 7:

[2528] The user device analyzes the emotion data using OpenCV and TensorFlow and sends the results to the server.

[2529] The transmitted data includes emotion analysis results based on the user's facial expressions and reactions.

[2530] Technologies used: OpenCV, TensorFlow

[2531] Step 8:

[2532] The server adjusts the design data based on the emotion analysis results and generates new design data.

[2533] Using the new design data, a 3D simulation image is generated again, and the total cost and construction schedule are also recalculated.

[2534] Technologies used: Python, Blender, Autodesk Revit

[2535] Step 9:

[2536] The server transmits the regenerated 3D simulation image, total cost and construction schedule to the user terminal.

[2537] The user terminal displays the received update information to the user, who then checks it again.

[2538] Technologies used: HTTP / HTTPS protocol, Python

[2539] Step 10:

[2540] If the user is satisfied with the final design, he sends his approval to the server.

[2541] The server generates a proposal for the construction company based on the final design data and sends the proposal to the construction company.

[2542] Technologies used: Python, documentation generation tools

[2543] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2544] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2545] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2546] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2547] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2548] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2549] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2550] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2551] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never wan...

Claims

1. A means for the user to input their desired exterior structure; A means for the server to analyze input data from a user; A means for the server to generate an exterior design based on the analyzed data; A means for the server to generate a 3D simulation image based on the exterior design; A means for the server to transmit the generated simulation image, total cost and construction schedule to a user terminal; a means for the terminal to display a simulation image and detailed information to a user; A means for a user to request a change to a simulation result; a server receiving the change request and updating the design data; A means for the server to generate a proposal to a construction company based on the final design data and transmit the proposal; A system including:

2. 2. The system according to claim 1, wherein the means for the user to input his / her desires for the exterior site includes means for the user to input the shape and size of the lot, the layout of the house, and specific elements of the exterior site.

3. 2. The system of claim 1, wherein the server includes means for calculating total costs and means for calculating construction schedules.

4. 2. The system of claim 1, wherein the means for the terminal to display the simulation image and detailed information to the user includes means for displaying updated information to the user in real time.

5. 2. The system according to claim 1, further comprising means for the server to recalculate the simulation image, total cost and construction schedule based on a change request from the user, and to transmit the updated information to the user terminal.

Images