System

Abstract

A system is provided.SOLUTION: This system includes a means for uploading the drawing data of a room, a means for analyzing the uploaded drawing data, a means for executing Feng Shui evaluation based on the analyzed drawing data, a means for generating the advice of optimal arrangement or design based on the Feng Shui evaluation, and a means for presenting the generated advice.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Achieving room layout and interior design that incorporates Feng Shui principles is difficult for many people and requires specialized knowledge and experience. It is especially difficult to adapt the principles of Feng Shui to suit individual lifestyles and preferences. As a result, some people fail to effectively utilize Feng Shui and create a harmonious living space. [Means for solving the problem]

[0005] The present invention provides a system including a means for uploading room plan data, a means for analyzing the uploaded plan data, a means for performing a feng shui evaluation based on the analyzed plan data, a means for generating advice on optimal layout and design based on the feng shui evaluation, and a means for presenting the generated advice. This system allows users to easily receive advice based on feng shui principles and adjust the layout and design of their rooms accordingly. As a result, a comfortable and harmonious living space can be realized.

[0006] "Room drawing data" is digital information that represents the layout and structure of a room.

[0007] "Means for uploading" refers to a function or interface that allows a user to send room drawing data to a server or the like.

[0008] "Means for analysis" refers to the function of analyzing uploaded room drawing data and extracting information such as the room's structure, dimensions, location of windows and doors, and the layout of existing furniture.

[0009] A "feng shui evaluation" refers to the analytical process of evaluating a room's structure and layout based on the principles of feng shui to optimize harmony and energy flow.

[0010] "Means for generating advice" refers to the function of creating design suggestions such as specific furniture placement and color usage based on the results of the feng shui evaluation.

[0011] "Presentation means" refers to a function or interface for displaying the generated advice to the user in visual or text form.

[0012] "System" refers to a set of devices and programs that provide feng shui advice regarding room layout and design, consisting of multiple interfaces, servers, data analysis devices, and evaluation algorithms. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The embodiments for carrying out the present invention will be described in detail below.

[0035] Basic system configuration

[0036] Users upload room plan data via their devices. The devices then send this data to the server. The server analyzes the received data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[0037] Program processing

[0038] Uploading drawing data

[0039] 1. User: Select the room drawing data from the terminal and press the upload button.

[0040] 2. Terminal: Receives drawing data and sends it to the server.

[0041] Drawing data analysis

[0042] 3. Server: Once the drawing data is received, image processing algorithms are used to extract information such as room boundaries, window and door locations, and the placement of existing furniture.

[0043] 4. Server: Stores the extracted information in a database.

[0044] Conducting a Feng Shui evaluation

[0045] 5. Server: Based on the stored data, the Feng Shui evaluation algorithm is executed. The evaluation algorithm applies the concept of the eight directions, for example, to evaluate the structure and layout of the room from the perspective of Feng Shui.

[0046] 6. Server: Based on the evaluation results, identify areas that need improvement and the optimal layout.

[0047] Generating Advice

[0048] 7. Server: Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that matches the user's lifestyle and preferences. Specific examples of this advice include suggestions for furniture placement and color usage.

[0049] 8. Server: Sends the generated advice in JSON format to the device.

[0050] Providing advice

[0051] 9. Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[0052] 10. Terminal: Displays an interface that provides advice to the user.

[0053] Specific examples

[0054] Living room improvements

[0055] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0056] 2. Terminal: Receives drawing data and sends it to the server.

[0057] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0058] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[0059] 5. Server: Generates an evaluation result, for example, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[0060] 6. Server: Generates improvement advice such as "place plants in the southeast corner" or "move the sofa to the north side."

[0061] 7. Server: Sends advice in JSON format to the device.

[0062] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[0063] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[0064] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui, and to create a comfortable and harmonious living space.

[0065] The processing flow will be explained below.

[0066] Step 1:

[0067] User: Select the room drawing data from the terminal and press the upload button.

[0068] Step 2:

[0069] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[0070] Step 3:

[0071] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[0072] Step 4:

[0073] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[0074] Step 5:

[0075] Server: Based on the stored metadata, it runs a feng shui evaluation algorithm and evaluates the room's structure and layout based on feng shui principles.

[0076] Step 6:

[0077] Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement.

[0078] Step 7:

[0079] Server: Based on the results of the Feng Shui evaluation, it generates advice on optimal furniture placement, color usage, etc.

[0080] Step 8:

[0081] Server: Sends the generated advice in JSON format to the device.

[0082] Step 9:

[0083] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[0084] Step 10:

[0085] Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[0086] Step 11:

[0087] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[0088] Example 1

[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0090] Modern interior design requires optimal furniture placement and color design based on the principles of Feng Shui. However, conventional methods require specialized knowledge and are difficult for average users. Furthermore, manual analysis is time-consuming and inefficient. Therefore, there is a need for a system that allows users to easily create interior designs based on the principles of Feng Shui.

[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0092] In this invention, the server includes means for transmitting room plan data to the server, means for analyzing the plan data transmitted to the server, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for transmitting the generated advice to a terminal, and means for visually presenting the advice received by the terminal, thereby enabling a user to easily and efficiently achieve an optimal interior design based on the principles of feng shui even without specialized knowledge.

[0093] "Room plan data" refers to images or electronic files that contain information about the interior structure and furniture layout.

[0094] "Uploading" refers to the act of sending data from a user's terminal to a server via a network.

[0095] A "server" is a computer system that receives, analyzes, evaluates data, and generates and sends advice to users.

[0096] "Analysis" refers to the process of using image processing techniques and algorithms to identify room structure and furniture layout from drawing data.

[0097] A "feng shui evaluation" is the process of analyzing a room's structure and layout based on the principles of feng shui and determining whether it is good or bad.

[0098] "Layout" refers to the planning and layout of how furniture and decorations are arranged in a room.

[0099] "Design" refers to design guidelines such as furniture placement and color selection based on the room's feng shui.

[0100] "Advice" refers to specific improvements or recommendations proposed to the user based on the Feng Shui assessment.

[0101] The "JSON format" is a lightweight data format for structuring, storing, and transmitting data, and primarily represents data as key-value pairs.

[0102] A "terminal" refers to an electronic device such as a computer or smartphone used by a user.

[0103] "Visual presentation" refers to the act of displaying analysis results and advice to the user in an easy-to-read format such as figures, graphs, or layout diagrams.

[0104] The present invention is a system that allows users to upload room plan data, performs a feng shui evaluation based on that data, and provides advice on optimal layout and design.

[0105] Basic system configuration

[0106] Users upload room plan data using devices such as personal computers or smartphones. The devices then send the uploaded plan data to a server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[0107] Hardware and software used

[0108] 1. Hardware:

[0109] User devices: personal computers, smartphones, etc.

[0110] Server: A server computer for data processing and storage.

[0111] 2. Software:

[0112] Image processing library: OpenCV

[0113] Database: MySQL

[0114] Programming language: Python (implementation of Feng Shui evaluation algorithm)

[0115] Interface design tool: Adobe XD

[0116] Program processing overview

[0117] 1. Upload drawing data:

[0118] The user uses the terminal to select the room drawing data and presses the upload button.

[0119] The terminal receives the drawing data and sends it to the server via an HTTP request.

[0120] 2. Drawing data analysis:

[0121] The server stores the received drawing data in a temporary directory and executes image processing algorithms using the OpenCV library.

[0122] The server converts the information extracted by image processing into structured data (e.g., JSON format) and stores it in a MySQL database.

[0123] 3. Conduct a Feng Shui assessment:

[0124] The server retrieves the stored data and runs a feng shui evaluation algorithm implemented in Python.

[0125] As an evaluation result, the server identifies the Feng Shui score and areas for improvement for each area and saves them in JSON format.

[0126] 4. Generating Advice:

[0127] The server uses automated scripts to generate specific placement and design advice based on the results of the feng shui assessment.

[0128] The server encodes the generated advice in JSON format and sends it to the terminal as an HTTP response.

[0129] 5. Providing advice:

[0130] The device decodes the received advice data and updates various UI components.

[0131] The terminal displays an interface for the user, presenting analysis results and design suggestions.

[0132] Specific examples

[0133] Living room improvements

[0134] 1. User: Selects the blueprint data (JPEG format) of his / her living room and clicks the button to upload.

[0135] 2. Terminal: Sends the selected drawing data to the server as an HTTP request.

[0136] 3. Server: Analyzes the drawing data using OpenCV to determine room dimensions and furniture layout.

[0137] 4. Server: The extracted data is stored in MySQL and the Feng Shui evaluation algorithm implemented in Python is executed.

[0138] 5. Server: Generates a Feng Shui evaluation result, such as "The living room window is located in the southeast, so it would be good to place plants in this direction."

[0139] 6. Server: Generates suggestions in JSON format as realization advice, such as "Place plants in the southeast corner" or "Move the sofa to the north side."

[0140] 7. Server: Sends the generated advice to the terminal as a response.

[0141] 8. Terminal: Parses the received advice and creates a visual layout using HTML and CSS.

[0142] 9. Terminal: Provides an interface that displays advice to the user and explains specific steps for reconfiguration.

[0143] Prompt Sentence Examples

[0144] "I want to upload a blueprint of my living room and receive advice based on Feng Shui."

[0145] "I'd like to improve the feng shui of my bedroom layout. Could you please analyze the blueprint data and give me some advice?"

[0146] This system allows users to easily and efficiently create optimal interior designs based on Feng Shui principles, even without specialized knowledge.

[0147] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0148] Step 1:

[0149] User: Uses the terminal to select the room drawing data and presses the upload button. The input is the file selected by the user, and the output is the selected drawing data (e.g., JPEG format).

[0150] Step 2:

[0151] Terminal: Reads the selected drawing data, creates an HTTP request, and sends it to the server. The input is the drawing data selected by the user, and the output is an HTTP request sent to the server. At this time, the file data is sent in multipart format.

[0152] Step 3:

[0153] Server: Receives drawing data and saves it in a temporary directory. The input is the drawing data sent from the terminal, and the output is a drawing file saved in the temporary directory.

[0154] Step 4:

[0155] Server: Analyzes the drawing data using the OpenCV library. Specifically, it performs edge detection and contour extraction to recognize room boundaries and furniture layout. The input is the drawing file saved in a temporary directory, and the output is the room structure data extracted as the analysis result.

[0156] Step 5:

[0157] Server: The analysis results are converted into JSON format and saved in a MySQL database. The input is the structure data obtained by the analysis, and the output is the Feng Shui evaluation data saved in the database.

[0158] Step 6:

[0159] Server: Retrieves structural data from the MySQL database and executes the Feng Shui evaluation algorithm. The input is the structural data retrieved from the database, and the output is the Feng Shui score and points for improvement as the evaluation results.

[0160] Step 7:

[0161] Server: Generates specific furniture placement and color advice based on the Feng Shui evaluation results. The input is the Feng Shui evaluation results, and the output is JSON-formatted data containing specific advice.

[0162] Step 8:

[0163] Server: Sends the generated advice to the terminal as an HTTP response. The input is JSON data containing the advice, and the output is the HTTP response sent to the terminal.

[0164] Step 9:

[0165] Terminal: Decodes the received advice and updates the UI components. Specifically, it creates a layout using HTML and CSS to visually display the advice content. The input is advice data in JSON format, and the output is a visually displayed advice screen.

[0166] Step 10:

[0167] Terminal: Provides an interface that presents advice to the user and explains specific procedures for rearrangement. The input is a visually displayed advice screen, and the output is specific procedures for rearrangement provided to the user.

[0168] (Application example 1)

[0169] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0170] Conventional interior layout advice systems analyze the user's room blueprint data and propose optimal layouts and designs from a Feng Shui perspective. However, there are limited ways to visually confirm this advice. Furthermore, systems that allow users to simulate actual furniture layouts or experience them in virtual stores are not commonly used. This makes it difficult for users to intuitively understand the feasibility of the advice provided, and they lack the information necessary to make specific layout changes. This leads to issues such as reduced user satisfaction and reliability.

[0171] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0172] In this invention, the server includes means for uploading room plan data, means for analyzing the uploaded plan data, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for presenting the generated advice, means for visually displaying the advice in a virtual space, and means for experiencing furniture layout in a virtual store, thereby enabling a user to visually and intuitively understand the provided advice and perform an actual layout simulation in the virtual space.

[0173] "Room drawing data" is information in a digital file format that indicates the structure and layout of a room.

[0174] "Means for uploading" refers to a mechanism that allows a user to use a terminal to send room drawing data to a server.

[0175] The "analysis means" is a processing system that uses an image processing algorithm to identify the structure and each element of the room from the drawing data received by the server.

[0176] "Means for conducting a Feng Shui evaluation" refers to a method for applying the principles of Feng Shui to conduct an evaluation based on the analyzed information of the room.

[0177] The "means for generating advice" is a system that automatically creates optimal layout and design suggestions based on the results of the feng shui evaluation, taking into account the user's lifestyle and preferences.

[0178] The "means for presenting advice" is a means for notifying the user of the generated advice on placement or design visually or audibly.

[0179] "Means for visual display in virtual space" refers to a function that provides users with advice based on Feng Shui evaluation as a 3D model or virtual reality.

[0180] The "means for experiencing furniture arrangement in a virtual store" is a system that allows users to try out furniture arrangements in a virtual space.

[0181] This invention is a system that allows users to upload their own room plan data, analyzes it, and provides advice on optimal layout and design based on the principles of Feng Shui. This system utilizes a virtual store environment, in particular, allowing users to visually confirm advice and simulate furniture layout in a virtual space.

[0182] When a user uploads room plan data from their device, the device sends the data to the server. The server then analyzes the received plan data using image processing algorithms to extract information about the room structure and the location of each element. This analysis uses image processing libraries such as OpenCV.

[0183] The server then runs a feng shui evaluation algorithm based on the analyzed data. This algorithm evaluates the room's structure and furniture placement, and identifies areas for improvement and optimal placement based on the principles of feng shui. Specifically, it applies the concept of the eight cardinal directions and generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[0184] Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that suits the user's lifestyle and preferences. This advice includes suggestions for furniture placement and color usage, such as "place plants in the southeast corner" or "move the sofa to the north side." The generated advice is sent to the device in JSON format.

[0185] The device analyzes the received advice and converts it into a visually understandable format, such as creating furniture layout plans and color suggestions, which the user can view in a virtual space using a smartphone or head-mounted display.

[0186] For example, if a user uploads blueprints of a living room, the server will identify the shape of the room, the location of windows and doors, and the layout of existing furniture, and then propose the optimal layout and design based on that.The user can view the proposal in a virtual space using a head-mounted display, and can actually change the layout in a virtual store to simulate it.

[0187] An example of a prompt for the generative AI model is as follows:

[0188] "Analyze the drawing data, including the room footprint, window, door, and existing furniture locations, and generate optimal furniture placement advice based on Feng Shui principles. This advice includes specific furniture placement, color suggestions, and plant placement. For example, move the sofa to the north side of the living room and place plants in the southeast corner."

[0189] This allows users to visually and intuitively understand the advice provided and simulate actual layouts in a virtual space, ultimately helping users to create a comfortable and harmonious living space.

[0190] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0191] Step 1:

[0192] The user selects the room drawing data and sends an upload request from the terminal.

[0193] Input: User's drawing data (e.g. JPEG file)

[0194] Action: The user clicks the "Upload Drawing Data" button in the application.

[0195] Output: The drawing data is saved on the terminal and sent to the server.

[0196] Step 2:

[0197] The terminal transmits the uploaded drawing data to the server.

[0198] Input: Drawing data selected by the user in step 1

[0199] Operation: The terminal sends drawing data to the server as an HTTP request.

[0200] Output: The server receives the drawing data.

[0201] Step 3:

[0202] The server analyzes the received drawing data and extracts information about the room structure and the location of elements.

[0203] Input: Uploaded drawing data

[0204] How it works: The server uses image processing algorithms such as OpenCV to identify the location of walls, windows, doors and existing furniture in the room.

[0205] Output: Room structure information and element position information as analysis results

[0206] Step 4:

[0207] The server performs a feng shui evaluation based on the analyzed data.

[0208] Input: Analysis results from Step 3 (room structure information and element location information)

[0209] How it works: It applies Feng Shui algorithms to make an assessment based on, for example, the eight directions or the five elements.

[0210] Output: Feng Shui evaluation result (e.g. "The living room window is in the southeast, so it would be good to place some plants there.")

[0211] Step 5:

[0212] The server generates optimal placement and design advice based on the feng shui evaluation results.

[0213] Input: Step 4 Feng Shui evaluation results

[0214] How it works: Based on the results of the Feng Shui evaluation, it generates advice on furniture placement and color usage that suits the user's lifestyle and preferences.

[0215] Output: Specific placement advice (e.g., "Place plants in the southeast corner," "Move the sofa to the north side")

[0216] Step 6:

[0217] The server sends the generated advice to the terminal in JSON format.

[0218] Input: Specific placement advice for step 5

[0219] Behavior: The advice is converted to JSON format and sent to the device as an HTTP response.

[0220] Output: Advice in JSON format as received on the terminal

[0221] Step 7:

[0222] The device analyzes the received advice and displays it to the user in a visually easy-to-understand format.

[0223] Input: JSON format advice from step 6

[0224] How it works: Furniture layout plans and color suggestions are generated based on JSON data and reflected in the application interface.

[0225] Output: Layout and design proposals that users can visually check

[0226] Step 8:

[0227] Users can use a smartphone or head-mounted display to check and simulate proposed layouts and designs in a virtual space.

[0228] Input: Visual layout and design proposals from Step 7

[0229] How it works: The user wears a smartphone or a head-mounted display and manipulates and simulates the placement of furniture in a virtual space.

[0230] Output: Simulation of furniture arrangement in the virtual space experienced by the user

[0231] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0232] The present invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions.

[0233] Basic system configuration

[0234] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results and the user's emotional information, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[0235] Program processing

[0236] Uploading drawing data

[0237] 1. User: Select the room drawing data from the terminal and press the upload button.

[0238] 2. Terminal: Converts the drawing data into an appropriate format (e.g., JSON metadata) and sends it to the server.

[0239] Drawing data analysis

[0240] 3. Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[0241] 4. Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[0242] Recognizing user emotions

[0243] 5. On the device: An emotion engine is used to recognize the user's emotions (e.g., happiness, sadness, nervousness, etc.) in real time. This emotion data is obtained from input devices such as sensors and cameras.

[0244] 6. Terminal: Sends the recognized emotion data to the server.

[0245] Conducting a Feng Shui evaluation

[0246] 7. Server: Based on the stored metadata and sentiment data, it runs a Feng Shui evaluation algorithm and evaluates the room structure and layout based on Feng Shui principles.

[0247] 8. Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement, taking into account the user's emotional information.

[0248] Generating Advice

[0249] 9. Server: Based on the results of the Feng Shui evaluation and the emotional data, the server generates layout and design advice that is optimal for the user's emotional state. Specific examples of this advice include suggestions for furniture placement and color usage.

[0250] 10. Server: Sends the generated advice in JSON format to the device.

[0251] Providing advice

[0252] 11. Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[0253] 12. Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[0254] Specific examples

[0255] Living room improvements

[0256] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0257] 2. Terminal: Receives drawing data and sends it to the server.

[0258] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0259] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[0260] 5. Terminal: Using an emotion engine, the user's emotions are acquired from facial expressions, voice, etc., and sent to the server.

[0261] 6. Server: For example, it generates an evaluation result such as "The living room window is located in the southeast, so it would be good to place plants in this direction," and generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[0262] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[0263] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[0264] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[0265] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui and their own emotional state, thereby creating a comfortable and harmonious living space.

[0266] The processing flow will be explained below.

[0267] Step 1:

[0268] User: Select the room drawing data from the terminal and press the upload button.

[0269] Step 2:

[0270] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[0271] Step 3:

[0272] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[0273] Step 4:

[0274] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[0275] Step 5:

[0276] On the device: Recognizes the user's emotions in real time using an emotion engine. Emotion data is collected using methods such as facial expression analysis and voice analysis.

[0277] Step 6:

[0278] Terminal: Sends the recognized emotion data to the server.

[0279] Step 7:

[0280] Server: Executes the Feng Shui evaluation algorithm based on the stored analysis result metadata and the received emotion data.

[0281] Step 8:

[0282] Server: Based on the principles of Feng Shui, for example by applying the concept of the "eight directions," we analyze the structure and layout of a room and evaluate the flow and balance of energy.

[0283] Step 9:

[0284] Server: It also considers the user's emotional information and identifies areas that need improvement and the optimal layout. For example, if the user is looking for a relaxing environment, it will suggest a layout and color scheme that matches that emotion.

[0285] Step 10:

[0286] Server: Generates specific advice such as optimal furniture placement and color usage, including recommendations that reflect the user's emotional state.

[0287] Step 11:

[0288] Server: Sends the generated advice in JSON format to the device.

[0289] Step 12:

[0290] Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[0291] Step 13:

[0292] Terminal: Displays an interface that provides advice to the user, including specific rearrangement instructions and a list of recommended items.

[0293] Step 14:

[0294] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[0295] Specific examples

[0296] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0297] 2. Terminal: Receives drawing data and sends it to the server.

[0298] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0299] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[0300] 5. Terminal: The emotion engine analyzes the user's facial expressions and voice, and sends the user's emotion data to the server.

[0301] 6. Server: For example, it generates a Feng Shui assessment such as, "The living room window is located in the southeast, and placing plants in this direction will improve your luck," and generates advice based on the situation, such as suggesting calming colors if the user is looking for relaxation, or bright colors if the user is looking for vitality.

[0302] 7. Server: Create specific improvement advice such as "Place plants in the southeast corner" and "Move the sofa to the north side."

[0303] 8. Terminal: Analyzes the received advice and creates visual layout and color suggestions.

[0304] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[0305] In this way, users can achieve optimal room layout and design based on Feng Shui principles and their own emotional state, creating a comfortable and harmonious living space.

[0306] Example 2

[0307] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0308] Conventional Feng Shui evaluation systems simply provide advice on room layout and design based on the principles of Feng Shui, but do not take into account the user's emotional state, making it difficult to improve the user's psychological satisfaction and comfort.

[0309] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0310] In this invention, the server includes means for analyzing uploaded drawing data, means for performing a feng shui evaluation based on the analyzed drawing data, and means for generating advice on optimal layout and design based on the feng shui evaluation, thereby enabling suggestions for room layout and design that appropriately take into account the user's emotional state in addition to advice based on the principles of feng shui.

[0311] "Drawing data" is data that represents the layout and structure of a room, and is usually provided as an image file in JPEG or PNG format.

[0312] "Means for uploading" refers to the method by which a user sends drawing data to the system through a terminal.

[0313] "Means of analysis" refers to the process of extracting information such as room boundaries and furniture positions from the received drawing data.

[0314] "Means for conducting Feng Shui evaluation" refers to a method for evaluating the layout of a room in accordance with the principles of Feng Shui based on the analyzed data.

[0315] "Means for generating advice" refers to a method for generating optimal placement and design suggestions based on the results of the Feng Shui assessment and the user's emotional state.

[0316] The "means for presenting advice" refers to a method for displaying the generated advice to the user in a visually easy-to-understand format.

[0317] "Means for recognizing emotions" refers to a method for understanding a user's emotional state in real time from their facial expressions and voice.

[0318] "Means for using emotional data in analysis" refers to methods for incorporating recognized emotional information into the Feng Shui evaluation and advice generation process.

[0319] This invention is a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui. By combining this system with an emotion engine that recognizes the user's emotions, it is possible to improve the user's psychological satisfaction and comfort.

[0320] Basic system configuration

[0321] Hardware and Software

[0322] Terminal (user device): Uploads drawing data and performs emotion recognition. Smartphones, tablets, PCs, etc. are used.

[0323] Server: Analyzes the drawing data, performs Feng Shui evaluations, and generates advice. A high-performance processor and sufficient memory are recommended.

[0324] Image processing algorithms (OpenCV, TensorFlow, etc.): used to analyze drawing data.

[0325] Database (MySQL, Postgres, etc.): Used to store the parsed data.

[0326] Emotion Engine (Emotion API, Face Recognition API): Used to recognize user emotions.

[0327] Processing flow

[0328] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. The device then recognizes the user's emotions in real time and sends this emotional data to the server. The server generates optimal layout and design advice based on the results of the feng shui evaluation and the user's emotional information. This advice is then sent back to the device and presented to the user.

[0329] Specific examples

[0330] Living room improvements

[0331] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0332] 2. Terminal: Receives drawing data and sends it to the server.

[0333] 3. Server: Runs the algorithm used (e.g. OpenCV or TensorFlow) to determine the dimensions of the living room, the location of windows and doors, and the layout of existing furniture.

[0334] 4. Server: Performs Feng Shui evaluation based on the extracted information.

[0335] 5. Device: Using the Emotion API, emotions are acquired from the user's facial expressions, voice, etc. and sent to the server.

[0336] 6. Server: Generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction." If the user is relaxed, it suggests calm colors, and if they are feeling down, it suggests bright colors.

[0337] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[0338] 8. Terminal: Analyzes the received advice and converts it into a visually understandable format.

[0339] 9. Terminal: Provide advice in the user interface, including specific steps for reconfiguring the device.

[0340] Prompt Sentence Examples

[0341] Here are some example prompts to input to a generative AI model:

[0342] Please provide a detailed explanation of each step in your system, including the algorithms, tools, and data formats used, in order to allow users to upload a living room blueprint and receive optimal room improvement advice based on Feng Shui and emotions. For example, please mention image processing using OpenCV and emotion recognition using EmotionAPI.

[0343] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0344] Step 1:

[0345] User: Select the room drawing data and press the upload button on the device.

[0346] Input: Room plan data in JPEG or PNG format.

[0347] Operation: Select the drawing data on the terminal and press the upload button to register the drawing data in the system.

[0348] Step 2:

[0349] Terminal: Converts the drawing data into an appropriate format (metadata in JSON format) and sends it to the server.

[0350] Input: Drawing data in JPEG or PNG format.

[0351] Output: Metadata in JSON format.

[0352] Operation: The drawing data is read, basic information about the drawing (file name, upload date and time, etc.) is converted to JSON format, and sent to the server via the Internet.

[0353] Step 3:

[0354] Server: Analyzes the received drawing data using image processing algorithms (such as OpenCV or TensorFlow).

[0355] Input: Metadata in JSON format.

[0356] Output: The resulting room boundaries, positions and dimensions of windows, doors and existing furniture.

[0357] How it works: It runs image processing algorithms to analyze the location and dimensions of each element in the room (boundaries, windows, doors, furniture).

[0358] Step 4:

[0359] Server: Stores the analyzed information in a database and generates metadata.

[0360] Input: The resulting location and dimensions of each element in the room.

[0361] Output: Analysis results and associated metadata stored in a database.

[0362] Operation: The analysis results are stored in a database and metadata required for subsequent processing is generated.

[0363] Step 5:

[0364] Terminal: Using an emotion engine (Emotion API, Face Recognition API, etc.), the user's emotions are recognized in real time and sent to the server.

[0365] Input: User's facial and voice data.

[0366] Output: Sentiment data in JSON format.

[0367] How it works: The user's facial expressions and voice are captured through the camera and microphone, analyzed by the emotion engine, and the results are sent to the server in JSON format.

[0368] Step 6:

[0369] Server: Runs the Feng Shui evaluation algorithm based on the stored metadata and sentiment data.

[0370] Input: Metadata, emotion data.

[0371] Output: Feng Shui evaluation results.

[0372] How it works: Analyzes and evaluates the structure and energy flow of a room based on the principles of Feng Shui.

[0373] Step 7:

[0374] Server: Based on the results of the Feng Shui evaluation and emotional data, it generates placement and design advice that is optimal for the user's emotional state.

[0375] Input: Feng Shui evaluation results, emotion data.

[0376] Output: Furniture placement and color suggestions as advice.

[0377] How it works: Generates optimal layout and design suggestions based on Feng Shui assessment and emotion data. Specifically, it suggests furniture placement and color usage.

[0378] Step 8:

[0379] Server: Sends the generated advice in JSON format to the device.

[0380] Input: Advice on placement and design suggestions.

[0381] Output: Advice data in JSON format.

[0382] Operation: The generated advice is converted into JSON format and sent to the terminal.

[0383] Step 9:

[0384] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format.

[0385] Input: Advice data in JSON format.

[0386] Output: Furniture layout and color suggestions.

[0387] How it works: Parses advice data in JSON format and generates a visually friendly interface using HTML, CSS, and JavaScript.

[0388] Step 10:

[0389] Terminal: Displays an interface that presents advice to the user.

[0390] Input: Furniture layout and color suggestions.

[0391] Output: A user-friendly interface.

[0392] How it works: The user interface displays specific rearrangement steps and visual suggestions, making it easy for users to follow the advice.

[0393] (Application example 2)

[0394] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0395] Conventional Feng Shui evaluation systems only provide layout advice based on room diagram data and are unable to provide advice that takes user emotions into account. As a result, they lack consideration for the user's actual comfort and satisfaction, limiting their ability to provide optimal living spaces. Furthermore, even in commercial spaces such as virtual stores, there is a need for layout adjustments based on the real-time changing emotions of customers and staff.

[0396] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0397] In this invention, the server includes means for analyzing drawing data, means for recognizing a user's emotion, and means for generating advice based on the analyzed drawing data and the user's emotion, thereby providing advice on optimal layout and design based on the user's emotion, making it possible to realize a more comfortable and satisfying residential or commercial space.

[0398] "Room drawing data" is information that indicates the layout of the room, the position and dimensions of the furniture, etc.

[0399] "Uploading" is the act of sending data from a local device to a remote system, such as a server.

[0400] "Analysis" is the process of processing data and extracting meaningful information from it.

[0401] A "Feng Shui evaluation" is the process of assessing the energy flow and balance of a room based on the principles of Feng Shui.

[0402] "Optimal placement and design advice" refers to suggestions for furniture placement and color based on the results of the Feng Shui evaluation.

[0403] "Means for recognizing user emotions" refers to means for recognizing emotions in real time from the user's facial expressions and voice using cameras and audio sensors.

[0404] "Means for presenting generated advice" refers to a method for presenting analysis results and advice to the user in a visually easy-to-understand manner.

[0405] "Room elements" refers to the physical structures in a room, such as walls, furniture, windows, and doors.

[0406] "Furniture placement and color suggestions" refers to specific advice on where to place furniture and the colors to use in the room.

[0407] This invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions. This system is mainly composed of three elements: a server, a terminal, and the user.

[0408] Basic system configuration

[0409] 1. Upload the drawing data

[0410] A user uploads room drawing data via a terminal, which converts the data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[0411] 2. Analysis of drawing data

[0412] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores the analyzed information in a database. It then generates metadata for the analysis results according to a feng shui evaluation algorithm.

[0413] 3. User Emotion Recognition

[0414] The device uses an emotion engine to acquire the user's emotions in real time from cameras and sensors, including facial and voice data, and sends it to the server as emotion data.

[0415] 4. Conduct a Feng Shui assessment

[0416] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[0417] 5. Generating Advice

[0418] The server generates optimal layout and design advice based on the user's emotional state based on the results of the Feng Shui evaluation and the emotional data. This advice includes specific suggestions for furniture placement and color usage. The generated advice is then sent to the device in JSON format.

[0419] 6. Providing advice

[0420] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and displays an interface to present to the user, suggesting specific steps for rearrangement and a list of recommended items.

[0421] Specific examples

[0422] Living room improvements

[0423] 1. A user uploads a drawing of a living room. The drawing data can be, for example, a JPEG image.

[0424] 2. The device sends the drawing data to a server, which uses image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0425] 3. The device uses an emotion engine to recognize the user's emotions based on facial expressions and voice data acquired from cameras and microphones, and transmits the emotions to the server.

[0426] 4. The server runs the Feng Shui evaluation algorithm and combines the analysis results metadata with the emotion data to make an evaluation.

[0427] 5. For example, based on the Feng Shui evaluation result that "the living room window is located in the southeast, so it is good to place plants in this direction," the system generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[0428] 6. The device analyzes the generated advice and presents it to the user as a visual layout diagram and color proposal, allowing the user to confirm specific steps for re-arrangement.

[0429] Prompt Sentence Examples

[0430] "Virtual store Feng Shui evaluation system: Based on store drawing data and real-time collected sentiment data, it generates optimal store layout and interior placement advice in accordance with Feng Shui principles. The specific steps are as follows:

[0431] 1. Upload the store's blueprint data.

[0432] 2. Use sensors and cameras to collect real-time voice and facial expression data in-store.

[0433] 3. Analyze the drawing data and extract the store's important elements (walls, windows, furniture, etc.).

[0434] 4. Run the Feng Shui evaluation algorithm based on the sentiment data.

[0435] 5. Combine the analysis results with sentiment data to generate optimal store layout and interior design advice.

[0436] 6. Based on the advice provided, we will display a visual suggesting specific changes to the layout.

[0437] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0438] Step 1:

[0439] Uploading drawing data

[0440] The user selects the room plan data via the terminal and presses the upload button. The terminal converts this plan data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[0441] Input: Room drawing data (JPEG, PNG, etc.)

[0442] Output: Metadata in JSON format

[0443] Step 2:

[0444] Drawing data analysis

[0445] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores this information in a database.

[0446] Input: JSON formatted metadata

[0447] Output: Analysis result metadata (room element information)

[0448] Step 3:

[0449] User Emotion Recognition

[0450] The device uses an emotion engine to acquire the user's real-time emotional data (facial expressions and voice) from cameras and sensors and transmits it to the server as emotional data.

[0451] Input: User's facial expressions and voice data

[0452] Output: User emotion data

[0453] Step 4:

[0454] Conducting a Feng Shui evaluation

[0455] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[0456] Input: Metadata of analysis results, user emotion data

[0457] Output: Feng Shui evaluation results

[0458] Step 5:

[0459] Generating Advice

[0460] The server generates optimal layout and design advice based on the results of the Feng Shui evaluation and emotional data. This advice includes specific examples such as furniture placement and color usage. The advice is also tailored to the user's emotional state.

[0461] Input: Feng Shui evaluation results, user emotion data

[0462] Output: JSON data of the advice

[0463] Step 6:

[0464] Providing advice

[0465] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and then presents the user with specific rearrangement procedures and a list of recommended items.

[0466] Input: JSON data for advice

[0467] Output: Visual layout, color suggestions, and layout change instructions

[0468] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0469] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0470] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0471] [Second embodiment]

[0472] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0473] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0474] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0475] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0476] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0477] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0478] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0479] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0480] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0481] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0482] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0483] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0484] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The embodiments for carrying out the present invention will be described in detail below.

[0485] Basic system configuration

[0486] Users upload room plan data via their devices. The devices then send this data to the server. The server analyzes the received data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[0487] Program processing

[0488] Uploading drawing data

[0489] 1. User: Select the room drawing data from the terminal and press the upload button.

[0490] 2. Terminal: Receives drawing data and sends it to the server.

[0491] Drawing data analysis

[0492] 3. Server: Once the drawing data is received, image processing algorithms are used to extract information such as room boundaries, window and door locations, and the placement of existing furniture.

[0493] 4. Server: Stores the extracted information in a database.

[0494] Conducting a Feng Shui evaluation

[0495] 5. Server: Based on the stored data, the Feng Shui evaluation algorithm is executed. The evaluation algorithm applies the concept of the eight directions, for example, to evaluate the structure and layout of the room from the perspective of Feng Shui.

[0496] 6. Server: Based on the evaluation results, identify areas that need improvement and the optimal layout.

[0497] Generating Advice

[0498] 7. Server: Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that matches the user's lifestyle and preferences. Specific examples of this advice include suggestions for furniture placement and color usage.

[0499] 8. Server: Sends the generated advice in JSON format to the device.

[0500] Providing advice

[0501] 9. Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[0502] 10. Terminal: Displays an interface that provides advice to the user.

[0503] Specific examples

[0504] Living room improvements

[0505] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0506] 2. Terminal: Receives drawing data and sends it to the server.

[0507] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0508] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[0509] 5. Server: Generates an evaluation result, for example, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[0510] 6. Server: Generates improvement advice such as "place plants in the southeast corner" or "move the sofa to the north side."

[0511] 7. Server: Sends advice in JSON format to the device.

[0512] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[0513] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[0514] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui, and to create a comfortable and harmonious living space.

[0515] The processing flow will be explained below.

[0516] Step 1:

[0517] User: Select the room drawing data from the terminal and press the upload button.

[0518] Step 2:

[0519] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[0520] Step 3:

[0521] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[0522] Step 4:

[0523] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[0524] Step 5:

[0525] Server: Based on the stored metadata, it runs a feng shui evaluation algorithm and evaluates the room's structure and layout based on feng shui principles.

[0526] Step 6:

[0527] Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement.

[0528] Step 7:

[0529] Server: Based on the results of the Feng Shui evaluation, it generates advice on optimal furniture placement, color usage, etc.

[0530] Step 8:

[0531] Server: Sends the generated advice in JSON format to the device.

[0532] Step 9:

[0533] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[0534] Step 10:

[0535] Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[0536] Step 11:

[0537] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[0538] Example 1

[0539] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0540] Modern interior design requires optimal furniture placement and color design based on the principles of Feng Shui. However, conventional methods require specialized knowledge and are difficult for average users. Furthermore, manual analysis is time-consuming and inefficient. Therefore, there is a need for a system that allows users to easily create interior designs based on the principles of Feng Shui.

[0541] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0542] In this invention, the server includes means for transmitting room plan data to the server, means for analyzing the plan data transmitted to the server, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for transmitting the generated advice to a terminal, and means for visually presenting the advice received by the terminal, thereby enabling a user to easily and efficiently achieve an optimal interior design based on the principles of feng shui even without specialized knowledge.

[0543] "Room plan data" refers to images or electronic files that contain information about the interior structure and furniture layout.

[0544] "Uploading" refers to the act of sending data from a user's terminal to a server via a network.

[0545] A "server" is a computer system that receives, analyzes, evaluates data, and generates and sends advice to users.

[0546] "Analysis" refers to the process of using image processing techniques and algorithms to identify room structure and furniture layout from drawing data.

[0547] A "feng shui evaluation" is the process of analyzing a room's structure and layout based on the principles of feng shui and determining whether it is good or bad.

[0548] "Layout" refers to the planning and layout of how furniture and decorations are arranged in a room.

[0549] "Design" refers to design guidelines such as furniture placement and color selection based on the room's feng shui.

[0550] "Advice" refers to specific improvements or recommendations proposed to the user based on the Feng Shui assessment.

[0551] The "JSON format" is a lightweight data format for structuring, storing, and transmitting data, and primarily represents data as key-value pairs.

[0552] A "terminal" refers to an electronic device such as a computer or smartphone used by a user.

[0553] "Visual presentation" refers to the act of displaying analysis results and advice to the user in an easy-to-read format such as figures, graphs, or layout diagrams.

[0554] The present invention is a system that allows users to upload room plan data, performs a feng shui evaluation based on that data, and provides advice on optimal layout and design.

[0555] Basic system configuration

[0556] Users upload room plan data using devices such as personal computers or smartphones. The devices then send the uploaded plan data to a server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[0557] Hardware and software used

[0558] 1. Hardware:

[0559] User devices: personal computers, smartphones, etc.

[0560] Server: A server computer for data processing and storage.

[0561] 2. Software:

[0562] Image processing library: OpenCV

[0563] Database: MySQL

[0564] Programming language: Python (implementation of Feng Shui evaluation algorithm)

[0565] Interface design tool: Adobe XD

[0566] Program processing overview

[0567] 1. Upload drawing data:

[0568] The user uses the terminal to select the room drawing data and presses the upload button.

[0569] The terminal receives the drawing data and sends it to the server via an HTTP request.

[0570] 2. Drawing data analysis:

[0571] The server stores the received drawing data in a temporary directory and executes image processing algorithms using the OpenCV library.

[0572] The server converts the information extracted by image processing into structured data (e.g., JSON format) and stores it in a MySQL database.

[0573] 3. Conduct a Feng Shui assessment:

[0574] The server retrieves the stored data and runs a feng shui evaluation algorithm implemented in Python.

[0575] As an evaluation result, the server identifies the Feng Shui score and areas for improvement for each area and saves them in JSON format.

[0576] 4. Generating Advice:

[0577] The server uses automated scripts to generate specific placement and design advice based on the results of the feng shui assessment.

[0578] The server encodes the generated advice in JSON format and sends it to the terminal as an HTTP response.

[0579] 5. Providing advice:

[0580] The device decodes the received advice data and updates various UI components.

[0581] The terminal displays an interface for the user, presenting analysis results and design suggestions.

[0582] Specific examples

[0583] Living room improvements

[0584] 1. User: Selects the blueprint data (JPEG format) of his / her living room and clicks the button to upload.

[0585] 2. Terminal: Sends the selected drawing data to the server as an HTTP request.

[0586] 3. Server: Analyzes the drawing data using OpenCV to determine room dimensions and furniture layout.

[0587] 4. Server: The extracted data is stored in MySQL and the Feng Shui evaluation algorithm implemented in Python is executed.

[0588] 5. Server: Generates a Feng Shui evaluation result, such as "The living room window is located in the southeast, so it would be good to place plants in this direction."

[0589] 6. Server: Generates suggestions in JSON format as realization advice, such as "Place plants in the southeast corner" or "Move the sofa to the north side."

[0590] 7. Server: Sends the generated advice to the terminal as a response.

[0591] 8. Terminal: Parses the received advice and creates a visual layout using HTML and CSS.

[0592] 9. Terminal: Provides an interface that displays advice to the user and explains specific steps for reconfiguration.

[0593] Prompt Sentence Examples

[0594] "I want to upload a blueprint of my living room and receive advice based on Feng Shui."

[0595] "I'd like to improve the feng shui of my bedroom layout. Could you please analyze the blueprint data and give me some advice?"

[0596] This system allows users to easily and efficiently create optimal interior designs based on Feng Shui principles, even without specialized knowledge.

[0597] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0598] Step 1:

[0599] User: Uses the terminal to select the room drawing data and presses the upload button. The input is the file selected by the user, and the output is the selected drawing data (e.g., JPEG format).

[0600] Step 2:

[0601] Terminal: Reads the selected drawing data, creates an HTTP request, and sends it to the server. The input is the drawing data selected by the user, and the output is an HTTP request sent to the server. At this time, the file data is sent in multipart format.

[0602] Step 3:

[0603] Server: Receives drawing data and saves it in a temporary directory. The input is the drawing data sent from the terminal, and the output is a drawing file saved in the temporary directory.

[0604] Step 4:

[0605] Server: Analyzes the drawing data using the OpenCV library. Specifically, it performs edge detection and contour extraction to recognize room boundaries and furniture layout. The input is the drawing file saved in a temporary directory, and the output is the room structure data extracted as the analysis result.

[0606] Step 5:

[0607] Server: The analysis results are converted into JSON format and saved in a MySQL database. The input is the structure data obtained by the analysis, and the output is the Feng Shui evaluation data saved in the database.

[0608] Step 6:

[0609] Server: Retrieves structural data from the MySQL database and executes the Feng Shui evaluation algorithm. The input is the structural data retrieved from the database, and the output is the Feng Shui score and points for improvement as the evaluation results.

[0610] Step 7:

[0611] Server: Generates specific furniture placement and color advice based on the Feng Shui evaluation results. The input is the Feng Shui evaluation results, and the output is JSON-formatted data containing specific advice.

[0612] Step 8:

[0613] Server: Sends the generated advice to the terminal as an HTTP response. The input is JSON data containing the advice, and the output is the HTTP response sent to the terminal.

[0614] Step 9:

[0615] Terminal: Decodes the received advice and updates the UI components. Specifically, it creates a layout using HTML and CSS to visually display the advice content. The input is advice data in JSON format, and the output is a visually displayed advice screen.

[0616] Step 10:

[0617] Terminal: Provides an interface that presents advice to the user and explains specific procedures for rearrangement. The input is a visually displayed advice screen, and the output is specific procedures for rearrangement provided to the user.

[0618] (Application example 1)

[0619] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0620] Conventional interior layout advice systems analyze the user's room blueprint data and propose optimal layouts and designs from a Feng Shui perspective. However, there are limited ways to visually confirm this advice. Furthermore, systems that allow users to simulate actual furniture layouts or experience them in virtual stores are not commonly used. This makes it difficult for users to intuitively understand the feasibility of the advice provided, and they lack the information necessary to make specific layout changes. This leads to issues such as reduced user satisfaction and reliability.

[0621] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0622] In this invention, the server includes means for uploading room plan data, means for analyzing the uploaded plan data, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for presenting the generated advice, means for visually displaying the advice in a virtual space, and means for experiencing furniture layout in a virtual store, thereby enabling a user to visually and intuitively understand the provided advice and perform an actual layout simulation in the virtual space.

[0623] "Room drawing data" is information in a digital file format that indicates the structure and layout of a room.

[0624] "Means for uploading" refers to a mechanism that allows a user to use a terminal to send room drawing data to a server.

[0625] The "analysis means" is a processing system that uses an image processing algorithm to identify the structure and each element of the room from the drawing data received by the server.

[0626] "Means for conducting a Feng Shui evaluation" refers to a method for applying the principles of Feng Shui to conduct an evaluation based on the analyzed information of the room.

[0627] The "means for generating advice" is a system that automatically creates optimal layout and design suggestions based on the results of the feng shui evaluation, taking into account the user's lifestyle and preferences.

[0628] The "means for presenting advice" is a means for notifying the user of the generated advice on placement or design visually or audibly.

[0629] "Means for visual display in virtual space" refers to a function that provides users with advice based on Feng Shui evaluation as a 3D model or virtual reality.

[0630] The "means for experiencing furniture arrangement in a virtual store" is a system that allows users to try out furniture arrangements in a virtual space.

[0631] This invention is a system that allows users to upload their own room plan data, analyzes it, and provides advice on optimal layout and design based on the principles of Feng Shui. This system utilizes a virtual store environment, in particular, allowing users to visually confirm advice and simulate furniture layout in a virtual space.

[0632] When a user uploads room plan data from their device, the device sends the data to the server. The server then analyzes the received plan data using image processing algorithms to extract information about the room structure and the location of each element. This analysis uses image processing libraries such as OpenCV.

[0633] The server then runs a feng shui evaluation algorithm based on the analyzed data. This algorithm evaluates the room's structure and furniture placement, and identifies areas for improvement and optimal placement based on the principles of feng shui. Specifically, it applies the concept of the eight cardinal directions and generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[0634] Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that suits the user's lifestyle and preferences. This advice includes suggestions for furniture placement and color usage, such as "place plants in the southeast corner" or "move the sofa to the north side." The generated advice is sent to the device in JSON format.

[0635] The device analyzes the received advice and converts it into a visually understandable format, such as creating furniture layout plans and color suggestions, which the user can view in a virtual space using a smartphone or head-mounted display.

[0636] For example, if a user uploads blueprints of a living room, the server will identify the shape of the room, the location of windows and doors, and the layout of existing furniture, and then propose the optimal layout and design based on that.The user can view the proposal in a virtual space using a head-mounted display, and can actually change the layout in a virtual store to simulate it.

[0637] An example of a prompt for the generative AI model is as follows:

[0638] "Analyze the drawing data, including the room footprint, window, door, and existing furniture locations, and generate optimal furniture placement advice based on Feng Shui principles. This advice includes specific furniture placement, color suggestions, and plant placement. For example, move the sofa to the north side of the living room and place plants in the southeast corner."

[0639] This allows users to visually and intuitively understand the advice provided and simulate actual layouts in a virtual space, ultimately helping users to create a comfortable and harmonious living space.

[0640] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0641] Step 1:

[0642] The user selects the room drawing data and sends an upload request from the terminal.

[0643] Input: User's drawing data (e.g. JPEG file)

[0644] Action: The user clicks the "Upload Drawing Data" button in the application.

[0645] Output: The drawing data is saved on the terminal and sent to the server.

[0646] Step 2:

[0647] The terminal transmits the uploaded drawing data to the server.

[0648] Input: Drawing data selected by the user in step 1

[0649] Operation: The terminal sends drawing data to the server as an HTTP request.

[0650] Output: The server receives the drawing data.

[0651] Step 3:

[0652] The server analyzes the received drawing data and extracts information about the room structure and the location of elements.

[0653] Input: Uploaded drawing data

[0654] How it works: The server uses image processing algorithms such as OpenCV to identify the location of walls, windows, doors and existing furniture in the room.

[0655] Output: Room structure information and element position information as analysis results

[0656] Step 4:

[0657] The server performs a feng shui evaluation based on the analyzed data.

[0658] Input: Analysis results from Step 3 (room structure information and element location information)

[0659] How it works: It applies Feng Shui algorithms to make an assessment based on, for example, the eight directions or the five elements.

[0660] Output: Feng Shui evaluation result (e.g. "The living room window is in the southeast, so it would be good to place some plants there.")

[0661] Step 5:

[0662] The server generates optimal placement and design advice based on the feng shui evaluation results.

[0663] Input: Step 4 Feng Shui evaluation results

[0664] How it works: Based on the results of the Feng Shui evaluation, it generates advice on furniture placement and color usage that suits the user's lifestyle and preferences.

[0665] Output: Specific placement advice (e.g., "Place plants in the southeast corner," "Move the sofa to the north side")

[0666] Step 6:

[0667] The server sends the generated advice to the terminal in JSON format.

[0668] Input: Specific placement advice for step 5

[0669] Behavior: The advice is converted to JSON format and sent to the device as an HTTP response.

[0670] Output: Advice in JSON format as received on the terminal

[0671] Step 7:

[0672] The device analyzes the received advice and displays it to the user in a visually easy-to-understand format.

[0673] Input: JSON format advice from step 6

[0674] How it works: Furniture layout plans and color suggestions are generated based on JSON data and reflected in the application interface.

[0675] Output: Layout and design proposals that users can visually check

[0676] Step 8:

[0677] Users can use a smartphone or head-mounted display to check and simulate proposed layouts and designs in a virtual space.

[0678] Input: Visual layout and design proposals from Step 7

[0679] How it works: The user wears a smartphone or a head-mounted display and manipulates and simulates the placement of furniture in a virtual space.

[0680] Output: Simulation of furniture arrangement in the virtual space experienced by the user

[0681] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0682] The present invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions.

[0683] Basic system configuration

[0684] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results and the user's emotional information, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[0685] Program processing

[0686] Uploading drawing data

[0687] 1. User: Select the room drawing data from the terminal and press the upload button.

[0688] 2. Terminal: Converts the drawing data into an appropriate format (e.g., JSON metadata) and sends it to the server.

[0689] Drawing data analysis

[0690] 3. Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[0691] 4. Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[0692] Recognizing user emotions

[0693] 5. On the device: An emotion engine is used to recognize the user's emotions (e.g., happiness, sadness, nervousness, etc.) in real time. This emotion data is obtained from input devices such as sensors and cameras.

[0694] 6. Terminal: Sends the recognized emotion data to the server.

[0695] Conducting a Feng Shui evaluation

[0696] 7. Server: Based on the stored metadata and sentiment data, it runs a Feng Shui evaluation algorithm and evaluates the room structure and layout based on Feng Shui principles.

[0697] 8. Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement, taking into account the user's emotional information.

[0698] Generating Advice

[0699] 9. Server: Based on the results of the Feng Shui evaluation and the emotional data, the server generates layout and design advice that is optimal for the user's emotional state. Specific examples of this advice include suggestions for furniture placement and color usage.

[0700] 10. Server: Sends the generated advice in JSON format to the device.

[0701] Providing advice

[0702] 11. Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[0703] 12. Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[0704] Specific examples

[0705] Living room improvements

[0706] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0707] 2. Terminal: Receives drawing data and sends it to the server.

[0708] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0709] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[0710] 5. Terminal: Using an emotion engine, the user's emotions are acquired from facial expressions, voice, etc., and sent to the server.

[0711] 6. Server: For example, it generates an evaluation result such as "The living room window is located in the southeast, so it would be good to place plants in this direction," and generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[0712] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[0713] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[0714] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[0715] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui and their own emotional state, thereby creating a comfortable and harmonious living space.

[0716] The processing flow will be explained below.

[0717] Step 1:

[0718] User: Select the room drawing data from the terminal and press the upload button.

[0719] Step 2:

[0720] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[0721] Step 3:

[0722] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[0723] Step 4:

[0724] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[0725] Step 5:

[0726] On the device: Recognizes the user's emotions in real time using an emotion engine. Emotion data is collected using methods such as facial expression analysis and voice analysis.

[0727] Step 6:

[0728] Terminal: Sends the recognized emotion data to the server.

[0729] Step 7:

[0730] Server: Executes the Feng Shui evaluation algorithm based on the stored analysis result metadata and the received emotion data.

[0731] Step 8:

[0732] Server: Based on the principles of Feng Shui, for example by applying the concept of the "eight directions," we analyze the structure and layout of a room and evaluate the flow and balance of energy.

[0733] Step 9:

[0734] Server: It also considers the user's emotional information and identifies areas that need improvement and the optimal layout. For example, if the user is looking for a relaxing environment, it will suggest a layout and color scheme that matches that emotion.

[0735] Step 10:

[0736] Server: Generates specific advice such as optimal furniture placement and color usage, including recommendations that reflect the user's emotional state.

[0737] Step 11:

[0738] Server: Sends the generated advice in JSON format to the device.

[0739] Step 12:

[0740] Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[0741] Step 13:

[0742] Terminal: Displays an interface that provides advice to the user, including specific rearrangement instructions and a list of recommended items.

[0743] Step 14:

[0744] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[0745] Specific examples

[0746] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0747] 2. Terminal: Receives drawing data and sends it to the server.

[0748] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0749] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[0750] 5. Terminal: The emotion engine analyzes the user's facial expressions and voice, and sends the user's emotion data to the server.

[0751] 6. Server: For example, it generates a Feng Shui assessment such as, "The living room window is located in the southeast, and placing plants in this direction will improve your luck," and generates advice based on the situation, such as suggesting calming colors if the user is looking for relaxation, or bright colors if the user is looking for vitality.

[0752] 7. Server: Create specific improvement advice such as "Place plants in the southeast corner" and "Move the sofa to the north side."

[0753] 8. Terminal: Analyzes the received advice and creates visual layout and color suggestions.

[0754] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[0755] In this way, users can achieve optimal room layout and design based on Feng Shui principles and their own emotional state, creating a comfortable and harmonious living space.

[0756] Example 2

[0757] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0758] Conventional Feng Shui evaluation systems simply provide advice on room layout and design based on the principles of Feng Shui, but do not take into account the user's emotional state, making it difficult to improve the user's psychological satisfaction and comfort.

[0759] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0760] In this invention, the server includes means for analyzing uploaded drawing data, means for performing a feng shui evaluation based on the analyzed drawing data, and means for generating advice on optimal layout and design based on the feng shui evaluation, thereby enabling suggestions for room layout and design that appropriately take into account the user's emotional state in addition to advice based on the principles of feng shui.

[0761] "Drawing data" is data that represents the layout and structure of a room, and is usually provided as an image file in JPEG or PNG format.

[0762] "Means for uploading" refers to the method by which a user sends drawing data to the system through a terminal.

[0763] "Means of analysis" refers to the process of extracting information such as room boundaries and furniture positions from the received drawing data.

[0764] "Means for conducting Feng Shui evaluation" refers to a method for evaluating the layout of a room in accordance with the principles of Feng Shui based on the analyzed data.

[0765] "Means for generating advice" refers to a method for generating optimal placement and design suggestions based on the results of the Feng Shui assessment and the user's emotional state.

[0766] The "means for presenting advice" refers to a method for displaying the generated advice to the user in a visually easy-to-understand format.

[0767] "Means for recognizing emotions" refers to a method for understanding a user's emotional state in real time from their facial expressions and voice.

[0768] "Means for using emotional data in analysis" refers to methods for incorporating recognized emotional information into the Feng Shui evaluation and advice generation process.

[0769] This invention is a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui. By combining this system with an emotion engine that recognizes the user's emotions, it is possible to improve the user's psychological satisfaction and comfort.

[0770] Basic system configuration

[0771] Hardware and Software

[0772] Terminal (user device): Uploads drawing data and performs emotion recognition. Smartphones, tablets, PCs, etc. are used.

[0773] Server: Analyzes the drawing data, performs Feng Shui evaluations, and generates advice. A high-performance processor and sufficient memory are recommended.

[0774] Image processing algorithms (OpenCV, TensorFlow, etc.): used to analyze drawing data.

[0775] Database (MySQL, Postgres, etc.): Used to store the parsed data.

[0776] Emotion Engine (Emotion API, Face Recognition API): Used to recognize user emotions.

[0777] Processing flow

[0778] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. The device then recognizes the user's emotions in real time and sends this emotional data to the server. The server generates optimal layout and design advice based on the results of the feng shui evaluation and the user's emotional information. This advice is then sent back to the device and presented to the user.

[0779] Specific examples

[0780] Living room improvements

[0781] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0782] 2. Terminal: Receives drawing data and sends it to the server.

[0783] 3. Server: Runs the algorithm used (e.g. OpenCV or TensorFlow) to determine the dimensions of the living room, the location of windows and doors, and the layout of existing furniture.

[0784] 4. Server: Performs Feng Shui evaluation based on the extracted information.

[0785] 5. Device: Using the Emotion API, emotions are acquired from the user's facial expressions, voice, etc. and sent to the server.

[0786] 6. Server: Generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction." If the user is relaxed, it suggests calm colors, and if they are feeling down, it suggests bright colors.

[0787] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[0788] 8. Terminal: Analyzes the received advice and converts it into a visually understandable format.

[0789] 9. Terminal: Provide advice in the user interface, including specific steps for reconfiguring the device.

[0790] Prompt Sentence Examples

[0791] Here are some example prompts to input to a generative AI model:

[0792] Please provide a detailed explanation of each step in your system, including the algorithms, tools, and data formats used, in order to allow users to upload a living room blueprint and receive optimal room improvement advice based on Feng Shui and emotions. For example, please mention image processing using OpenCV and emotion recognition using EmotionAPI.

[0793] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0794] Step 1:

[0795] User: Select the room drawing data and press the upload button on the device.

[0796] Input: Room plan data in JPEG or PNG format.

[0797] Operation: Select the drawing data on the terminal and press the upload button to register the drawing data in the system.

[0798] Step 2:

[0799] Terminal: Converts the drawing data into an appropriate format (metadata in JSON format) and sends it to the server.

[0800] Input: Drawing data in JPEG or PNG format.

[0801] Output: Metadata in JSON format.

[0802] Operation: The drawing data is read, basic information about the drawing (file name, upload date and time, etc.) is converted to JSON format, and sent to the server via the Internet.

[0803] Step 3:

[0804] Server: Analyzes the received drawing data using image processing algorithms (such as OpenCV or TensorFlow).

[0805] Input: Metadata in JSON format.

[0806] Output: The resulting room boundaries, positions and dimensions of windows, doors and existing furniture.

[0807] How it works: It runs image processing algorithms to analyze the location and dimensions of each element in the room (boundaries, windows, doors, furniture).

[0808] Step 4:

[0809] Server: Stores the analyzed information in a database and generates metadata.

[0810] Input: The resulting location and dimensions of each element in the room.

[0811] Output: Analysis results and associated metadata stored in a database.

[0812] Operation: The analysis results are stored in a database and metadata required for subsequent processing is generated.

[0813] Step 5:

[0814] Terminal: Using an emotion engine (Emotion API, Face Recognition API, etc.), the user's emotions are recognized in real time and sent to the server.

[0815] Input: User's facial and voice data.

[0816] Output: Sentiment data in JSON format.

[0817] How it works: The user's facial expressions and voice are captured through the camera and microphone, analyzed by the emotion engine, and the results are sent to the server in JSON format.

[0818] Step 6:

[0819] Server: Runs the Feng Shui evaluation algorithm based on the stored metadata and sentiment data.

[0820] Input: Metadata, emotion data.

[0821] Output: Feng Shui evaluation results.

[0822] How it works: Analyzes and evaluates the structure and energy flow of a room based on the principles of Feng Shui.

[0823] Step 7:

[0824] Server: Based on the results of the Feng Shui evaluation and emotional data, it generates placement and design advice that is optimal for the user's emotional state.

[0825] Input: Feng Shui evaluation results, emotion data.

[0826] Output: Furniture placement and color suggestions as advice.

[0827] How it works: Generates optimal layout and design suggestions based on Feng Shui assessment and emotion data. Specifically, it suggests furniture placement and color usage.

[0828] Step 8:

[0829] Server: Sends the generated advice in JSON format to the device.

[0830] Input: Advice on placement and design suggestions.

[0831] Output: Advice data in JSON format.

[0832] Operation: The generated advice is converted into JSON format and sent to the terminal.

[0833] Step 9:

[0834] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format.

[0835] Input: Advice data in JSON format.

[0836] Output: Furniture layout and color suggestions.

[0837] How it works: Parses advice data in JSON format and generates a visually friendly interface using HTML, CSS, and JavaScript.

[0838] Step 10:

[0839] Terminal: Displays an interface that presents advice to the user.

[0840] Input: Furniture layout and color suggestions.

[0841] Output: A user-friendly interface.

[0842] How it works: The user interface displays specific rearrangement steps and visual suggestions, making it easy for users to follow the advice.

[0843] (Application example 2)

[0844] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0845] Conventional Feng Shui evaluation systems only provide layout advice based on room diagram data and are unable to provide advice that takes user emotions into account. As a result, they lack consideration for the user's actual comfort and satisfaction, limiting their ability to provide optimal living spaces. Furthermore, even in commercial spaces such as virtual stores, there is a need for layout adjustments based on the real-time changing emotions of customers and staff.

[0846] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0847] In this invention, the server includes means for analyzing drawing data, means for recognizing a user's emotion, and means for generating advice based on the analyzed drawing data and the user's emotion, thereby providing advice on optimal layout and design based on the user's emotion, making it possible to realize a more comfortable and satisfying residential or commercial space.

[0848] "Room drawing data" is information that indicates the layout of the room, the position and dimensions of the furniture, etc.

[0849] "Uploading" is the act of sending data from a local device to a remote system, such as a server.

[0850] "Analysis" is the process of processing data and extracting meaningful information from it.

[0851] A "Feng Shui evaluation" is the process of assessing the energy flow and balance of a room based on the principles of Feng Shui.

[0852] "Optimal placement and design advice" refers to suggestions for furniture placement and color based on the results of the Feng Shui evaluation.

[0853] "Means for recognizing user emotions" refers to means for recognizing emotions in real time from the user's facial expressions and voice using cameras and audio sensors.

[0854] "Means for presenting generated advice" refers to a method for presenting analysis results and advice to the user in a visually easy-to-understand manner.

[0855] "Room elements" refers to the physical structures in a room, such as walls, furniture, windows, and doors.

[0856] "Furniture placement and color suggestions" refers to specific advice on where to place furniture and the colors to use in the room.

[0857] This invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions. This system is mainly composed of three elements: a server, a terminal, and the user.

[0858] Basic system configuration

[0859] 1. Upload the drawing data

[0860] A user uploads room drawing data via a terminal, which converts the data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[0861] 2. Analysis of drawing data

[0862] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores the analyzed information in a database. It then generates metadata for the analysis results according to a feng shui evaluation algorithm.

[0863] 3. User Emotion Recognition

[0864] The device uses an emotion engine to acquire the user's emotions in real time from cameras and sensors, including facial and voice data, and sends it to the server as emotion data.

[0865] 4. Conduct a Feng Shui assessment

[0866] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[0867] 5. Generating Advice

[0868] The server generates optimal layout and design advice based on the user's emotional state based on the results of the Feng Shui evaluation and the emotional data. This advice includes specific suggestions for furniture placement and color usage. The generated advice is then sent to the device in JSON format.

[0869] 6. Providing advice

[0870] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and displays an interface to present to the user, suggesting specific steps for rearrangement and a list of recommended items.

[0871] Specific examples

[0872] Living room improvements

[0873] 1. A user uploads a drawing of a living room. The drawing data can be, for example, a JPEG image.

[0874] 2. The device sends the drawing data to a server, which uses image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0875] 3. The device uses an emotion engine to recognize the user's emotions based on facial expressions and voice data acquired from cameras and microphones, and transmits the emotions to the server.

[0876] 4. The server runs the Feng Shui evaluation algorithm and combines the analysis results metadata with the emotion data to make an evaluation.

[0877] 5. For example, based on the Feng Shui evaluation result that "the living room window is located in the southeast, so it is good to place plants in this direction," the system generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[0878] 6. The device analyzes the generated advice and presents it to the user as a visual layout diagram and color proposal, allowing the user to confirm specific steps for re-arrangement.

[0879] Prompt Sentence Examples

[0880] "Virtual store Feng Shui evaluation system: Based on store drawing data and real-time collected sentiment data, it generates optimal store layout and interior placement advice in accordance with Feng Shui principles. The specific steps are as follows:

[0881] 1. Upload the store's blueprint data.

[0882] 2. Use sensors and cameras to collect real-time voice and facial expression data in-store.

[0883] 3. Analyze the drawing data and extract the store's important elements (walls, windows, furniture, etc.).

[0884] 4. Run the Feng Shui evaluation algorithm based on the sentiment data.

[0885] 5. Combine the analysis results with sentiment data to generate optimal store layout and interior design advice.

[0886] 6. Based on the advice provided, we will display a visual suggesting specific changes to the layout.

[0887] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0888] Step 1:

[0889] Uploading drawing data

[0890] The user selects the room plan data via the terminal and presses the upload button. The terminal converts this plan data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[0891] Input: Room drawing data (JPEG, PNG, etc.)

[0892] Output: Metadata in JSON format

[0893] Step 2:

[0894] Drawing data analysis

[0895] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores this information in a database.

[0896] Input: JSON formatted metadata

[0897] Output: Analysis result metadata (room element information)

[0898] Step 3:

[0899] User Emotion Recognition

[0900] The device uses an emotion engine to acquire the user's real-time emotional data (facial expressions and voice) from cameras and sensors and transmits it to the server as emotional data.

[0901] Input: User's facial expressions and voice data

[0902] Output: User emotion data

[0903] Step 4:

[0904] Conducting a Feng Shui evaluation

[0905] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[0906] Input: Metadata of analysis results, user emotion data

[0907] Output: Feng Shui evaluation results

[0908] Step 5:

[0909] Generating Advice

[0910] The server generates optimal layout and design advice based on the results of the Feng Shui evaluation and emotional data. This advice includes specific examples such as furniture placement and color usage. The advice is also tailored to the user's emotional state.

[0911] Input: Feng Shui evaluation results, user emotion data

[0912] Output: JSON data of the advice

[0913] Step 6:

[0914] Providing advice

[0915] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and then presents the user with specific rearrangement procedures and a list of recommended items.

[0916] Input: JSON data for advice

[0917] Output: Visual layout, color suggestions, and layout change instructions

[0918] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0919] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0920] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0921] [Third embodiment]

[0922] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0923] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0924] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0925] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0926] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0927] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0928] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0929] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0930] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0931] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0932] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0933] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0934] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The embodiments for carrying out the present invention will be described in detail below.

[0935] Basic system configuration

[0936] Users upload room plan data via their devices. The devices then send this data to the server. The server analyzes the received data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[0937] Program processing

[0938] Uploading drawing data

[0939] 1. User: Select the room drawing data from the terminal and press the upload button.

[0940] 2. Terminal: Receives drawing data and sends it to the server.

[0941] Drawing data analysis

[0942] 3. Server: Once the drawing data is received, image processing algorithms are used to extract information such as room boundaries, window and door locations, and the placement of existing furniture.

[0943] 4. Server: Stores the extracted information in a database.

[0944] Conducting a Feng Shui evaluation

[0945] 5. Server: Based on the stored data, the Feng Shui evaluation algorithm is executed. The evaluation algorithm applies the concept of the eight directions, for example, to evaluate the structure and layout of the room from the perspective of Feng Shui.

[0946] 6. Server: Based on the evaluation results, identify areas that need improvement and the optimal layout.

[0947] Generating Advice

[0948] 7. Server: Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that matches the user's lifestyle and preferences. Specific examples of this advice include suggestions for furniture placement and color usage.

[0949] 8. Server: Sends the generated advice in JSON format to the device.

[0950] Providing advice

[0951] 9. Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[0952] 10. Terminal: Displays an interface that provides advice to the user.

[0953] Specific examples

[0954] Living room improvements

[0955] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[0956] 2. Terminal: Receives drawing data and sends it to the server.

[0957] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[0958] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[0959] 5. Server: Generates an evaluation result, for example, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[0960] 6. Server: Generates improvement advice such as "place plants in the southeast corner" or "move the sofa to the north side."

[0961] 7. Server: Sends advice in JSON format to the device.

[0962] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[0963] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[0964] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui, and to create a comfortable and harmonious living space.

[0965] The processing flow will be explained below.

[0966] Step 1:

[0967] User: Select the room drawing data from the terminal and press the upload button.

[0968] Step 2:

[0969] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[0970] Step 3:

[0971] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[0972] Step 4:

[0973] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[0974] Step 5:

[0975] Server: Based on the stored metadata, it runs a feng shui evaluation algorithm and evaluates the room's structure and layout based on feng shui principles.

[0976] Step 6:

[0977] Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement.

[0978] Step 7:

[0979] Server: Based on the results of the Feng Shui evaluation, it generates advice on optimal furniture placement, color usage, etc.

[0980] Step 8:

[0981] Server: Sends the generated advice in JSON format to the device.

[0982] Step 9:

[0983] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[0984] Step 10:

[0985] Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[0986] Step 11:

[0987] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[0988] Example 1

[0989] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0990] Modern interior design requires optimal furniture placement and color design based on the principles of Feng Shui. However, conventional methods require specialized knowledge and are difficult for average users. Furthermore, manual analysis is time-consuming and inefficient. Therefore, there is a need for a system that allows users to easily create interior designs based on the principles of Feng Shui.

[0991] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0992] In this invention, the server includes means for transmitting room plan data to the server, means for analyzing the plan data transmitted to the server, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for transmitting the generated advice to a terminal, and means for visually presenting the advice received by the terminal, thereby enabling a user to easily and efficiently achieve an optimal interior design based on the principles of feng shui even without specialized knowledge.

[0993] "Room plan data" refers to images or electronic files that contain information about the interior structure and furniture layout.

[0994] "Uploading" refers to the act of sending data from a user's terminal to a server via a network.

[0995] A "server" is a computer system that receives, analyzes, evaluates data, and generates and sends advice to users.

[0996] "Analysis" refers to the process of using image processing techniques and algorithms to identify room structure and furniture layout from drawing data.

[0997] A "feng shui evaluation" is the process of analyzing a room's structure and layout based on the principles of feng shui and determining whether it is good or bad.

[0998] "Layout" refers to the planning and layout of how furniture and decorations are arranged in a room.

[0999] "Design" refers to design guidelines such as furniture placement and color selection based on the room's feng shui.

[1000] "Advice" refers to specific improvements or recommendations proposed to the user based on the Feng Shui assessment.

[1001] The "JSON format" is a lightweight data format for structuring, storing, and transmitting data, and primarily represents data as key-value pairs.

[1002] A "terminal" refers to an electronic device such as a computer or smartphone used by a user.

[1003] "Visual presentation" refers to the act of displaying analysis results and advice to the user in an easy-to-read format such as figures, graphs, or layout diagrams.

[1004] The present invention is a system that allows users to upload room plan data, performs a feng shui evaluation based on that data, and provides advice on optimal layout and design.

[1005] Basic system configuration

[1006] Users upload room plan data using devices such as personal computers or smartphones. The devices then send the uploaded plan data to a server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[1007] Hardware and software used

[1008] 1. Hardware:

[1009] User devices: personal computers, smartphones, etc.

[1010] Server: A server computer for data processing and storage.

[1011] 2. Software:

[1012] Image processing library: OpenCV

[1013] Database: MySQL

[1014] Programming language: Python (implementation of Feng Shui evaluation algorithm)

[1015] Interface design tool: Adobe XD

[1016] Program processing overview

[1017] 1. Upload drawing data:

[1018] The user uses the terminal to select the room drawing data and presses the upload button.

[1019] The terminal receives the drawing data and sends it to the server via an HTTP request.

[1020] 2. Drawing data analysis:

[1021] The server stores the received drawing data in a temporary directory and executes image processing algorithms using the OpenCV library.

[1022] The server converts the information extracted by image processing into structured data (e.g., JSON format) and stores it in a MySQL database.

[1023] 3. Conduct a Feng Shui assessment:

[1024] The server retrieves the stored data and runs a feng shui evaluation algorithm implemented in Python.

[1025] As an evaluation result, the server identifies the Feng Shui score and areas for improvement for each area and saves them in JSON format.

[1026] 4. Generating Advice:

[1027] The server uses automated scripts to generate specific placement and design advice based on the results of the feng shui assessment.

[1028] The server encodes the generated advice in JSON format and sends it to the terminal as an HTTP response.

[1029] 5. Providing advice:

[1030] The device decodes the received advice data and updates various UI components.

[1031] The terminal displays an interface for the user, presenting analysis results and design suggestions.

[1032] Specific examples

[1033] Living room improvements

[1034] 1. User: Selects the blueprint data (JPEG format) of his / her living room and clicks the button to upload.

[1035] 2. Terminal: Sends the selected drawing data to the server as an HTTP request.

[1036] 3. Server: Analyzes the drawing data using OpenCV to determine room dimensions and furniture layout.

[1037] 4. Server: The extracted data is stored in MySQL and the Feng Shui evaluation algorithm implemented in Python is executed.

[1038] 5. Server: Generates a Feng Shui evaluation result, such as "The living room window is located in the southeast, so it would be good to place plants in this direction."

[1039] 6. Server: Generates suggestions in JSON format as realization advice, such as "Place plants in the southeast corner" or "Move the sofa to the north side."

[1040] 7. Server: Sends the generated advice to the terminal as a response.

[1041] 8. Terminal: Parses the received advice and creates a visual layout using HTML and CSS.

[1042] 9. Terminal: Provides an interface that displays advice to the user and explains specific steps for reconfiguration.

[1043] Prompt Sentence Examples

[1044] "I want to upload a blueprint of my living room and receive advice based on Feng Shui."

[1045] "I'd like to improve the feng shui of my bedroom layout. Could you please analyze the blueprint data and give me some advice?"

[1046] This system allows users to easily and efficiently create optimal interior designs based on Feng Shui principles, even without specialized knowledge.

[1047] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1048] Step 1:

[1049] User: Uses the terminal to select the room drawing data and presses the upload button. The input is the file selected by the user, and the output is the selected drawing data (e.g., JPEG format).

[1050] Step 2:

[1051] Terminal: Reads the selected drawing data, creates an HTTP request, and sends it to the server. The input is the drawing data selected by the user, and the output is an HTTP request sent to the server. At this time, the file data is sent in multipart format.

[1052] Step 3:

[1053] Server: Receives drawing data and saves it in a temporary directory. The input is the drawing data sent from the terminal, and the output is a drawing file saved in the temporary directory.

[1054] Step 4:

[1055] Server: Analyzes the drawing data using the OpenCV library. Specifically, it performs edge detection and contour extraction to recognize room boundaries and furniture layout. The input is the drawing file saved in a temporary directory, and the output is the room structure data extracted as the analysis result.

[1056] Step 5:

[1057] Server: The analysis results are converted into JSON format and saved in a MySQL database. The input is the structure data obtained by the analysis, and the output is the Feng Shui evaluation data saved in the database.

[1058] Step 6:

[1059] Server: Retrieves structural data from the MySQL database and executes the Feng Shui evaluation algorithm. The input is the structural data retrieved from the database, and the output is the Feng Shui score and points for improvement as the evaluation results.

[1060] Step 7:

[1061] Server: Generates specific furniture placement and color advice based on the Feng Shui evaluation results. The input is the Feng Shui evaluation results, and the output is JSON-formatted data containing specific advice.

[1062] Step 8:

[1063] Server: Sends the generated advice to the terminal as an HTTP response. The input is JSON data containing the advice, and the output is the HTTP response sent to the terminal.

[1064] Step 9:

[1065] Terminal: Decodes the received advice and updates the UI components. Specifically, it creates a layout using HTML and CSS to visually display the advice content. The input is advice data in JSON format, and the output is a visually displayed advice screen.

[1066] Step 10:

[1067] Terminal: Provides an interface that presents advice to the user and explains specific procedures for rearrangement. The input is a visually displayed advice screen, and the output is specific procedures for rearrangement provided to the user.

[1068] (Application example 1)

[1069] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1070] Conventional interior layout advice systems analyze the user's room blueprint data and propose optimal layouts and designs from a Feng Shui perspective. However, there are limited ways to visually confirm this advice. Furthermore, systems that allow users to simulate actual furniture layouts or experience them in virtual stores are not commonly used. This makes it difficult for users to intuitively understand the feasibility of the advice provided, and they lack the information necessary to make specific layout changes. This leads to issues such as reduced user satisfaction and reliability.

[1071] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1072] In this invention, the server includes means for uploading room plan data, means for analyzing the uploaded plan data, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for presenting the generated advice, means for visually displaying the advice in a virtual space, and means for experiencing furniture layout in a virtual store, thereby enabling a user to visually and intuitively understand the provided advice and perform an actual layout simulation in the virtual space.

[1073] "Room drawing data" is information in a digital file format that indicates the structure and layout of a room.

[1074] "Means for uploading" refers to a mechanism that allows a user to use a terminal to send room drawing data to a server.

[1075] The "analysis means" is a processing system that uses an image processing algorithm to identify the structure and each element of the room from the drawing data received by the server.

[1076] "Means for conducting a Feng Shui evaluation" refers to a method for applying the principles of Feng Shui to conduct an evaluation based on the analyzed information of the room.

[1077] The "means for generating advice" is a system that automatically creates optimal layout and design suggestions based on the results of the feng shui evaluation, taking into account the user's lifestyle and preferences.

[1078] The "means for presenting advice" is a means for notifying the user of the generated advice on placement or design visually or audibly.

[1079] "Means for visual display in virtual space" refers to a function that provides users with advice based on Feng Shui evaluation as a 3D model or virtual reality.

[1080] The "means for experiencing furniture arrangement in a virtual store" is a system that allows users to try out furniture arrangements in a virtual space.

[1081] This invention is a system that allows users to upload their own room plan data, analyzes it, and provides advice on optimal layout and design based on the principles of Feng Shui. This system utilizes a virtual store environment, in particular, allowing users to visually confirm advice and simulate furniture layout in a virtual space.

[1082] When a user uploads room plan data from their device, the device sends the data to the server. The server then analyzes the received plan data using image processing algorithms to extract information about the room structure and the location of each element. This analysis uses image processing libraries such as OpenCV.

[1083] The server then runs a feng shui evaluation algorithm based on the analyzed data. This algorithm evaluates the room's structure and furniture placement, and identifies areas for improvement and optimal placement based on the principles of feng shui. Specifically, it applies the concept of the eight cardinal directions and generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[1084] Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that suits the user's lifestyle and preferences. This advice includes suggestions for furniture placement and color usage, such as "place plants in the southeast corner" or "move the sofa to the north side." The generated advice is sent to the device in JSON format.

[1085] The device analyzes the received advice and converts it into a visually understandable format, such as creating furniture layout plans and color suggestions, which the user can view in a virtual space using a smartphone or head-mounted display.

[1086] For example, if a user uploads blueprints of a living room, the server will identify the shape of the room, the location of windows and doors, and the layout of existing furniture, and then propose the optimal layout and design based on that.The user can view the proposal in a virtual space using a head-mounted display, and can actually change the layout in a virtual store to simulate it.

[1087] An example of a prompt for the generative AI model is as follows:

[1088] "Analyze the drawing data, including the room footprint, window, door, and existing furniture locations, and generate optimal furniture placement advice based on Feng Shui principles. This advice includes specific furniture placement, color suggestions, and plant placement. For example, move the sofa to the north side of the living room and place plants in the southeast corner."

[1089] This allows users to visually and intuitively understand the advice provided and simulate actual layouts in a virtual space, ultimately helping users to create a comfortable and harmonious living space.

[1090] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1091] Step 1:

[1092] The user selects the room drawing data and sends an upload request from the terminal.

[1093] Input: User's drawing data (e.g. JPEG file)

[1094] Action: The user clicks the "Upload Drawing Data" button in the application.

[1095] Output: The drawing data is saved on the terminal and sent to the server.

[1096] Step 2:

[1097] The terminal transmits the uploaded drawing data to the server.

[1098] Input: Drawing data selected by the user in step 1

[1099] Operation: The terminal sends drawing data to the server as an HTTP request.

[1100] Output: The server receives the drawing data.

[1101] Step 3:

[1102] The server analyzes the received drawing data and extracts information about the room structure and the location of elements.

[1103] Input: Uploaded drawing data

[1104] How it works: The server uses image processing algorithms such as OpenCV to identify the location of walls, windows, doors and existing furniture in the room.

[1105] Output: Room structure information and element position information as analysis results

[1106] Step 4:

[1107] The server performs a feng shui evaluation based on the analyzed data.

[1108] Input: Analysis results from Step 3 (room structure information and element location information)

[1109] How it works: It applies Feng Shui algorithms to make an assessment based on, for example, the eight directions or the five elements.

[1110] Output: Feng Shui evaluation result (e.g. "The living room window is in the southeast, so it would be good to place some plants there.")

[1111] Step 5:

[1112] The server generates optimal placement and design advice based on the feng shui evaluation results.

[1113] Input: Step 4 Feng Shui evaluation results

[1114] How it works: Based on the results of the Feng Shui evaluation, it generates advice on furniture placement and color usage that suits the user's lifestyle and preferences.

[1115] Output: Specific placement advice (e.g., "Place plants in the southeast corner," "Move the sofa to the north side")

[1116] Step 6:

[1117] The server sends the generated advice to the terminal in JSON format.

[1118] Input: Specific placement advice for step 5

[1119] Behavior: The advice is converted to JSON format and sent to the device as an HTTP response.

[1120] Output: Advice in JSON format as received on the terminal

[1121] Step 7:

[1122] The device analyzes the received advice and displays it to the user in a visually easy-to-understand format.

[1123] Input: JSON format advice from step 6

[1124] How it works: Furniture layout plans and color suggestions are generated based on JSON data and reflected in the application interface.

[1125] Output: Layout and design proposals that users can visually check

[1126] Step 8:

[1127] Users can use a smartphone or head-mounted display to check and simulate proposed layouts and designs in a virtual space.

[1128] Input: Visual layout and design proposals from Step 7

[1129] How it works: The user wears a smartphone or a head-mounted display and manipulates and simulates the placement of furniture in a virtual space.

[1130] Output: Simulation of furniture arrangement in the virtual space experienced by the user

[1131] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1132] The present invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions.

[1133] Basic system configuration

[1134] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results and the user's emotional information, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[1135] Program processing

[1136] Uploading drawing data

[1137] 1. User: Select the room drawing data from the terminal and press the upload button.

[1138] 2. Terminal: Converts the drawing data into an appropriate format (e.g., JSON metadata) and sends it to the server.

[1139] Drawing data analysis

[1140] 3. Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[1141] 4. Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[1142] Recognizing user emotions

[1143] 5. On the device: An emotion engine is used to recognize the user's emotions (e.g., happiness, sadness, nervousness, etc.) in real time. This emotion data is obtained from input devices such as sensors and cameras.

[1144] 6. Terminal: Sends the recognized emotion data to the server.

[1145] Conducting a Feng Shui evaluation

[1146] 7. Server: Based on the stored metadata and sentiment data, it runs a Feng Shui evaluation algorithm and evaluates the room structure and layout based on Feng Shui principles.

[1147] 8. Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement, taking into account the user's emotional information.

[1148] Generating Advice

[1149] 9. Server: Based on the results of the Feng Shui evaluation and the emotional data, the server generates layout and design advice that is optimal for the user's emotional state. Specific examples of this advice include suggestions for furniture placement and color usage.

[1150] 10. Server: Sends the generated advice in JSON format to the device.

[1151] Providing advice

[1152] 11. Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[1153] 12. Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[1154] Specific examples

[1155] Living room improvements

[1156] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[1157] 2. Terminal: Receives drawing data and sends it to the server.

[1158] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[1159] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[1160] 5. Terminal: Using an emotion engine, the user's emotions are acquired from facial expressions, voice, etc., and sent to the server.

[1161] 6. Server: For example, it generates an evaluation result such as "The living room window is located in the southeast, so it would be good to place plants in this direction," and generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[1162] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[1163] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[1164] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[1165] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui and their own emotional state, thereby creating a comfortable and harmonious living space.

[1166] The processing flow will be explained below.

[1167] Step 1:

[1168] User: Select the room drawing data from the terminal and press the upload button.

[1169] Step 2:

[1170] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[1171] Step 3:

[1172] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[1173] Step 4:

[1174] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[1175] Step 5:

[1176] On the device: Recognizes the user's emotions in real time using an emotion engine. Emotion data is collected using methods such as facial expression analysis and voice analysis.

[1177] Step 6:

[1178] Terminal: Sends the recognized emotion data to the server.

[1179] Step 7:

[1180] Server: Executes the Feng Shui evaluation algorithm based on the stored analysis result metadata and the received emotion data.

[1181] Step 8:

[1182] Server: Based on the principles of Feng Shui, for example by applying the concept of the "eight directions," we analyze the structure and layout of a room and evaluate the flow and balance of energy.

[1183] Step 9:

[1184] Server: It also considers the user's emotional information and identifies areas that need improvement and the optimal layout. For example, if the user is looking for a relaxing environment, it will suggest a layout and color scheme that matches that emotion.

[1185] Step 10:

[1186] Server: Generates specific advice such as optimal furniture placement and color usage, including recommendations that reflect the user's emotional state.

[1187] Step 11:

[1188] Server: Sends the generated advice in JSON format to the device.

[1189] Step 12:

[1190] Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[1191] Step 13:

[1192] Terminal: Displays an interface that provides advice to the user, including specific rearrangement instructions and a list of recommended items.

[1193] Step 14:

[1194] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[1195] Specific examples

[1196] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[1197] 2. Terminal: Receives drawing data and sends it to the server.

[1198] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[1199] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[1200] 5. Terminal: The emotion engine analyzes the user's facial expressions and voice, and sends the user's emotion data to the server.

[1201] 6. Server: For example, it generates a Feng Shui assessment such as, "The living room window is located in the southeast, and placing plants in this direction will improve your luck," and generates advice based on the situation, such as suggesting calming colors if the user is looking for relaxation, or bright colors if the user is looking for vitality.

[1202] 7. Server: Create specific improvement advice such as "Place plants in the southeast corner" and "Move the sofa to the north side."

[1203] 8. Terminal: Analyzes the received advice and creates visual layout and color suggestions.

[1204] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[1205] In this way, users can achieve optimal room layout and design based on Feng Shui principles and their own emotional state, creating a comfortable and harmonious living space.

[1206] Example 2

[1207] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1208] Conventional Feng Shui evaluation systems simply provide advice on room layout and design based on the principles of Feng Shui, but do not take into account the user's emotional state, making it difficult to improve the user's psychological satisfaction and comfort.

[1209] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1210] In this invention, the server includes means for analyzing uploaded drawing data, means for performing a feng shui evaluation based on the analyzed drawing data, and means for generating advice on optimal layout and design based on the feng shui evaluation, thereby enabling suggestions for room layout and design that appropriately take into account the user's emotional state in addition to advice based on the principles of feng shui.

[1211] "Drawing data" is data that represents the layout and structure of a room, and is usually provided as an image file in JPEG or PNG format.

[1212] "Means for uploading" refers to the method by which a user sends drawing data to the system through a terminal.

[1213] "Means of analysis" refers to the process of extracting information such as room boundaries and furniture positions from the received drawing data.

[1214] "Means for conducting Feng Shui evaluation" refers to a method for evaluating the layout of a room in accordance with the principles of Feng Shui based on the analyzed data.

[1215] "Means for generating advice" refers to a method for generating optimal placement and design suggestions based on the results of the Feng Shui assessment and the user's emotional state.

[1216] The "means for presenting advice" refers to a method for displaying the generated advice to the user in a visually easy-to-understand format.

[1217] "Means for recognizing emotions" refers to a method for understanding a user's emotional state in real time from their facial expressions and voice.

[1218] "Means for using emotional data in analysis" refers to methods for incorporating recognized emotional information into the Feng Shui evaluation and advice generation process.

[1219] This invention is a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui. By combining this system with an emotion engine that recognizes the user's emotions, it is possible to improve the user's psychological satisfaction and comfort.

[1220] Basic system configuration

[1221] Hardware and Software

[1222] Terminal (user device): Uploads drawing data and performs emotion recognition. Smartphones, tablets, PCs, etc. are used.

[1223] Server: Analyzes the drawing data, performs Feng Shui evaluations, and generates advice. A high-performance processor and sufficient memory are recommended.

[1224] Image processing algorithms (OpenCV, TensorFlow, etc.): used to analyze drawing data.

[1225] Database (MySQL, Postgres, etc.): Used to store the parsed data.

[1226] Emotion Engine (Emotion API, Face Recognition API): Used to recognize user emotions.

[1227] Processing flow

[1228] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. The device then recognizes the user's emotions in real time and sends this emotional data to the server. The server generates optimal layout and design advice based on the results of the feng shui evaluation and the user's emotional information. This advice is then sent back to the device and presented to the user.

[1229] Specific examples

[1230] Living room improvements

[1231] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[1232] 2. Terminal: Receives drawing data and sends it to the server.

[1233] 3. Server: Runs the algorithm used (e.g. OpenCV or TensorFlow) to determine the dimensions of the living room, the location of windows and doors, and the layout of existing furniture.

[1234] 4. Server: Performs Feng Shui evaluation based on the extracted information.

[1235] 5. Device: Using the Emotion API, emotions are acquired from the user's facial expressions, voice, etc. and sent to the server.

[1236] 6. Server: Generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction." If the user is relaxed, it suggests calm colors, and if they are feeling down, it suggests bright colors.

[1237] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[1238] 8. Terminal: Analyzes the received advice and converts it into a visually understandable format.

[1239] 9. Terminal: Provide advice in the user interface, including specific steps for reconfiguring the device.

[1240] Prompt Sentence Examples

[1241] Here are some example prompts to input to a generative AI model:

[1242] Please provide a detailed explanation of each step in your system, including the algorithms, tools, and data formats used, in order to allow users to upload a living room blueprint and receive optimal room improvement advice based on Feng Shui and emotions. For example, please mention image processing using OpenCV and emotion recognition using EmotionAPI.

[1243] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1244] Step 1:

[1245] User: Select the room drawing data and press the upload button on the device.

[1246] Input: Room plan data in JPEG or PNG format.

[1247] Operation: Select the drawing data on the terminal and press the upload button to register the drawing data in the system.

[1248] Step 2:

[1249] Terminal: Converts the drawing data into an appropriate format (metadata in JSON format) and sends it to the server.

[1250] Input: Drawing data in JPEG or PNG format.

[1251] Output: Metadata in JSON format.

[1252] Operation: The drawing data is read, basic information about the drawing (file name, upload date and time, etc.) is converted to JSON format, and sent to the server via the Internet.

[1253] Step 3:

[1254] Server: Analyzes the received drawing data using image processing algorithms (such as OpenCV or TensorFlow).

[1255] Input: Metadata in JSON format.

[1256] Output: The resulting room boundaries, positions and dimensions of windows, doors and existing furniture.

[1257] How it works: It runs image processing algorithms to analyze the location and dimensions of each element in the room (boundaries, windows, doors, furniture).

[1258] Step 4:

[1259] Server: Stores the analyzed information in a database and generates metadata.

[1260] Input: The resulting location and dimensions of each element in the room.

[1261] Output: Analysis results and associated metadata stored in a database.

[1262] Operation: The analysis results are stored in a database and metadata required for subsequent processing is generated.

[1263] Step 5:

[1264] Terminal: Using an emotion engine (Emotion API, Face Recognition API, etc.), the user's emotions are recognized in real time and sent to the server.

[1265] Input: User's facial and voice data.

[1266] Output: Sentiment data in JSON format.

[1267] How it works: The user's facial expressions and voice are captured through the camera and microphone, analyzed by the emotion engine, and the results are sent to the server in JSON format.

[1268] Step 6:

[1269] Server: Runs the Feng Shui evaluation algorithm based on the stored metadata and sentiment data.

[1270] Input: Metadata, emotion data.

[1271] Output: Feng Shui evaluation results.

[1272] How it works: Analyzes and evaluates the structure and energy flow of a room based on the principles of Feng Shui.

[1273] Step 7:

[1274] Server: Based on the results of the Feng Shui evaluation and emotional data, it generates placement and design advice that is optimal for the user's emotional state.

[1275] Input: Feng Shui evaluation results, emotion data.

[1276] Output: Furniture placement and color suggestions as advice.

[1277] How it works: Generates optimal layout and design suggestions based on Feng Shui assessment and emotion data. Specifically, it suggests furniture placement and color usage.

[1278] Step 8:

[1279] Server: Sends the generated advice in JSON format to the device.

[1280] Input: Advice on placement and design suggestions.

[1281] Output: Advice data in JSON format.

[1282] Operation: The generated advice is converted into JSON format and sent to the terminal.

[1283] Step 9:

[1284] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format.

[1285] Input: Advice data in JSON format.

[1286] Output: Furniture layout and color suggestions.

[1287] How it works: Parses advice data in JSON format and generates a visually friendly interface using HTML, CSS, and JavaScript.

[1288] Step 10:

[1289] Terminal: Displays an interface that presents advice to the user.

[1290] Input: Furniture layout and color suggestions.

[1291] Output: A user-friendly interface.

[1292] How it works: The user interface displays specific rearrangement steps and visual suggestions, making it easy for users to follow the advice.

[1293] (Application example 2)

[1294] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1295] Conventional Feng Shui evaluation systems only provide layout advice based on room diagram data and are unable to provide advice that takes user emotions into account. As a result, they lack consideration for the user's actual comfort and satisfaction, limiting their ability to provide optimal living spaces. Furthermore, even in commercial spaces such as virtual stores, there is a need for layout adjustments based on the real-time changing emotions of customers and staff.

[1296] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1297] In this invention, the server includes means for analyzing drawing data, means for recognizing a user's emotion, and means for generating advice based on the analyzed drawing data and the user's emotion, thereby providing advice on optimal layout and design based on the user's emotion, making it possible to realize a more comfortable and satisfying residential or commercial space.

[1298] "Room drawing data" is information that indicates the layout of the room, the position and dimensions of the furniture, etc.

[1299] "Uploading" is the act of sending data from a local device to a remote system, such as a server.

[1300] "Analysis" is the process of processing data and extracting meaningful information from it.

[1301] A "Feng Shui evaluation" is the process of assessing the energy flow and balance of a room based on the principles of Feng Shui.

[1302] "Optimal placement and design advice" refers to suggestions for furniture placement and color based on the results of the Feng Shui evaluation.

[1303] "Means for recognizing user emotions" refers to means for recognizing emotions in real time from the user's facial expressions and voice using cameras and audio sensors.

[1304] "Means for presenting generated advice" refers to a method for presenting analysis results and advice to the user in a visually easy-to-understand manner.

[1305] "Room elements" refers to the physical structures in a room, such as walls, furniture, windows, and doors.

[1306] "Furniture placement and color suggestions" refers to specific advice on where to place furniture and the colors to use in the room.

[1307] This invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions. This system is mainly composed of three elements: a server, a terminal, and the user.

[1308] Basic system configuration

[1309] 1. Upload the drawing data

[1310] A user uploads room drawing data via a terminal, which converts the data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[1311] 2. Analysis of drawing data

[1312] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores the analyzed information in a database. It then generates metadata for the analysis results according to a feng shui evaluation algorithm.

[1313] 3. User Emotion Recognition

[1314] The device uses an emotion engine to acquire the user's emotions in real time from cameras and sensors, including facial and voice data, and sends it to the server as emotion data.

[1315] 4. Conduct a Feng Shui assessment

[1316] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[1317] 5. Generating Advice

[1318] The server generates optimal layout and design advice based on the user's emotional state based on the results of the Feng Shui evaluation and the emotional data. This advice includes specific suggestions for furniture placement and color usage. The generated advice is then sent to the device in JSON format.

[1319] 6. Providing advice

[1320] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and displays an interface to present to the user, suggesting specific steps for rearrangement and a list of recommended items.

[1321] Specific examples

[1322] Living room improvements

[1323] 1. A user uploads a drawing of a living room. The drawing data can be, for example, a JPEG image.

[1324] 2. The device sends the drawing data to a server, which uses image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[1325] 3. The device uses an emotion engine to recognize the user's emotions based on facial expressions and voice data acquired from cameras and microphones, and transmits the emotions to the server.

[1326] 4. The server runs the Feng Shui evaluation algorithm and combines the analysis results metadata with the emotion data to make an evaluation.

[1327] 5. For example, based on the Feng Shui evaluation result that "the living room window is located in the southeast, so it is good to place plants in this direction," the system generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[1328] 6. The device analyzes the generated advice and presents it to the user as a visual layout diagram and color proposal, allowing the user to confirm specific steps for re-arrangement.

[1329] Prompt Sentence Examples

[1330] "Virtual store Feng Shui evaluation system: Based on store drawing data and real-time collected sentiment data, it generates optimal store layout and interior placement advice in accordance with Feng Shui principles. The specific steps are as follows:

[1331] 1. Upload the store's blueprint data.

[1332] 2. Use sensors and cameras to collect real-time voice and facial expression data in-store.

[1333] 3. Analyze the drawing data and extract the store's important elements (walls, windows, furniture, etc.).

[1334] 4. Run the Feng Shui evaluation algorithm based on the sentiment data.

[1335] 5. Combine the analysis results with sentiment data to generate optimal store layout and interior design advice.

[1336] 6. Based on the advice provided, we will display a visual suggesting specific changes to the layout.

[1337] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1338] Step 1:

[1339] Uploading drawing data

[1340] The user selects the room plan data via the terminal and presses the upload button. The terminal converts this plan data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[1341] Input: Room drawing data (JPEG, PNG, etc.)

[1342] Output: Metadata in JSON format

[1343] Step 2:

[1344] Drawing data analysis

[1345] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores this information in a database.

[1346] Input: JSON formatted metadata

[1347] Output: Analysis result metadata (room element information)

[1348] Step 3:

[1349] User Emotion Recognition

[1350] The device uses an emotion engine to acquire the user's real-time emotional data (facial expressions and voice) from cameras and sensors and transmits it to the server as emotional data.

[1351] Input: User's facial expressions and voice data

[1352] Output: User emotion data

[1353] Step 4:

[1354] Conducting a Feng Shui evaluation

[1355] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[1356] Input: Metadata of analysis results, user emotion data

[1357] Output: Feng Shui evaluation results

[1358] Step 5:

[1359] Generating Advice

[1360] The server generates optimal layout and design advice based on the results of the Feng Shui evaluation and emotional data. This advice includes specific examples such as furniture placement and color usage. The advice is also tailored to the user's emotional state.

[1361] Input: Feng Shui evaluation results, user emotion data

[1362] Output: JSON data of the advice

[1363] Step 6:

[1364] Providing advice

[1365] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and then presents the user with specific rearrangement procedures and a list of recommended items.

[1366] Input: JSON data for advice

[1367] Output: Visual layout, color suggestions, and layout change instructions

[1368] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1369] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1370] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1371] [Fourth embodiment]

[1372] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1373] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1374] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1375] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1376] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1377] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1378] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1379] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1380] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1381] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1382] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1383] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1384] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1385] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The embodiments for carrying out the present invention will be described in detail below.

[1386] Basic system configuration

[1387] Users upload room plan data via their devices. The devices then send this data to the server. The server analyzes the received data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[1388] Program processing

[1389] Uploading drawing data

[1390] 1. User: Select the room drawing data from the terminal and press the upload button.

[1391] 2. Terminal: Receives drawing data and sends it to the server.

[1392] Drawing data analysis

[1393] 3. Server: Once the drawing data is received, image processing algorithms are used to extract information such as room boundaries, window and door locations, and the placement of existing furniture.

[1394] 4. Server: Stores the extracted information in a database.

[1395] Conducting a Feng Shui evaluation

[1396] 5. Server: Based on the stored data, the Feng Shui evaluation algorithm is executed. The evaluation algorithm applies the concept of the eight directions, for example, to evaluate the structure and layout of the room from the perspective of Feng Shui.

[1397] 6. Server: Based on the evaluation results, identify areas that need improvement and the optimal layout.

[1398] Generating Advice

[1399] 7. Server: Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that matches the user's lifestyle and preferences. Specific examples of this advice include suggestions for furniture placement and color usage.

[1400] 8. Server: Sends the generated advice in JSON format to the device.

[1401] Providing advice

[1402] 9. Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[1403] 10. Terminal: Displays an interface that provides advice to the user.

[1404] Specific examples

[1405] Living room improvements

[1406] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[1407] 2. Terminal: Receives drawing data and sends it to the server.

[1408] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[1409] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[1410] 5. Server: Generates an evaluation result, for example, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[1411] 6. Server: Generates improvement advice such as "place plants in the southeast corner" or "move the sofa to the north side."

[1412] 7. Server: Sends advice in JSON format to the device.

[1413] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[1414] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[1415] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui, and to create a comfortable and harmonious living space.

[1416] The processing flow will be explained below.

[1417] Step 1:

[1418] User: Select the room drawing data from the terminal and press the upload button.

[1419] Step 2:

[1420] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[1421] Step 3:

[1422] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[1423] Step 4:

[1424] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[1425] Step 5:

[1426] Server: Based on the stored metadata, it runs a feng shui evaluation algorithm and evaluates the room's structure and layout based on feng shui principles.

[1427] Step 6:

[1428] Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement.

[1429] Step 7:

[1430] Server: Based on the results of the Feng Shui evaluation, it generates advice on optimal furniture placement, color usage, etc.

[1431] Step 8:

[1432] Server: Sends the generated advice in JSON format to the device.

[1433] Step 9:

[1434] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[1435] Step 10:

[1436] Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[1437] Step 11:

[1438] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[1439] Example 1

[1440] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1441] Modern interior design requires optimal furniture placement and color design based on the principles of Feng Shui. However, conventional methods require specialized knowledge and are difficult for average users. Furthermore, manual analysis is time-consuming and inefficient. Therefore, there is a need for a system that allows users to easily create interior designs based on the principles of Feng Shui.

[1442] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1443] In this invention, the server includes means for transmitting room plan data to the server, means for analyzing the plan data transmitted to the server, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for transmitting the generated advice to a terminal, and means for visually presenting the advice received by the terminal, thereby enabling a user to easily and efficiently achieve an optimal interior design based on the principles of feng shui even without specialized knowledge.

[1444] "Room plan data" refers to images or electronic files that contain information about the interior structure and furniture layout.

[1445] "Uploading" refers to the act of sending data from a user's terminal to a server via a network.

[1446] A "server" is a computer system that receives, analyzes, evaluates data, and generates and sends advice to users.

[1447] "Analysis" refers to the process of using image processing techniques and algorithms to identify room structure and furniture layout from drawing data.

[1448] A "feng shui evaluation" is the process of analyzing a room's structure and layout based on the principles of feng shui and determining whether it is good or bad.

[1449] "Layout" refers to the planning and layout of how furniture and decorations are arranged in a room.

[1450] "Design" refers to design guidelines such as furniture placement and color selection based on the room's feng shui.

[1451] "Advice" refers to specific improvements or recommendations proposed to the user based on the Feng Shui assessment.

[1452] The "JSON format" is a lightweight data format for structuring, storing, and transmitting data, and primarily represents data as key-value pairs.

[1453] A "terminal" refers to an electronic device such as a computer or smartphone used by a user.

[1454] "Visual presentation" refers to the act of displaying analysis results and advice to the user in an easy-to-read format such as figures, graphs, or layout diagrams.

[1455] The present invention is a system that allows users to upload room plan data, performs a feng shui evaluation based on that data, and provides advice on optimal layout and design.

[1456] Basic system configuration

[1457] Users upload room plan data using devices such as personal computers or smartphones. The devices then send the uploaded plan data to a server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[1458] Hardware and software used

[1459] 1. Hardware:

[1460] User devices: personal computers, smartphones, etc.

[1461] Server: A server computer for data processing and storage.

[1462] 2. Software:

[1463] Image processing library: OpenCV

[1464] Database: MySQL

[1465] Programming language: Python (implementation of Feng Shui evaluation algorithm)

[1466] Interface design tool: Adobe XD

[1467] Program processing overview

[1468] 1. Upload drawing data:

[1469] The user uses the terminal to select the room drawing data and presses the upload button.

[1470] The terminal receives the drawing data and sends it to the server via an HTTP request.

[1471] 2. Drawing data analysis:

[1472] The server stores the received drawing data in a temporary directory and executes image processing algorithms using the OpenCV library.

[1473] The server converts the information extracted by image processing into structured data (e.g., JSON format) and stores it in a MySQL database.

[1474] 3. Conduct a Feng Shui assessment:

[1475] The server retrieves the stored data and runs a feng shui evaluation algorithm implemented in Python.

[1476] As an evaluation result, the server identifies the Feng Shui score and areas for improvement for each area and saves them in JSON format.

[1477] 4. Generating Advice:

[1478] The server uses automated scripts to generate specific placement and design advice based on the results of the feng shui assessment.

[1479] The server encodes the generated advice in JSON format and sends it to the terminal as an HTTP response.

[1480] 5. Providing advice:

[1481] The device decodes the received advice data and updates various UI components.

[1482] The terminal displays an interface for the user, presenting analysis results and design suggestions.

[1483] Specific examples

[1484] Living room improvements

[1485] 1. User: Selects the blueprint data (JPEG format) of his / her living room and clicks the button to upload.

[1486] 2. Terminal: Sends the selected drawing data to the server as an HTTP request.

[1487] 3. Server: Analyzes the drawing data using OpenCV to determine room dimensions and furniture layout.

[1488] 4. Server: The extracted data is stored in MySQL and the Feng Shui evaluation algorithm implemented in Python is executed.

[1489] 5. Server: Generates a Feng Shui evaluation result, such as "The living room window is located in the southeast, so it would be good to place plants in this direction."

[1490] 6. Server: Generates suggestions in JSON format as realization advice, such as "Place plants in the southeast corner" or "Move the sofa to the north side."

[1491] 7. Server: Sends the generated advice to the terminal as a response.

[1492] 8. Terminal: Parses the received advice and creates a visual layout using HTML and CSS.

[1493] 9. Terminal: Provides an interface that displays advice to the user and explains specific steps for reconfiguration.

[1494] Prompt Sentence Examples

[1495] "I want to upload a blueprint of my living room and receive advice based on Feng Shui."

[1496] "I'd like to improve the feng shui of my bedroom layout. Could you please analyze the blueprint data and give me some advice?"

[1497] This system allows users to easily and efficiently create optimal interior designs based on Feng Shui principles, even without specialized knowledge.

[1498] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1499] Step 1:

[1500] User: Uses the terminal to select the room drawing data and presses the upload button. The input is the file selected by the user, and the output is the selected drawing data (e.g., JPEG format).

[1501] Step 2:

[1502] Terminal: Reads the selected drawing data, creates an HTTP request, and sends it to the server. The input is the drawing data selected by the user, and the output is an HTTP request sent to the server. At this time, the file data is sent in multipart format.

[1503] Step 3:

[1504] Server: Receives drawing data and saves it in a temporary directory. The input is the drawing data sent from the terminal, and the output is a drawing file saved in the temporary directory.

[1505] Step 4:

[1506] Server: Analyzes the drawing data using the OpenCV library. Specifically, it performs edge detection and contour extraction to recognize room boundaries and furniture layout. The input is the drawing file saved in a temporary directory, and the output is the room structure data extracted as the analysis result.

[1507] Step 5:

[1508] Server: The analysis results are converted into JSON format and saved in a MySQL database. The input is the structure data obtained by the analysis, and the output is the Feng Shui evaluation data saved in the database.

[1509] Step 6:

[1510] Server: Retrieves structural data from the MySQL database and executes the Feng Shui evaluation algorithm. The input is the structural data retrieved from the database, and the output is the Feng Shui score and points for improvement as the evaluation results.

[1511] Step 7:

[1512] Server: Generates specific furniture placement and color advice based on the Feng Shui evaluation results. The input is the Feng Shui evaluation results, and the output is JSON-formatted data containing specific advice.

[1513] Step 8:

[1514] Server: Sends the generated advice to the terminal as an HTTP response. The input is JSON data containing the advice, and the output is the HTTP response sent to the terminal.

[1515] Step 9:

[1516] Terminal: Decodes the received advice and updates the UI components. Specifically, it creates a layout using HTML and CSS to visually display the advice content. The input is advice data in JSON format, and the output is a visually displayed advice screen.

[1517] Step 10:

[1518] Terminal: Provides an interface that presents advice to the user and explains specific procedures for rearrangement. The input is a visually displayed advice screen, and the output is specific procedures for rearrangement provided to the user.

[1519] (Application example 1)

[1520] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1521] Conventional interior layout advice systems analyze the user's room blueprint data and propose optimal layouts and designs from a Feng Shui perspective. However, there are limited ways to visually confirm this advice. Furthermore, systems that allow users to simulate actual furniture layouts or experience them in virtual stores are not commonly used. This makes it difficult for users to intuitively understand the feasibility of the advice provided, and they lack the information necessary to make specific layout changes. This leads to issues such as reduced user satisfaction and reliability.

[1522] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1523] In this invention, the server includes means for uploading room plan data, means for analyzing the uploaded plan data, means for performing a feng shui evaluation based on the analyzed plan data, means for generating advice on optimal layout and design based on the feng shui evaluation, means for presenting the generated advice, means for visually displaying the advice in a virtual space, and means for experiencing furniture layout in a virtual store, thereby enabling a user to visually and intuitively understand the provided advice and perform an actual layout simulation in the virtual space.

[1524] "Room drawing data" is information in a digital file format that indicates the structure and layout of a room.

[1525] "Means for uploading" refers to a mechanism that allows a user to use a terminal to send room drawing data to a server.

[1526] The "analysis means" is a processing system that uses an image processing algorithm to identify the structure and each element of the room from the drawing data received by the server.

[1527] "Means for conducting a Feng Shui evaluation" refers to a method for applying the principles of Feng Shui to conduct an evaluation based on the analyzed information of the room.

[1528] The "means for generating advice" is a system that automatically creates optimal layout and design suggestions based on the results of the feng shui evaluation, taking into account the user's lifestyle and preferences.

[1529] The "means for presenting advice" is a means for notifying the user of the generated advice on placement or design visually or audibly.

[1530] "Means for visual display in virtual space" refers to a function that provides users with advice based on Feng Shui evaluation as a 3D model or virtual reality.

[1531] The "means for experiencing furniture arrangement in a virtual store" is a system that allows users to try out furniture arrangements in a virtual space.

[1532] This invention is a system that allows users to upload their own room plan data, analyzes it, and provides advice on optimal layout and design based on the principles of Feng Shui. This system utilizes a virtual store environment, in particular, allowing users to visually confirm advice and simulate furniture layout in a virtual space.

[1533] When a user uploads room plan data from their device, the device sends the data to the server. The server then analyzes the received plan data using image processing algorithms to extract information about the room structure and the location of each element. This analysis uses image processing libraries such as OpenCV.

[1534] The server then runs a feng shui evaluation algorithm based on the analyzed data. This algorithm evaluates the room's structure and furniture placement, and identifies areas for improvement and optimal placement based on the principles of feng shui. Specifically, it applies the concept of the eight cardinal directions and generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction."

[1535] Based on the results of the Feng Shui evaluation, the server generates optimal layout and design advice that suits the user's lifestyle and preferences. This advice includes suggestions for furniture placement and color usage, such as "place plants in the southeast corner" or "move the sofa to the north side." The generated advice is sent to the device in JSON format.

[1536] The device analyzes the received advice and converts it into a visually understandable format, such as creating furniture layout plans and color suggestions, which the user can view in a virtual space using a smartphone or head-mounted display.

[1537] For example, if a user uploads blueprints of a living room, the server will identify the shape of the room, the location of windows and doors, and the layout of existing furniture, and then propose the optimal layout and design based on that.The user can view the proposal in a virtual space using a head-mounted display, and can actually change the layout in a virtual store to simulate it.

[1538] An example of a prompt for the generative AI model is as follows:

[1539] "Analyze the drawing data, including the room footprint, window, door, and existing furniture locations, and generate optimal furniture placement advice based on Feng Shui principles. This advice includes specific furniture placement, color suggestions, and plant placement. For example, move the sofa to the north side of the living room and place plants in the southeast corner."

[1540] This allows users to visually and intuitively understand the advice provided and simulate actual layouts in a virtual space, ultimately helping users to create a comfortable and harmonious living space.

[1541] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1542] Step 1:

[1543] The user selects the room drawing data and sends an upload request from the terminal.

[1544] Input: User's drawing data (e.g. JPEG file)

[1545] Action: The user clicks the "Upload Drawing Data" button in the application.

[1546] Output: The drawing data is saved on the terminal and sent to the server.

[1547] Step 2:

[1548] The terminal transmits the uploaded drawing data to the server.

[1549] Input: Drawing data selected by the user in step 1

[1550] Operation: The terminal sends drawing data to the server as an HTTP request.

[1551] Output: The server receives the drawing data.

[1552] Step 3:

[1553] The server analyzes the received drawing data and extracts information about the room structure and the location of elements.

[1554] Input: Uploaded drawing data

[1555] How it works: The server uses image processing algorithms such as OpenCV to identify the location of walls, windows, doors and existing furniture in the room.

[1556] Output: Room structure information and element position information as analysis results

[1557] Step 4:

[1558] The server performs a feng shui evaluation based on the analyzed data.

[1559] Input: Analysis results from Step 3 (room structure information and element location information)

[1560] How it works: It applies Feng Shui algorithms to make an assessment based on, for example, the eight directions or the five elements.

[1561] Output: Feng Shui evaluation result (e.g. "The living room window is in the southeast, so it would be good to place some plants there.")

[1562] Step 5:

[1563] The server generates optimal placement and design advice based on the feng shui evaluation results.

[1564] Input: Step 4 Feng Shui evaluation results

[1565] How it works: Based on the results of the Feng Shui evaluation, it generates advice on furniture placement and color usage that suits the user's lifestyle and preferences.

[1566] Output: Specific placement advice (e.g., "Place plants in the southeast corner," "Move the sofa to the north side")

[1567] Step 6:

[1568] The server sends the generated advice to the terminal in JSON format.

[1569] Input: Specific placement advice for step 5

[1570] Behavior: The advice is converted to JSON format and sent to the device as an HTTP response.

[1571] Output: Advice in JSON format as received on the terminal

[1572] Step 7:

[1573] The device analyzes the received advice and displays it to the user in a visually easy-to-understand format.

[1574] Input: JSON format advice from step 6

[1575] How it works: Furniture layout plans and color suggestions are generated based on JSON data and reflected in the application interface.

[1576] Output: Layout and design proposals that users can visually check

[1577] Step 8:

[1578] Users can use a smartphone or head-mounted display to check and simulate proposed layouts and designs in a virtual space.

[1579] Input: Visual layout and design proposals from Step 7

[1580] How it works: The user wears a smartphone or a head-mounted display and manipulates and simulates the placement of furniture in a virtual space.

[1581] Output: Simulation of furniture arrangement in the virtual space experienced by the user

[1582] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1583] The present invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions.

[1584] Basic system configuration

[1585] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. Based on the evaluation results and the user's emotional information, the server generates advice on optimal layout and design. This advice is then sent back to the device and presented to the user.

[1586] Program processing

[1587] Uploading drawing data

[1588] 1. User: Select the room drawing data from the terminal and press the upload button.

[1589] 2. Terminal: Converts the drawing data into an appropriate format (e.g., JSON metadata) and sends it to the server.

[1590] Drawing data analysis

[1591] 3. Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[1592] 4. Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[1593] Recognizing user emotions

[1594] 5. On the device: An emotion engine is used to recognize the user's emotions (e.g., happiness, sadness, nervousness, etc.) in real time. This emotion data is obtained from input devices such as sensors and cameras.

[1595] 6. Terminal: Sends the recognized emotion data to the server.

[1596] Conducting a Feng Shui evaluation

[1597] 7. Server: Based on the stored metadata and sentiment data, it runs a Feng Shui evaluation algorithm and evaluates the room structure and layout based on Feng Shui principles.

[1598] 8. Server: The evaluation algorithm analyzes the energy flow and balance in each direction and identifies problems and areas that need improvement, taking into account the user's emotional information.

[1599] Generating Advice

[1600] 9. Server: Based on the results of the Feng Shui evaluation and the emotional data, the server generates layout and design advice that is optimal for the user's emotional state. Specific examples of this advice include suggestions for furniture placement and color usage.

[1601] 10. Server: Sends the generated advice in JSON format to the device.

[1602] Providing advice

[1603] 11. Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions).

[1604] 12. Terminal: Displays an interface that provides advice to the user, including specific rearrangement steps and a list of recommended items.

[1605] Specific examples

[1606] Living room improvements

[1607] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[1608] 2. Terminal: Receives drawing data and sends it to the server.

[1609] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[1610] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[1611] 5. Terminal: Using an emotion engine, the user's emotions are acquired from facial expressions, voice, etc., and sent to the server.

[1612] 6. Server: For example, it generates an evaluation result such as "The living room window is located in the southeast, so it would be good to place plants in this direction," and generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[1613] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[1614] 8. Terminal: Analyzes the received advice and creates a visual layout diagram.

[1615] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[1616] The present invention allows users to easily realize room layout and design based on the principles of Feng Shui and their own emotional state, thereby creating a comfortable and harmonious living space.

[1617] The processing flow will be explained below.

[1618] Step 1:

[1619] User: Select the room drawing data from the terminal and press the upload button.

[1620] Step 2:

[1621] Terminal: Receives drawing data, converts it into an appropriate format (e.g., JSON metadata), and sends it to the server.

[1622] Step 3:

[1623] Server: Receives the drawing data and uses image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture.

[1624] Step 4:

[1625] Server: Stores the analyzed information in a database and generates metadata for the analysis results.

[1626] Step 5:

[1627] On the device: Recognizes the user's emotions in real time using an emotion engine. Emotion data is collected using methods such as facial expression analysis and voice analysis.

[1628] Step 6:

[1629] Terminal: Sends the recognized emotion data to the server.

[1630] Step 7:

[1631] Server: Executes the Feng Shui evaluation algorithm based on the stored analysis result metadata and the received emotion data.

[1632] Step 8:

[1633] Server: Based on the principles of Feng Shui, for example by applying the concept of the "eight directions," we analyze the structure and layout of a room and evaluate the flow and balance of energy.

[1634] Step 9:

[1635] Server: It also considers the user's emotional information and identifies areas that need improvement and the optimal layout. For example, if the user is looking for a relaxing environment, it will suggest a layout and color scheme that matches that emotion.

[1636] Step 10:

[1637] Server: Generates specific advice such as optimal furniture placement and color usage, including recommendations that reflect the user's emotional state.

[1638] Step 11:

[1639] Server: Sends the generated advice in JSON format to the device.

[1640] Step 12:

[1641] Terminal: Analyzes the received advice and converts it into a visually understandable format (e.g., furniture layout diagram, color suggestions).

[1642] Step 13:

[1643] Terminal: Displays an interface that provides advice to the user, including specific rearrangement instructions and a list of recommended items.

[1644] Step 14:

[1645] User: Based on the advice provided, adjust the layout and design of their room to create the optimal living space.

[1646] Specific examples

[1647] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[1648] 2. Terminal: Receives drawing data and sends it to the server.

[1649] 3. Server: Runs image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[1650] 4. Server: Executes the Feng Shui evaluation algorithm based on the extracted information.

[1651] 5. Terminal: The emotion engine analyzes the user's facial expressions and voice, and sends the user's emotion data to the server.

[1652] 6. Server: For example, it generates a Feng Shui assessment such as, "The living room window is located in the southeast, and placing plants in this direction will improve your luck," and generates advice based on the situation, such as suggesting calming colors if the user is looking for relaxation, or bright colors if the user is looking for vitality.

[1653] 7. Server: Create specific improvement advice such as "Place plants in the southeast corner" and "Move the sofa to the north side."

[1654] 8. Terminal: Analyzes the received advice and creates visual layout and color suggestions.

[1655] 9. Terminal: Provides advice to the user and explains specific steps for reconfiguration.

[1656] In this way, users can achieve optimal room layout and design based on Feng Shui principles and their own emotional state, creating a comfortable and harmonious living space.

[1657] Example 2

[1658] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1659] Conventional Feng Shui evaluation systems simply provide advice on room layout and design based on the principles of Feng Shui, but do not take into account the user's emotional state, making it difficult to improve the user's psychological satisfaction and comfort.

[1660] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1661] In this invention, the server includes means for analyzing uploaded drawing data, means for performing a feng shui evaluation based on the analyzed drawing data, and means for generating advice on optimal layout and design based on the feng shui evaluation, thereby enabling suggestions for room layout and design that appropriately take into account the user's emotional state in addition to advice based on the principles of feng shui.

[1662] "Drawing data" is data that represents the layout and structure of a room, and is usually provided as an image file in JPEG or PNG format.

[1663] "Means for uploading" refers to the method by which a user sends drawing data to the system through a terminal.

[1664] "Means of analysis" refers to the process of extracting information such as room boundaries and furniture positions from the received drawing data.

[1665] "Means for conducting Feng Shui evaluation" refers to a method for evaluating the layout of a room in accordance with the principles of Feng Shui based on the analyzed data.

[1666] "Means for generating advice" refers to a method for generating optimal placement and design suggestions based on the results of the Feng Shui assessment and the user's emotional state.

[1667] The "means for presenting advice" refers to a method for displaying the generated advice to the user in a visually easy-to-understand format.

[1668] "Means for recognizing emotions" refers to a method for understanding a user's emotional state in real time from their facial expressions and voice.

[1669] "Means for using emotional data in analysis" refers to methods for incorporating recognized emotional information into the Feng Shui evaluation and advice generation process.

[1670] This invention is a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui. By combining this system with an emotion engine that recognizes the user's emotions, it is possible to improve the user's psychological satisfaction and comfort.

[1671] Basic system configuration

[1672] Hardware and Software

[1673] Terminal (user device): Uploads drawing data and performs emotion recognition. Smartphones, tablets, PCs, etc. are used.

[1674] Server: Analyzes the drawing data, performs Feng Shui evaluations, and generates advice. A high-performance processor and sufficient memory are recommended.

[1675] Image processing algorithms (OpenCV, TensorFlow, etc.): used to analyze drawing data.

[1676] Database (MySQL, Postgres, etc.): Used to store the parsed data.

[1677] Emotion Engine (Emotion API, Face Recognition API): Used to recognize user emotions.

[1678] Processing flow

[1679] The user uploads room plan data via their device. The device then sends this data to the server. The server analyzes the received plan data and evaluates it based on the principles of feng shui. The device then recognizes the user's emotions in real time and sends this emotional data to the server. The server generates optimal layout and design advice based on the results of the feng shui evaluation and the user's emotional information. This advice is then sent back to the device and presented to the user.

[1680] Specific examples

[1681] Living room improvements

[1682] 1. User: Uploads the drawing data (e.g., JPEG format) of the living room.

[1683] 2. Terminal: Receives drawing data and sends it to the server.

[1684] 3. Server: Runs the algorithm used (e.g. OpenCV or TensorFlow) to determine the dimensions of the living room, the location of windows and doors, and the layout of existing furniture.

[1685] 4. Server: Performs Feng Shui evaluation based on the extracted information.

[1686] 5. Device: Using the Emotion API, emotions are acquired from the user's facial expressions, voice, etc. and sent to the server.

[1687] 6. Server: Generates an evaluation result such as, "The living room window is located in the southeast, so it would be good to place plants in this direction." If the user is relaxed, it suggests calm colors, and if they are feeling down, it suggests bright colors.

[1688] 7. Server: As improvement advice, suggest things like "place plants in the southeast corner" or "move the sofa to the north side."

[1689] 8. Terminal: Analyzes the received advice and converts it into a visually understandable format.

[1690] 9. Terminal: Provide advice in the user interface, including specific steps for reconfiguring the device.

[1691] Prompt Sentence Examples

[1692] Here are some example prompts to input to a generative AI model:

[1693] Please provide a detailed explanation of each step in your system, including the algorithms, tools, and data formats used, in order to allow users to upload a living room blueprint and receive optimal room improvement advice based on Feng Shui and emotions. For example, please mention image processing using OpenCV and emotion recognition using EmotionAPI.

[1694] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1695] Step 1:

[1696] User: Select the room drawing data and press the upload button on the device.

[1697] Input: Room plan data in JPEG or PNG format.

[1698] Operation: Select the drawing data on the terminal and press the upload button to register the drawing data in the system.

[1699] Step 2:

[1700] Terminal: Converts the drawing data into an appropriate format (metadata in JSON format) and sends it to the server.

[1701] Input: Drawing data in JPEG or PNG format.

[1702] Output: Metadata in JSON format.

[1703] Operation: The drawing data is read, basic information about the drawing (file name, upload date and time, etc.) is converted to JSON format, and sent to the server via the Internet.

[1704] Step 3:

[1705] Server: Analyzes the received drawing data using image processing algorithms (such as OpenCV or TensorFlow).

[1706] Input: Metadata in JSON format.

[1707] Output: The resulting room boundaries, positions and dimensions of windows, doors and existing furniture.

[1708] How it works: It runs image processing algorithms to analyze the location and dimensions of each element in the room (boundaries, windows, doors, furniture).

[1709] Step 4:

[1710] Server: Stores the analyzed information in a database and generates metadata.

[1711] Input: The resulting location and dimensions of each element in the room.

[1712] Output: Analysis results and associated metadata stored in a database.

[1713] Operation: The analysis results are stored in a database and metadata required for subsequent processing is generated.

[1714] Step 5:

[1715] Terminal: Using an emotion engine (Emotion API, Face Recognition API, etc.), the user's emotions are recognized in real time and sent to the server.

[1716] Input: User's facial and voice data.

[1717] Output: Sentiment data in JSON format.

[1718] How it works: The user's facial expressions and voice are captured through the camera and microphone, analyzed by the emotion engine, and the results are sent to the server in JSON format.

[1719] Step 6:

[1720] Server: Runs the Feng Shui evaluation algorithm based on the stored metadata and sentiment data.

[1721] Input: Metadata, emotion data.

[1722] Output: Feng Shui evaluation results.

[1723] How it works: Analyzes and evaluates the structure and energy flow of a room based on the principles of Feng Shui.

[1724] Step 7:

[1725] Server: Based on the results of the Feng Shui evaluation and emotional data, it generates placement and design advice that is optimal for the user's emotional state.

[1726] Input: Feng Shui evaluation results, emotion data.

[1727] Output: Furniture placement and color suggestions as advice.

[1728] How it works: Generates optimal layout and design suggestions based on Feng Shui assessment and emotion data. Specifically, it suggests furniture placement and color usage.

[1729] Step 8:

[1730] Server: Sends the generated advice in JSON format to the device.

[1731] Input: Advice on placement and design suggestions.

[1732] Output: Advice data in JSON format.

[1733] Operation: The generated advice is converted into JSON format and sent to the terminal.

[1734] Step 9:

[1735] Terminal: Analyzes the received advice and converts it into a visually easy-to-understand format.

[1736] Input: Advice data in JSON format.

[1737] Output: Furniture layout and color suggestions.

[1738] How it works: Parses advice data in JSON format and generates a visually friendly interface using HTML, CSS, and JavaScript.

[1739] Step 10:

[1740] Terminal: Displays an interface that presents advice to the user.

[1741] Input: Furniture layout and color suggestions.

[1742] Output: A user-friendly interface.

[1743] How it works: The user interface displays specific rearrangement steps and visual suggestions, making it easy for users to follow the advice.

[1744] (Application example 2)

[1745] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1746] Conventional Feng Shui evaluation systems only provide layout advice based on room diagram data and are unable to provide advice that takes user emotions into account. As a result, they lack consideration for the user's actual comfort and satisfaction, limiting their ability to provide optimal living spaces. Furthermore, even in commercial spaces such as virtual stores, there is a need for layout adjustments based on the real-time changing emotions of customers and staff.

[1747] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1748] In this invention, the server includes means for analyzing drawing data, means for recognizing a user's emotion, and means for generating advice based on the analyzed drawing data and the user's emotion, thereby providing advice on optimal layout and design based on the user's emotion, making it possible to realize a more comfortable and satisfying residential or commercial space.

[1749] "Room drawing data" is information that indicates the layout of the room, the position and dimensions of the furniture, etc.

[1750] "Uploading" is the act of sending data from a local device to a remote system, such as a server.

[1751] "Analysis" is the process of processing data and extracting meaningful information from it.

[1752] A "Feng Shui evaluation" is the process of assessing the energy flow and balance of a room based on the principles of Feng Shui.

[1753] "Optimal placement and design advice" refers to suggestions for furniture placement and color based on the results of the Feng Shui evaluation.

[1754] "Means for recognizing user emotions" refers to means for recognizing emotions in real time from the user's facial expressions and voice using cameras and audio sensors.

[1755] "Means for presenting generated advice" refers to a method for presenting analysis results and advice to the user in a visually easy-to-understand manner.

[1756] "Room elements" refers to the physical structures in a room, such as walls, furniture, windows, and doors.

[1757] "Furniture placement and color suggestions" refers to specific advice on where to place furniture and the colors to use in the room.

[1758] This invention combines a system that analyzes room plan data and provides advice on optimal layout and design based on the principles of Feng Shui with an emotion engine that recognizes the user's emotions. This system is mainly composed of three elements: a server, a terminal, and the user.

[1759] Basic system configuration

[1760] 1. Upload the drawing data

[1761] A user uploads room drawing data via a terminal, which converts the data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[1762] 2. Analysis of drawing data

[1763] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores the analyzed information in a database. It then generates metadata for the analysis results according to a feng shui evaluation algorithm.

[1764] 3. User Emotion Recognition

[1765] The device uses an emotion engine to acquire the user's emotions in real time from cameras and sensors, including facial and voice data, and sends it to the server as emotion data.

[1766] 4. Conduct a Feng Shui assessment

[1767] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[1768] 5. Generating Advice

[1769] The server generates optimal layout and design advice based on the user's emotional state based on the results of the Feng Shui evaluation and the emotional data. This advice includes specific suggestions for furniture placement and color usage. The generated advice is then sent to the device in JSON format.

[1770] 6. Providing advice

[1771] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and displays an interface to present to the user, suggesting specific steps for rearrangement and a list of recommended items.

[1772] Specific examples

[1773] Living room improvements

[1774] 1. A user uploads a drawing of a living room. The drawing data can be, for example, a JPEG image.

[1775] 2. The device sends the drawing data to a server, which uses image processing algorithms to determine the living room's dimensions, the location of windows and doors, and the layout of existing furniture.

[1776] 3. The device uses an emotion engine to recognize the user's emotions based on facial expressions and voice data acquired from cameras and microphones, and transmits the emotions to the server.

[1777] 4. The server runs the Feng Shui evaluation algorithm and combines the analysis results metadata with the emotion data to make an evaluation.

[1778] 5. For example, based on the Feng Shui evaluation result that "the living room window is located in the southeast, so it is good to place plants in this direction," the system generates advice that reflects the user's emotional state, such as suggesting calming colors when the user is relaxed and bright colors when the user is feeling down.

[1779] 6. The device analyzes the generated advice and presents it to the user as a visual layout diagram and color proposal, allowing the user to confirm specific steps for re-arrangement.

[1780] Prompt Sentence Examples

[1781] "Virtual store Feng Shui evaluation system: Based on store drawing data and real-time collected sentiment data, it generates optimal store layout and interior placement advice in accordance with Feng Shui principles. The specific steps are as follows:

[1782] 1. Upload the store's blueprint data.

[1783] 2. Use sensors and cameras to collect real-time voice and facial expression data in-store.

[1784] 3. Analyze the drawing data and extract the store's important elements (walls, windows, furniture, etc.).

[1785] 4. Run the Feng Shui evaluation algorithm based on the sentiment data.

[1786] 5. Combine the analysis results with sentiment data to generate optimal store layout and interior design advice.

[1787] 6. Based on the advice provided, we will display a visual suggesting specific changes to the layout.

[1788] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1789] Step 1:

[1790] Uploading drawing data

[1791] The user selects the room plan data via the terminal and presses the upload button. The terminal converts this plan data into an appropriate format (e.g., JSON format metadata) and sends it to the server.

[1792] Input: Room drawing data (JPEG, PNG, etc.)

[1793] Output: Metadata in JSON format

[1794] Step 2:

[1795] Drawing data analysis

[1796] The server analyzes the received drawing data, using image processing algorithms to extract important elements such as room boundaries, window and door locations, and existing furniture, and stores this information in a database.

[1797] Input: JSON formatted metadata

[1798] Output: Analysis result metadata (room element information)

[1799] Step 3:

[1800] User Emotion Recognition

[1801] The device uses an emotion engine to acquire the user's real-time emotional data (facial expressions and voice) from cameras and sensors and transmits it to the server as emotional data.

[1802] Input: User's facial expressions and voice data

[1803] Output: User emotion data

[1804] Step 4:

[1805] Conducting a Feng Shui evaluation

[1806] The server runs a feng shui evaluation algorithm based on the stored analysis results metadata and emotional data, analyzing the energy flow and balance in each direction and identifying problems and areas requiring improvement, taking into account the user's emotional information.

[1807] Input: Metadata of analysis results, user emotion data

[1808] Output: Feng Shui evaluation results

[1809] Step 5:

[1810] Generating Advice

[1811] The server generates optimal layout and design advice based on the results of the Feng Shui evaluation and emotional data. This advice includes specific examples such as furniture placement and color usage. The advice is also tailored to the user's emotional state.

[1812] Input: Feng Shui evaluation results, user emotion data

[1813] Output: JSON data of the advice

[1814] Step 6:

[1815] Providing advice

[1816] The device analyzes the received advice and converts it into a visually easy-to-understand format (e.g., furniture layout diagram, color suggestions), and then presents the user with specific rearrangement procedures and a list of recommended items.

[1817] Input: JSON data for advice

[1818] Output: Visual layout, color suggestions, and layout change instructions

[1819] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1820] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1821] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1822] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1823] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1824] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1825] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1826] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1827] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1828] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1829] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1830] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1831] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1832] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1833] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1834] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1835] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1836] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1837] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1838] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1839] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1840] The following is further disclosed regarding the above embodiment.

[1841] (Claim 1)

[1842] A means to upload room drawing data,

[1843] means for analyzing the uploaded drawing data;

[1844] A means for performing a feng shui evaluation based on the analyzed drawing data;

[1845] A means of generating optimal placement and design advice based on Feng Shui assessments;

[1846] a means for presenting the generated advice;

[1847] A system including:

[1848] (Claim 2)

[1849] 10. The system of claim 1, further comprising means for analyzing a location of an element within a room.

[1850] (Claim 3)

[1851] 10. The system of claim 1, further comprising means for generating furniture placement and color suggestions based on the results of the Feng Shui assessment.

[1852] "Example 1"

[1853] (Claim 1)

[1854] A means to upload room drawing data,

[1855] means for transmitting the uploaded drawing data to a server;

[1856] A means for analyzing the drawing data transmitted to the server;

[1857] A means for performing a feng shui evaluation based on the analyzed drawing data;

[1858] A means of generating optimal placement and design advice based on Feng Shui assessments;

[1859] means for transmitting the generated advice to a terminal;

[1860] a means for visually presenting the advice received at the device;

[1861] A system including:

[1862] (Claim 2)

[1863] 10. The system of claim 1, further comprising means for analyzing the location of elements within the room using image processing techniques.

[1864] (Claim 3)

[1865] 10. The system of claim 1, further comprising means for generating furniture placement and color suggestions in JSON format based on the results of the Feng Shui assessment.

[1866] "Application Example 1"

[1867] (Claim 1)

[1868] A means to upload room drawing data,

[1869] means for analyzing the uploaded drawing data;

[1870] A means for performing a feng shui evaluation based on the analyzed drawing data;

[1871] A means of generating optimal placement and design advice based on Feng Shui assessments;

[1872] a means for presenting the generated advice;

[1873] A means of visually displaying advice in a virtual space;

[1874] A means for experiencing furniture arrangement in a virtual store;

[1875] A system including:

[1876] (Claim 2)

[1877] 10. The system of claim 1, further comprising means for analyzing a location of an element within a room.

[1878] (Claim 3)

[1879] 10. The system of claim 1, further comprising means for generating furniture placement and color suggestions based on the results of the Feng Shui assessment.

[1880] "Example 2: Combining Emotion Engines"

[1881] (Claim 1)

[1882] A means to upload room drawing data,

[1883] means for analyzing the uploaded drawing data;

[1884] A means for performing a feng shui evaluation based on the analyzed drawing data;

[1885] A means of generating optimal placement and design advice based on Feng Shui assessments;

[1886] a means for presenting the generated advice;

[1887] means for recognizing a user's emotion;

[1888] a means for using the recognized emotion data for analysis;

[1889] A system including:

[1890] (Claim 2)

[1891] 10. The system of claim 1, further comprising means for analyzing a location of an element within a room.

[1892] (Claim 3)

[1893] 10. The system of claim 1, further comprising means for generating furniture placement and color suggestions based on the results of the Feng Shui assessment.

[1894] "Application example 2 when combining emotion engines"

[1895] (Claim 1)

[1896] A means to upload room drawing data,

[1897] means for analyzing the uploaded drawing data;

[1898] A means for performing a feng shui evaluation based on the analyzed drawing data;

[1899] A means of generating optimal placement and design advice based on Feng Shui assessments;

[1900] means for recognizing a user's emotion;

[1901] means for generating advice based on the analyzed drawing data and the user's emotions;

[1902] a means for presenting the generated advice;

[1903] A system including:

[1904] (Claim 2)

[1905] 10. The system of claim 1, further comprising means for analyzing a location of an element within a room.

[1906] (Claim 3)

[1907] 10. The system of claim 1, further comprising means for generating furniture placement and color suggestions based on the results of the Feng Shui assessment. [Explanation of symbols]

[1908] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means to upload room drawing data, means for analyzing the uploaded drawing data; A means for performing a feng shui evaluation based on the analyzed drawing data; A means of generating optimal placement and design advice based on Feng Shui assessments; a means for presenting the generated advice; A system including:

2. The system of claim 1 , further comprising means for analyzing the location of elements within a room.

3. The system of claim 1 , further comprising means for generating furniture arrangement and color suggestions based on the results of the Feng Shui evaluation.

Images