system

Abstract

We provide the system. [Solution] A means for receiving images via a user terminal, A means for analyzing the received image and identifying the exterior wall portion, Means for generating multiple painting options for an identified exterior wall portion, A means of displaying the generated painting options on the user terminal and making them selectable, A means of providing augmented reality visualization based on selected painting options, A system that includes this.

Description

【Technical Field】 , , 【0004】 , , , 【0005】 , , , , 【0001】 The technology of the present disclosure relates to a system. 【Background Art】 【0002】 Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. 【Prior Art Documents】 【Patent Documents】 【0003】 【Patent Document 1】 Japanese Patent Application Laid-Open No. 2022-180282 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 In conventional exterior wall painting reforms, it has been difficult for customers to visually imagine what colors and designs are appropriate for the exterior of their houses, and it has been a problem that it takes time and effort for selection. In addition, the simulation for confirming the actual finish has been insufficient, which has been a factor in reducing customer satisfaction. Thus, it has been demanded to materialize a painting plan and facilitate the customer to make a satisfactory choice. 【Means for Solving the Problems】 【0005】 This invention relates to a system for easily simulating exterior wall painting plans using images captured by a user terminal. The system includes means for receiving images from the user terminal, analyzing those images, and identifying exterior wall sections. Furthermore, it includes means for generating multiple painting options for the identified exterior wall sections and displaying them on the user terminal. In addition, it provides augmented reality visualization based on the selected painting option and includes means for fine-tuning the painting option using the user terminal, thereby enabling the user to intuitively and quickly select the optimal painting plan. 【0006】 A "user terminal" is an electronic device used by a user to operate an interface, and is a means of capturing images and displaying simulation results. 【0007】 "Analyzing an image" refers to a series of computational processes used to process received image data and identify specific attributes or regions. 【0008】 "Exterior wall portion" refers to the area of ​​a house's exterior that should be painted, excluding elements that are not painted, such as doors and windows. 【0009】 "Painting options" refer to design choices such as colors, textures, and patterns that can be applied to the exterior walls. 【0010】 Augmented reality visualization is a technology that overlays virtual information and images onto real-world footage to create a more detailed and realistic visualization. 【0011】 "Means for receiving images" refers to a processing mechanism for acquiring image data transmitted from a user terminal. 【0012】 "Fine-tuning" refers to the act of making detailed adjustments to the color and texture settings of the displayed paint options to suit the user's preferences. [Brief explanation of the drawing] 【0013】 [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of the data processing device and smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, when an emotion engine is combined. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention] 【0014】 An example of an embodiment of the system according to the technology of the present disclosure will be described below with reference to the accompanying drawings. 【0015】 First, the terms used in the following description will be explained. 【0016】 In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like. 【0017】 In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor. 【0018】 In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like. 【0019】 In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark). 【0020】 In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or." 【0021】 [First Embodiment] 【0022】 Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment. 【0023】 As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server. 【0024】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0025】 The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52. 【0026】 The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input. 【0027】 The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. 【0028】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54. 【0029】 Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14. 【0030】 As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30. 【0031】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0032】 In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0033】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal". 【0034】 The embodiments for carrying out the present invention are described below. This system is an interactive platform for providing a simulation of exterior wall painting. First, the user takes a photograph of the exterior of their home and uploads it to the system using a terminal. At this time, the terminal guides the user through the image selection and transmission operations via a user interface, making it easy for the user to send images to the system. 【0035】 The server analyzes the received image. Specifically, it uses an AI model to identify the exterior wall portion of the image. The server excludes unpainted areas such as windows and doors, and identifies the areas that can be painted. For these identified areas, the server generates painting options. The generated painting options include variations in color, texture, and pattern, offering the user a number of design choices. 【0036】 The terminal displays these painting options suggested by the server. Users can select each option through the interface, and the selected design is reflected in a real-time simulation applied to the exterior wall. In this process, the terminal utilizes augmented reality technology to provide a sense of realism as if the user were actually visiting the site. For example, by looking around through the terminal's camera, users can see from various angles how the selected design will blend into the real space. 【0037】 Furthermore, users can utilize fine-tuning functions on the interface. Specific examples include slightly brightening the selected hue or changing the texture intensity. These features allow users to intuitively and precisely finalize a paint design that perfectly matches their needs. Therefore, this system aims to streamline the exterior paint selection process through visual simulation, thereby improving user satisfaction. 【0038】 The following describes the processing flow. 【0039】 Step 1: 【0040】 Users take photos of the exterior of their homes with their smartphones or cameras and upload those images to the system via their devices. Following the interface, users select images and send them to the server by pressing the upload button. 【0041】 Step 2: 【0042】 The server receives the uploaded image and begins image analysis using an AI model. The server first preprocesses the image, adjusting the resolution and removing noise. Then, it identifies the exterior wall portion and excludes unpainted areas such as windows and doors. 【0043】 Step 3: 【0044】 The server generates paint options applicable to the identified exterior wall section. Specifically, it uses an AI model to create different options for color, texture, and pattern, and combines them with trend information obtained from a database to provide the optimal choice. 【0045】 Step 4: 【0046】 The generated painting options are sent to the terminal and displayed to the user through the interface. The user can view these options and choose their preferred design. The selected design is then reflected on the exterior wall in real time. 【0047】 Step 5: 【0048】 The device activates augmented reality mode, allowing the user to overlay their selected paint design onto their actual home using the smart device's camera. The user can then move the device to experience the paint design from various angles. 【0049】 Step 6: 【0050】 Users can fine-tune painting options on the interface. They can easily make minor design changes by adjusting color sliders and texture intensity. These adjustments are immediately reflected in the simulation. 【0051】 (Example 1) 【0052】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0053】 Traditional exterior design changes were difficult to visualize until they were tested on a physical prototype, and fine-tuning the user's chosen design required specialized knowledge. Furthermore, the need to prepare physical samples resulted in costly and time-consuming processes. This often led to a gap between the user's desired design and the final product. 【0054】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0055】 In this invention, the server includes means for receiving visual information from a user device, means for analyzing the received visual information and identifying the exterior portion of a building, and means for generating multiple decorative options for the identified exterior portion. This allows the user to easily try out various designs and make fine adjustments. 【0056】 A "user device" is a computing device operated by a user, which inputs visual information through interaction with the system and displays the results. 【0057】 "Visual information" refers to digital data such as images and videos obtained through user input. 【0058】 A "server" is a computer system that centrally processes data and provides information through communication with user devices. 【0059】 "Analysis" refers to the process of processing visual information and extracting useful information. 【0060】 "The exterior surface of a building" refers to the painted or decorated outer surface of a building that is identifiable within the building's visual information. 【0061】 "Decorative options" refer to different design choices, such as color, texture, and pattern, that are proposed for specific exterior parts. 【0062】 "Presentation" refers to the visual display of options on a user device, enabling the user to perform actions. 【0063】 "Selection" refers to the operation in which a user chooses one option from several decorative options. 【0064】 "Fine-tuning" refers to the process of further adjusting each element of the selected decorative options. 【0065】 Augmented reality visualization refers to a technology that overlays visual information from the real world with digital information to apply virtual designs to buildings. 【0066】 This invention provides a system for users to visually examine, select, and fine-tune the exterior design of a building. The system uses a portable computing device such as a smartphone or tablet as the user device. 【0067】 The user first takes a photograph of the building's exterior. The terminal uploads the captured image to the system and sends it to the server as visual information. The terminal's user interface assists the user in easily selecting and sending images. 【0068】 The server analyzes the received visual information using a generative AI model. Specifically, it employs a technique to identify the exterior parts of buildings in the image and exclude areas that are not to be painted, such as windows and doors. The AI ​​model's analysis enables more accurate area identification. 【0069】 The server generates multiple decorative options for the identified exterior portion. These include design elements such as color, texture, and pattern. Through the generating AI model, it is possible to present options that closely match the user's desired design. For example, prompts such as "a modern look in a light tone of blue" can be used. 【0070】 The terminal visualizes and displays decorative options presented by the server to the user. The user can select their desired design from these options and see the results in real time. Furthermore, the selected design can be overlaid on the real building using augmented reality technology, allowing for visual confirmation from different angles. 【0071】 Furthermore, users can make fine adjustments through the interface. Specifically, they can change the hue and adjust the intensity of the texture, allowing for detailed customization. The intuitive and user-friendly interface helps in realizing the ideal design. 【0072】 In this way, this system streamlines the selection and adjustment of exterior designs and provides an innovative means to improve the user experience. 【0073】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0074】 Step 1: 【0075】 The user takes a photograph of the building's exterior using their own device. The input is an image of the building. The image is selected through the user interface and sent to the system. The output is visual information uploaded to the server. 【0076】 Step 2: 【0077】 The server analyzes the visual information received from the user's device. It then activates a generating AI model to identify the exterior parts of a building from the input image. Specifically, the AI ​​model uses image analysis techniques to identify the building's exterior walls, windows, doors, etc., at the pixel level, and excludes parts that are not to be painted. The output is data of the analyzed exterior parts. 【0078】 Step 3: 【0079】 The server generates decorative options based on the analysis results. The input is data of the identified exterior portion. Using a generative AI model, it generates multiple designs based on a prompt (e.g., "a modern look in a light blue tone"). These designs include variations in color, texture, and pattern. The output is a list of decorative options that the user can select. 【0080】 Step 4: 【0081】 The terminal displays decoration options from the server in a user interface. The input consists of several generated decoration options. The user reviews the displayed options and selects their desired design. The output is the design selected by the user. 【0082】 Step 5: 【0083】 The device performs augmented reality visualization using the selected design. The input consists of the user-selected design and visual information of the real-world building. The device utilizes augmented reality technology to perform a real-time simulation applying the selected design to the exterior. The output allows the user to see how the design will actually appear on the building's exterior. 【0084】 Step 6: 【0085】 The user fine-tunes decorative options on the interface. Inputs include the selected design and the user's additional adjustment instructions. The terminal updates the design based on the user's instructions regarding hue and texture intensity. The output is the final design that meets the user's preferences. 【0086】 (Application Example 1) 【0087】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0088】 In the design and construction of exterior wall painting at construction sites, there are challenges in that it is difficult for customers and contractors to have a visual image of the finished product and to share a concrete vision of the completed work. Furthermore, the time required for adjusting construction plans and fine-tuning designs is also a challenge. 【0089】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0090】 In this invention, the server includes means for receiving video from a user device, means for analyzing the received video and identifying the exterior wall portion of a structure, and means for generating a number of paint options for the identified exterior wall portion of the structure. This makes it possible for customers and contractors to visualize a concrete completed image before construction and to make design adjustments quickly and efficiently. 【0091】 A "user device" is an electronic device that a user directly operates to send and receive information, such as a smartphone or tablet. 【0092】 "Image" refers to visual data generated based on light information, and includes images and videos displayed in digital format on a user's device. 【0093】 "Analysis" refers to the process of examining given data in detail to identify its constituent elements and characteristics, and in particular, it includes understanding and interpreting images and videos using AI technology. 【0094】 A "structure" is a building constructed by humans, and mainly refers to physically fixed entities such as buildings and infrastructure. 【0095】 The term "exterior wall portion" refers to the wall surface that covers and protects a structure from the outside, and is mainly composed of exterior cladding. 【0096】 "Painting options" refers to variations in the type, color, and texture of paint applied to the exterior walls of a structure, and includes multiple proposals used in determining the design. 【0097】 Augmented reality visualization is a technology that overlays digital information onto the real world, allowing users to visually perceive virtual objects within their real-world environment. 【0098】 "Visualization" refers to the technique of displaying information or data as images or videos to make it easier for humans to understand through their visual senses. 【0099】 "Textured design" refers to a realistic representation in visual design that reproduces the texture and physical properties of an object's surface. 【0100】 This system is implemented using user devices such as smartphones and personal computers. The user begins by using the device's camera function to capture images of the exterior wall of the structure to be constructed. The captured images are transmitted to a server via the user's device. The server utilizes a high-performance AI model to analyze the received images in detail. This analysis process identifies the exterior wall portion of the structure and excludes other parts. 【0101】 After identifying the exterior wall section, the server generates numerous paint options. These options incorporate a variety of colors, textures, and designs. The generated paint options are sent to the user device and presented to the user via the device's display for selection. 【0102】 Once the user selects their desired paint options, this information is sent back to the server, which then generates an augmented reality (AR) visualization based on the selection. This visualization can be viewed through the user's device's display, allowing the user to see a concrete image of how the selected design will look on the actual construction site. 【0103】 Furthermore, users can make detailed adjustments to their paint options. These adjustments include fine-tuning colors and changing textures. The server quickly reflects these adjustments, providing users with updated visualizations in real time. 【0104】 As a concrete example, let's consider a house under construction as a model. To check how the exterior walls of the house will look, the user takes a photo of the site with their smartphone and uploads it to the system. An example of a prompt message at this time might be: "We will perform a simulation of exterior wall painting. Analyze the photo of the exterior walls to be painted with the AI ​​model and indicate the areas that can be painted. Suggest multiple paint variations and create an image of the selected color applied to the real world using AR." 【0105】 This system allows for the visualization of the construction plan, enabling users to see the post-construction image in advance, facilitating communication between customers and contractors, and improving the efficiency and accuracy of construction. 【0106】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0107】 Step 1: 【0108】 The terminal provides an interface for users to capture images of the exterior walls of structures. Users take photos of the exterior walls using a camera, such as a smartphone, and save them to the terminal. During this process, users can adjust the shooting angle, lighting intensity, and other settings as needed. The input is the captured image, and the output is image data ready for processing. 【0109】 Step 2: 【0110】 The terminal sends the captured image to the server. The server analyzes the received image using an AI model. Specifically, the generating AI model identifies the outer wall portion of structures in the image and excludes the rest. The input is image data sent from the user terminal, and the output is the analysis result with the outer wall portion identified. 【0111】 Step 3: 【0112】 Based on the analysis results, the server generates numerous paint options applicable to the exterior walls of the structure. This process creates various variations combining colors, textures, and patterns. The input is data on the identified exterior wall sections, and the output is a list of the generated paint options. 【0113】 Step 4: 【0114】 The server sends the generated paint options to the terminal, which then presents them to the user. The user can then choose their desired design from the presented paint options. The input is the paint option data from the server, and the output is the paint design selected by the user. 【0115】 Step 5: 【0116】 The user submits their selected paint design to the server. The server generates an augmented reality (AR) visualization based on this information and sends it to the user's device. This visualization allows the user to visually see how the selected design would look on a real-world structure. The input is the design data selected by the user, and the output is the AR visualization data. 【0117】 Step 6: 【0118】 The terminal displays the received augmented reality visualization to the user. The user can view a realistic image of the selected design through the terminal's screen and request adjustments as needed. The input is augmented reality visualization data from the server, and the output is the visualization image viewed by the user. 【0119】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0120】 Embodiments of the present invention will be described in detail below. This system is an interactive platform that combines an exterior wall painting simulation with an emotion engine. Users take photos of the exterior of their homes with their smartphones or cameras and upload them to the system via a terminal. The terminal interface is designed to be intuitive for users to operate, making it easy to upload images. 【0121】 The server analyzes the received images using an AI model. First, it preprocesses the images and adjusts the resolution appropriately before identifying the exterior wall areas. The server removes unpainted areas and generates multiple painting options for the paintable areas. In this process, the AI ​​model generates designs with different colors, textures, and patterns, providing the user with a variety of choices. 【0122】 Furthermore, this system incorporates an emotion engine. The server uses the terminal interface to provide data and usage information, allowing the emotion engine to recognize the user's emotional state. For example, it collects the user's reactions when they make selections and adjustments, and analyzes emotions such as joy, surprise, and confusion in real time. This makes it possible to suggest the most suitable painting option for the user's emotions. 【0123】 The terminal displays paint options suggested by the server on its screen, allowing the user to select one. Once a selection is made, a simulation is immediately run, visualizing how the selected design would look applied to the exterior walls. Furthermore, the terminal uses augmented reality technology, enabling the user to view the exterior of their home through the device. This allows the user to visually experience how the selected paint design will look in a real-world environment from multiple angles. 【0124】 Furthermore, users can fine-tune the suggested paint options based on their emotions. They can create the optimal design that suits their feelings by making detailed changes to hue and texture through the on-device interface. For example, they can adjust the colors to softer tones to create a more relaxing space. This system allows users to select the optimal exterior design while considering their own emotions, leading to an unprecedented improvement in the customer experience. 【0125】 The following describes the processing flow. 【0126】 Step 1: 【0127】 The user takes a photo of the exterior of their home and uploads the image to the system using an application on their device. The device displays instructions for selecting the image file through its user interface, making it easy to send the image to the server. 【0128】 Step 2: 【0129】 The server analyzes images received from the terminal using an AI model. First, it optimizes the resolution and removes noise as a preprocessing step. Then, it identifies the exterior wall portion of the image and extracts the area to be painted. Unpainted areas such as windows and doors are automatically excluded. 【0130】 Step 3: 【0131】 The server generates multiple painting options for the identified exterior wall section. It performs hue conversion, texture addition, and pattern generation to create designs based on trends and preferences retrieved from a database as user-selectable options. 【0132】 Step 4: 【0133】 The emotion engine is activated and analyzes the user's emotions through the device. Specifically, it determines the user's current emotional state based on information obtained from the camera and voice input. This data is used to optimize painting options. 【0134】 Step 5: 【0135】 The server sends painting options based on the analysis results to the terminal in real time. The terminal visually displays these options side-by-side on the user interface, allowing the user to review each option. 【0136】 Step 6: 【0137】 Users select and fine-tune painting options on the interface. They can adjust colors and textures using sliders and buttons, allowing for personalized customization to suit their preferences. 【0138】 Step 7: 【0139】 The device offers augmented reality capabilities, displaying how the paint design selected by the user through the device will fit the exterior of the house. This allows the user to intuitively see how the design will fit in a real-world environment. 【0140】 (Example 2) 【0141】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal". 【0142】 In recent years, while the options for decorative design in buildings have become increasingly diverse, users often struggle to make informed choices. Furthermore, although digital design simulations are widespread, there is a lack of interactive suggestions that take user emotions into account. This poses a significant obstacle to users selecting the optimal design. Additionally, traditional methods often result in a discrepancy between simulation results and how things appear in the real world, making intuitive decision-making difficult. 【0143】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0144】 In this invention, the server includes means for acquiring visual information using user equipment, means for analyzing the acquired visual information and identifying surface parts of structures, and means for analyzing the user's emotional state using a generative AI model and proposing design options that correspond to those emotions. This enables personalized design suggestions based on the user's emotions, and by linking visual information with information from the real world, more intuitive and effective design selection becomes possible. 【0145】 "User equipment" refers to devices used by users to acquire visual information and perform interactive operations. 【0146】 "Visual information" refers to image or video data acquired by the user through a device, and includes information such as the appearance of a structure. 【0147】 A "server" is a centralized processing unit that analyzes visual information and generates and provides design options. 【0148】 "Surface portion of a structure" refers to the exterior or a portion of a building or other structure to which the design is applied. 【0149】 "Design options" refer to multiple design proposals that differ in color, pattern, texture, etc., representing the visual options available to the user. 【0150】 "Virtual reality display" refers to a technology that presents the design options selected by the user in a simulated state on visual information. 【0151】 A "generative AI model" is an artificial intelligence technology used for design generation and user sentiment analysis, and it has the function of automatically generating new suggestions. 【0152】 "Emotional state" refers to the mental response determined by analyzing the emotions expressed by the user when making selections or performing actions. 【0153】 This invention provides a system that enables users to more intuitively select and visualize architectural designs. The system functions by combining user-facing devices, a server, and a generative AI model. 【0154】 Users take photos of the structure's exterior using their smartphones or other cameras. They then upload these images to the system via their personal devices. These devices have the functionality to send the acquired images to the server. The user devices feature an intuitive interface, making image uploading easy. 【0155】 The server first analyzes the received visual information (image data). This analysis uses image processing techniques to appropriately adjust high-resolution image data, and then identifies surface areas of structures such as exterior walls. Computer vision algorithms and trained models are employed for this purpose. Next, the server utilizes a generative AI model to generate various design options, including color and texture, for the identified areas. The generative AI model creates design proposals in real time according to the prompt messages. 【0156】 For example, a possible prompt might read, "Please suggest a calm blue exterior wall design that matches the appearance of my house. My house is located in a sunny spot with lots of greenery around." This prompt allows the generating AI model to present colors and designs that meet the user's preferences. 【0157】 Once the options are generated, the server returns them to the user's device. The user's device displays the suggested designs on the screen, allowing the user to select the best design based on their feelings and preferences. The selected design is then visualized through virtual reality display technology, as if it were applied to a real structure. This allows the user to concretely experience what their chosen design would look like. 【0158】 Furthermore, users can fine-tune their choices using their user-defined devices. They can build their favorite design by changing hues and textures. In this way, the present invention is highly interactive and supports the selection of designs that incorporate the user's preferences and emotions. 【0159】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0160】 Step 1: 【0161】 Users take photos of the exterior of their homes using their smartphones or cameras and upload the resulting images to their devices. The interface is intuitive, allowing users to easily select and send images. In this step, image data is provided to the system as input. 【0162】 Step 2: 【0163】 The server acquires image data received from the user's device. Next, it adjusts the image resolution using image processing technology and identifies the surface parts of structures such as exterior walls. Computer vision algorithms are used for this identification, and the process identifies the pixels of the exterior wall. As output, a digital mask of the structure's surface is generated. 【0164】 Step 3: 【0165】 The server uses a generative AI model on the identified surface area to generate design options. This process uses prompt text as input to create design proposals in real time, with colors, textures, and patterns based on the user's preferences. Multiple design options are generated as output. 【0166】 Step 4: 【0167】 The server sends the generated design options to the user's device. The device displays these options to the user, allowing them to select according to their preferences. The user's selection is fed back to the system, and the selected design is prepared for the next processing step. 【0168】 Step 5: 【0169】 The user visualizes their selected design through virtual reality display technology. The device uses cameras and sensors to overlay the selected design onto actual structures, allowing the user to view its effects from various angles. The output is a real-time video of the design superimposed on the real environment. 【0170】 Step 6: 【0171】 Users can also fine-tune the design on their device. They can change colors and textures through the interface to achieve the most satisfying design. Based on user input, data is updated in real time, and the final design proposal is finalized. The output is the user-adjusted, optimal design data. 【0172】 (Application Example 2) 【0173】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal". 【0174】 Existing exterior paint design selection systems fail to take user emotions into account when proposing designs, making it difficult to maximize user satisfaction. Furthermore, they lack sufficient visual confirmation in real-world environments, preventing users from experiencing how their chosen design will actually look through the application. 【0175】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0176】 In this invention, the server includes means for receiving images from a user device, means for analyzing the received images and identifying the exterior portion of a building, and means for generating multiple color options for the identified exterior portion of the building. This enables optimal design suggestions using emotion recognition technology and real-time visual experiences using augmented reality technology. 【0177】 A "user device" is a device operated by the user, and is a terminal that acquires and displays images and communicates data with the system. 【0178】 "Analyzing an image" means extracting specific information or features from received image data and performing data processing or assigning meaning to it according to the purpose. 【0179】 "Exterior building components" refer to structural elements located on the outside of a building, particularly the exterior walls and facade. 【0180】 "Color options" refer to design choices that include variations in hue, brightness, saturation, and other parameters applicable to a specific area. 【0181】 Augmented reality visualization is a technology that integrates and displays the real world with virtual data, providing users with an environment where they can experience virtual elements within the real world. 【0182】 "Emotional state" refers to a state that indicates a user's psychological feelings and mood, and is based on data obtained through the user interface. 【0183】 "Design proposal" is a process in which the system creates and presents selectable designs to users based on their needs and preferences. 【0184】 The system implementing this invention consists of a user terminal, a server, and data communication via the internet. The system begins with the user using a terminal such as a smartphone or tablet to photograph the exterior of a building and upload the image to the system. The terminal has a user-friendly interface, allowing the user to intuitively select and upload images. 【0185】 On the server, an AI model is run to analyze the received image data. First, the exterior of the building is identified using an image analysis library such as TENSORFLOW®. This process involves preprocessing the image, adjusting the resolution appropriately, and extracting the paintable areas. Next, OpenAI® generative AI models are used to automatically generate color options for the identified areas. These include multiple design variations with various hues, textures, and patterns. 【0186】 From these generated options, the system uses an emotion engine to provide the most suitable suggestion based on the user's emotional state. The emotion engine utilizes natural language processing technologies such as IBM Watson® Natural Language Understanding, taking into account the user's reaction to the options presented in the interface. The user's responses are collected as text data, and the system analyzes this data to evaluate in real time which suggestions elicit positive emotions from the user. 【0187】 Finally, the server sends the proposed painting options back to the user's device, and the application on the device uses AR technologies such as Unity or ARKit to visualize them in the real world. This allows the user to overlay the virtual painting onto the exterior of an existing building and experience the simulation results intuitively from many angles. 【0188】 For example, if a user is looking for a "relaxing and warm atmosphere," this system can suggest soft color tones. An example of a prompt might be, "I want the exterior walls of my house to have colors that evoke the warmth of spring." This prompt allows the system to reflect this in the design generation process, providing customized options to enhance user satisfaction. 【0189】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0190】 Step 1: 【0191】 The user takes a photograph of the building's exterior using their device. The captured image data is saved on the device, and this data is uploaded to a server by the application for analysis. The input is image data of the building's exterior, and the output is the image file transferred to the server. 【0192】 Step 2: 【0193】 The server analyzes the received image. Specifically, it uses an image analysis library (e.g., TensorFlow) to adjust the image resolution and identify the exterior portion of the building. The input is the image data obtained from step 1, and the output is the region data of the identified exterior portion of the building. 【0194】 Step 3: 【0195】 The server generates multiple color options for identified building exteriors. Using an OpenAI generative AI model, it creates design variations including hue, texture, and pattern. The input is identified area data, and the output is generated color option data. 【0196】 Step 4: 【0197】 The server uses an emotion engine to assess the user's emotional state and suggest the optimal color option. This assessment utilizes the user's past choices and reaction data, which are analyzed using IBM Watson Natural Language Understanding. The input consists of color option data and user reaction data, and the output is the optimal color option. 【0198】 Step 5: 【0199】 The server sends the optimal color options to the user's device, which then displays those options on its screen. Furthermore, the device uses Unity or ARKit to overlay these options onto the real world as an augmented reality visualization. The input is the optimal color options, and the output is the augmented reality display on the device. 【0200】 Step 6: 【0201】 The user observes the visualization in augmented reality and fine-tunes the color options. The device receives the user's adjustment data and sends it to the server for further evaluation and optimization. The input is the user's adjustment data, and the output is the final color options reflecting the adjustments. 【0202】 The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data. 【0203】 Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0204】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14. 【0205】 [Second Embodiment] 【0206】 Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment. 【0207】 As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server. 【0208】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0209】 The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52. 【0210】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0211】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0212】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0213】 Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0214】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0215】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0216】 In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0217】 Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0218】 The embodiments for carrying out the present invention are described below. This system is an interactive platform for providing a simulation of exterior wall painting. First, the user takes a photograph of the exterior of their home and uploads it to the system using a terminal. At this time, the terminal guides the user through the image selection and transmission operations via a user interface, making it easy for the user to send images to the system. 【0219】 The server analyzes the received image. Specifically, it uses an AI model to identify the exterior wall portion of the image. The server excludes unpainted areas such as windows and doors, and identifies the areas that can be painted. For these identified areas, the server generates painting options. The generated painting options include variations in color, texture, and pattern, offering the user a number of design choices. 【0220】 The terminal displays these painting options suggested by the server. Users can select each option through the interface, and the selected design is reflected in a real-time simulation applied to the exterior wall. In this process, the terminal utilizes augmented reality technology to provide a sense of realism as if the user were actually visiting the site. For example, by looking around through the terminal's camera, users can see from various angles how the selected design will blend into the real space. 【0221】 Furthermore, users can utilize fine-tuning functions on the interface. Specific examples include slightly brightening the selected hue or changing the texture intensity. These features allow users to intuitively and precisely finalize a paint design that perfectly matches their needs. Therefore, this system aims to streamline the exterior paint selection process through visual simulation, thereby improving user satisfaction. 【0222】 The following describes the processing flow. 【0223】 Step 1: 【0224】 Users take photos of the exterior of their homes with their smartphones or cameras and upload those images to the system via their devices. Following the interface, users select images and send them to the server by pressing the upload button. 【0225】 Step 2: 【0226】 The server receives the uploaded image and begins image analysis using an AI model. The server first preprocesses the image, adjusting the resolution and removing noise. Then, it identifies the exterior wall portion and excludes unpainted areas such as windows and doors. 【0227】 Step 3: 【0228】 The server generates paint options applicable to the identified exterior wall section. Specifically, it uses an AI model to create different options for color, texture, and pattern, and combines them with trend information obtained from a database to provide the optimal choice. 【0229】 Step 4: 【0230】 The generated painting options are sent to the terminal and displayed to the user through the interface. The user can view these options and choose their preferred design. The selected design is then reflected on the exterior wall in real time. 【0231】 Step 5: 【0232】 The device activates augmented reality mode, allowing the user to overlay their selected paint design onto their actual home using the smart device's camera. The user can then move the device to experience the paint design from various angles. 【0233】 Step 6: 【0234】 Users can fine-tune painting options on the interface. They can easily make minor design changes by adjusting color sliders and texture intensity. These adjustments are immediately reflected in the simulation. 【0235】 (Example 1) 【0236】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0237】 Traditional exterior design changes were difficult to visualize until they were tested on a physical prototype, and fine-tuning the user's chosen design required specialized knowledge. Furthermore, the need to prepare physical samples resulted in costly and time-consuming processes. This often led to a gap between the user's desired design and the final product. 【0238】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0239】 In this invention, the server includes means for receiving visual information from a user device, means for analyzing the received visual information and identifying the exterior portion of a building, and means for generating multiple decorative options for the identified exterior portion. This allows the user to easily try out various designs and make fine adjustments. 【0240】 A "user device" is a computing device operated by a user, which inputs visual information through interaction with the system and displays the results. 【0241】 "Visual information" refers to digital data such as images and videos obtained through user input. 【0242】 A "server" is a computer system that centrally processes data and provides information through communication with user devices. 【0243】 "Analysis" refers to the process of processing visual information and extracting useful information. 【0244】 "The exterior surface of a building" refers to the painted or decorated outer surface of a building that is identifiable within the building's visual information. 【0245】 "Decorative options" refer to different design choices, such as color, texture, and pattern, that are proposed for specific exterior parts. 【0246】 "Presentation" refers to the visual display of options on a user device, enabling the user to perform actions. 【0247】 "Selection" refers to the operation in which a user chooses one option from several decorative options. 【0248】 "Fine-tuning" refers to the process of further adjusting each element of the selected decorative options. 【0249】 Augmented reality visualization refers to a technology that overlays visual information from the real world with digital information to apply virtual designs to buildings. 【0250】 This invention provides a system for users to visually examine, select, and fine-tune the exterior design of a building. The system uses a portable computing device such as a smartphone or tablet as the user device. 【0251】 The user first takes a photograph of the building's exterior. The terminal uploads the captured image to the system and sends it to the server as visual information. The terminal's user interface assists the user in easily selecting and sending images. 【0252】 The server analyzes the received visual information using a generative AI model. Specifically, it employs a technique to identify the exterior parts of buildings in the image and exclude areas that are not to be painted, such as windows and doors. The AI ​​model's analysis enables more accurate area identification. 【0253】 The server generates multiple decorative options for the identified exterior portion. These include design elements such as color, texture, and pattern. Through the generating AI model, it is possible to present options that closely match the user's desired design. For example, prompts such as "a modern look in a light tone of blue" can be used. 【0254】 The terminal visualizes and displays decorative options presented by the server to the user. The user can select their desired design from these options and see the results in real time. Furthermore, the selected design can be overlaid on the real building using augmented reality technology, allowing for visual confirmation from different angles. 【0255】 Furthermore, users can make fine adjustments through the interface. Specifically, they can change the hue and adjust the intensity of the texture, allowing for detailed customization. The intuitive and user-friendly interface helps in realizing the ideal design. 【0256】 In this way, this system streamlines the selection and adjustment of exterior designs and provides an innovative means to improve the user experience. 【0257】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0258】 Step 1: 【0259】 The user takes a photograph of the building's exterior using their own device. The input is an image of the building. The image is selected through the user interface and sent to the system. The output is visual information uploaded to the server. 【0260】 Step 2: 【0261】 The server analyzes the visual information received from the user's device. It then activates a generating AI model to identify the exterior parts of a building from the input image. Specifically, the AI ​​model uses image analysis techniques to identify the building's exterior walls, windows, doors, etc., at the pixel level, and excludes parts that are not to be painted. The output is data of the analyzed exterior parts. 【0262】 Step 3: 【0263】 The server generates decorative options based on the analysis results. The input is data of the identified exterior portion. Using a generative AI model, it generates multiple designs based on a prompt (e.g., "a modern look in a light blue tone"). These designs include variations in color, texture, and pattern. The output is a list of decorative options that the user can select. 【0264】 Step 4: 【0265】 The terminal displays decoration options from the server in a user interface. The input consists of several generated decoration options. The user reviews the displayed options and selects their desired design. The output is the design selected by the user. 【0266】 Step 5: 【0267】 The device performs augmented reality visualization using the selected design. The input consists of the user-selected design and visual information of the real-world building. The device utilizes augmented reality technology to perform a real-time simulation applying the selected design to the exterior. The output allows the user to see how the design will actually appear on the building's exterior. 【0268】 Step 6: 【0269】 The user fine-tunes decorative options on the interface. Inputs include the selected design and the user's additional adjustment instructions. The terminal updates the design based on the user's instructions regarding hue and texture intensity. The output is the final design that meets the user's preferences. 【0270】 (Application Example 1) 【0271】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0272】 In the design and construction of exterior wall painting at construction sites, there are challenges in that it is difficult for customers and contractors to have a visual image of the finished product and to share a concrete vision of the completed work. Furthermore, the time required for adjusting construction plans and fine-tuning designs is also a challenge. 【0273】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0274】 In this invention, the server includes means for receiving video from a user device, means for analyzing the received video and identifying the exterior wall portion of a structure, and means for generating a number of paint options for the identified exterior wall portion of the structure. This makes it possible for customers and contractors to visualize a concrete completed image before construction and to make design adjustments quickly and efficiently. 【0275】 A "user device" is an electronic device that a user directly operates to send and receive information, such as a smartphone or tablet. 【0276】 "Image" refers to visual data generated based on light information, and includes images and videos displayed in digital format on a user's device. 【0277】 "Analysis" refers to the process of examining given data in detail to find its components and features, especially including understanding and judging images and videos using AI technology. 【0278】 "Structure" refers to man-made buildings, mainly referring to physically fixed entities such as buildings and infrastructure. 【0279】 "Outer wall part" refers to the wall surface for covering and protecting the structure from the outside, mainly referring to the part composed of exterior materials. 【0280】 "Painting options" refer to the types, colors, and texture variations of paints applied to the outer walls of structures, including multiple proposals used in design decisions. 【0281】 "Augmented reality visualization" is a technology that overlays digital information on the real world and refers to a method by which users can visually confirm virtual objects in the real environment. 【0282】 "Visualization" refers to the method of displaying information and data as images or videos to make them easier to understand through human vision. 【0283】 "Textured design" in visual design refers to a realistic representation that reproduces the texture and physical properties of the surface of an object. 【0284】 This system is implemented using user devices such as smartphones and personal computers. The user first starts by using the camera function of the device to take a video of the outer wall of the structure planned for construction. The captured video is sent to the server via the user device. The server utilizes a high-performance AI model to analyze the received video in detail. In this analysis process, the outer wall part of the structure is identified and other parts are excluded. 【0285】 After identifying the outer wall part, the server generates a number of painting options. These options incorporate various colors, textures, and designs. The generated painting options are sent to the user device and presented in a selectable state through the device's display. 【0286】 When the user selects a desired painting option, the information is sent back to the server, and the server generates an augmented reality (AR) visualization based on the selection information. This visualization can be viewed through the display of the user device, and the user can confirm what the design selected at the actual construction site will look like as a specific image. 【0287】 Also, the user can make detailed adjustments to the painting options. This adjustment includes fine-tuning of colors and changes in textures. The server quickly reflects these adjustments and provides the user with updated visualizations at any time. 【0288】 As a specific example, consider a house under construction as a model. To check how the outer wall of the house will look, the user takes a photo of the site with a smartphone and uploads it to the system. An example of the prompt text at this time could be an instruction like "Perform a simulation of the outer wall painting. Analyze the photo of the outer wall to be constructed with an AI model and indicate the paintable areas. Propose a number of painting variations and create an image with the selected color applied to the real space in AR." 【0289】 This enables the system to preview the post-construction image through the visualization of the construction plan, smooth the communication between both customers and constructors, and improve the efficiency and accuracy of the construction. 【0290】 The flow of the specific process in Application Example 1 will be described using FIG. 12. 【0291】 Step 1: 【0292】 The terminal provides an interface for users to capture images of the exterior walls of structures. Users take photos of the exterior walls using a camera, such as a smartphone, and save them to the terminal. During this process, users can adjust the shooting angle, lighting intensity, and other settings as needed. The input is the captured image, and the output is image data ready for processing. 【0293】 Step 2: 【0294】 The terminal sends the captured image to the server. The server analyzes the received image using an AI model. Specifically, the generating AI model identifies the outer wall portion of structures in the image and excludes the rest. The input is image data sent from the user terminal, and the output is the analysis result with the outer wall portion identified. 【0295】 Step 3: 【0296】 Based on the analysis results, the server generates numerous paint options applicable to the exterior walls of the structure. This process creates various variations combining colors, textures, and patterns. The input is data on the identified exterior wall sections, and the output is a list of the generated paint options. 【0297】 Step 4: 【0298】 The server sends the generated paint options to the terminal, which then presents them to the user. The user can then choose their desired design from the presented paint options. The input is the paint option data from the server, and the output is the paint design selected by the user. 【0299】 Step 5: 【0300】 The user submits their selected paint design to the server. The server generates an augmented reality (AR) visualization based on this information and sends it to the user's device. This visualization allows the user to visually see how the selected design would look on a real-world structure. The input is the design data selected by the user, and the output is the AR visualization data. 【0301】 Step 6: 【0302】 The terminal displays the received augmented reality visualization to the user. The user can view a realistic image of the selected design through the terminal's screen and request adjustments as needed. The input is augmented reality visualization data from the server, and the output is the visualization image viewed by the user. 【0303】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0304】 Embodiments of the present invention will be described in detail below. This system is an interactive platform that combines an exterior wall painting simulation with an emotion engine. Users take photos of the exterior of their homes with their smartphones or cameras and upload them to the system via a terminal. The terminal interface is designed to be intuitive for users to operate, making it easy to upload images. 【0305】 The server analyzes the received images using an AI model. First, it preprocesses the images and adjusts the resolution appropriately before identifying the exterior wall areas. The server removes unpainted areas and generates multiple painting options for the paintable areas. In this process, the AI ​​model generates designs with different colors, textures, and patterns, providing the user with a variety of choices. 【0306】 Furthermore, this system incorporates an emotion engine. Based on the data and usage provided by the user through the terminal interface, the emotion engine of the server recognizes the user's emotional state. For example, it collects the user's reactions when selecting and adjusting, and analyzes emotions such as joy, surprise, and confusion in real time. Thereby, it is possible to propose the most suitable painting option for the user's emotion. 【0307】 The terminal displays the painting options proposed by the server on the screen, enabling the user to select. When a selection is made, a simulation is immediately executed, visualizing the state where the selected design is applied to the outer wall. Furthermore, the terminal uses augmented reality technology to enable the user to view the exterior of their home through the device. Thereby, the user can visually experience from multiple angles how the selected painting design is reflected in the actual environment. 【0308】 Also, the user can finely adjust the proposed painting options based on emotion. While making fine changes to the hue and texture on the interface of the terminal, an optimal design according to emotion can be constructed. As a specific example, by adjusting the color to a softer tone, a relaxing space can be created, and adjustments according to emotion are possible. With this system, the user can optimally select the exterior wall design while considering their own emotions, improving the customer experience like never before. 【0309】 The following explains the processing flow. 【0310】 Step 1: 【0311】 The user takes a photo of the exterior of their home and uploads the image to the system using the terminal application. The terminal displays the procedure for selecting an image file through the user interface, enabling the image to be easily sent to the server. 【0312】 Step 2: 【0313】 The server analyzes images received from the terminal using an AI model. First, it optimizes the resolution and removes noise as a preprocessing step. Then, it identifies the exterior wall portion of the image and extracts the area to be painted. Unpainted areas such as windows and doors are automatically excluded. 【0314】 Step 3: 【0315】 The server generates multiple painting options for the identified exterior wall section. It performs hue conversion, texture addition, and pattern generation to create designs based on trends and preferences retrieved from a database as user-selectable options. 【0316】 Step 4: 【0317】 The emotion engine is activated and analyzes the user's emotions through the device. Specifically, it determines the user's current emotional state based on information obtained from the camera and voice input. This data is used to optimize painting options. 【0318】 Step 5: 【0319】 The server sends painting options based on the analysis results to the terminal in real time. The terminal visually displays these options side-by-side on the user interface, allowing the user to review each option. 【0320】 Step 6: 【0321】 Users select and fine-tune painting options on the interface. They can adjust colors and textures using sliders and buttons, allowing for personalized customization to suit their preferences. 【0322】 Step 7: 【0323】 The device offers augmented reality capabilities, displaying how the paint design selected by the user through the device will fit the exterior of the house. This allows the user to intuitively see how the design will fit in a real-world environment. 【0324】 (Example 2) 【0325】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0326】 In recent years, while the options for decorative design in buildings have become increasingly diverse, users often struggle to make informed choices. Furthermore, although digital design simulations are widespread, there is a lack of interactive suggestions that take user emotions into account. This poses a significant obstacle to users selecting the optimal design. Additionally, traditional methods often result in a discrepancy between simulation results and how things appear in the real world, making intuitive decision-making difficult. 【0327】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0328】 In this invention, the server includes means for acquiring visual information using user equipment, means for analyzing the acquired visual information and identifying surface parts of structures, and means for analyzing the user's emotional state using a generative AI model and proposing design options that correspond to those emotions. This enables personalized design suggestions based on the user's emotions, and by linking visual information with information from the real world, more intuitive and effective design selection becomes possible. 【0329】 "User equipment" refers to devices used by users to acquire visual information and perform interactive operations. 【0330】 "Visual information" refers to image or video data acquired by the user through a device, and includes information such as the appearance of a structure. 【0331】 A "server" is a centralized processing unit that analyzes visual information and generates and provides design options. 【0332】 "Surface portion of a structure" refers to the exterior or a portion of a building or other structure to which the design is applied. 【0333】 "Design options" refer to multiple design proposals that differ in color, pattern, texture, etc., representing the visual options available to the user. 【0334】 "Virtual reality display" refers to a technology that presents the design options selected by the user in a simulated state on visual information. 【0335】 A "generative AI model" is an artificial intelligence technology used for design generation and user sentiment analysis, and it has the function of automatically generating new suggestions. 【0336】 "Emotional state" refers to the mental response determined by analyzing the emotions expressed by the user when making selections or performing actions. 【0337】 This invention provides a system that enables users to more intuitively select and visualize architectural designs. The system functions by combining user-facing devices, a server, and a generative AI model. 【0338】 Users take photos of the structure's exterior using their smartphones or other cameras. They then upload these images to the system via their personal devices. These devices have the functionality to send the acquired images to the server. The user devices feature an intuitive interface, making image uploading easy. 【0339】 The server first analyzes the received visual information (image data). This analysis uses image processing techniques to appropriately adjust high-resolution image data, and then identifies surface areas of structures such as exterior walls. Computer vision algorithms and trained models are employed for this purpose. Next, the server utilizes a generative AI model to generate various design options, including color and texture, for the identified areas. The generative AI model creates design proposals in real time according to the prompt messages. 【0340】 For example, a possible prompt might read, "Please suggest a calm blue exterior wall design that matches the appearance of my house. My house is located in a sunny spot with lots of greenery around." This prompt allows the generating AI model to present colors and designs that meet the user's preferences. 【0341】 Once the options are generated, the server returns them to the user's device. The user's device displays the suggested designs on the screen, allowing the user to select the best design based on their feelings and preferences. The selected design is then visualized through virtual reality display technology, as if it were applied to a real structure. This allows the user to concretely experience what their chosen design would look like. 【0342】 Furthermore, users can fine-tune their choices using their user-defined devices. They can build their favorite design by changing hues and textures. In this way, the present invention is highly interactive and supports the selection of designs that incorporate the user's preferences and emotions. 【0343】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0344】 Step 1: 【0345】 Users take photos of the exterior of their homes using their smartphones or cameras and upload the resulting images to their devices. The interface is intuitive, allowing users to easily select and send images. In this step, image data is provided to the system as input. 【0346】 Step 2: 【0347】 The server acquires image data received from the user's device. Next, it adjusts the image resolution using image processing technology and identifies the surface parts of structures such as exterior walls. Computer vision algorithms are used for this identification, and the process identifies the pixels of the exterior wall. As output, a digital mask of the structure's surface is generated. 【0348】 Step 3: 【0349】 The server uses a generative AI model on the identified surface area to generate design options. This process uses prompt text as input to create design proposals in real time, with colors, textures, and patterns based on the user's preferences. Multiple design options are generated as output. 【0350】 Step 4: 【0351】 The server sends the generated design options to the user's device. The device displays these options to the user, allowing them to select according to their preferences. The user's selection is fed back to the system, and the selected design is prepared for the next processing step. 【0352】 Step 5: 【0353】 The user visualizes their selected design through virtual reality display technology. The device uses cameras and sensors to overlay the selected design onto actual structures, allowing the user to view its effects from various angles. The output is a real-time video of the design superimposed on the real environment. 【0354】 Step 6: 【0355】 Users can also fine-tune the design on their device. They can change colors and textures through the interface to achieve the most satisfying design. Based on user input, data is updated in real time, and the final design proposal is finalized. The output is the user-adjusted, optimal design data. 【0356】 (Application Example 2) 【0357】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0358】 Existing exterior paint design selection systems fail to take user emotions into account when proposing designs, making it difficult to maximize user satisfaction. Furthermore, they lack sufficient visual confirmation in real-world environments, preventing users from experiencing how their chosen design will actually look through the application. 【0359】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0360】 In this invention, the server includes means for receiving images from a user device, means for analyzing the received images and identifying the exterior portion of a building, and means for generating multiple color options for the identified exterior portion of the building. This enables optimal design suggestions using emotion recognition technology and real-time visual experiences using augmented reality technology. 【0361】 A "user device" is a device operated by the user, and is a terminal that acquires and displays images and communicates data with the system. 【0362】 "Analyzing an image" means extracting specific information or features from received image data and performing data processing or assigning meaning to it according to the purpose. 【0363】 "Exterior building components" refer to structural elements located on the outside of a building, particularly the exterior walls and facade. 【0364】 "Color options" refer to design choices that include variations in hue, brightness, saturation, and other parameters applicable to a specific area. 【0365】 Augmented reality visualization is a technology that integrates and displays the real world with virtual data, providing users with an environment where they can experience virtual elements within the real world. 【0366】 "Emotional state" refers to a state that indicates a user's psychological feelings and mood, and is based on data obtained through the user interface. 【0367】 "Design proposal" is a process in which the system creates and presents selectable designs to users based on their needs and preferences. 【0368】 The system implementing this invention consists of a user terminal, a server, and data communication via the internet. The system begins with the user using a terminal such as a smartphone or tablet to photograph the exterior of a building and upload the image to the system. The terminal has a user-friendly interface, allowing the user to intuitively select and upload images. 【0369】 On the server, an AI model is run to analyze the received image data. First, the exterior of the building is identified using an image analysis library such as TensorFlow. This process involves preprocessing the image, adjusting the resolution appropriately, and extracting the paintable areas. Next, OpenAI's generative AI model is used to automatically generate color options for the identified areas. This includes multiple design variations with various hues, textures, and patterns. 【0370】 From these generated options, the system uses an emotion engine to provide the most suitable suggestion based on the user's emotional state. The emotion engine utilizes natural language processing technologies such as IBM Watson Natural Language Understanding, taking into account the user's reactions to the options presented in the interface. User responses are collected as text data, and the system analyzes this data to evaluate in real time which suggestions elicit positive emotions from the user. 【0371】 Finally, the server sends the proposed painting options back to the user's device, and the application on the device uses AR technologies such as Unity or ARKit to visualize them in the real world. This allows the user to overlay the virtual painting onto the exterior of an existing building and experience the simulation results intuitively from many angles. 【0372】 For example, if a user is looking for a "relaxing and warm atmosphere," this system can suggest soft color tones. An example of a prompt might be, "I want the exterior walls of my house to have colors that evoke the warmth of spring." This prompt allows the system to reflect this in the design generation process, providing customized options to enhance user satisfaction. 【0373】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0374】 Step 1: 【0375】 The user takes a photograph of the building's exterior using their device. The captured image data is saved on the device, and this data is uploaded to a server by the application for analysis. The input is image data of the building's exterior, and the output is the image file transferred to the server. 【0376】 Step 2: 【0377】 The server analyzes the received image. Specifically, it uses an image analysis library (e.g., TensorFlow) to adjust the image resolution and identify the exterior portion of the building. The input is the image data obtained from step 1, and the output is the region data of the identified exterior portion of the building. 【0378】 Step 3: 【0379】 The server generates multiple color options for identified building exteriors. Using an OpenAI generative AI model, it creates design variations including hue, texture, and pattern. The input is identified area data, and the output is generated color option data. 【0380】 Step 4: 【0381】 The server uses an emotion engine to assess the user's emotional state and suggest the optimal color option. This assessment utilizes the user's past choices and reaction data, which are analyzed using IBM Watson Natural Language Understanding. The input consists of color option data and user reaction data, and the output is the optimal color option. 【0382】 Step 5: 【0383】 The server sends the optimal color options to the user's device, which then displays those options on its screen. Furthermore, the device uses Unity or ARKit to overlay these options onto the real world as an augmented reality visualization. The input is the optimal color options, and the output is the augmented reality display on the device. 【0384】 Step 6: 【0385】 The user observes the visualization in augmented reality and fine-tunes the color options. The device receives the user's adjustment data and sends it to the server for further evaluation and optimization. The input is the user's adjustment data, and the output is the final color options reflecting the adjustments. 【0386】 The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0387】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0388】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214. 【0389】 [Third Embodiment] 【0390】 Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment. 【0391】 As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server. 【0392】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0393】 The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52. 【0394】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0395】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0396】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0397】 Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0398】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0399】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0400】 In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0401】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal". 【0402】 The embodiments for carrying out the present invention are described below. This system is an interactive platform for providing a simulation of exterior wall painting. First, the user takes a photograph of the exterior of their home and uploads it to the system using a terminal. At this time, the terminal guides the user through the image selection and transmission operations via a user interface, making it easy for the user to send images to the system. 【0403】 The server analyzes the received image. Specifically, it uses an AI model to identify the exterior wall portion of the image. The server excludes unpainted areas such as windows and doors, and identifies the areas that can be painted. For these identified areas, the server generates painting options. The generated painting options include variations in color, texture, and pattern, offering the user a number of design choices. 【0404】 The terminal displays these painting options suggested by the server. Users can select each option through the interface, and the selected design is reflected in a real-time simulation applied to the exterior wall. In this process, the terminal utilizes augmented reality technology to provide a sense of realism as if the user were actually visiting the site. For example, by looking around through the terminal's camera, users can see from various angles how the selected design will blend into the real space. 【0405】 Furthermore, users can utilize fine-tuning functions on the interface. Specific examples include slightly brightening the selected hue or changing the texture intensity. These features allow users to intuitively and precisely finalize a paint design that perfectly matches their needs. Therefore, this system aims to streamline the exterior paint selection process through visual simulation, thereby improving user satisfaction. 【0406】 The following describes the processing flow. 【0407】 Step 1: 【0408】 Users take photos of the exterior of their homes with their smartphones or cameras and upload those images to the system via their devices. Following the interface, users select images and send them to the server by pressing the upload button. 【0409】 Step 2: 【0410】 The server receives the uploaded image and begins image analysis using an AI model. The server first preprocesses the image, adjusting the resolution and removing noise. Then, it identifies the exterior wall portion and excludes unpainted areas such as windows and doors. 【0411】 Step 3: 【0412】 The server generates paint options applicable to the identified exterior wall section. Specifically, it uses an AI model to create different options for color, texture, and pattern, and combines them with trend information obtained from a database to provide the optimal choice. 【0413】 Step 4: 【0414】 The generated painting options are sent to the terminal and displayed to the user through the interface. The user can view these options and choose their preferred design. The selected design is then reflected on the exterior wall in real time. 【0415】 Step 5: 【0416】 The device activates augmented reality mode, allowing the user to overlay their selected paint design onto their actual home using the smart device's camera. The user can then move the device to experience the paint design from various angles. 【0417】 Step 6: 【0418】 Users can fine-tune painting options on the interface. They can easily make minor design changes by adjusting color sliders and texture intensity. These adjustments are immediately reflected in the simulation. 【0419】 (Example 1) 【0420】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0421】 Traditional exterior design changes were difficult to visualize until they were tested on a physical prototype, and fine-tuning the user's chosen design required specialized knowledge. Furthermore, the need to prepare physical samples resulted in costly and time-consuming processes. This often led to a gap between the user's desired design and the final product. 【0422】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0423】 In this invention, the server includes means for receiving visual information from a user device, means for analyzing the received visual information and identifying the exterior portion of a building, and means for generating multiple decorative options for the identified exterior portion. This allows the user to easily try out various designs and make fine adjustments. 【0424】 A "user device" is a computing device operated by a user, which inputs visual information through interaction with the system and displays the results. 【0425】 "Visual information" refers to digital data such as images and videos obtained through user input. 【0426】 A "server" is a computer system that centrally processes data and provides information through communication with user devices. 【0427】 "Analysis" refers to the process of processing visual information and extracting useful information. 【0428】 "The exterior surface of a building" refers to the painted or decorated outer surface of a building that is identifiable within the building's visual information. 【0429】 "Decorative options" refer to different design choices, such as color, texture, and pattern, that are proposed for specific exterior parts. 【0430】 "Presentation" refers to the visual display of options on a user device, enabling the user to perform actions. 【0431】 "Selection" refers to the operation in which a user chooses one option from several decorative options. 【0432】 "Fine-tuning" refers to the process of further adjusting each element of the selected decorative options. 【0433】 Augmented reality visualization refers to a technology that overlays visual information from the real world with digital information to apply virtual designs to buildings. 【0434】 This invention provides a system for users to visually examine, select, and fine-tune the exterior design of a building. The system uses a portable computing device such as a smartphone or tablet as the user device. 【0435】 The user first takes a photograph of the building's exterior. The terminal uploads the captured image to the system and sends it to the server as visual information. The terminal's user interface assists the user in easily selecting and sending images. 【0436】 The server analyzes the received visual information using a generative AI model. Specifically, it employs a technique to identify the exterior parts of buildings in the image and exclude areas that are not to be painted, such as windows and doors. The AI ​​model's analysis enables more accurate area identification. 【0437】 The server generates multiple decorative options for the identified exterior portion. These include design elements such as color, texture, and pattern. Through the generating AI model, it is possible to present options that closely match the user's desired design. For example, prompts such as "a modern look in a light tone of blue" can be used. 【0438】 The terminal visualizes and displays decorative options presented by the server to the user. The user can select their desired design from these options and see the results in real time. Furthermore, the selected design can be overlaid on the real building using augmented reality technology, allowing for visual confirmation from different angles. 【0439】 Furthermore, users can make fine adjustments through the interface. Specifically, they can change the hue and adjust the intensity of the texture, allowing for detailed customization. The intuitive and user-friendly interface helps in realizing the ideal design. 【0440】 In this way, this system streamlines the selection and adjustment of exterior designs and provides an innovative means to improve the user experience. 【0441】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0442】 Step 1: 【0443】 The user takes a photograph of the building's exterior using their own device. The input is an image of the building. The image is selected through the user interface and sent to the system. The output is visual information uploaded to the server. 【0444】 Step 2: 【0445】 The server analyzes the visual information received from the user's device. It then activates a generating AI model to identify the exterior parts of a building from the input image. Specifically, the AI ​​model uses image analysis techniques to identify the building's exterior walls, windows, doors, etc., at the pixel level, and excludes parts that are not to be painted. The output is data of the analyzed exterior parts. 【0446】 Step 3: 【0447】 The server generates decorative options based on the analysis results. The input is data of the identified exterior portion. Using a generative AI model, it generates multiple designs based on a prompt (e.g., "a modern look in a light blue tone"). These designs include variations in color, texture, and pattern. The output is a list of decorative options that the user can select. 【0448】 Step 4: 【0449】 The terminal displays decoration options from the server in a user interface. The input consists of several generated decoration options. The user reviews the displayed options and selects their desired design. The output is the design selected by the user. 【0450】 Step 5: 【0451】 The device performs augmented reality visualization using the selected design. The input consists of the user-selected design and visual information of the real-world building. The device utilizes augmented reality technology to perform a real-time simulation applying the selected design to the exterior. The output allows the user to see how the design will actually appear on the building's exterior. 【0452】 Step 6: 【0453】 The user fine-tunes decorative options on the interface. Inputs include the selected design and the user's additional adjustment instructions. The terminal updates the design based on the user's instructions regarding hue and texture intensity. The output is the final design that meets the user's preferences. 【0454】 (Application Example 1) 【0455】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0456】 In the design and construction of exterior wall painting at construction sites, there are challenges in that it is difficult for customers and contractors to have a visual image of the finished product and to share a concrete vision of the completed work. Furthermore, the time required for adjusting construction plans and fine-tuning designs is also a challenge. 【0457】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0458】 In this invention, the server includes means for receiving video from a user device, means for analyzing the received video and identifying the exterior wall portion of a structure, and means for generating a number of paint options for the identified exterior wall portion of the structure. This makes it possible for customers and contractors to visualize a concrete completed image before construction and to make design adjustments quickly and efficiently. 【0459】 A "user device" is an electronic device that a user directly operates to send and receive information, such as a smartphone or tablet. 【0460】 "Image" refers to visual data generated based on light information, and includes images and videos displayed in digital format on a user's device. 【0461】 "Analysis" refers to the process of examining given data in detail to identify its constituent elements and characteristics, and in particular, it includes understanding and interpreting images and videos using AI technology. 【0462】 A "structure" is a building constructed by humans, and mainly refers to physically fixed entities such as buildings and infrastructure. 【0463】 The term "exterior wall portion" refers to the wall surface that covers and protects a structure from the outside, and is mainly composed of exterior cladding. 【0464】 "Painting options" refers to variations in the type, color, and texture of paint applied to the exterior walls of a structure, and includes multiple proposals used in determining the design. 【0465】 Augmented reality visualization is a technology that overlays digital information onto the real world, allowing users to visually perceive virtual objects within their real-world environment. 【0466】 "Visualization" refers to the technique of displaying information or data as images or videos to make it easier for humans to understand through their visual senses. 【0467】 "Textured design" refers to a realistic representation in visual design that reproduces the texture and physical properties of an object's surface. 【0468】 This system is implemented using user devices such as smartphones and personal computers. The user begins by using the device's camera function to capture images of the exterior wall of the structure to be constructed. The captured images are transmitted to a server via the user's device. The server utilizes a high-performance AI model to analyze the received images in detail. This analysis process identifies the exterior wall portion of the structure and excludes other parts. 【0469】 After identifying the exterior wall section, the server generates numerous paint options. These options incorporate a variety of colors, textures, and designs. The generated paint options are sent to the user device and presented to the user via the device's display for selection. 【0470】 Once the user selects their desired paint options, this information is sent back to the server, which then generates an augmented reality (AR) visualization based on the selection. This visualization can be viewed through the user's device's display, allowing the user to see a concrete image of how the selected design will look on the actual construction site. 【0471】 Furthermore, users can make detailed adjustments to their paint options. These adjustments include fine-tuning colors and changing textures. The server quickly reflects these adjustments, providing users with updated visualizations in real time. 【0472】 As a concrete example, let's consider a house under construction as a model. To check how the exterior walls of the house will look, the user takes a photo of the site with their smartphone and uploads it to the system. An example of a prompt message at this time might be: "We will perform a simulation of exterior wall painting. Analyze the photo of the exterior walls to be painted with the AI ​​model and indicate the areas that can be painted. Suggest multiple paint variations and create an image of the selected color applied to the real world using AR." 【0473】 This system allows for the visualization of the construction plan, enabling users to see the post-construction image in advance, facilitating communication between customers and contractors, and improving the efficiency and accuracy of construction. 【0474】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0475】 Step 1: 【0476】 The terminal provides an interface for users to capture images of the exterior walls of structures. Users take photos of the exterior walls using a camera, such as a smartphone, and save them to the terminal. During this process, users can adjust the shooting angle, lighting intensity, and other settings as needed. The input is the captured image, and the output is image data ready for processing. 【0477】 Step 2: 【0478】 The terminal sends the captured image to the server. The server analyzes the received image using an AI model. Specifically, the generating AI model identifies the outer wall portion of structures in the image and excludes the rest. The input is image data sent from the user terminal, and the output is the analysis result with the outer wall portion identified. 【0479】 Step 3: 【0480】 Based on the analysis results, the server generates numerous paint options applicable to the exterior walls of the structure. This process creates various variations combining colors, textures, and patterns. The input is data on the identified exterior wall sections, and the output is a list of the generated paint options. 【0481】 Step 4: 【0482】 The server sends the generated paint options to the terminal, which then presents them to the user. The user can then choose their desired design from the presented paint options. The input is the paint option data from the server, and the output is the paint design selected by the user. 【0483】 Step 5: 【0484】 The user submits their selected paint design to the server. The server generates an augmented reality (AR) visualization based on this information and sends it to the user's device. This visualization allows the user to visually see how the selected design would look on a real-world structure. The input is the design data selected by the user, and the output is the AR visualization data. 【0485】 Step 6: 【0486】 The terminal displays the received augmented reality visualization to the user. The user can view a realistic image of the selected design through the terminal's screen and request adjustments as needed. The input is augmented reality visualization data from the server, and the output is the visualization image viewed by the user. 【0487】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0488】 Embodiments of the present invention will be described in detail below. This system is an interactive platform that combines an exterior wall painting simulation with an emotion engine. Users take photos of the exterior of their homes with their smartphones or cameras and upload them to the system via a terminal. The terminal interface is designed to be intuitive for users to operate, making it easy to upload images. 【0489】 The server analyzes the received images using an AI model. First, it preprocesses the images and adjusts the resolution appropriately before identifying the exterior wall areas. The server removes unpainted areas and generates multiple painting options for the paintable areas. In this process, the AI ​​model generates designs with different colors, textures, and patterns, providing the user with a variety of choices. 【0490】 Furthermore, this system incorporates an emotion engine. The server uses the terminal interface to provide data and usage information, allowing the emotion engine to recognize the user's emotional state. For example, it collects the user's reactions when they make selections and adjustments, and analyzes emotions such as joy, surprise, and confusion in real time. This makes it possible to suggest the most suitable painting option for the user's emotions. 【0491】 The terminal displays paint options suggested by the server on its screen, allowing the user to select one. Once a selection is made, a simulation is immediately run, visualizing how the selected design would look applied to the exterior walls. Furthermore, the terminal uses augmented reality technology, enabling the user to view the exterior of their home through the device. This allows the user to visually experience how the selected paint design will look in a real-world environment from multiple angles. 【0492】 Furthermore, users can fine-tune the suggested paint options based on their emotions. They can create the optimal design that suits their feelings by making detailed changes to hue and texture through the on-device interface. For example, they can adjust the colors to softer tones to create a more relaxing space. This system allows users to select the optimal exterior design while considering their own emotions, leading to an unprecedented improvement in the customer experience. 【0493】 The following describes the processing flow. 【0494】 Step 1: 【0495】 The user takes a photo of the exterior of their home and uploads the image to the system using an application on their device. The device displays instructions for selecting the image file through its user interface, making it easy to send the image to the server. 【0496】 Step 2: 【0497】 The server analyzes images received from the terminal using an AI model. First, it optimizes the resolution and removes noise as a preprocessing step. Then, it identifies the exterior wall portion of the image and extracts the area to be painted. Unpainted areas such as windows and doors are automatically excluded. 【0498】 Step 3: 【0499】 The server generates multiple painting options for the identified exterior wall section. It performs hue conversion, texture addition, and pattern generation to create designs based on trends and preferences retrieved from a database as user-selectable options. 【0500】 Step 4: 【0501】 The emotion engine is activated and analyzes the user's emotions through the device. Specifically, it determines the user's current emotional state based on information obtained from the camera and voice input. This data is used to optimize painting options. 【0502】 Step 5: 【0503】 The server sends painting options based on the analysis results to the terminal in real time. The terminal visually displays these options side-by-side on the user interface, allowing the user to review each option. 【0504】 Step 6: 【0505】 Users select and fine-tune painting options on the interface. They can adjust colors and textures using sliders and buttons, allowing for personalized customization to suit their preferences. 【0506】 Step 7: 【0507】 The device offers augmented reality capabilities, displaying how the paint design selected by the user through the device will fit the exterior of the house. This allows the user to intuitively see how the design will fit in a real-world environment. 【0508】 (Example 2) 【0509】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0510】 In recent years, while the options for decorative design in buildings have become increasingly diverse, users often struggle to make informed choices. Furthermore, although digital design simulations are widespread, there is a lack of interactive suggestions that take user emotions into account. This poses a significant obstacle to users selecting the optimal design. Additionally, traditional methods often result in a discrepancy between simulation results and how things appear in the real world, making intuitive decision-making difficult. 【0511】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0512】 In this invention, the server includes means for acquiring visual information using user equipment, means for analyzing the acquired visual information and identifying surface parts of structures, and means for analyzing the user's emotional state using a generative AI model and proposing design options that correspond to those emotions. This enables personalized design suggestions based on the user's emotions, and by linking visual information with information from the real world, more intuitive and effective design selection becomes possible. 【0513】 "User equipment" refers to devices used by users to acquire visual information and perform interactive operations. 【0514】 "Visual information" refers to image or video data acquired by the user through a device, and includes information such as the appearance of a structure. 【0515】 A "server" is a centralized processing unit that analyzes visual information and generates and provides design options. 【0516】 "Surface portion of a structure" refers to the exterior or a portion of a building or other structure to which the design is applied. 【0517】 "Design options" refer to multiple design proposals that differ in color, pattern, texture, etc., representing the visual options available to the user. 【0518】 "Virtual reality display" refers to a technology that presents the design options selected by the user in a simulated state on visual information. 【0519】 A "generative AI model" is an artificial intelligence technology used for design generation and user sentiment analysis, and it has the function of automatically generating new suggestions. 【0520】 "Emotional state" refers to the mental response determined by analyzing the emotions expressed by the user when making selections or performing actions. 【0521】 This invention provides a system that enables users to more intuitively select and visualize architectural designs. The system functions by combining user-facing devices, a server, and a generative AI model. 【0522】 Users take photos of the structure's exterior using their smartphones or other cameras. They then upload these images to the system via their personal devices. These devices have the functionality to send the acquired images to the server. The user devices feature an intuitive interface, making image uploading easy. 【0523】 The server first analyzes the received visual information (image data). This analysis uses image processing techniques to appropriately adjust high-resolution image data, and then identifies surface areas of structures such as exterior walls. Computer vision algorithms and trained models are employed for this purpose. Next, the server utilizes a generative AI model to generate various design options, including color and texture, for the identified areas. The generative AI model creates design proposals in real time according to the prompt messages. 【0524】 For example, a possible prompt might read, "Please suggest a calm blue exterior wall design that matches the appearance of my house. My house is located in a sunny spot with lots of greenery around." This prompt allows the generating AI model to present colors and designs that meet the user's preferences. 【0525】 Once the options are generated, the server returns them to the user's device. The user's device displays the suggested designs on the screen, allowing the user to select the best design based on their feelings and preferences. The selected design is then visualized through virtual reality display technology, as if it were applied to a real structure. This allows the user to concretely experience what their chosen design would look like. 【0526】 Furthermore, users can fine-tune their choices using their user-defined devices. They can build their favorite design by changing hues and textures. In this way, the present invention is highly interactive and supports the selection of designs that incorporate the user's preferences and emotions. 【0527】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0528】 Step 1: 【0529】 Users take photos of the exterior of their homes using their smartphones or cameras and upload the resulting images to their devices. The interface is intuitive, allowing users to easily select and send images. In this step, image data is provided to the system as input. 【0530】 Step 2: 【0531】 The server acquires image data received from the user's device. Next, it adjusts the image resolution using image processing technology and identifies the surface parts of structures such as exterior walls. Computer vision algorithms are used for this identification, and the process identifies the pixels of the exterior wall. As output, a digital mask of the structure's surface is generated. 【0532】 Step 3: 【0533】 The server uses a generative AI model on the identified surface area to generate design options. This process uses prompt text as input to create design proposals in real time, with colors, textures, and patterns based on the user's preferences. Multiple design options are generated as output. 【0534】 Step 4: 【0535】 The server sends the generated design options to the user's device. The device displays these options to the user, allowing them to select according to their preferences. The user's selection is fed back to the system, and the selected design is prepared for the next processing step. 【0536】 Step 5: 【0537】 The user visualizes their selected design through virtual reality display technology. The device uses cameras and sensors to overlay the selected design onto actual structures, allowing the user to view its effects from various angles. The output is a real-time video of the design superimposed on the real environment. 【0538】 Step 6: 【0539】 Users can also fine-tune the design on their device. They can change colors and textures through the interface to achieve the most satisfying design. Based on user input, data is updated in real time, and the final design proposal is finalized. The output is the user-adjusted, optimal design data. 【0540】 (Application Example 2) 【0541】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0542】 Existing exterior paint design selection systems fail to take user emotions into account when proposing designs, making it difficult to maximize user satisfaction. Furthermore, they lack sufficient visual confirmation in real-world environments, preventing users from experiencing how their chosen design will actually look through the application. 【0543】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0544】 In this invention, the server includes means for receiving images from a user device, means for analyzing the received images and identifying the exterior portion of a building, and means for generating multiple color options for the identified exterior portion of the building. This enables optimal design suggestions using emotion recognition technology and real-time visual experiences using augmented reality technology. 【0545】 A "user device" is a device operated by the user, and is a terminal that acquires and displays images and communicates data with the system. 【0546】 "Analyzing an image" means extracting specific information or features from received image data and performing data processing or assigning meaning to it according to the purpose. 【0547】 "Exterior building components" refer to structural elements located on the outside of a building, particularly the exterior walls and facade. 【0548】 "Color options" refer to design choices that include variations in hue, brightness, saturation, and other parameters applicable to a specific area. 【0549】 Augmented reality visualization is a technology that integrates and displays the real world with virtual data, providing users with an environment where they can experience virtual elements within the real world. 【0550】 "Emotional state" refers to a state that indicates a user's psychological feelings and mood, and is based on data obtained through the user interface. 【0551】 "Design proposal" is a process in which the system creates and presents selectable designs to users based on their needs and preferences. 【0552】 The system implementing this invention consists of a user terminal, a server, and data communication via the internet. The system begins with the user using a terminal such as a smartphone or tablet to photograph the exterior of a building and upload the image to the system. The terminal has a user-friendly interface, allowing the user to intuitively select and upload images. 【0553】 On the server, an AI model is run to analyze the received image data. First, the exterior of the building is identified using an image analysis library such as TensorFlow. This process involves preprocessing the image, adjusting the resolution appropriately, and extracting the paintable areas. Next, OpenAI's generative AI model is used to automatically generate color options for the identified areas. This includes multiple design variations with various hues, textures, and patterns. 【0554】 From these generated options, the system uses an emotion engine to provide the most suitable suggestion based on the user's emotional state. The emotion engine utilizes natural language processing technologies such as IBM Watson Natural Language Understanding, taking into account the user's reactions to the options presented in the interface. User responses are collected as text data, and the system analyzes this data to evaluate in real time which suggestions elicit positive emotions from the user. 【0555】 Finally, the server sends the proposed painting options back to the user's device, and the application on the device uses AR technologies such as Unity or ARKit to visualize them in the real world. This allows the user to overlay the virtual painting onto the exterior of an existing building and experience the simulation results intuitively from many angles. 【0556】 For example, if a user is looking for a "relaxing and warm atmosphere," this system can suggest soft color tones. An example of a prompt might be, "I want the exterior walls of my house to have colors that evoke the warmth of spring." This prompt allows the system to reflect this in the design generation process, providing customized options to enhance user satisfaction. 【0557】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0558】 Step 1: 【0559】 The user takes a photograph of the building's exterior using their device. The captured image data is saved on the device, and this data is uploaded to a server by the application for analysis. The input is image data of the building's exterior, and the output is the image file transferred to the server. 【0560】 Step 2: 【0561】 The server analyzes the received image. Specifically, it uses an image analysis library (e.g., TensorFlow) to adjust the image resolution and identify the exterior portion of the building. The input is the image data obtained from step 1, and the output is the region data of the identified exterior portion of the building. 【0562】 Step 3: 【0563】 The server generates multiple color options for identified building exteriors. Using an OpenAI generative AI model, it creates design variations including hue, texture, and pattern. The input is identified area data, and the output is generated color option data. 【0564】 Step 4: 【0565】 The server uses an emotion engine to assess the user's emotional state and suggest the optimal color option. This assessment utilizes the user's past choices and reaction data, which are analyzed using IBM Watson Natural Language Understanding. The input consists of color option data and user reaction data, and the output is the optimal color option. 【0566】 Step 5: 【0567】 The server sends the optimal color options to the user's device, which then displays those options on its screen. Furthermore, the device uses Unity or ARKit to overlay these options onto the real world as an augmented reality visualization. The input is the optimal color options, and the output is the augmented reality display on the device. 【0568】 Step 6: 【0569】 The user observes the visualization in augmented reality and fine-tunes the color options. The device receives the user's adjustment data and sends it to the server for further evaluation and optimization. The input is the user's adjustment data, and the output is the final color options reflecting the adjustments. 【0570】 The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0571】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0572】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314. 【0573】 [Fourth Embodiment] 【0574】 Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment. 【0575】 As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server. 【0576】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0577】 The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52. 【0578】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0579】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0580】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0581】 The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes. 【0582】 Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0583】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0584】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0585】 In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0586】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0587】 The embodiments for carrying out the present invention are described below. This system is an interactive platform for providing a simulation of exterior wall painting. First, the user takes a photograph of the exterior of their home and uploads it to the system using a terminal. At this time, the terminal guides the user through the image selection and transmission operations via a user interface, making it easy for the user to send images to the system. 【0588】 The server analyzes the received image. Specifically, it uses an AI model to identify the exterior wall portion of the image. The server excludes unpainted areas such as windows and doors, and identifies the areas that can be painted. For these identified areas, the server generates painting options. The generated painting options include variations in color, texture, and pattern, offering the user a number of design choices. 【0589】 The terminal displays these painting options suggested by the server. Users can select each option through the interface, and the selected design is reflected in a real-time simulation applied to the exterior wall. In this process, the terminal utilizes augmented reality technology to provide a sense of realism as if the user were actually visiting the site. For example, by looking around through the terminal's camera, users can see from various angles how the selected design will blend into the real space. 【0590】 Furthermore, users can utilize fine-tuning functions on the interface. Specific examples include slightly brightening the selected hue or changing the texture intensity. These features allow users to intuitively and precisely finalize a paint design that perfectly matches their needs. Therefore, this system aims to streamline the exterior paint selection process through visual simulation, thereby improving user satisfaction. 【0591】 The following describes the processing flow. 【0592】 Step 1: 【0593】 Users take photos of the exterior of their homes with their smartphones or cameras and upload those images to the system via their devices. Following the interface, users select images and send them to the server by pressing the upload button. 【0594】 Step 2: 【0595】 The server receives the uploaded image and begins image analysis using an AI model. The server first preprocesses the image, adjusting the resolution and removing noise. Then, it identifies the exterior wall portion and excludes unpainted areas such as windows and doors. 【0596】 Step 3: 【0597】 The server generates paint options applicable to the identified exterior wall section. Specifically, it uses an AI model to create different options for color, texture, and pattern, and combines them with trend information obtained from a database to provide the optimal choice. 【0598】 Step 4: 【0599】 The generated painting options are sent to the terminal and displayed to the user through the interface. The user can view these options and choose their preferred design. The selected design is then reflected on the exterior wall in real time. 【0600】 Step 5: 【0601】 The device activates augmented reality mode, allowing the user to overlay their selected paint design onto their actual home using the smart device's camera. The user can then move the device to experience the paint design from various angles. 【0602】 Step 6: 【0603】 Users can fine-tune painting options on the interface. They can easily make minor design changes by adjusting color sliders and texture intensity. These adjustments are immediately reflected in the simulation. 【0604】 (Example 1) 【0605】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0606】 Traditional exterior design changes were difficult to visualize until they were tested on a physical prototype, and fine-tuning the user's chosen design required specialized knowledge. Furthermore, the need to prepare physical samples resulted in costly and time-consuming processes. This often led to a gap between the user's desired design and the final product. 【0607】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0608】 In this invention, the server includes means for receiving visual information from a user device, means for analyzing the received visual information and identifying the exterior portion of a building, and means for generating multiple decorative options for the identified exterior portion. This allows the user to easily try out various designs and make fine adjustments. 【0609】 A "user device" is a computing device operated by a user, which inputs visual information through interaction with the system and displays the results. 【0610】 "Visual information" refers to digital data such as images and videos obtained through user input. 【0611】 A "server" is a computer system that centrally processes data and provides information through communication with user devices. 【0612】 "Analysis" refers to the process of processing visual information and extracting useful information. 【0613】 "The exterior surface of a building" refers to the painted or decorated outer surface of a building that is identifiable within the building's visual information. 【0614】 "Decorative options" refer to different design choices, such as color, texture, and pattern, that are proposed for specific exterior parts. 【0615】 "Presentation" refers to the visual display of options on a user device, enabling the user to perform actions. 【0616】 "Selection" refers to the operation in which a user chooses one option from several decorative options. 【0617】 "Fine-tuning" refers to the process of further adjusting each element of the selected decorative options. 【0618】 Augmented reality visualization refers to a technology that overlays visual information from the real world with digital information to apply virtual designs to buildings. 【0619】 This invention provides a system for users to visually examine, select, and fine-tune the exterior design of a building. The system uses a portable computing device such as a smartphone or tablet as the user device. 【0620】 The user first takes a photograph of the building's exterior. The terminal uploads the captured image to the system and sends it to the server as visual information. The terminal's user interface assists the user in easily selecting and sending images. 【0621】 The server analyzes the received visual information using a generative AI model. Specifically, it employs a technique to identify the exterior parts of buildings in the image and exclude areas that are not to be painted, such as windows and doors. The AI ​​model's analysis enables more accurate area identification. 【0622】 The server generates multiple decorative options for the identified exterior portion. These include design elements such as color, texture, and pattern. Through the generating AI model, it is possible to present options that closely match the user's desired design. For example, prompts such as "a modern look in a light tone of blue" can be used. 【0623】 The terminal visualizes and displays decorative options presented by the server to the user. The user can select their desired design from these options and see the results in real time. Furthermore, the selected design can be overlaid on the real building using augmented reality technology, allowing for visual confirmation from different angles. 【0624】 Furthermore, users can make fine adjustments through the interface. Specifically, they can change the hue and adjust the intensity of the texture, allowing for detailed customization. The intuitive and user-friendly interface helps in realizing the ideal design. 【0625】 In this way, this system streamlines the selection and adjustment of exterior designs and provides an innovative means to improve the user experience. 【0626】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0627】 Step 1: 【0628】 The user takes a photograph of the building's exterior using their own device. The input is an image of the building. The image is selected through the user interface and sent to the system. The output is visual information uploaded to the server. 【0629】 Step 2: 【0630】 The server analyzes the visual information received from the user's device. It then activates a generating AI model to identify the exterior parts of a building from the input image. Specifically, the AI ​​model uses image analysis techniques to identify the building's exterior walls, windows, doors, etc., at the pixel level, and excludes parts that are not to be painted. The output is data of the analyzed exterior parts. 【0631】 Step 3: 【0632】 The server generates decorative options based on the analysis results. The input is data of the identified exterior portion. Using a generative AI model, it generates multiple designs based on a prompt (e.g., "a modern look in a light blue tone"). These designs include variations in color, texture, and pattern. The output is a list of decorative options that the user can select. 【0633】 Step 4: 【0634】 The terminal displays decoration options from the server in a user interface. The input consists of several generated decoration options. The user reviews the displayed options and selects their desired design. The output is the design selected by the user. 【0635】 Step 5: 【0636】 The device performs augmented reality visualization using the selected design. The input consists of the user-selected design and visual information of the real-world building. The device utilizes augmented reality technology to perform a real-time simulation applying the selected design to the exterior. The output allows the user to see how the design will actually appear on the building's exterior. 【0637】 Step 6: 【0638】 The user fine-tunes decorative options on the interface. Inputs include the selected design and the user's additional adjustment instructions. The terminal updates the design based on the user's instructions regarding hue and texture intensity. The output is the final design that meets the user's preferences. 【0639】 (Application Example 1) 【0640】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0641】 In the design and construction of exterior wall painting at construction sites, there are challenges in that it is difficult for customers and contractors to have a visual image of the finished product and to share a concrete vision of the completed work. Furthermore, the time required for adjusting construction plans and fine-tuning designs is also a challenge. 【0642】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0643】 In this invention, the server includes means for receiving video from a user device, means for analyzing the received video and identifying the exterior wall portion of a structure, and means for generating a number of paint options for the identified exterior wall portion of the structure. This makes it possible for customers and contractors to visualize a concrete completed image before construction and to make design adjustments quickly and efficiently. 【0644】 A "user device" is an electronic device that a user directly operates to send and receive information, such as a smartphone or tablet. 【0645】 "Image" refers to visual data generated based on light information, and includes images and videos displayed in digital format on a user's device. 【0646】 "Analysis" refers to the process of examining given data in detail to identify its constituent elements and characteristics, and in particular, it includes understanding and interpreting images and videos using AI technology. 【0647】 A "structure" is a building constructed by humans, and mainly refers to physically fixed entities such as buildings and infrastructure. 【0648】 The term "exterior wall portion" refers to the wall surface that covers and protects a structure from the outside, and is mainly composed of exterior cladding. 【0649】 "Painting options" refers to variations in the type, color, and texture of paint applied to the exterior walls of a structure, and includes multiple proposals used in determining the design. 【0650】 Augmented reality visualization is a technology that overlays digital information onto the real world, allowing users to visually perceive virtual objects within their real-world environment. 【0651】 "Visualization" refers to the technique of displaying information or data as images or videos to make it easier for humans to understand through their visual senses. 【0652】 "Textured design" refers to a realistic representation in visual design that reproduces the texture and physical properties of an object's surface. 【0653】 This system is implemented using user devices such as smartphones and personal computers. The user begins by using the device's camera function to capture images of the exterior wall of the structure to be constructed. The captured images are transmitted to a server via the user's device. The server utilizes a high-performance AI model to analyze the received images in detail. This analysis process identifies the exterior wall portion of the structure and excludes other parts. 【0654】 After identifying the exterior wall section, the server generates numerous paint options. These options incorporate a variety of colors, textures, and designs. The generated paint options are sent to the user device and presented to the user via the device's display for selection. 【0655】 Once the user selects their desired paint options, this information is sent back to the server, which then generates an augmented reality (AR) visualization based on the selection. This visualization can be viewed through the user's device's display, allowing the user to see a concrete image of how the selected design will look on the actual construction site. 【0656】 Furthermore, users can make detailed adjustments to their paint options. These adjustments include fine-tuning colors and changing textures. The server quickly reflects these adjustments, providing users with updated visualizations in real time. 【0657】 As a concrete example, let's consider a house under construction as a model. To check how the exterior walls of the house will look, the user takes a photo of the site with their smartphone and uploads it to the system. An example of a prompt message at this time might be: "We will perform a simulation of exterior wall painting. Analyze the photo of the exterior walls to be painted with the AI ​​model and indicate the areas that can be painted. Suggest multiple paint variations and create an image of the selected color applied to the real world using AR." 【0658】 This system allows for the visualization of the construction plan, enabling users to see the post-construction image in advance, facilitating communication between customers and contractors, and improving the efficiency and accuracy of construction. 【0659】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0660】 Step 1: 【0661】 The terminal provides an interface for users to capture images of the exterior walls of structures. Users take photos of the exterior walls using a camera, such as a smartphone, and save them to the terminal. During this process, users can adjust the shooting angle, lighting intensity, and other settings as needed. The input is the captured image, and the output is image data ready for processing. 【0662】 Step 2: 【0663】 The terminal sends the captured image to the server. The server analyzes the received image using an AI model. Specifically, the generating AI model identifies the outer wall portion of structures in the image and excludes the rest. The input is image data sent from the user terminal, and the output is the analysis result with the outer wall portion identified. 【0664】 Step 3: 【0665】 Based on the analysis results, the server generates numerous paint options applicable to the exterior walls of the structure. This process creates various variations combining colors, textures, and patterns. The input is data on the identified exterior wall sections, and the output is a list of the generated paint options. 【0666】 Step 4: 【0667】 The server sends the generated paint options to the terminal, which then presents them to the user. The user can then choose their desired design from the presented paint options. The input is the paint option data from the server, and the output is the paint design selected by the user. 【0668】 Step 5: 【0669】 The user submits their selected paint design to the server. The server generates an augmented reality (AR) visualization based on this information and sends it to the user's device. This visualization allows the user to visually see how the selected design would look on a real-world structure. The input is the design data selected by the user, and the output is the AR visualization data. 【0670】 Step 6: 【0671】 The terminal displays the received augmented reality visualization to the user. The user can view a realistic image of the selected design through the terminal's screen and request adjustments as needed. The input is augmented reality visualization data from the server, and the output is the visualization image viewed by the user. 【0672】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0673】 Embodiments of the present invention will be described in detail below. This system is an interactive platform that combines an exterior wall painting simulation with an emotion engine. Users take photos of the exterior of their homes with their smartphones or cameras and upload them to the system via a terminal. The terminal interface is designed to be intuitive for users to operate, making it easy to upload images. 【0674】 The server analyzes the received images using an AI model. First, it preprocesses the images and adjusts the resolution appropriately before identifying the exterior wall areas. The server removes unpainted areas and generates multiple painting options for the paintable areas. In this process, the AI ​​model generates designs with different colors, textures, and patterns, providing the user with a variety of choices. 【0675】 Furthermore, this system incorporates an emotion engine. The server uses the terminal interface to provide data and usage information, allowing the emotion engine to recognize the user's emotional state. For example, it collects the user's reactions when they make selections and adjustments, and analyzes emotions such as joy, surprise, and confusion in real time. This makes it possible to suggest the most suitable painting option for the user's emotions. 【0676】 The terminal displays paint options suggested by the server on its screen, allowing the user to select one. Once a selection is made, a simulation is immediately run, visualizing how the selected design would look applied to the exterior walls. Furthermore, the terminal uses augmented reality technology, enabling the user to view the exterior of their home through the device. This allows the user to visually experience how the selected paint design will look in a real-world environment from multiple angles. 【0677】 Furthermore, users can fine-tune the suggested paint options based on their emotions. They can create the optimal design that suits their feelings by making detailed changes to hue and texture through the on-device interface. For example, they can adjust the colors to softer tones to create a more relaxing space. This system allows users to select the optimal exterior design while considering their own emotions, leading to an unprecedented improvement in the customer experience. 【0678】 The following describes the processing flow. 【0679】 Step 1: 【0680】 The user takes a photo of the exterior of their home and uploads the image to the system using an application on their device. The device displays instructions for selecting the image file through its user interface, making it easy to send the image to the server. 【0681】 Step 2: 【0682】 The server analyzes images received from the terminal using an AI model. First, it optimizes the resolution and removes noise as a preprocessing step. Then, it identifies the exterior wall portion of the image and extracts the area to be painted. Unpainted areas such as windows and doors are automatically excluded. 【0683】 Step 3: 【0684】 The server generates multiple painting options for the identified exterior wall section. It performs hue conversion, texture addition, and pattern generation to create designs based on trends and preferences retrieved from a database as user-selectable options. 【0685】 Step 4: 【0686】 The emotion engine is activated and analyzes the user's emotions through the device. Specifically, it determines the user's current emotional state based on information obtained from the camera and voice input. This data is used to optimize painting options. 【0687】 Step 5: 【0688】 The server sends painting options based on the analysis results to the terminal in real time. The terminal visually displays these options side-by-side on the user interface, allowing the user to review each option. 【0689】 Step 6: 【0690】 Users select and fine-tune painting options on the interface. They can adjust colors and textures using sliders and buttons, allowing for personalized customization to suit their preferences. 【0691】 Step 7: 【0692】 The device offers augmented reality capabilities, displaying how the paint design selected by the user through the device will fit the exterior of the house. This allows the user to intuitively see how the design will fit in a real-world environment. 【0693】 (Example 2) 【0694】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0695】 In recent years, while the options for decorative design in buildings have become increasingly diverse, users often struggle to make informed choices. Furthermore, although digital design simulations are widespread, there is a lack of interactive suggestions that take user emotions into account. This poses a significant obstacle to users selecting the optimal design. Additionally, traditional methods often result in a discrepancy between simulation results and how things appear in the real world, making intuitive decision-making difficult. 【0696】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0697】 In this invention, the server includes means for acquiring visual information using user equipment, means for analyzing the acquired visual information and identifying surface parts of structures, and means for analyzing the user's emotional state using a generative AI model and proposing design options that correspond to those emotions. This enables personalized design suggestions based on the user's emotions, and by linking visual information with information from the real world, more intuitive and effective design selection becomes possible. 【0698】 "User equipment" refers to devices used by users to acquire visual information and perform interactive operations. 【0699】 "Visual information" refers to image or video data acquired by the user through a device, and includes information such as the appearance of a structure. 【0700】 A "server" is a centralized processing unit that analyzes visual information and generates and provides design options. 【0701】 "Surface portion of a structure" refers to the exterior or a portion of a building or other structure to which the design is applied. 【0702】 "Design options" refer to multiple design proposals that differ in color, pattern, texture, etc., representing the visual options available to the user. 【0703】 "Virtual reality display" refers to a technology that presents the design options selected by the user in a simulated state on visual information. 【0704】 A "generative AI model" is an artificial intelligence technology used for design generation and user sentiment analysis, and it has the function of automatically generating new suggestions. 【0705】 "Emotional state" refers to the mental response determined by analyzing the emotions expressed by the user when making selections or performing actions. 【0706】 This invention provides a system that enables users to more intuitively select and visualize architectural designs. The system functions by combining user-facing devices, a server, and a generative AI model. 【0707】 Users take photos of the structure's exterior using their smartphones or other cameras. They then upload these images to the system via their personal devices. These devices have the functionality to send the acquired images to the server. The user devices feature an intuitive interface, making image uploading easy. 【0708】 The server first analyzes the received visual information (image data). This analysis uses image processing techniques to appropriately adjust high-resolution image data, and then identifies surface areas of structures such as exterior walls. Computer vision algorithms and trained models are employed for this purpose. Next, the server utilizes a generative AI model to generate various design options, including color and texture, for the identified areas. The generative AI model creates design proposals in real time according to the prompt messages. 【0709】 For example, a possible prompt might read, "Please suggest a calm blue exterior wall design that matches the appearance of my house. My house is located in a sunny spot with lots of greenery around." This prompt allows the generating AI model to present colors and designs that meet the user's preferences. 【0710】 Once the options are generated, the server returns them to the user's device. The user's device displays the suggested designs on the screen, allowing the user to select the best design based on their feelings and preferences. The selected design is then visualized through virtual reality display technology, as if it were applied to a real structure. This allows the user to concretely experience what their chosen design would look like. 【0711】 Furthermore, users can fine-tune their choices using their user-defined devices. They can build their favorite design by changing hues and textures. In this way, the present invention is highly interactive and supports the selection of designs that incorporate the user's preferences and emotions. 【0712】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0713】 Step 1: 【0714】 Users take photos of the exterior of their homes using their smartphones or cameras and upload the resulting images to their devices. The interface is intuitive, allowing users to easily select and send images. In this step, image data is provided to the system as input. 【0715】 Step 2: 【0716】 The server acquires image data received from the user's device. Next, it adjusts the image resolution using image processing technology and identifies the surface parts of structures such as exterior walls. Computer vision algorithms are used for this identification, and the process identifies the pixels of the exterior wall. As output, a digital mask of the structure's surface is generated. 【0717】 Step 3: 【0718】 The server uses a generative AI model on the identified surface area to generate design options. This process uses prompt text as input to create design proposals in real time, with colors, textures, and patterns based on the user's preferences. Multiple design options are generated as output. 【0719】 Step 4: 【0720】 The server sends the generated design options to the user's device. The device displays these options to the user, allowing them to select according to their preferences. The user's selection is fed back to the system, and the selected design is prepared for the next processing step. 【0721】 Step 5: 【0722】 The user visualizes their selected design through virtual reality display technology. The device uses cameras and sensors to overlay the selected design onto actual structures, allowing the user to view its effects from various angles. The output is a real-time video of the design superimposed on the real environment. 【0723】 Step 6: 【0724】 Users can also fine-tune the design on their device. They can change colors and textures through the interface to achieve the most satisfying design. Based on user input, data is updated in real time, and the final design proposal is finalized. The output is the user-adjusted, optimal design data. 【0725】 (Application Example 2) 【0726】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0727】 Existing exterior paint design selection systems fail to take user emotions into account when proposing designs, making it difficult to maximize user satisfaction. Furthermore, they lack sufficient visual confirmation in real-world environments, preventing users from experiencing how their chosen design will actually look through the application. 【0728】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0729】 In this invention, the server includes means for receiving images from a user device, means for analyzing the received images and identifying the exterior portion of a building, and means for generating multiple color options for the identified exterior portion of the building. This enables optimal design suggestions using emotion recognition technology and real-time visual experiences using augmented reality technology. 【0730】 A "user device" is a device operated by the user, and is a terminal that acquires and displays images and communicates data with the system. 【0731】 "Analyzing an image" means extracting specific information or features from received image data and performing data processing or assigning meaning to it according to the purpose. 【0732】 "Exterior building components" refer to structural elements located on the outside of a building, particularly the exterior walls and facade. 【0733】 "Color options" refer to design choices that include variations in hue, brightness, saturation, and other parameters applicable to a specific area. 【0734】 Augmented reality visualization is a technology that integrates and displays the real world with virtual data, providing users with an environment where they can experience virtual elements within the real world. 【0735】 "Emotional state" refers to a state that indicates a user's psychological feelings and mood, and is based on data obtained through the user interface. 【0736】 "Design proposal" is a process in which the system creates and presents selectable designs to users based on their needs and preferences. 【0737】 The system implementing this invention consists of a user terminal, a server, and data communication via the internet. The system begins with the user using a terminal such as a smartphone or tablet to photograph the exterior of a building and upload the image to the system. The terminal has a user-friendly interface, allowing the user to intuitively select and upload images. 【0738】 On the server, an AI model is run to analyze the received image data. First, the exterior of the building is identified using an image analysis library such as TensorFlow. This process involves preprocessing the image, adjusting the resolution appropriately, and extracting the paintable areas. Next, OpenAI's generative AI model is used to automatically generate color options for the identified areas. This includes multiple design variations with various hues, textures, and patterns. 【0739】 From these generated options, the system uses an emotion engine to provide the most suitable suggestion based on the user's emotional state. The emotion engine utilizes natural language processing technologies such as IBM Watson Natural Language Understanding, taking into account the user's reactions to the options presented in the interface. User responses are collected as text data, and the system analyzes this data to evaluate in real time which suggestions elicit positive emotions from the user. 【0740】 Finally, the server sends the proposed painting options back to the user's device, and the application on the device uses AR technologies such as Unity or ARKit to visualize them in the real world. This allows the user to overlay the virtual painting onto the exterior of an existing building and experience the simulation results intuitively from many angles. 【0741】 For example, if a user is looking for a "relaxing and warm atmosphere," this system can suggest soft color tones. An example of a prompt might be, "I want the exterior walls of my house to have colors that evoke the warmth of spring." This prompt allows the system to reflect this in the design generation process, providing customized options to enhance user satisfaction. 【0742】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0743】 Step 1: 【0744】 The user takes a photograph of the building's exterior using their device. The captured image data is saved on the device, and this data is uploaded to a server by the application for analysis. The input is image data of the building's exterior, and the output is the image file transferred to the server. 【0745】 Step 2: 【0746】 The server analyzes the received image. Specifically, it uses an image analysis library (e.g., TensorFlow) to adjust the image resolution and identify the exterior portion of the building. The input is the image data obtained from step 1, and the output is the region data of the identified exterior portion of the building. 【0747】 Step 3: 【0748】 The server generates multiple color options for identified building exteriors. Using an OpenAI generative AI model, it creates design variations including hue, texture, and pattern. The input is identified area data, and the output is generated color option data. 【0749】 Step 4: 【0750】 The server uses an emotion engine to assess the user's emotional state and suggest the optimal color option. This assessment utilizes the user's past choices and reaction data, which are analyzed using IBM Watson Natural Language Understanding. The input consists of color option data and user reaction data, and the output is the optimal color option. 【0751】 Step 5: 【0752】 The server sends the optimal color options to the user's device, which then displays those options on its screen. Furthermore, the device uses Unity or ARKit to overlay these options onto the real world as an augmented reality visualization. The input is the optimal color options, and the output is the augmented reality display on the device. 【0753】 Step 6: 【0754】 The user observes the visualization in augmented reality and fine-tunes the color options. The device receives the user's adjustment data and sends it to the server for further evaluation and optimization. The input is the user's adjustment data, and the output is the final color options reflecting the adjustments. 【0755】 The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0756】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0757】 In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414. 【0758】 Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion. 【0759】 Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together. 【0760】 These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression. 【0761】 The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become. 【0762】 Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant. 【0763】 The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more." 【0764】 The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values. 【0765】 The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format. 【0766】 In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data. 【0767】 In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56. 【0768】 Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12. 【0769】 Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56. 【0770】 The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory. 【0771】 The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor. 【0772】 Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources. 【0773】 Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose. 【0774】 The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above. 【0775】 All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference. 【0776】 The following is further disclosed regarding the embodiments described above. 【0777】 (Claim 1) 【0778】 A means for receiving images via a user terminal, 【0779】 A means for analyzing the received image and identifying the exterior wall portion, 【0780】 Means for generating multiple painting options for an identified exterior wall portion, 【0781】 A means of displaying the generated painting options on the user terminal and making them selectable, 【0782】 A means of providing augmented reality visualization based on selected painting options, 【0783】 A system that includes this. 【0784】 (Claim 2) 【0785】 The system according to claim 1, further comprising means for enabling fine-tuning of painting options via a user terminal. 【0786】 (Claim 3) 【0787】 The system according to claim 1, comprising means for generating a hue-converted and textured pattern for an identified exterior wall portion. 【0788】 "Example 1" 【0789】 (Claim 1) 【0790】 A means for receiving visual information by a user device, 【0791】 A means for analyzing received visual information and identifying the exterior surface of a building, 【0792】 Means for generating multiple decorative options for an identified outer surface portion, 【0793】 A means for presenting the generated decorative options to the user device and making them selectable, 【0794】 A means of providing augmented reality visualizations based on selected decorative options, 【0795】 A system that includes this. 【0796】 (Claim 2) 【0797】 The system according to claim 1, further comprising means for enabling fine-tuning of decorative options by a user device. 【0798】 (Claim 3) 【0799】 The system according to claim 1, comprising means for generating a hue-converted and textured pattern for an identified outer surface portion. 【0800】 "Application Example 1" 【0801】 (Claim 1) 【0802】 A means for receiving video by a user device, 【0803】 A means for analyzing received video and identifying the outer wall portion of a structure, 【0804】 A means for generating a number of paint options for the exterior wall portion of an identified structure, 【0805】 A means for presenting the generated painting options to the user device and making them selectable, 【0806】 A means of providing augmented reality visualization based on selected paint options, 【0807】 A means to enable visualization at the structural work site and support coordination between design and construction, 【0808】 A system that includes this. 【0809】 (Claim 2) 【0810】 The system according to claim 1, further comprising means for enabling detailed adjustment of paint options by a user device. 【0811】 (Claim 3) 【0812】 The system according to claim 1, comprising means for generating a hue-shifted and textured design for an identified exterior wall portion of a structure. 【0813】 "Example 2 of combining an emotion engine" 【0814】 (Claim 1) 【0815】 A means of acquiring visual information using user-provided equipment, 【0816】 A means for analyzing acquired visual information and identifying the surface portion of a structure, 【0817】 A means for generating multiple design options for a surface portion of an identified structure, 【0818】 A means of displaying the generated design options on the user's device and making them selectable, 【0819】 A means of providing a virtual reality display based on selected design options, 【0820】 A method for analyzing a user's emotional state using a generative AI model and suggesting design options that correspond to those emotions, 【0821】 A system that includes this. 【0822】 (Claim 2) 【0823】 The system according to claim 1, comprising means for enabling detailed adjustment of design options using user-provided equipment. 【0824】 (Claim 3) 【0825】 The system according to claim 1, comprising means for generating a color transformation and a patterned design for a surface portion of a specified structure. 【0826】 "Application example 2 when combining with an emotional engine" 【0827】 (Claim 1) 【0828】 Means for receiving images by user equipment, 【0829】 A means for analyzing the received image and identifying the exterior portion of the building, 【0830】 Means for generating multiple color options for identified building exterior parts, 【0831】 A means for displaying and making selectable the generated color options on the user device, 【0832】 A means of providing augmented reality visualizations based on selected color options, 【0833】 A means of recognizing the user's emotional state and suggesting the optimal color option based on it, 【0834】 A system that includes this. 【0835】 (Claim 2) 【0836】 The system according to claim 1, further comprising means for enabling fine-tuning of color options by a user device. 【0837】 (Claim 3) 【0838】 The system according to claim 1, comprising means for generating a hue-shifted and textured pattern for an identified exterior portion of a building. [Explanation of symbols] 【0839】 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

[Claim 1] A means for receiving images via a user terminal, A means for analyzing the received image and identifying the exterior wall portion, Means for generating multiple painting options for an identified exterior wall portion, A means of displaying the generated painting options on the user terminal and making them selectable, A means of providing augmented reality visualization based on selected painting options, A system that includes this. [Claim 2] The system according to claim 1, further comprising means for enabling fine-tuning of painting options via a user terminal. [Claim 3] The system according to claim 1, comprising means for generating a hue-converted and textured pattern for an identified exterior wall portion.

Images