System

Abstract

A system is provided.SOLUTION: This system is provided with a terminal for inputting the desired conditions of a user, an identification device for collecting and analyzing the geographical information of a country or a district, a conversation device for collecting information on the Internet and judging regional characteristics, and a generation device for generating a building model and providing a visual image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In particular, when purchasing a detached home, it is difficult to visualize the property's sunlight, view, and other factors at the time of purchase, and it is also difficult to accurately find the area, land, and building that best suits the living environment desired. This problem causes significant anxiety for users in real estate transactions, which are often referred to as the biggest purchase of a person's life. The present invention aims to provide a system that solves these problems and allows users to purchase properties with peace of mind. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems with a system including the following means: a terminal for inputting the user's desired conditions; an identification device for collecting and analyzing national and local geographic information; a conversation device for collecting information on the Internet and determining regional characteristics; and a generation device for generating a building model and providing a visual image. Furthermore, by further including an identification device that performs a sunlight simulation of a location selected based on the user's desired conditions, the user can obtain an image of the specific living environment of the location specified. Furthermore, by incorporating a conversation device that collects and classifies data on the living and educational environments at the specified location, it is possible to accurately present areas and land that meet the user's desires.

[0006] A "terminal" is a device through which a user enters their desired conditions, including a PC, smartphone, tablet, etc.

[0007] An "identification device" is a device or system that has the function of collecting and analyzing national or local geographic information, and analyzes data on land location, area, elevation difference, and surrounding facilities.

[0008] A "conversation device" is a device or system that has the function of collecting information on the Internet and determining regional characteristics, and analyzes word-of-mouth information, bulletin board posts, weather data, etc.

[0009] A "generation device" is a device or system that has the function of generating building models and providing visual images, and generates images of specific living environments using 3D rendering technology, etc.

[0010] "Sunlight simulation" is the process of simulating the movement of the sun and the shadow cast by a building at a specified location, and calculating the sunlight conditions for each season.

[0011] "Living environment" refers to information about the daily lives of residents in the designated area, including public safety, transportation, shopping facilities, medical institutions, etc.

[0012] "Educational environment" refers to information related to education in a designated area, including the number and quality of schools, educational programs, and accessibility to schools. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] The present invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[0035] System Overview

[0036] 1. User Usage

[0037] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0038] 2. Data Collection and Analysis

[0039] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[0040] 3. Collection and classification of local information

[0041] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[0042] 4. Image Graphic Generation

[0043] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[0044] System details

[0045] Device behavior:

[0046] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[0047] Server behavior:

[0048] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[0049] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[0050] Specific examples

[0051] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0052] 1. User input: The user inputs the above desired conditions into the terminal.

[0053] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[0054] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[0055] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[0056] 5. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[0057] This process allows users to view a specific visual image of the property that meets their requirements, reducing anxiety about purchasing and allowing them to select a property with greater confidence.

[0058] The processing flow will be explained below.

[0059] Step 1:

[0060] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[0061] Step 2:

[0062] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[0063] Step 3:

[0064] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[0065] Step 4:

[0066] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[0067] Step 5:

[0068] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[0069] Step 6:

[0070] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[0071] Step 7:

[0072] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[0073] Step 8:

[0074] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[0075] Step 9:

[0076] The server sends the generated 3D model and simulation results to the terminal.

[0077] Step 10:

[0078] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[0079] Step 11:

[0080] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[0081] Example 1

[0082] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0083] In today's world, when choosing a residential environment, users must gather a great deal of information and spend a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there is a lack of means to visually confirm the geographical information, regional characteristics, and specific image of sunlight and views associated with the property. This makes it difficult for users to efficiently search for properties that meet their desired criteria and make accurate decisions.

[0084] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0085] In this invention, the server includes means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area, a conversation device means for collecting information on the Internet and determining the area characteristics, and a generation device means for generating a three-dimensional model of the building and providing a visual image, thereby enabling the user to efficiently search for properties that meet the desired conditions while visually confirming them.

[0086] "Terminal means for inputting user's desired conditions" refers to electronic devices that allow users to input and transmit specific desired conditions for housing. This includes smartphones, PCs, tablets, etc.

[0087] "Identification device means for collecting and analyzing national and local geographic information" means a device for collecting and analyzing geographic information system (GIS) data for a specified area, including the use of a GPS device or a map service API.

[0088] The "conversation device means for collecting information on the Internet and determining regional characteristics" is a device for collecting data from online resources (such as review sites, bulletin boards, and weather information) and analyzing and determining the characteristics of the region (e.g., "active," "calm," etc.).

[0089] "Generating device means for generating a three-dimensional model of a building and providing a visual image" refers to a device that generates a three-dimensional model of a building or land based on collected data and provides a visual image. This includes 3D modeling software and rendering software.

[0090] "Server means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area" refers to a server for using an identification device means to collect and analyze geographic information for the specified area based on the desired conditions entered by the user.

[0091] "Server means for generating three-dimensional models based on collected data and creating visual images" refers to a server for generating three-dimensional models of buildings and land based on data collected by the identification device means and conversation device means and creating visual images.

[0092] The "identification device means for performing sunlight simulation" is a device that analyzes geographic information in order to simulate the sunlight conditions of land and buildings.

[0093] The "conversation device means for collecting and classifying data on living and educational environments" is a device for extracting, organizing, and classifying data on living and educational environments from online sources.

[0094] MODE FOR CARRYING OUT THE INVENTION

[0095] This invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[0096] The overall operation of the system is as follows:

[0097] User Actions

[0098] 1. The user uses the terminal to enter their desired conditions.

[0099] Desired conditions include specific elements such as area, budget, family composition, lifestyle, etc. For example, users can use a dedicated smartphone app or PC web app to enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0100] Server Processing

[0101] 2. The device sends the user's desired conditions to the server.

[0102] The transmission method used is an HTTP POST request.

[0103] 3. The server uses the identification device to collect geographic information (GIS data) of the specified area.

[0104] Specifically, map services such as Google Maps API and OpenStreetMap API are used to obtain data such as land location, area, elevation difference, and the location of surrounding facilities.

[0105] 4. The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[0106] This analysis uses data analysis tools such as ArcGIS to simulate the sunlight conditions in a specified area.

[0107] 5. The server uses the conversation device to collect information on the Internet.

[0108] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc. through social media APIs such as the Twitter API and Reddit API, and weather forecast services such as the OpenWeather API.

[0109] 6. The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" or "calm."

[0110] Use NLP tools (e.g., NLTK and SpaCy) to analyze text data from reviews and posts and evaluate local characteristics.

[0111] 3D Content Generation

[0112] 7. The server uses the generation device to generate a three-dimensional model of the building based on the data collected by the identification device and conversation device.

[0113] Use 3D modeling software (e.g., SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the designated area.

[0114] 8. The server generates simulation results for specific sunlight and views based on the 3D model.

[0115] Use rendering software (e.g. Blender or Lumion) to simulate sunlight and views and generate the results as high-resolution images.

[0116] Displaying the results

[0117] 9. The terminal displays the results (information and image graphics of the candidate sites) sent from the server to the user.

[0118] Users can view information about the candidate locations along with the generated visual image (e.g., how sunny the garden is, the view from the living room, etc.).

[0119] Specific examples

[0120] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the server will process the information using the following prompt statement:

[0121] When a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the system collects geographical information and reviews of Tokorozawa City, and visually presents the results of a 3D simulation of sunlight and views to the user.

[0122] Also, when a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system will operate as follows.

[0123] When a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system collects geographical information and reviews of Shinjuku Ward and provides the results of a 3D simulation that reflects the nighttime lighting and the lively atmosphere of the city.

[0124] This allows users to feel more confident in choosing the property that best meets their desired conditions.

[0125] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0126] Step 1:

[0127] The user uses the terminal to input the desired housing conditions.

[0128] Specific operation: The user opens a dedicated smartphone app or PC web app and enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful."

[0129] Input: Desired conditions entered by the user (area, budget, family composition, lifestyle, etc.)

[0130] Output: The user's desired conditions data is registered on the terminal.

[0131] Step 2:

[0132] The terminal sends the user's desired conditions to the server.

[0133] Specific operation: When the terminal presses the "Send" button on the input form, the entered data is sent to the server as an HTTP POST request.

[0134] Input: User's desired conditions data

[0135] Output: The desired condition data arrives at the server.

[0136] Step 3:

[0137] The server uses the identification device to collect geographic information for the specified area.

[0138] Specific operation: The server calls a geographic information system API (Google Maps API or OpenStreetMap API) to obtain detailed geographic information about Tokorozawa City (location, area, elevation difference, and location of surrounding facilities).

[0139] Input: User's desired conditions (especially information about the area)

[0140] Data processing: Call the geographic information system API to obtain the necessary geographic data.

[0141] Output: Collected geographic data

[0142] Step 4:

[0143] The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[0144] Specific operation: Using the GIS data acquired by the server, a sunlight simulation for the specified area is performed using a data analysis tool (such as ArcGIS).

[0145] Input: Collected geographic data

[0146] Data calculation: Perform a sunlight simulation based on GIS data to obtain specific results.

[0147] Output: Sunlight simulation results

[0148] Step 5:

[0149] The server uses the conversation device to collect information on the Internet.

[0150] Specific operation: The server uses SNS APIs (Twitter API and Reddit API) and weather service APIs (OpenWeather API) to collect word-of-mouth information and weather data about Tokorozawa City.

[0151] Input: User's desired conditions (regional information)

[0152] Data processing: Collect word-of-mouth and weather data from the Internet.

[0153] Output: Review data and weather data

[0154] Step 6:

[0155] The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" and "calm."

[0156] Specific operation: The server analyzes the text data of reviews using natural language processing tools (NLTK or SpaCy) and classifies regional characteristics into categories.

[0157] Input: Collected review data and weather data

[0158] Data calculation: Perform text analysis and categorize local ratings.

[0159] Output: Classified area characteristic data

[0160] Step 7:

[0161] The server uses a generation device to generate a three-dimensional model of the building based on the data collected by the identification device and the conversation device.

[0162] What it does: The server uses 3D modeling software (SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the specified area.

[0163] Input: Collected and analyzed geographic and area characteristic data

[0164] Data processing: Using 3D modeling software, the collected and analyzed data is constructed into a visual model.

[0165] Output: 3D model of the building

[0166] Step 8:

[0167] The server generates simulation results for specific sunlight and views based on the 3D model.

[0168] How it works: The server uses rendering software (Blender or Lumion) to simulate sunlight and views, and generates the results as high-resolution images.

[0169] Input: Generated 3D model of the building

[0170] Data calculation: Running the simulation in rendering software to generate a visual image.

[0171] Output: Image graphics of the simulation results

[0172] Step 9:

[0173] The terminal displays the results (information and image graphics of candidate sites) sent from the server to the user.

[0174] Specific operation: The device displays the image and text data received from the server within the app, allowing the user to check information about each candidate location.

[0175] Input: Candidate site information and image graphics sent from the server

[0176] Output: Site information and visual images displayed to the user

[0177] These steps allow users to efficiently search for properties that meet their desired criteria while visually checking them.

[0178] (Application example 1)

[0179] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0180] Previously, when considering purchasing or renting a property, users had to visit the property in person to check it out, making it difficult to efficiently find a property that met their desired conditions. It was also difficult to get a concrete image of the sunlight and surrounding environment, making it difficult to decide whether to purchase or sign a contract. There is a need for a system that solves these issues and allows users to select properties more efficiently and with peace of mind.

[0181] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0182] In this invention, the server includes terminal means for inputting the user's desired conditions, identification device means for collecting and analyzing national and local geographic information, conversation device means for collecting information on the Internet and determining regional characteristics, generation device means for generating a building model and providing a visual image, means for collecting and analyzing information on the region and property based on the desired conditions and simulating specific views and sunlight in a 3D model, and means for providing a visual image displayed on the terminal used. This allows the user to efficiently consider properties that meet their desired conditions while visually imagining them.

[0183] "User's desired conditions" are conditions such as the desired area, price, family composition, and lifestyle that the user enters when selecting a property.

[0184] A "terminal" is a device used by a user to input desired conditions, specifically a smartphone or computer.

[0185] An "identification device" is a device for collecting and analyzing national and local geographic information.

[0186] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics.

[0187] A "generation device" is a device for generating a building model and providing a visual image.

[0188] "Sunlight simulation" is a process of virtually calculating and simulating the sunlight conditions at a specified location.

[0189] A "3D model" is a three-dimensional virtual model of a building or landscape that is generated based on collected data.

[0190] "Means for providing visual images" refers to a method for displaying the generated 3D model and the results of the sunlight simulation on a user's device and providing a visual image.

[0191] This invention is a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, an interactive device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and means for collecting and analyzing information on regions and properties based on the desired conditions, simulating specific views and sunlight in 3D models, and providing visual images.

[0192] System Overview

[0193] 1. User Usage

[0194] Users use a terminal to input their desired conditions, which include the area, budget, family composition, lifestyle, etc. For example, a user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0195] 2. Data Collection and Analysis

[0196] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[0197] 3. Collection and classification of local information

[0198] The server uses the chat device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. It analyzes this data and classifies regional characteristics into categories such as "active" and "calm."

[0199] 4. Image Graphic Generation

[0200] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image, creating and displaying images including simulation results of specific sunlight and views.

[0201] System details

[0202] Device behavior:

[0203] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[0204] Server behavior:

[0205] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[0206] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[0207] Specific operation example

[0208] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0209] 1. User input: The user inputs the above desired conditions into the terminal.

[0210] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[0211] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[0212] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[0213] 5. Displaying the results: The device displays the generated image along with information about the candidate locations to the user. This display includes information such as the amount of sunlight in the garden and the view from the living room. This process allows the user to consider properties that meet their desired criteria with a concrete visual image.

[0214] Example of input prompt for generative AI model

[0215] TXT

[0216] The user entered the following desired conditions: "Tokorozawa City," "budget 50 million yen," "family-friendly," "close to schools," and "quiet."

[0217] Based on this, collect GIS data and local information for the specified area and display a 3D model of the property and a sunlight simulation.

[0218] Generate property information that matches your needs and provide visual images of it.

[0219] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0220] Step 1:

[0221] Users use a terminal to input their desired conditions. These conditions include the area, budget, family composition, lifestyle, etc. The entered desired conditions are sent to the server via the terminal. The input (e.g., "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," "quiet") is used as data for the next step.

[0222] Step 2:

[0223] Based on the received desired conditions, the server uses an identification device to collect geographic information system (GIS) data for the specified area. The collected data includes the location of the land, its area, elevation difference, and the location of surrounding facilities. Based on the input (e.g., "Tokorozawa City"), the GIS data is obtained, and the server analyzes it before proceeding to the next step.

[0224] Step 3:

[0225] The server uses the conversation device to collect local information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. The acquired data is analyzed and the local characteristics are classified into categories such as "active" and "calm." The collected Internet information is analyzed based on the input (e.g., "Tokorozawa City"), and the local characteristics are classified.

[0226] Step 4:

[0227] The server generates a 3D model of the building based on the data collected by the identification device and conversation device. It uses the generation device to simulate specific sunlight and views, and creates a visual image that visualizes the results. Based on input (e.g., GIS data and analysis results of regional characteristics), the 3D model and sunlight simulation are performed, and the results are generated as a visual image.

[0228] Step 5:

[0229] The server sends the generated image along with property information for the candidate location to the terminal. The terminal displays the received information to the user. The displayed information includes sunlight, views, and the location of surrounding facilities. Based on the input (e.g., the 3D model and sunlight simulation results), the final visual image and property information are provided to the user.

[0230] Through this series of steps, users can consider properties that meet their desired criteria with a concrete visual image.

[0231] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0232] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[0233] System Overview

[0234] 1. User Usage

[0235] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0236] 2. Data Collection and Analysis

[0237] The server uses an identification device to collect national and local geographic information system (GIS) data, including information on the location, area, elevation, and surrounding facilities of the land. Based on this data, a sunlight simulation is performed for the specified land.

[0238] 3. Collection and classification of local information

[0239] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[0240] 4. Image Graphic Generation

[0241] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[0242] 5. Emotional Engine Optimization

[0243] The server uses an emotion engine that analyzes the user's facial expressions, voice, input, etc. to recognize the user's emotions in real time, thereby evaluating the user's interests and satisfaction and customizing the candidate locations and information presented.

[0244] For example, if a user responds positively to the presented information, such as feeling "happy" or "interesting," other candidate locations with those characteristics will be presented preferentially.

[0245] System details

[0246] Device behavior:

[0247] The device sends the desired conditions entered by the user to the server, as well as the user's emotional data recognized by the emotion engine.

[0248] The terminal displays the results (information and image graphics of candidate locations) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[0249] Server behavior:

[0250] The server analyzes the user's desired conditions and emotional data received from the terminal, and uses an identification device to collect and analyze GIS data for the specified area.

[0251] The server uses the conversation device to collect local information and classify characteristics.

[0252] The server combines the collected GIS data and regional characteristic data, and selects candidate sites while also taking into account the user's emotional data.

[0253] The server uses a generator to generate a 3D model of the building for the selected land, creating a visual image.

[0254] Specific examples

[0255] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0256] 1. User input: The user inputs the above desired conditions into the terminal.

[0257] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[0258] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[0259] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[0260] 5. Utilizing an emotion engine: If a user expresses emotion such as "interest" toward a proposed location, the server will reflect that information and prioritize the display of more attractive candidate locations.

[0261] 6. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[0262] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[0263] The processing flow will be explained below.

[0264] Step 1:

[0265] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[0266] Step 2:

[0267] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[0268] Step 3:

[0269] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[0270] Step 4:

[0271] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[0272] Step 5:

[0273] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[0274] Step 6:

[0275] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[0276] Step 7:

[0277] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[0278] Step 8:

[0279] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[0280] Step 9:

[0281] The server uses an emotion engine to analyze the user's facial expressions, voice, input content, etc., and recognizes the user's emotions in real time.

[0282] Step 10:

[0283] The server uses an emotion engine to analyze the user's emotional data and customize the candidate locations and information it presents. For example, if the user has a positive reaction to a candidate location, it will prioritize other similar candidate locations.

[0284] Step 11:

[0285] The server transmits the generated 3D model and simulation results to the terminal.

[0286] Step 12:

[0287] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[0288] Step 13:

[0289] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[0290] Step 14:

[0291] The emotion engine learns from users' choices and reactions and uses them as feedback to improve the accuracy of future location suggestions.

[0292] Example 2

[0293] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0294] In the past, searching for the living environment and property information users desired required a lot of time and effort. Furthermore, the information obtained was difficult to understand visually, and was not customized based on the user's feelings or reactions, resulting in low convenience. Furthermore, there was a lack of evaluations based on detailed data on living and educational environments, or real-time sunlight simulations. These issues made it difficult for users to make an accurate and satisfactory property selection.

[0295] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0296] In this invention, the server includes a display device for inputting the user's desired conditions, an identification device for collecting and analyzing geographic information, a dialogue device for collecting data on the Internet and determining regional characteristics, a generation device for generating building structures and providing visual displays, an emotion engine for recognizing and analyzing the user's emotions, and a processing device for customizing and presenting property information based on the collected and analyzed information. This allows the user to obtain property information that meets their desired conditions in a visually easy-to-understand format without spending time and effort, and to receive information customized based on their emotions.

[0297] A "display device" is a device that provides an interface for users to input desired conditions.

[0298] An "identification device" is a device for collecting and analyzing geographic information.

[0299] An "interactive device" is a device for collecting data on the Internet and determining regional characteristics.

[0300] A "generator" is a device that generates a building structure based on collected data and provides a visual representation.

[0301] The "emotion engine means" is a system for recognizing and analyzing the user's emotions.

[0302] The "processing means" is a system for customizing and presenting property information based on collected and analyzed information.

[0303] MODE FOR CARRYING OUT THE INVENTION

[0304] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, a display device, an identification device, a dialogue device, a generation device, and an emotion engine.

[0305] System Overview

[0306] 1. User Usage

[0307] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0308] 2. Data Collection and Analysis

[0309] The server uses an identification device to collect and analyze national and local geographic information, including the location, area, elevation difference, and information on surrounding facilities. Based on this data, a sunlight simulation is performed for the specified land.

[0310] 3. Collection and classification of local information

[0311] The server uses the interactive device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and regional characteristics are classified into categories such as "clam-filled" and "calm."

[0312] 4. Image Graphic Generation

[0313] The server uses a generation device to generate a 3D model of the building based on the data collected by the identification device and dialogue device, and provides a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[0314] 5. Emotional Engine Optimization

[0315] The server uses an emotion engine that analyzes the user's facial expressions, voice, and input to recognize the user's emotions in real time. This allows the system to evaluate the user's interest and satisfaction and customize the property information presented. For example, if the user responds positively to the information presented, such as "happy" or "interesting," the system will prioritize the presentation of other properties that share those characteristics.

[0316] 6. Displaying the results

[0317] The terminal displays the results (property information and image graphics) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[0318] Specific examples

[0319] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0320] 1. User Input:

[0321] The user inputs the above desired conditions into the terminal.

[0322] 2. Data Collection:

[0323] The server collects geographic information about Tokorozawa City using an identification device.

[0324] 3. Determining regional characteristics:

[0325] The server uses an interactive device to collect word-of-mouth information, message boards, and weather information for Tokorozawa City, and evaluates the living environment as "peaceful."

[0326] 4. Image generation:

[0327] The server uses a generator to perform a sunlight simulation at the specified location, creating a 3D model of the building and generating a visual image.

[0328] 5. Leveraging the Emotion Engine:

[0329] If the user expresses an interest in the presented candidate locations, the server reflects this information and prioritizes the display of more attractive candidate locations.

[0330] 6. Displaying the results:

[0331] The device will then display the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[0332] Specific examples of prompts to input to generative AI models

[0333] Start searching for properties in Tokorozawa City, with a budget of ¥50 million, suitable for families, close to schools, and a peaceful location. Display information and visual images of properties in Tokorozawa City that best fit these criteria. Also, analyze the user's facial expressions and voice to prioritize properties that the user is interested in.

[0334] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[0335] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0336] Step 1: Enter user preferences

[0337] The user inputs desired conditions using a terminal.

[0338] The conditions you enter include the area, budget, family structure, lifestyle, etc. For example, you can enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0339] Input data: User's desired conditions (area, budget, family structure, lifestyle)

[0340] Output data: The entered desired conditions are sent to the server.

[0341] Step 2: Gather geographic information

[0342] The server uses the identification device to collect geographic information about the specified area.

[0343] The data collected includes information on the land's location, area, elevation difference, and surrounding facilities.

[0344] Input data: User's desired conditions (region)

[0345] Output data: Geographic information (location, area, elevation difference, surrounding facilities)

[0346] Step 3: Determine regional characteristics

[0347] The server uses the interactive device to collect relevant information on the Internet.

[0348] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc.

[0349] The acquired data is analyzed, regional characteristics are identified, and the area is classified as calm, etc.

[0350] Input data: User's desired conditions (region)

[0351] Output data: Regional characteristics data (living environment, educational environment, regional classification)

[0352] Step 4: Data analysis and customized property selection

[0353] The server selects candidate properties based on the data collected by the identification device and the dialogue device.

[0354] Input data: Geographical information, regional characteristics data, user preferences

[0355] Output data: List of candidate properties

[0356] Step 5: Creating a visual image

[0357] The server uses a generation device to generate a 3D model of the candidate property.

[0358] Also include sunlight simulations and view images.

[0359] Input data: candidate property list, geographic information

[0360] Output data: Visual image (3D model, sunlight simulation, view image)

[0361] Step 6: Sentiment Analysis and Customization

[0362] The server uses an emotion engine to analyze the user's facial expressions, voice, and input in real time.

[0363] Determine the user's emotional state (e.g., interested, happy, etc.) and customize the information provided.

[0364] Input data: visual images, user reactions

[0365] Output data: customized property information

[0366] Step 7: View the results

[0367] The device displays the results sent from the server to the user.

[0368] In addition to property information, the display includes visual images such as how sunny the garden is and the view from the living room.

[0369] Input data: customized property information, visual images

[0370] Output data: Property information and visual images displayed to the user

[0371] (Application example 2)

[0372] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0373] In traditional property selection, users must individually check multiple information sources, which takes a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there are limited ways to check the property's visual image, specific sunlight, and view in advance, which often leaves users unsure about their satisfaction after purchasing. Furthermore, because customized suggestions that take user emotions into consideration are not made, there is a lack of systems that can optimally meet users' needs.

[0374] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, a conversation device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and an emotion engine for recognizing and analyzing the user's emotions. This allows the user to efficiently search for property information that matches their desired conditions and check specific images of sunlight and views in advance. In addition, property information can be customized based on the user's emotional data, allowing them to receive optimal suggestions, thereby improving post-purchase satisfaction.

[0375] "User" refers to an individual or corporation who uses this system to search for and evaluate property information that meets their desired conditions.

[0376] A "terminal" is a device that allows users to input desired conditions and displays the system's processing results. Examples include smartphones, tablets, PCs, smart glasses, and head-mounted displays.

[0377] "Identification equipment" refers to equipment used to collect and analyze national and local geographic information. Specifically, it includes servers and related software that handle GIS data.

[0378] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics. Specifically, it includes a server equipped with a web scraping tool or a natural language processing engine.

[0379] A "generator" is a device that generates a building model based on collected data and provides a visual image. Examples include 3D modeling software and rendering engines.

[0380] The "emotion engine" is a device that recognizes the user's emotions by analyzing their facial expressions and voice, and optimizes the system's operation. Specifically, it includes a server equipped with emotion recognition software and an AI model.

[0381] "Generative AI model" refers to an artificial intelligence model used to generate optimal property information and visual images based on collected data and user sentiment data.

[0382] A "prompt" is an input document that provides instructions to a generative AI model. Specifically, it is a document based on the user's desired conditions and emotions.

[0383] System configuration

[0384] This invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and further recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[0385] Hardware and software used

[0386] Devices: smartphones, tablets, PCs, smart glasses, head-mounted displays, etc.

[0387] Identification device: GIS data server and related software (e.g., Python, pandas, geopandas)

[0388] Conversational device: A server with a web scraping tool and a natural language processing engine (e.g., Scrapy, an NLP toolkit)

[0389] Generator: 3D modeling software and rendering engines (e.g. Unity, Blender)

[0390] Emotion engine: A server with emotion recognition software and AI models (e.g., Microsoft Azure Cognitive Services)

[0391] Generative AI model: An AI model that generates optimal property information and visual images based on collected data and user sentiment data.

[0392] Data acquisition and processing procedures

[0393] Enter the user's desired conditions

[0394] The user uses a terminal to input desired conditions (area, budget, family composition, lifestyle, etc.). For example, the user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0395] Data collection and analysis

[0396] The server uses the identification device to collect and analyze GIS data for the specified area, including information on the location, area, elevation, and surrounding facilities of the land.

[0397] Collection and classification of local information

[0398] The server uses the chat device to collect information from the Internet (such as review sites, message boards, and weather information) and acquires data to determine regional characteristics, which are then classified into categories such as "active" and "calm."

[0399] 3D model generation and visualization

[0400] The server uses a generator to generate a 3D model of the building based on the collected data and performs a sunlight simulation, creating a concrete visual image that is displayed on the device.

[0401] Optimization by Emotion Engine

[0402] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize emotional data in real time, thereby evaluating the user's interests and satisfaction and optimizing the property information presented.

[0403] Example

[0404] If a user enters a prompt such as "I am looking for a property in Tokorozawa City within 50 million yen that is family-friendly and has a peaceful environment," the following actions will occur:

[0405] 1. The user enters the desired conditions into the terminal and sends them to the server.

[0406] 2. The server uses the identification device to collect and analyze GIS data for Tokorozawa City.

[0407] 3. The server uses the conversation device to collect information on the Internet about the living and educational environment in Tokorozawa City and evaluates it as "peaceful."

[0408] 4. The server uses the generator to simulate sunlight at the specified location and generate a 3D model of the building.

[0409] 5. The server uses an emotion engine to analyze the user's emotion data and customize the property information based on positive responses.

[0410] 6. The final result and 3D image are displayed on the user's device.

[0411] In this way, the user can obtain property information that matches his or her desired conditions along with a concrete visual image, and can receive proposals that are optimized based on emotional data.

[0412] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0413] Step 1:

[0414] The user inputs desired conditions into the terminal. Specifically, they input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet." This input is sent to the server as JSON format data.

[0415] Step 2:

[0416] The server analyzes the desired condition data it receives and uses an identification device to collect GIS data for the specified area (Tokorozawa City). This GIS data includes information on the location, area, elevation difference, and surrounding facilities of the land. As a result, the input is the user's desired condition data, and the output is GIS data for the specified area.

[0417] Step 3:

[0418] The server analyzes the collected GIS data and identifies promising property candidates based on the specified criteria. Specifically, it uses Python's pandas and geopandas libraries to filter and sort the data. As a result, the input is GIS data and the output is a list of potential properties.

[0419] Step 4:

[0420] The server uses a conversation device to collect information about the living and educational environment in Tokorozawa City from the Internet. Specifically, it uses Scrapy and an NLP toolkit to extract and analyze data from review sites and bulletin boards. As a result, the input is a list of candidate locations, and the output is regional characteristic data.

[0421] Step 5:

[0422] The server analyzes the collected area characteristic data and classifies the living environment of the candidate area into categories such as "active" or "calm." This determines whether the area meets the user's desired conditions. This determination is made using machine learning models and statistical analysis methods. The input is the area characteristic data, and the output is the category classification results.

[0423] Step 6:

[0424] The server uses a generator to perform a sunlight simulation of the candidate sites. Specifically, it uses Unity or Blender to generate a 3D model and create a visual image. The input is the candidate site list and GIS data, and the output is the sunlight simulation results and the 3D model.

[0425] Step 7:

[0426] The server uses an emotion engine to analyze the user's facial expressions and voice in real time to recognize emotional data. Specifically, it captures the user's facial expressions and tone of voice through a camera and microphone, and performs emotion analysis using Microsoft Azure Cognitive Services. The input is real-time audio and video data, and the output is emotional data.

[0427] Step 8:

[0428] The server uses a generative AI model to optimize the property listings based on the emotion data and desired conditions. Specifically, the AI ​​model analyzes the prompt text and regenerates property listings that match the user's preferences. The input is desired condition data and emotion data, and the output is an optimized property listing.

[0429] Step 9:

[0430] The final results and 3D images are displayed on the user's device. The device displays these results in real time, allowing the user to view property information directly through the interface. It also iterates based on the user's new responses to provide optimal suggestions. The input is the optimized property list and 3D model, and the output is the visual image and property information presented to the user.

[0431] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0432] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0433] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0434] [Second embodiment]

[0435] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0436] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0437] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0438] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0439] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0440] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0441] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0442] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0443] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0444] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0445] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0446] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0447] The present invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[0448] System Overview

[0449] 1. User Usage

[0450] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0451] 2. Data Collection and Analysis

[0452] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[0453] 3. Collection and classification of local information

[0454] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[0455] 4. Image Graphic Generation

[0456] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[0457] System details

[0458] Device behavior:

[0459] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[0460] Server behavior:

[0461] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[0462] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[0463] Specific examples

[0464] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0465] 1. User input: The user inputs the above desired conditions into the terminal.

[0466] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[0467] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[0468] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[0469] 5. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[0470] This process allows users to view a specific visual image of the property that meets their requirements, reducing anxiety about purchasing and allowing them to select a property with greater confidence.

[0471] The processing flow will be explained below.

[0472] Step 1:

[0473] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[0474] Step 2:

[0475] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[0476] Step 3:

[0477] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[0478] Step 4:

[0479] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[0480] Step 5:

[0481] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[0482] Step 6:

[0483] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[0484] Step 7:

[0485] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[0486] Step 8:

[0487] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[0488] Step 9:

[0489] The server sends the generated 3D model and simulation results to the terminal.

[0490] Step 10:

[0491] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[0492] Step 11:

[0493] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[0494] Example 1

[0495] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0496] In today's world, when choosing a residential environment, users must gather a great deal of information and spend a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there is a lack of means to visually confirm the geographical information, regional characteristics, and specific image of sunlight and views associated with the property. This makes it difficult for users to efficiently search for properties that meet their desired criteria and make accurate decisions.

[0497] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0498] In this invention, the server includes means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area, a conversation device means for collecting information on the Internet and determining the area characteristics, and a generation device means for generating a three-dimensional model of the building and providing a visual image, thereby enabling the user to efficiently search for properties that meet the desired conditions while visually confirming them.

[0499] "Terminal means for inputting user's desired conditions" refers to electronic devices that allow users to input and transmit specific desired conditions for housing. This includes smartphones, PCs, tablets, etc.

[0500] "Identification device means for collecting and analyzing national and local geographic information" means a device for collecting and analyzing geographic information system (GIS) data for a specified area, including the use of a GPS device or a map service API.

[0501] The "conversation device means for collecting information on the Internet and determining regional characteristics" is a device for collecting data from online resources (such as review sites, bulletin boards, and weather information) and analyzing and determining the characteristics of the region (e.g., "active," "calm," etc.).

[0502] "Generating device means for generating a three-dimensional model of a building and providing a visual image" refers to a device that generates a three-dimensional model of a building or land based on collected data and provides a visual image. This includes 3D modeling software and rendering software.

[0503] "Server means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area" refers to a server for using an identification device means to collect and analyze geographic information for the specified area based on the desired conditions entered by the user.

[0504] "Server means for generating three-dimensional models based on collected data and creating visual images" refers to a server for generating three-dimensional models of buildings and land based on data collected by the identification device means and conversation device means and creating visual images.

[0505] The "identification device means for performing sunlight simulation" is a device that analyzes geographic information in order to simulate the sunlight conditions of land and buildings.

[0506] The "conversation device means for collecting and classifying data on living and educational environments" is a device for extracting, organizing, and classifying data on living and educational environments from online sources.

[0507] MODE FOR CARRYING OUT THE INVENTION

[0508] This invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[0509] The overall operation of the system is as follows:

[0510] User Actions

[0511] 1. The user uses the terminal to enter their desired conditions.

[0512] Desired conditions include specific elements such as area, budget, family composition, lifestyle, etc. For example, users can use a dedicated smartphone app or PC web app to enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0513] Server Processing

[0514] 2. The device sends the user's desired conditions to the server.

[0515] The transmission method used is an HTTP POST request.

[0516] 3. The server uses the identification device to collect geographic information (GIS data) of the specified area.

[0517] Specifically, map services such as Google Maps API and OpenStreetMap API are used to obtain data such as land location, area, elevation difference, and the location of surrounding facilities.

[0518] 4. The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[0519] This analysis uses data analysis tools such as ArcGIS to simulate the sunlight conditions in a specified area.

[0520] 5. The server uses the conversation device to collect information on the Internet.

[0521] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc. through social media APIs such as the Twitter API and Reddit API, and weather forecast services such as the OpenWeather API.

[0522] 6. The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" or "calm."

[0523] Use NLP tools (e.g., NLTK and SpaCy) to analyze text data from reviews and posts and evaluate local characteristics.

[0524] 3D Content Generation

[0525] 7. The server uses the generation device to generate a three-dimensional model of the building based on the data collected by the identification device and conversation device.

[0526] Use 3D modeling software (e.g., SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the designated area.

[0527] 8. The server generates simulation results for specific sunlight and views based on the 3D model.

[0528] Use rendering software (e.g. Blender or Lumion) to simulate sunlight and views and generate the results as high-resolution images.

[0529] Displaying the results

[0530] 9. The terminal displays the results (information and image graphics of the candidate sites) sent from the server to the user.

[0531] Users can view information about the candidate locations along with the generated visual image (e.g., how sunny the garden is, the view from the living room, etc.).

[0532] Specific examples

[0533] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the server will process the information using the following prompt statement:

[0534] When a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the system collects geographical information and reviews of Tokorozawa City, and visually presents the results of a 3D simulation of sunlight and views to the user.

[0535] Also, when a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system will operate as follows.

[0536] When a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system collects geographical information and reviews of Shinjuku Ward and provides the results of a 3D simulation that reflects the nighttime lighting and the lively atmosphere of the city.

[0537] This allows users to feel more confident in choosing the property that best meets their desired conditions.

[0538] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0539] Step 1:

[0540] The user uses the terminal to input the desired housing conditions.

[0541] Specific operation: The user opens a dedicated smartphone app or PC web app and enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful."

[0542] Input: Desired conditions entered by the user (area, budget, family composition, lifestyle, etc.)

[0543] Output: The user's desired conditions data is registered on the terminal.

[0544] Step 2:

[0545] The terminal sends the user's desired conditions to the server.

[0546] Specific operation: When the terminal presses the "Send" button on the input form, the entered data is sent to the server as an HTTP POST request.

[0547] Input: User's desired conditions data

[0548] Output: The desired condition data arrives at the server.

[0549] Step 3:

[0550] The server uses the identification device to collect geographic information for the specified area.

[0551] Specific operation: The server calls a geographic information system API (Google Maps API or OpenStreetMap API) to obtain detailed geographic information about Tokorozawa City (location, area, elevation difference, and location of surrounding facilities).

[0552] Input: User's desired conditions (especially information about the area)

[0553] Data processing: Call the geographic information system API to obtain the necessary geographic data.

[0554] Output: Collected geographic data

[0555] Step 4:

[0556] The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[0557] Specific operation: Using the GIS data acquired by the server, a sunlight simulation for the specified area is performed using a data analysis tool (such as ArcGIS).

[0558] Input: Collected geographic data

[0559] Data calculation: Perform a sunlight simulation based on GIS data to obtain specific results.

[0560] Output: Sunlight simulation results

[0561] Step 5:

[0562] The server uses the conversation device to collect information on the Internet.

[0563] Specific operation: The server uses SNS APIs (Twitter API and Reddit API) and weather service APIs (OpenWeather API) to collect word-of-mouth information and weather data about Tokorozawa City.

[0564] Input: User's desired conditions (regional information)

[0565] Data processing: Collect word-of-mouth and weather data from the Internet.

[0566] Output: Review data and weather data

[0567] Step 6:

[0568] The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" and "calm."

[0569] Specific operation: The server analyzes the text data of reviews using natural language processing tools (NLTK or SpaCy) and classifies regional characteristics into categories.

[0570] Input: Collected review data and weather data

[0571] Data calculation: Perform text analysis and categorize local ratings.

[0572] Output: Classified area characteristic data

[0573] Step 7:

[0574] The server uses a generation device to generate a three-dimensional model of the building based on the data collected by the identification device and the conversation device.

[0575] What it does: The server uses 3D modeling software (SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the specified area.

[0576] Input: Collected and analyzed geographic and area characteristic data

[0577] Data processing: Using 3D modeling software, the collected and analyzed data is constructed into a visual model.

[0578] Output: 3D model of the building

[0579] Step 8:

[0580] The server generates simulation results for specific sunlight and views based on the 3D model.

[0581] How it works: The server uses rendering software (Blender or Lumion) to simulate sunlight and views, and generates the results as high-resolution images.

[0582] Input: Generated 3D model of the building

[0583] Data calculation: Running the simulation in rendering software to generate a visual image.

[0584] Output: Image graphics of the simulation results

[0585] Step 9:

[0586] The terminal displays the results (information and image graphics of candidate sites) sent from the server to the user.

[0587] Specific operation: The device displays the image and text data received from the server within the app, allowing the user to check information about each candidate location.

[0588] Input: Candidate site information and image graphics sent from the server

[0589] Output: Site information and visual images displayed to the user

[0590] These steps allow users to efficiently search for properties that meet their desired criteria while visually checking them.

[0591] (Application example 1)

[0592] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0593] Previously, when considering purchasing or renting a property, users had to visit the property in person to check it out, making it difficult to efficiently find a property that met their desired conditions. It was also difficult to get a concrete image of the sunlight and surrounding environment, making it difficult to decide whether to purchase or sign a contract. There is a need for a system that solves these issues and allows users to select properties more efficiently and with peace of mind.

[0594] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0595] In this invention, the server includes terminal means for inputting the user's desired conditions, identification device means for collecting and analyzing national and local geographic information, conversation device means for collecting information on the Internet and determining regional characteristics, generation device means for generating a building model and providing a visual image, means for collecting and analyzing information on the region and property based on the desired conditions and simulating specific views and sunlight in a 3D model, and means for providing a visual image displayed on the terminal used. This allows the user to efficiently consider properties that meet their desired conditions while visually imagining them.

[0596] "User's desired conditions" are conditions such as the desired area, price, family composition, and lifestyle that the user enters when selecting a property.

[0597] A "terminal" is a device used by a user to input desired conditions, specifically a smartphone or computer.

[0598] An "identification device" is a device for collecting and analyzing national and local geographic information.

[0599] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics.

[0600] A "generation device" is a device for generating a building model and providing a visual image.

[0601] "Sunlight simulation" is a process of virtually calculating and simulating the sunlight conditions at a specified location.

[0602] A "3D model" is a three-dimensional virtual model of a building or landscape that is generated based on collected data.

[0603] "Means for providing visual images" refers to a method for displaying the generated 3D model and the results of the sunlight simulation on a user's device and providing a visual image.

[0604] This invention is a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, an interactive device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and means for collecting and analyzing information on regions and properties based on the desired conditions, simulating specific views and sunlight in 3D models, and providing visual images.

[0605] System Overview

[0606] 1. User Usage

[0607] Users use a terminal to input their desired conditions, which include the area, budget, family composition, lifestyle, etc. For example, a user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0608] 2. Data Collection and Analysis

[0609] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[0610] 3. Collection and classification of local information

[0611] The server uses the chat device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. It analyzes this data and classifies regional characteristics into categories such as "active" and "calm."

[0612] 4. Image Graphic Generation

[0613] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image, creating and displaying images including simulation results of specific sunlight and views.

[0614] System details

[0615] Device behavior:

[0616] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[0617] Server behavior:

[0618] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[0619] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[0620] Specific operation example

[0621] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0622] 1. User input: The user inputs the above desired conditions into the terminal.

[0623] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[0624] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[0625] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[0626] 5. Displaying the results: The device displays the generated image along with information about the candidate locations to the user. This display includes information such as the amount of sunlight in the garden and the view from the living room. This process allows the user to consider properties that meet their desired criteria with a concrete visual image.

[0627] Example of input prompt for generative AI model

[0628] TXT

[0629] The user entered the following desired conditions: "Tokorozawa City," "budget 50 million yen," "family-friendly," "close to schools," and "quiet."

[0630] Based on this, collect GIS data and local information for the specified area and display a 3D model of the property and a sunlight simulation.

[0631] Generate property information that matches your needs and provide visual images of it.

[0632] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0633] Step 1:

[0634] Users use a terminal to input their desired conditions. These conditions include the area, budget, family composition, lifestyle, etc. The entered desired conditions are sent to the server via the terminal. The input (e.g., "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," "quiet") is used as data for the next step.

[0635] Step 2:

[0636] Based on the received desired conditions, the server uses an identification device to collect geographic information system (GIS) data for the specified area. The collected data includes the location of the land, its area, elevation difference, and the location of surrounding facilities. Based on the input (e.g., "Tokorozawa City"), the GIS data is obtained, and the server analyzes it before proceeding to the next step.

[0637] Step 3:

[0638] The server uses the conversation device to collect local information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. The acquired data is analyzed and the local characteristics are classified into categories such as "active" and "calm." The collected Internet information is analyzed based on the input (e.g., "Tokorozawa City"), and the local characteristics are classified.

[0639] Step 4:

[0640] The server generates a 3D model of the building based on the data collected by the identification device and conversation device. It uses the generation device to simulate specific sunlight and views, and creates a visual image that visualizes the results. Based on input (e.g., GIS data and analysis results of regional characteristics), the 3D model and sunlight simulation are performed, and the results are generated as a visual image.

[0641] Step 5:

[0642] The server sends the generated image along with property information for the candidate location to the terminal. The terminal displays the received information to the user. The displayed information includes sunlight, views, and the location of surrounding facilities. Based on the input (e.g., the 3D model and sunlight simulation results), the final visual image and property information are provided to the user.

[0643] Through this series of steps, users can consider properties that meet their desired criteria with a concrete visual image.

[0644] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0645] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[0646] System Overview

[0647] 1. User Usage

[0648] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0649] 2. Data Collection and Analysis

[0650] The server uses an identification device to collect national and local geographic information system (GIS) data, including information on the location, area, elevation, and surrounding facilities of the land. Based on this data, a sunlight simulation is performed for the specified land.

[0651] 3. Collection and classification of local information

[0652] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[0653] 4. Image Graphic Generation

[0654] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[0655] 5. Emotional Engine Optimization

[0656] The server uses an emotion engine that analyzes the user's facial expressions, voice, input, etc. to recognize the user's emotions in real time, thereby evaluating the user's interests and satisfaction and customizing the candidate locations and information presented.

[0657] For example, if a user responds positively to the presented information, such as feeling "happy" or "interesting," other candidate locations with those characteristics will be presented preferentially.

[0658] System details

[0659] Device behavior:

[0660] The device sends the desired conditions entered by the user to the server, as well as the user's emotional data recognized by the emotion engine.

[0661] The terminal displays the results (information and image graphics of candidate locations) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[0662] Server behavior:

[0663] The server analyzes the user's desired conditions and emotional data received from the terminal, and uses an identification device to collect and analyze GIS data for the specified area.

[0664] The server uses the conversation device to collect local information and classify characteristics.

[0665] The server combines the collected GIS data and regional characteristic data, and selects candidate sites while also taking into account the user's emotional data.

[0666] The server uses a generator to generate a 3D model of the building for the selected land, creating a visual image.

[0667] Specific examples

[0668] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0669] 1. User input: The user inputs the above desired conditions into the terminal.

[0670] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[0671] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[0672] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[0673] 5. Utilizing an emotion engine: If a user expresses emotion such as "interest" toward a proposed location, the server will reflect that information and prioritize the display of more attractive candidate locations.

[0674] 6. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[0675] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[0676] The processing flow will be explained below.

[0677] Step 1:

[0678] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[0679] Step 2:

[0680] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[0681] Step 3:

[0682] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[0683] Step 4:

[0684] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[0685] Step 5:

[0686] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[0687] Step 6:

[0688] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[0689] Step 7:

[0690] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[0691] Step 8:

[0692] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[0693] Step 9:

[0694] The server uses an emotion engine to analyze the user's facial expressions, voice, input content, etc., and recognizes the user's emotions in real time.

[0695] Step 10:

[0696] The server uses an emotion engine to analyze the user's emotional data and customize the candidate locations and information it presents. For example, if the user has a positive reaction to a candidate location, it will prioritize other similar candidate locations.

[0697] Step 11:

[0698] The server transmits the generated 3D model and simulation results to the terminal.

[0699] Step 12:

[0700] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[0701] Step 13:

[0702] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[0703] Step 14:

[0704] The emotion engine learns from users' choices and reactions and uses them as feedback to improve the accuracy of future location suggestions.

[0705] Example 2

[0706] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0707] In the past, searching for the living environment and property information users desired required a lot of time and effort. Furthermore, the information obtained was difficult to understand visually, and was not customized based on the user's feelings or reactions, resulting in low convenience. Furthermore, there was a lack of evaluations based on detailed data on living and educational environments, or real-time sunlight simulations. These issues made it difficult for users to make an accurate and satisfactory property selection.

[0708] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0709] In this invention, the server includes a display device for inputting the user's desired conditions, an identification device for collecting and analyzing geographic information, a dialogue device for collecting data on the Internet and determining regional characteristics, a generation device for generating building structures and providing visual displays, an emotion engine for recognizing and analyzing the user's emotions, and a processing device for customizing and presenting property information based on the collected and analyzed information. This allows the user to obtain property information that meets their desired conditions in a visually easy-to-understand format without spending time and effort, and to receive information customized based on their emotions.

[0710] A "display device" is a device that provides an interface for users to input desired conditions.

[0711] An "identification device" is a device for collecting and analyzing geographic information.

[0712] An "interactive device" is a device for collecting data on the Internet and determining regional characteristics.

[0713] A "generator" is a device that generates a building structure based on collected data and provides a visual representation.

[0714] The "emotion engine means" is a system for recognizing and analyzing the user's emotions.

[0715] The "processing means" is a system for customizing and presenting property information based on collected and analyzed information.

[0716] MODE FOR CARRYING OUT THE INVENTION

[0717] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, a display device, an identification device, a dialogue device, a generation device, and an emotion engine.

[0718] System Overview

[0719] 1. User Usage

[0720] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0721] 2. Data Collection and Analysis

[0722] The server uses an identification device to collect and analyze national and local geographic information, including the location, area, elevation difference, and information on surrounding facilities. Based on this data, a sunlight simulation is performed for the specified land.

[0723] 3. Collection and classification of local information

[0724] The server uses the interactive device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and regional characteristics are classified into categories such as "clam-filled" and "calm."

[0725] 4. Image Graphic Generation

[0726] The server uses a generation device to generate a 3D model of the building based on the data collected by the identification device and dialogue device, and provides a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[0727] 5. Emotional Engine Optimization

[0728] The server uses an emotion engine that analyzes the user's facial expressions, voice, and input to recognize the user's emotions in real time. This allows the system to evaluate the user's interest and satisfaction and customize the property information presented. For example, if the user responds positively to the information presented, such as "happy" or "interesting," the system will prioritize the presentation of other properties that share those characteristics.

[0729] 6. Displaying the results

[0730] The terminal displays the results (property information and image graphics) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[0731] Specific examples

[0732] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0733] 1. User Input:

[0734] The user inputs the above desired conditions into the terminal.

[0735] 2. Data Collection:

[0736] The server collects geographic information about Tokorozawa City using an identification device.

[0737] 3. Determining regional characteristics:

[0738] The server uses an interactive device to collect word-of-mouth information, message boards, and weather information for Tokorozawa City, and evaluates the living environment as "peaceful."

[0739] 4. Image generation:

[0740] The server uses a generator to perform a sunlight simulation at the specified location, creating a 3D model of the building and generating a visual image.

[0741] 5. Leveraging the Emotion Engine:

[0742] If the user expresses an interest in the presented candidate locations, the server reflects this information and prioritizes the display of more attractive candidate locations.

[0743] 6. Displaying the results:

[0744] The device will then display the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[0745] Specific examples of prompts to input to generative AI models

[0746] Start searching for properties in Tokorozawa City, with a budget of ¥50 million, suitable for families, close to schools, and a peaceful location. Display information and visual images of properties in Tokorozawa City that best fit these criteria. Also, analyze the user's facial expressions and voice to prioritize properties that the user is interested in.

[0747] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[0748] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0749] Step 1: Enter user preferences

[0750] The user inputs desired conditions using a terminal.

[0751] The conditions you enter include the area, budget, family structure, lifestyle, etc. For example, you can enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0752] Input data: User's desired conditions (area, budget, family structure, lifestyle)

[0753] Output data: The entered desired conditions are sent to the server.

[0754] Step 2: Gather geographic information

[0755] The server uses the identification device to collect geographic information about the specified area.

[0756] The data collected includes information on the land's location, area, elevation difference, and surrounding facilities.

[0757] Input data: User's desired conditions (region)

[0758] Output data: Geographic information (location, area, elevation difference, surrounding facilities)

[0759] Step 3: Determine regional characteristics

[0760] The server uses the interactive device to collect relevant information on the Internet.

[0761] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc.

[0762] The acquired data is analyzed, regional characteristics are identified, and the area is classified as calm, etc.

[0763] Input data: User's desired conditions (region)

[0764] Output data: Regional characteristics data (living environment, educational environment, regional classification)

[0765] Step 4: Data analysis and customized property selection

[0766] The server selects candidate properties based on the data collected by the identification device and the dialogue device.

[0767] Input data: Geographical information, regional characteristics data, user preferences

[0768] Output data: List of candidate properties

[0769] Step 5: Creating a visual image

[0770] The server uses a generation device to generate a 3D model of the candidate property.

[0771] Also include sunlight simulations and view images.

[0772] Input data: candidate property list, geographic information

[0773] Output data: Visual image (3D model, sunlight simulation, view image)

[0774] Step 6: Sentiment Analysis and Customization

[0775] The server uses an emotion engine to analyze the user's facial expressions, voice, and input in real time.

[0776] Determine the user's emotional state (e.g., interested, happy, etc.) and customize the information provided.

[0777] Input data: visual images, user reactions

[0778] Output data: customized property information

[0779] Step 7: View the results

[0780] The device displays the results sent from the server to the user.

[0781] In addition to property information, the display includes visual images such as how sunny the garden is and the view from the living room.

[0782] Input data: customized property information, visual images

[0783] Output data: Property information and visual images displayed to the user

[0784] (Application example 2)

[0785] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0786] In traditional property selection, users must individually check multiple information sources, which takes a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there are limited ways to check the property's visual image, specific sunlight, and view in advance, which often leaves users unsure about their satisfaction after purchasing. Furthermore, because customized suggestions that take user emotions into consideration are not made, there is a lack of systems that can optimally meet users' needs.

[0787] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, a conversation device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and an emotion engine for recognizing and analyzing the user's emotions. This allows the user to efficiently search for property information that matches their desired conditions and check specific images of sunlight and views in advance. In addition, property information can be customized based on the user's emotional data, allowing them to receive optimal suggestions, thereby improving post-purchase satisfaction.

[0788] "User" refers to an individual or corporation who uses this system to search for and evaluate property information that meets their desired conditions.

[0789] A "terminal" is a device that allows users to input desired conditions and displays the system's processing results. Examples include smartphones, tablets, PCs, smart glasses, and head-mounted displays.

[0790] "Identification equipment" refers to equipment used to collect and analyze national and local geographic information. Specifically, it includes servers and related software that handle GIS data.

[0791] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics. Specifically, it includes a server equipped with a web scraping tool or a natural language processing engine.

[0792] A "generator" is a device that generates a building model based on collected data and provides a visual image. Examples include 3D modeling software and rendering engines.

[0793] The "emotion engine" is a device that recognizes the user's emotions by analyzing their facial expressions and voice, and optimizes the system's operation. Specifically, it includes a server equipped with emotion recognition software and an AI model.

[0794] "Generative AI model" refers to an artificial intelligence model used to generate optimal property information and visual images based on collected data and user sentiment data.

[0795] A "prompt" is an input document that provides instructions to a generative AI model. Specifically, it is a document based on the user's desired conditions and emotions.

[0796] System configuration

[0797] This invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and further recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[0798] Hardware and software used

[0799] Devices: smartphones, tablets, PCs, smart glasses, head-mounted displays, etc.

[0800] Identification device: GIS data server and related software (e.g., Python, pandas, geopandas)

[0801] Conversational device: A server with a web scraping tool and a natural language processing engine (e.g., Scrapy, an NLP toolkit)

[0802] Generator: 3D modeling software and rendering engines (e.g. Unity, Blender)

[0803] Emotion engine: A server with emotion recognition software and AI models (e.g., Microsoft Azure Cognitive Services)

[0804] Generative AI model: An AI model that generates optimal property information and visual images based on collected data and user sentiment data.

[0805] Data acquisition and processing procedures

[0806] Enter the user's desired conditions

[0807] The user uses a terminal to input desired conditions (area, budget, family composition, lifestyle, etc.). For example, the user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0808] Data collection and analysis

[0809] The server uses the identification device to collect and analyze GIS data for the specified area, including information on the location, area, elevation, and surrounding facilities of the land.

[0810] Collection and classification of local information

[0811] The server uses the chat device to collect information from the Internet (such as review sites, message boards, and weather information) and acquires data to determine regional characteristics, which are then classified into categories such as "active" and "calm."

[0812] 3D model generation and visualization

[0813] The server uses a generator to generate a 3D model of the building based on the collected data and performs a sunlight simulation, creating a concrete visual image that is displayed on the device.

[0814] Optimization by Emotion Engine

[0815] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize emotional data in real time, thereby evaluating the user's interests and satisfaction and optimizing the property information presented.

[0816] Example

[0817] If a user enters a prompt such as "I am looking for a property in Tokorozawa City within 50 million yen that is family-friendly and has a peaceful environment," the following actions will occur:

[0818] 1. The user enters the desired conditions into the terminal and sends them to the server.

[0819] 2. The server uses the identification device to collect and analyze GIS data for Tokorozawa City.

[0820] 3. The server uses the conversation device to collect information on the Internet about the living and educational environment in Tokorozawa City and evaluates it as "peaceful."

[0821] 4. The server uses the generator to simulate sunlight at the specified location and generate a 3D model of the building.

[0822] 5. The server uses an emotion engine to analyze the user's emotion data and customize the property information based on positive responses.

[0823] 6. The final result and 3D image are displayed on the user's device.

[0824] In this way, the user can obtain property information that matches his or her desired conditions along with a concrete visual image, and can receive proposals that are optimized based on emotional data.

[0825] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0826] Step 1:

[0827] The user inputs desired conditions into the terminal. Specifically, they input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet." This input is sent to the server as JSON format data.

[0828] Step 2:

[0829] The server analyzes the desired condition data it receives and uses an identification device to collect GIS data for the specified area (Tokorozawa City). This GIS data includes information on the location, area, elevation difference, and surrounding facilities of the land. As a result, the input is the user's desired condition data, and the output is GIS data for the specified area.

[0830] Step 3:

[0831] The server analyzes the collected GIS data and identifies promising property candidates based on the specified criteria. Specifically, it uses Python's pandas and geopandas libraries to filter and sort the data. As a result, the input is GIS data and the output is a list of potential properties.

[0832] Step 4:

[0833] The server uses a conversation device to collect information about the living and educational environment in Tokorozawa City from the Internet. Specifically, it uses Scrapy and an NLP toolkit to extract and analyze data from review sites and bulletin boards. As a result, the input is a list of candidate locations, and the output is regional characteristic data.

[0834] Step 5:

[0835] The server analyzes the collected area characteristic data and classifies the living environment of the candidate area into categories such as "active" or "calm." This determines whether the area meets the user's desired conditions. This determination is made using machine learning models and statistical analysis methods. The input is the area characteristic data, and the output is the category classification results.

[0836] Step 6:

[0837] The server uses a generator to perform a sunlight simulation of the candidate sites. Specifically, it uses Unity or Blender to generate a 3D model and create a visual image. The input is the candidate site list and GIS data, and the output is the sunlight simulation results and the 3D model.

[0838] Step 7:

[0839] The server uses an emotion engine to analyze the user's facial expressions and voice in real time to recognize emotional data. Specifically, it captures the user's facial expressions and tone of voice through a camera and microphone, and performs emotion analysis using Microsoft Azure Cognitive Services. The input is real-time audio and video data, and the output is emotional data.

[0840] Step 8:

[0841] The server uses a generative AI model to optimize the property listings based on the emotion data and desired conditions. Specifically, the AI ​​model analyzes the prompt text and regenerates property listings that match the user's preferences. The input is desired condition data and emotion data, and the output is an optimized property listing.

[0842] Step 9:

[0843] The final results and 3D images are displayed on the user's device. The device displays these results in real time, allowing the user to view property information directly through the interface. It also iterates based on the user's new responses to provide optimal suggestions. The input is the optimized property list and 3D model, and the output is the visual image and property information presented to the user.

[0844] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0845] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0846] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0847] [Third embodiment]

[0848] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0849] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0850] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0851] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0852] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0853] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0854] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0855] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0856] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0857] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0858] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0859] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0860] The present invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[0861] System Overview

[0862] 1. User Usage

[0863] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0864] 2. Data Collection and Analysis

[0865] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[0866] 3. Collection and classification of local information

[0867] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[0868] 4. Image Graphic Generation

[0869] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[0870] System details

[0871] Device behavior:

[0872] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[0873] Server behavior:

[0874] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[0875] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[0876] Specific examples

[0877] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[0878] 1. User input: The user inputs the above desired conditions into the terminal.

[0879] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[0880] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[0881] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[0882] 5. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[0883] This process allows users to view a specific visual image of the property that meets their requirements, reducing anxiety about purchasing and allowing them to select a property with greater confidence.

[0884] The processing flow will be explained below.

[0885] Step 1:

[0886] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[0887] Step 2:

[0888] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[0889] Step 3:

[0890] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[0891] Step 4:

[0892] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[0893] Step 5:

[0894] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[0895] Step 6:

[0896] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[0897] Step 7:

[0898] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[0899] Step 8:

[0900] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[0901] Step 9:

[0902] The server sends the generated 3D model and simulation results to the terminal.

[0903] Step 10:

[0904] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[0905] Step 11:

[0906] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[0907] Example 1

[0908] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0909] In today's world, when choosing a residential environment, users must gather a great deal of information and spend a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there is a lack of means to visually confirm the geographical information, regional characteristics, and specific image of sunlight and views associated with the property. This makes it difficult for users to efficiently search for properties that meet their desired criteria and make accurate decisions.

[0910] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0911] In this invention, the server includes means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area, a conversation device means for collecting information on the Internet and determining the area characteristics, and a generation device means for generating a three-dimensional model of the building and providing a visual image, thereby enabling the user to efficiently search for properties that meet the desired conditions while visually confirming them.

[0912] "Terminal means for inputting user's desired conditions" refers to electronic devices that allow users to input and transmit specific desired conditions for housing. This includes smartphones, PCs, tablets, etc.

[0913] "Identification device means for collecting and analyzing national and local geographic information" means a device for collecting and analyzing geographic information system (GIS) data for a specified area, including the use of a GPS device or a map service API.

[0914] The "conversation device means for collecting information on the Internet and determining regional characteristics" is a device for collecting data from online resources (such as review sites, bulletin boards, and weather information) and analyzing and determining the characteristics of the region (e.g., "active," "calm," etc.).

[0915] "Generating device means for generating a three-dimensional model of a building and providing a visual image" refers to a device that generates a three-dimensional model of a building or land based on collected data and provides a visual image. This includes 3D modeling software and rendering software.

[0916] "Server means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area" refers to a server for using an identification device means to collect and analyze geographic information for the specified area based on the desired conditions entered by the user.

[0917] "Server means for generating three-dimensional models based on collected data and creating visual images" refers to a server for generating three-dimensional models of buildings and land based on data collected by the identification device means and conversation device means and creating visual images.

[0918] The "identification device means for performing sunlight simulation" is a device that analyzes geographic information in order to simulate the sunlight conditions of land and buildings.

[0919] The "conversation device means for collecting and classifying data on living and educational environments" is a device for extracting, organizing, and classifying data on living and educational environments from online sources.

[0920] MODE FOR CARRYING OUT THE INVENTION

[0921] This invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[0922] The overall operation of the system is as follows:

[0923] User Actions

[0924] 1. The user uses the terminal to enter their desired conditions.

[0925] Desired conditions include specific elements such as area, budget, family composition, lifestyle, etc. For example, users can use a dedicated smartphone app or PC web app to enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[0926] Server Processing

[0927] 2. The device sends the user's desired conditions to the server.

[0928] The transmission method used is an HTTP POST request.

[0929] 3. The server uses the identification device to collect geographic information (GIS data) of the specified area.

[0930] Specifically, map services such as Google Maps API and OpenStreetMap API are used to obtain data such as land location, area, elevation difference, and the location of surrounding facilities.

[0931] 4. The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[0932] This analysis uses data analysis tools such as ArcGIS to simulate the sunlight conditions in a specified area.

[0933] 5. The server uses the conversation device to collect information on the Internet.

[0934] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc. through social media APIs such as the Twitter API and Reddit API, and weather forecast services such as the OpenWeather API.

[0935] 6. The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" or "calm."

[0936] Use NLP tools (e.g., NLTK and SpaCy) to analyze text data from reviews and posts and evaluate local characteristics.

[0937] 3D Content Generation

[0938] 7. The server uses the generation device to generate a three-dimensional model of the building based on the data collected by the identification device and conversation device.

[0939] Use 3D modeling software (e.g., SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the designated area.

[0940] 8. The server generates simulation results for specific sunlight and views based on the 3D model.

[0941] Use rendering software (e.g. Blender or Lumion) to simulate sunlight and views and generate the results as high-resolution images.

[0942] Displaying the results

[0943] 9. The terminal displays the results (information and image graphics of the candidate sites) sent from the server to the user.

[0944] Users can view information about the candidate locations along with the generated visual image (e.g., how sunny the garden is, the view from the living room, etc.).

[0945] Specific examples

[0946] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the server will process the information using the following prompt statement:

[0947] When a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the system collects geographical information and reviews of Tokorozawa City, and visually presents the results of a 3D simulation of sunlight and views to the user.

[0948] Also, when a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system will operate as follows.

[0949] When a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system collects geographical information and reviews of Shinjuku Ward and provides the results of a 3D simulation that reflects the nighttime lighting and the lively atmosphere of the city.

[0950] This allows users to feel more confident in choosing the property that best meets their desired conditions.

[0951] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0952] Step 1:

[0953] The user uses the terminal to input the desired housing conditions.

[0954] Specific operation: The user opens a dedicated smartphone app or PC web app and enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful."

[0955] Input: Desired conditions entered by the user (area, budget, family composition, lifestyle, etc.)

[0956] Output: The user's desired conditions data is registered on the terminal.

[0957] Step 2:

[0958] The terminal sends the user's desired conditions to the server.

[0959] Specific operation: When the terminal presses the "Send" button on the input form, the entered data is sent to the server as an HTTP POST request.

[0960] Input: User's desired conditions data

[0961] Output: The desired condition data arrives at the server.

[0962] Step 3:

[0963] The server uses the identification device to collect geographic information for the specified area.

[0964] Specific operation: The server calls a geographic information system API (Google Maps API or OpenStreetMap API) to obtain detailed geographic information about Tokorozawa City (location, area, elevation difference, and location of surrounding facilities).

[0965] Input: User's desired conditions (especially information about the area)

[0966] Data processing: Call the geographic information system API to obtain the necessary geographic data.

[0967] Output: Collected geographic data

[0968] Step 4:

[0969] The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[0970] Specific operation: Using the GIS data acquired by the server, a sunlight simulation for the specified area is performed using a data analysis tool (such as ArcGIS).

[0971] Input: Collected geographic data

[0972] Data calculation: Perform a sunlight simulation based on GIS data to obtain specific results.

[0973] Output: Sunlight simulation results

[0974] Step 5:

[0975] The server uses the conversation device to collect information on the Internet.

[0976] Specific operation: The server uses SNS APIs (Twitter API and Reddit API) and weather service APIs (OpenWeather API) to collect word-of-mouth information and weather data about Tokorozawa City.

[0977] Input: User's desired conditions (regional information)

[0978] Data processing: Collect word-of-mouth and weather data from the Internet.

[0979] Output: Review data and weather data

[0980] Step 6:

[0981] The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" and "calm."

[0982] Specific operation: The server analyzes the text data of reviews using natural language processing tools (NLTK or SpaCy) and classifies regional characteristics into categories.

[0983] Input: Collected review data and weather data

[0984] Data calculation: Perform text analysis and categorize local ratings.

[0985] Output: Classified area characteristic data

[0986] Step 7:

[0987] The server uses a generation device to generate a three-dimensional model of the building based on the data collected by the identification device and the conversation device.

[0988] What it does: The server uses 3D modeling software (SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the specified area.

[0989] Input: Collected and analyzed geographic and area characteristic data

[0990] Data processing: Using 3D modeling software, the collected and analyzed data is constructed into a visual model.

[0991] Output: 3D model of the building

[0992] Step 8:

[0993] The server generates simulation results for specific sunlight and views based on the 3D model.

[0994] How it works: The server uses rendering software (Blender or Lumion) to simulate sunlight and views, and generates the results as high-resolution images.

[0995] Input: Generated 3D model of the building

[0996] Data calculation: Running the simulation in rendering software to generate a visual image.

[0997] Output: Image graphics of the simulation results

[0998] Step 9:

[0999] The terminal displays the results (information and image graphics of candidate sites) sent from the server to the user.

[1000] Specific operation: The device displays the image and text data received from the server within the app, allowing the user to check information about each candidate location.

[1001] Input: Candidate site information and image graphics sent from the server

[1002] Output: Site information and visual images displayed to the user

[1003] These steps allow users to efficiently search for properties that meet their desired criteria while visually checking them.

[1004] (Application example 1)

[1005] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1006] Previously, when considering purchasing or renting a property, users had to visit the property in person to check it out, making it difficult to efficiently find a property that met their desired conditions. It was also difficult to get a concrete image of the sunlight and surrounding environment, making it difficult to decide whether to purchase or sign a contract. There is a need for a system that solves these issues and allows users to select properties more efficiently and with peace of mind.

[1007] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1008] In this invention, the server includes terminal means for inputting the user's desired conditions, identification device means for collecting and analyzing national and local geographic information, conversation device means for collecting information on the Internet and determining regional characteristics, generation device means for generating a building model and providing a visual image, means for collecting and analyzing information on the region and property based on the desired conditions and simulating specific views and sunlight in a 3D model, and means for providing a visual image displayed on the terminal used. This allows the user to efficiently consider properties that meet their desired conditions while visually imagining them.

[1009] "User's desired conditions" are conditions such as the desired area, price, family composition, and lifestyle that the user enters when selecting a property.

[1010] A "terminal" is a device used by a user to input desired conditions, specifically a smartphone or computer.

[1011] An "identification device" is a device for collecting and analyzing national and local geographic information.

[1012] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics.

[1013] A "generation device" is a device for generating a building model and providing a visual image.

[1014] "Sunlight simulation" is a process of virtually calculating and simulating the sunlight conditions at a specified location.

[1015] A "3D model" is a three-dimensional virtual model of a building or landscape that is generated based on collected data.

[1016] "Means for providing visual images" refers to a method for displaying the generated 3D model and the results of the sunlight simulation on a user's device and providing a visual image.

[1017] This invention is a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, an interactive device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and means for collecting and analyzing information on regions and properties based on the desired conditions, simulating specific views and sunlight in 3D models, and providing visual images.

[1018] System Overview

[1019] 1. User Usage

[1020] Users use a terminal to input their desired conditions, which include the area, budget, family composition, lifestyle, etc. For example, a user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1021] 2. Data Collection and Analysis

[1022] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[1023] 3. Collection and classification of local information

[1024] The server uses the chat device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. It analyzes this data and classifies regional characteristics into categories such as "active" and "calm."

[1025] 4. Image Graphic Generation

[1026] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image, creating and displaying images including simulation results of specific sunlight and views.

[1027] System details

[1028] Device behavior:

[1029] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[1030] Server behavior:

[1031] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[1032] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[1033] Specific operation example

[1034] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[1035] 1. User input: The user inputs the above desired conditions into the terminal.

[1036] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[1037] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[1038] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[1039] 5. Displaying the results: The device displays the generated image along with information about the candidate locations to the user. This display includes information such as the amount of sunlight in the garden and the view from the living room. This process allows the user to consider properties that meet their desired criteria with a concrete visual image.

[1040] Example of input prompt for generative AI model

[1041] TXT

[1042] The user entered the following desired conditions: "Tokorozawa City," "budget 50 million yen," "family-friendly," "close to schools," and "quiet."

[1043] Based on this, collect GIS data and local information for the specified area and display a 3D model of the property and a sunlight simulation.

[1044] Generate property information that matches your needs and provide visual images of it.

[1045] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1046] Step 1:

[1047] Users use a terminal to input their desired conditions. These conditions include the area, budget, family composition, lifestyle, etc. The entered desired conditions are sent to the server via the terminal. The input (e.g., "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," "quiet") is used as data for the next step.

[1048] Step 2:

[1049] Based on the received desired conditions, the server uses an identification device to collect geographic information system (GIS) data for the specified area. The collected data includes the location of the land, its area, elevation difference, and the location of surrounding facilities. Based on the input (e.g., "Tokorozawa City"), the GIS data is obtained, and the server analyzes it before proceeding to the next step.

[1050] Step 3:

[1051] The server uses the conversation device to collect local information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. The acquired data is analyzed and the local characteristics are classified into categories such as "active" and "calm." The collected Internet information is analyzed based on the input (e.g., "Tokorozawa City"), and the local characteristics are classified.

[1052] Step 4:

[1053] The server generates a 3D model of the building based on the data collected by the identification device and conversation device. It uses the generation device to simulate specific sunlight and views, and creates a visual image that visualizes the results. Based on input (e.g., GIS data and analysis results of regional characteristics), the 3D model and sunlight simulation are performed, and the results are generated as a visual image.

[1054] Step 5:

[1055] The server sends the generated image along with property information for the candidate location to the terminal. The terminal displays the received information to the user. The displayed information includes sunlight, views, and the location of surrounding facilities. Based on the input (e.g., the 3D model and sunlight simulation results), the final visual image and property information are provided to the user.

[1056] Through this series of steps, users can consider properties that meet their desired criteria with a concrete visual image.

[1057] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1058] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[1059] System Overview

[1060] 1. User Usage

[1061] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1062] 2. Data Collection and Analysis

[1063] The server uses an identification device to collect national and local geographic information system (GIS) data, including information on the location, area, elevation, and surrounding facilities of the land. Based on this data, a sunlight simulation is performed for the specified land.

[1064] 3. Collection and classification of local information

[1065] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[1066] 4. Image Graphic Generation

[1067] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[1068] 5. Emotional Engine Optimization

[1069] The server uses an emotion engine that analyzes the user's facial expressions, voice, input, etc. to recognize the user's emotions in real time, thereby evaluating the user's interests and satisfaction and customizing the candidate locations and information presented.

[1070] For example, if a user responds positively to the presented information, such as feeling "happy" or "interesting," other candidate locations with those characteristics will be presented preferentially.

[1071] System details

[1072] Device behavior:

[1073] The device sends the desired conditions entered by the user to the server, as well as the user's emotional data recognized by the emotion engine.

[1074] The terminal displays the results (information and image graphics of candidate locations) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[1075] Server behavior:

[1076] The server analyzes the user's desired conditions and emotional data received from the terminal, and uses an identification device to collect and analyze GIS data for the specified area.

[1077] The server uses the conversation device to collect local information and classify characteristics.

[1078] The server combines the collected GIS data and regional characteristic data, and selects candidate sites while also taking into account the user's emotional data.

[1079] The server uses a generator to generate a 3D model of the building for the selected land, creating a visual image.

[1080] Specific examples

[1081] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[1082] 1. User input: The user inputs the above desired conditions into the terminal.

[1083] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[1084] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[1085] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[1086] 5. Utilizing an emotion engine: If a user expresses emotion such as "interest" toward a proposed location, the server will reflect that information and prioritize the display of more attractive candidate locations.

[1087] 6. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[1088] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[1089] The processing flow will be explained below.

[1090] Step 1:

[1091] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[1092] Step 2:

[1093] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[1094] Step 3:

[1095] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[1096] Step 4:

[1097] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[1098] Step 5:

[1099] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[1100] Step 6:

[1101] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[1102] Step 7:

[1103] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[1104] Step 8:

[1105] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[1106] Step 9:

[1107] The server uses an emotion engine to analyze the user's facial expressions, voice, input content, etc., and recognizes the user's emotions in real time.

[1108] Step 10:

[1109] The server uses an emotion engine to analyze the user's emotional data and customize the candidate locations and information it presents. For example, if the user has a positive reaction to a candidate location, it will prioritize other similar candidate locations.

[1110] Step 11:

[1111] The server transmits the generated 3D model and simulation results to the terminal.

[1112] Step 12:

[1113] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[1114] Step 13:

[1115] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[1116] Step 14:

[1117] The emotion engine learns from users' choices and reactions and uses them as feedback to improve the accuracy of future location suggestions.

[1118] Example 2

[1119] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1120] In the past, searching for the living environment and property information users desired required a lot of time and effort. Furthermore, the information obtained was difficult to understand visually, and was not customized based on the user's feelings or reactions, resulting in low convenience. Furthermore, there was a lack of evaluations based on detailed data on living and educational environments, or real-time sunlight simulations. These issues made it difficult for users to make an accurate and satisfactory property selection.

[1121] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1122] In this invention, the server includes a display device for inputting the user's desired conditions, an identification device for collecting and analyzing geographic information, a dialogue device for collecting data on the Internet and determining regional characteristics, a generation device for generating building structures and providing visual displays, an emotion engine for recognizing and analyzing the user's emotions, and a processing device for customizing and presenting property information based on the collected and analyzed information. This allows the user to obtain property information that meets their desired conditions in a visually easy-to-understand format without spending time and effort, and to receive information customized based on their emotions.

[1123] A "display device" is a device that provides an interface for users to input desired conditions.

[1124] An "identification device" is a device for collecting and analyzing geographic information.

[1125] An "interactive device" is a device for collecting data on the Internet and determining regional characteristics.

[1126] A "generator" is a device that generates a building structure based on collected data and provides a visual representation.

[1127] The "emotion engine means" is a system for recognizing and analyzing the user's emotions.

[1128] The "processing means" is a system for customizing and presenting property information based on collected and analyzed information.

[1129] MODE FOR CARRYING OUT THE INVENTION

[1130] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, a display device, an identification device, a dialogue device, a generation device, and an emotion engine.

[1131] System Overview

[1132] 1. User Usage

[1133] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1134] 2. Data Collection and Analysis

[1135] The server uses an identification device to collect and analyze national and local geographic information, including the location, area, elevation difference, and information on surrounding facilities. Based on this data, a sunlight simulation is performed for the specified land.

[1136] 3. Collection and classification of local information

[1137] The server uses the interactive device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and regional characteristics are classified into categories such as "clam-filled" and "calm."

[1138] 4. Image Graphic Generation

[1139] The server uses a generation device to generate a 3D model of the building based on the data collected by the identification device and dialogue device, and provides a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[1140] 5. Emotional Engine Optimization

[1141] The server uses an emotion engine that analyzes the user's facial expressions, voice, and input to recognize the user's emotions in real time. This allows the system to evaluate the user's interest and satisfaction and customize the property information presented. For example, if the user responds positively to the information presented, such as "happy" or "interesting," the system will prioritize the presentation of other properties that share those characteristics.

[1142] 6. Displaying the results

[1143] The terminal displays the results (property information and image graphics) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[1144] Specific examples

[1145] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[1146] 1. User Input:

[1147] The user inputs the above desired conditions into the terminal.

[1148] 2. Data Collection:

[1149] The server collects geographic information about Tokorozawa City using an identification device.

[1150] 3. Determining regional characteristics:

[1151] The server uses an interactive device to collect word-of-mouth information, message boards, and weather information for Tokorozawa City, and evaluates the living environment as "peaceful."

[1152] 4. Image generation:

[1153] The server uses a generator to perform a sunlight simulation at the specified location, creating a 3D model of the building and generating a visual image.

[1154] 5. Leveraging the Emotion Engine:

[1155] If the user expresses an interest in the presented candidate locations, the server reflects this information and prioritizes the display of more attractive candidate locations.

[1156] 6. Displaying the results:

[1157] The device will then display the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[1158] Specific examples of prompts to input to generative AI models

[1159] Start searching for properties in Tokorozawa City, with a budget of ¥50 million, suitable for families, close to schools, and a peaceful location. Display information and visual images of properties in Tokorozawa City that best fit these criteria. Also, analyze the user's facial expressions and voice to prioritize properties that the user is interested in.

[1160] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[1161] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1162] Step 1: Enter user preferences

[1163] The user inputs desired conditions using a terminal.

[1164] The conditions you enter include the area, budget, family structure, lifestyle, etc. For example, you can enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1165] Input data: User's desired conditions (area, budget, family structure, lifestyle)

[1166] Output data: The entered desired conditions are sent to the server.

[1167] Step 2: Gather geographic information

[1168] The server uses the identification device to collect geographic information about the specified area.

[1169] The data collected includes information on the land's location, area, elevation difference, and surrounding facilities.

[1170] Input data: User's desired conditions (region)

[1171] Output data: Geographic information (location, area, elevation difference, surrounding facilities)

[1172] Step 3: Determine regional characteristics

[1173] The server uses the interactive device to collect relevant information on the Internet.

[1174] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc.

[1175] The acquired data is analyzed, regional characteristics are identified, and the area is classified as calm, etc.

[1176] Input data: User's desired conditions (region)

[1177] Output data: Regional characteristics data (living environment, educational environment, regional classification)

[1178] Step 4: Data analysis and customized property selection

[1179] The server selects candidate properties based on the data collected by the identification device and the dialogue device.

[1180] Input data: Geographical information, regional characteristics data, user preferences

[1181] Output data: List of candidate properties

[1182] Step 5: Creating a visual image

[1183] The server uses a generation device to generate a 3D model of the candidate property.

[1184] Also include sunlight simulations and view images.

[1185] Input data: candidate property list, geographic information

[1186] Output data: Visual image (3D model, sunlight simulation, view image)

[1187] Step 6: Sentiment Analysis and Customization

[1188] The server uses an emotion engine to analyze the user's facial expressions, voice, and input in real time.

[1189] Determine the user's emotional state (e.g., interested, happy, etc.) and customize the information provided.

[1190] Input data: visual images, user reactions

[1191] Output data: customized property information

[1192] Step 7: View the results

[1193] The device displays the results sent from the server to the user.

[1194] In addition to property information, the display includes visual images such as how sunny the garden is and the view from the living room.

[1195] Input data: customized property information, visual images

[1196] Output data: Property information and visual images displayed to the user

[1197] (Application example 2)

[1198] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1199] In traditional property selection, users must individually check multiple information sources, which takes a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there are limited ways to check the property's visual image, specific sunlight, and view in advance, which often leaves users unsure about their satisfaction after purchasing. Furthermore, because customized suggestions that take user emotions into consideration are not made, there is a lack of systems that can optimally meet users' needs.

[1200] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, a conversation device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and an emotion engine for recognizing and analyzing the user's emotions. This allows the user to efficiently search for property information that matches their desired conditions and check specific images of sunlight and views in advance. In addition, property information can be customized based on the user's emotional data, allowing them to receive optimal suggestions, thereby improving post-purchase satisfaction.

[1201] "User" refers to an individual or corporation who uses this system to search for and evaluate property information that meets their desired conditions.

[1202] A "terminal" is a device that allows users to input desired conditions and displays the system's processing results. Examples include smartphones, tablets, PCs, smart glasses, and head-mounted displays.

[1203] "Identification equipment" refers to equipment used to collect and analyze national and local geographic information. Specifically, it includes servers and related software that handle GIS data.

[1204] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics. Specifically, it includes a server equipped with a web scraping tool or a natural language processing engine.

[1205] A "generator" is a device that generates a building model based on collected data and provides a visual image. Examples include 3D modeling software and rendering engines.

[1206] The "emotion engine" is a device that recognizes the user's emotions by analyzing their facial expressions and voice, and optimizes the system's operation. Specifically, it includes a server equipped with emotion recognition software and an AI model.

[1207] "Generative AI model" refers to an artificial intelligence model used to generate optimal property information and visual images based on collected data and user sentiment data.

[1208] A "prompt" is an input document that provides instructions to a generative AI model. Specifically, it is a document based on the user's desired conditions and emotions.

[1209] System configuration

[1210] This invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and further recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[1211] Hardware and software used

[1212] Devices: smartphones, tablets, PCs, smart glasses, head-mounted displays, etc.

[1213] Identification device: GIS data server and related software (e.g., Python, pandas, geopandas)

[1214] Conversational device: A server with a web scraping tool and a natural language processing engine (e.g., Scrapy, an NLP toolkit)

[1215] Generator: 3D modeling software and rendering engines (e.g. Unity, Blender)

[1216] Emotion engine: A server with emotion recognition software and AI models (e.g., Microsoft Azure Cognitive Services)

[1217] Generative AI model: An AI model that generates optimal property information and visual images based on collected data and user sentiment data.

[1218] Data acquisition and processing procedures

[1219] Enter the user's desired conditions

[1220] The user uses a terminal to input desired conditions (area, budget, family composition, lifestyle, etc.). For example, the user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1221] Data collection and analysis

[1222] The server uses the identification device to collect and analyze GIS data for the specified area, including information on the location, area, elevation, and surrounding facilities of the land.

[1223] Collection and classification of local information

[1224] The server uses the chat device to collect information from the Internet (such as review sites, message boards, and weather information) and acquires data to determine regional characteristics, which are then classified into categories such as "active" and "calm."

[1225] 3D model generation and visualization

[1226] The server uses a generator to generate a 3D model of the building based on the collected data and performs a sunlight simulation, creating a concrete visual image that is displayed on the device.

[1227] Optimization by Emotion Engine

[1228] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize emotional data in real time, thereby evaluating the user's interests and satisfaction and optimizing the property information presented.

[1229] Example

[1230] If a user enters a prompt such as "I am looking for a property in Tokorozawa City within 50 million yen that is family-friendly and has a peaceful environment," the following actions will occur:

[1231] 1. The user enters the desired conditions into the terminal and sends them to the server.

[1232] 2. The server uses the identification device to collect and analyze GIS data for Tokorozawa City.

[1233] 3. The server uses the conversation device to collect information on the Internet about the living and educational environment in Tokorozawa City and evaluates it as "peaceful."

[1234] 4. The server uses the generator to simulate sunlight at the specified location and generate a 3D model of the building.

[1235] 5. The server uses an emotion engine to analyze the user's emotion data and customize the property information based on positive responses.

[1236] 6. The final result and 3D image are displayed on the user's device.

[1237] In this way, the user can obtain property information that matches his or her desired conditions along with a concrete visual image, and can receive proposals that are optimized based on emotional data.

[1238] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1239] Step 1:

[1240] The user inputs desired conditions into the terminal. Specifically, they input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet." This input is sent to the server as JSON format data.

[1241] Step 2:

[1242] The server analyzes the desired condition data it receives and uses an identification device to collect GIS data for the specified area (Tokorozawa City). This GIS data includes information on the location, area, elevation difference, and surrounding facilities of the land. As a result, the input is the user's desired condition data, and the output is GIS data for the specified area.

[1243] Step 3:

[1244] The server analyzes the collected GIS data and identifies promising property candidates based on the specified criteria. Specifically, it uses Python's pandas and geopandas libraries to filter and sort the data. As a result, the input is GIS data and the output is a list of potential properties.

[1245] Step 4:

[1246] The server uses a conversation device to collect information about the living and educational environment in Tokorozawa City from the Internet. Specifically, it uses Scrapy and an NLP toolkit to extract and analyze data from review sites and bulletin boards. As a result, the input is a list of candidate locations, and the output is regional characteristic data.

[1247] Step 5:

[1248] The server analyzes the collected area characteristic data and classifies the living environment of the candidate area into categories such as "active" or "calm." This determines whether the area meets the user's desired conditions. This determination is made using machine learning models and statistical analysis methods. The input is the area characteristic data, and the output is the category classification results.

[1249] Step 6:

[1250] The server uses a generator to perform a sunlight simulation of the candidate sites. Specifically, it uses Unity or Blender to generate a 3D model and create a visual image. The input is the candidate site list and GIS data, and the output is the sunlight simulation results and the 3D model.

[1251] Step 7:

[1252] The server uses an emotion engine to analyze the user's facial expressions and voice in real time to recognize emotional data. Specifically, it captures the user's facial expressions and tone of voice through a camera and microphone, and performs emotion analysis using Microsoft Azure Cognitive Services. The input is real-time audio and video data, and the output is emotional data.

[1253] Step 8:

[1254] The server uses a generative AI model to optimize the property listings based on the emotion data and desired conditions. Specifically, the AI ​​model analyzes the prompt text and regenerates property listings that match the user's preferences. The input is desired condition data and emotion data, and the output is an optimized property listing.

[1255] Step 9:

[1256] The final results and 3D images are displayed on the user's device. The device displays these results in real time, allowing the user to view property information directly through the interface. It also iterates based on the user's new responses to provide optimal suggestions. The input is the optimized property list and 3D model, and the output is the visual image and property information presented to the user.

[1257] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1258] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1259] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1260] [Fourth embodiment]

[1261] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1262] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1263] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1264] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1265] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1266] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1267] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1268] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1269] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1270] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1271] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1272] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1273] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1274] The present invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[1275] System Overview

[1276] 1. User Usage

[1277] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1278] 2. Data Collection and Analysis

[1279] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[1280] 3. Collection and classification of local information

[1281] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[1282] 4. Image Graphic Generation

[1283] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[1284] System details

[1285] Device behavior:

[1286] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[1287] Server behavior:

[1288] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[1289] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[1290] Specific examples

[1291] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[1292] 1. User input: The user inputs the above desired conditions into the terminal.

[1293] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[1294] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[1295] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[1296] 5. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[1297] This process allows users to view a specific visual image of the property that meets their requirements, reducing anxiety about purchasing and allowing them to select a property with greater confidence.

[1298] The processing flow will be explained below.

[1299] Step 1:

[1300] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[1301] Step 2:

[1302] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[1303] Step 3:

[1304] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[1305] Step 4:

[1306] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[1307] Step 5:

[1308] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[1309] Step 6:

[1310] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[1311] Step 7:

[1312] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[1313] Step 8:

[1314] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[1315] Step 9:

[1316] The server sends the generated 3D model and simulation results to the terminal.

[1317] Step 10:

[1318] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[1319] Step 11:

[1320] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[1321] Example 1

[1322] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1323] In today's world, when choosing a residential environment, users must gather a great deal of information and spend a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there is a lack of means to visually confirm the geographical information, regional characteristics, and specific image of sunlight and views associated with the property. This makes it difficult for users to efficiently search for properties that meet their desired criteria and make accurate decisions.

[1324] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1325] In this invention, the server includes means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area, a conversation device means for collecting information on the Internet and determining the area characteristics, and a generation device means for generating a three-dimensional model of the building and providing a visual image, thereby enabling the user to efficiently search for properties that meet the desired conditions while visually confirming them.

[1326] "Terminal means for inputting user's desired conditions" refers to electronic devices that allow users to input and transmit specific desired conditions for housing. This includes smartphones, PCs, tablets, etc.

[1327] "Identification device means for collecting and analyzing national and local geographic information" means a device for collecting and analyzing geographic information system (GIS) data for a specified area, including the use of a GPS device or a map service API.

[1328] The "conversation device means for collecting information on the Internet and determining regional characteristics" is a device for collecting data from online resources (such as review sites, bulletin boards, and weather information) and analyzing and determining the characteristics of the region (e.g., "active," "calm," etc.).

[1329] "Generating device means for generating a three-dimensional model of a building and providing a visual image" refers to a device that generates a three-dimensional model of a building or land based on collected data and provides a visual image. This includes 3D modeling software and rendering software.

[1330] "Server means for analyzing the user's desired conditions and using an identification device means to collect and analyze geographic information system data for the specified area" refers to a server for using an identification device means to collect and analyze geographic information for the specified area based on the desired conditions entered by the user.

[1331] "Server means for generating three-dimensional models based on collected data and creating visual images" refers to a server for generating three-dimensional models of buildings and land based on data collected by the identification device means and conversation device means and creating visual images.

[1332] The "identification device means for performing sunlight simulation" is a device that analyzes geographic information in order to simulate the sunlight conditions of land and buildings.

[1333] The "conversation device means for collecting and classifying data on living and educational environments" is a device for extracting, organizing, and classifying data on living and educational environments from online sources.

[1334] MODE FOR CARRYING OUT THE INVENTION

[1335] This invention provides a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal, an identification device, a conversation device, and a generation device.

[1336] The overall operation of the system is as follows:

[1337] User Actions

[1338] 1. The user uses the terminal to enter their desired conditions.

[1339] Desired conditions include specific elements such as area, budget, family composition, lifestyle, etc. For example, users can use a dedicated smartphone app or PC web app to enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1340] Server Processing

[1341] 2. The device sends the user's desired conditions to the server.

[1342] The transmission method used is an HTTP POST request.

[1343] 3. The server uses the identification device to collect geographic information (GIS data) of the specified area.

[1344] Specifically, map services such as Google Maps API and OpenStreetMap API are used to obtain data such as land location, area, elevation difference, and the location of surrounding facilities.

[1345] 4. The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[1346] This analysis uses data analysis tools such as ArcGIS to simulate the sunlight conditions in a specified area.

[1347] 5. The server uses the conversation device to collect information on the Internet.

[1348] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc. through social media APIs such as the Twitter API and Reddit API, and weather forecast services such as the OpenWeather API.

[1349] 6. The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" or "calm."

[1350] Use NLP tools (e.g., NLTK and SpaCy) to analyze text data from reviews and posts and evaluate local characteristics.

[1351] 3D Content Generation

[1352] 7. The server uses the generation device to generate a three-dimensional model of the building based on the data collected by the identification device and conversation device.

[1353] Use 3D modeling software (e.g., SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the designated area.

[1354] 8. The server generates simulation results for specific sunlight and views based on the 3D model.

[1355] Use rendering software (e.g. Blender or Lumion) to simulate sunlight and views and generate the results as high-resolution images.

[1356] Displaying the results

[1357] 9. The terminal displays the results (information and image graphics of the candidate sites) sent from the server to the user.

[1358] Users can view information about the candidate locations along with the generated visual image (e.g., how sunny the garden is, the view from the living room, etc.).

[1359] Specific examples

[1360] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the server will process the information using the following prompt statement:

[1361] When a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the system collects geographical information and reviews of Tokorozawa City, and visually presents the results of a 3D simulation of sunlight and views to the user.

[1362] Also, when a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system will operate as follows.

[1363] When a user enters conditions such as "Shinjuku Ward," "budget of 70 million yen," "suitable for single people," "near the station," and "lively at night," the system collects geographical information and reviews of Shinjuku Ward and provides the results of a 3D simulation that reflects the nighttime lighting and the lively atmosphere of the city.

[1364] This allows users to feel more confident in choosing the property that best meets their desired conditions.

[1365] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1366] Step 1:

[1367] The user uses the terminal to input the desired housing conditions.

[1368] Specific operation: The user opens a dedicated smartphone app or PC web app and enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful."

[1369] Input: Desired conditions entered by the user (area, budget, family composition, lifestyle, etc.)

[1370] Output: The user's desired conditions data is registered on the terminal.

[1371] Step 2:

[1372] The terminal sends the user's desired conditions to the server.

[1373] Specific operation: When the terminal presses the "Send" button on the input form, the entered data is sent to the server as an HTTP POST request.

[1374] Input: User's desired conditions data

[1375] Output: The desired condition data arrives at the server.

[1376] Step 3:

[1377] The server uses the identification device to collect geographic information for the specified area.

[1378] Specific operation: The server calls a geographic information system API (Google Maps API or OpenStreetMap API) to obtain detailed geographic information about Tokorozawa City (location, area, elevation difference, and location of surrounding facilities).

[1379] Input: User's desired conditions (especially information about the area)

[1380] Data processing: Call the geographic information system API to obtain the necessary geographic data.

[1381] Output: Collected geographic data

[1382] Step 4:

[1383] The server analyzes the collected geographical information and performs a simulation of the land's exposure to sunlight.

[1384] Specific operation: Using the GIS data acquired by the server, a sunlight simulation for the specified area is performed using a data analysis tool (such as ArcGIS).

[1385] Input: Collected geographic data

[1386] Data calculation: Perform a sunlight simulation based on GIS data to obtain specific results.

[1387] Output: Sunlight simulation results

[1388] Step 5:

[1389] The server uses the conversation device to collect information on the Internet.

[1390] Specific operation: The server uses SNS APIs (Twitter API and Reddit API) and weather service APIs (OpenWeather API) to collect word-of-mouth information and weather data about Tokorozawa City.

[1391] Input: User's desired conditions (regional information)

[1392] Data processing: Collect word-of-mouth and weather data from the Internet.

[1393] Output: Review data and weather data

[1394] Step 6:

[1395] The server analyzes the collected regional information and classifies regional characteristics into categories such as "active" and "calm."

[1396] Specific operation: The server analyzes the text data of reviews using natural language processing tools (NLTK or SpaCy) and classifies regional characteristics into categories.

[1397] Input: Collected review data and weather data

[1398] Data calculation: Perform text analysis and categorize local ratings.

[1399] Output: Classified area characteristic data

[1400] Step 7:

[1401] The server uses a generation device to generate a three-dimensional model of the building based on the data collected by the identification device and the conversation device.

[1402] What it does: The server uses 3D modeling software (SketchUp or Autodesk Revit) to create detailed 3D models of buildings in the specified area.

[1403] Input: Collected and analyzed geographic and area characteristic data

[1404] Data processing: Using 3D modeling software, the collected and analyzed data is constructed into a visual model.

[1405] Output: 3D model of the building

[1406] Step 8:

[1407] The server generates simulation results for specific sunlight and views based on the 3D model.

[1408] How it works: The server uses rendering software (Blender or Lumion) to simulate sunlight and views, and generates the results as high-resolution images.

[1409] Input: Generated 3D model of the building

[1410] Data calculation: Running the simulation in rendering software to generate a visual image.

[1411] Output: Image graphics of the simulation results

[1412] Step 9:

[1413] The terminal displays the results (information and image graphics of candidate sites) sent from the server to the user.

[1414] Specific operation: The device displays the image and text data received from the server within the app, allowing the user to check information about each candidate location.

[1415] Input: Candidate site information and image graphics sent from the server

[1416] Output: Site information and visual images displayed to the user

[1417] These steps allow users to efficiently search for properties that meet their desired criteria while visually checking them.

[1418] (Application example 1)

[1419] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1420] Previously, when considering purchasing or renting a property, users had to visit the property in person to check it out, making it difficult to efficiently find a property that met their desired conditions. It was also difficult to get a concrete image of the sunlight and surrounding environment, making it difficult to decide whether to purchase or sign a contract. There is a need for a system that solves these issues and allows users to select properties more efficiently and with peace of mind.

[1421] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1422] In this invention, the server includes terminal means for inputting the user's desired conditions, identification device means for collecting and analyzing national and local geographic information, conversation device means for collecting information on the Internet and determining regional characteristics, generation device means for generating a building model and providing a visual image, means for collecting and analyzing information on the region and property based on the desired conditions and simulating specific views and sunlight in a 3D model, and means for providing a visual image displayed on the terminal used. This allows the user to efficiently consider properties that meet their desired conditions while visually imagining them.

[1423] "User's desired conditions" are conditions such as the desired area, price, family composition, and lifestyle that the user enters when selecting a property.

[1424] A "terminal" is a device used by a user to input desired conditions, specifically a smartphone or computer.

[1425] An "identification device" is a device for collecting and analyzing national and local geographic information.

[1426] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics.

[1427] A "generation device" is a device for generating a building model and providing a visual image.

[1428] "Sunlight simulation" is a process of virtually calculating and simulating the sunlight conditions at a specified location.

[1429] A "3D model" is a three-dimensional virtual model of a building or landscape that is generated based on collected data.

[1430] "Means for providing visual images" refers to a method for displaying the generated 3D model and the results of the sunlight simulation on a user's device and providing a visual image.

[1431] This invention is a system that allows users to efficiently search for desired living environments and property information, and provides specific images of sunlight and views. The system includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, an interactive device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and means for collecting and analyzing information on regions and properties based on the desired conditions, simulating specific views and sunlight in 3D models, and providing visual images.

[1432] System Overview

[1433] 1. User Usage

[1434] Users use a terminal to input their desired conditions, which include the area, budget, family composition, lifestyle, etc. For example, a user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1435] 2. Data Collection and Analysis

[1436] The server uses an identification device to collect national and local geographic information system (GIS) data, including the location, area, elevation, and location of surrounding facilities, and then runs a sunlight simulation for the specified land.

[1437] 3. Collection and classification of local information

[1438] The server uses the chat device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. It analyzes this data and classifies regional characteristics into categories such as "active" and "calm."

[1439] 4. Image Graphic Generation

[1440] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image, creating and displaying images including simulation results of specific sunlight and views.

[1441] System details

[1442] Device behavior:

[1443] The terminal transmits the desired conditions entered by the user to the server, and displays the results (information and image graphics of candidate locations) sent from the server to the user.

[1444] Server behavior:

[1445] The server analyzes the user's desired conditions received from the terminal, collects GIS data for the specified area using the identification device, performs the necessary calculations, and uses the conversation device to collect area information and classify its characteristics.

[1446] The server uses a generator to generate a 3D model based on the collected data, creating a visual image.

[1447] Specific operation example

[1448] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[1449] 1. User input: The user inputs the above desired conditions into the terminal.

[1450] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[1451] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[1452] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[1453] 5. Displaying the results: The device displays the generated image along with information about the candidate locations to the user. This display includes information such as the amount of sunlight in the garden and the view from the living room. This process allows the user to consider properties that meet their desired criteria with a concrete visual image.

[1454] Example of input prompt for generative AI model

[1455] TXT

[1456] The user entered the following desired conditions: "Tokorozawa City," "budget 50 million yen," "family-friendly," "close to schools," and "quiet."

[1457] Based on this, collect GIS data and local information for the specified area and display a 3D model of the property and a sunlight simulation.

[1458] Generate property information that matches your needs and provide visual images of it.

[1459] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1460] Step 1:

[1461] Users use a terminal to input their desired conditions. These conditions include the area, budget, family composition, lifestyle, etc. The entered desired conditions are sent to the server via the terminal. The input (e.g., "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," "quiet") is used as data for the next step.

[1462] Step 2:

[1463] Based on the received desired conditions, the server uses an identification device to collect geographic information system (GIS) data for the specified area. The collected data includes the location of the land, its area, elevation difference, and the location of surrounding facilities. Based on the input (e.g., "Tokorozawa City"), the GIS data is obtained, and the server analyzes it before proceeding to the next step.

[1464] Step 3:

[1465] The server uses the conversation device to collect local information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. The acquired data is analyzed and the local characteristics are classified into categories such as "active" and "calm." The collected Internet information is analyzed based on the input (e.g., "Tokorozawa City"), and the local characteristics are classified.

[1466] Step 4:

[1467] The server generates a 3D model of the building based on the data collected by the identification device and conversation device. It uses the generation device to simulate specific sunlight and views, and creates a visual image that visualizes the results. Based on input (e.g., GIS data and analysis results of regional characteristics), the 3D model and sunlight simulation are performed, and the results are generated as a visual image.

[1468] Step 5:

[1469] The server sends the generated image along with property information for the candidate location to the terminal. The terminal displays the received information to the user. The displayed information includes sunlight, views, and the location of surrounding facilities. Based on the input (e.g., the 3D model and sunlight simulation results), the final visual image and property information are provided to the user.

[1470] Through this series of steps, users can consider properties that meet their desired criteria with a concrete visual image.

[1471] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1472] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[1473] System Overview

[1474] 1. User Usage

[1475] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1476] 2. Data Collection and Analysis

[1477] The server uses an identification device to collect national and local geographic information system (GIS) data, including information on the location, area, elevation, and surrounding facilities of the land. Based on this data, a sunlight simulation is performed for the specified land.

[1478] 3. Collection and classification of local information

[1479] The server uses the conversation device to collect information from the Internet. Specifically, it obtains data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and the regional characteristics are classified into categories such as "active" and "calm."

[1480] 4. Image Graphic Generation

[1481] The server uses the data collected by the recognition device and conversation device to generate a 3D model of the building and use a generation device to provide a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[1482] 5. Emotional Engine Optimization

[1483] The server uses an emotion engine that analyzes the user's facial expressions, voice, input, etc. to recognize the user's emotions in real time, thereby evaluating the user's interests and satisfaction and customizing the candidate locations and information presented.

[1484] For example, if a user responds positively to the presented information, such as feeling "happy" or "interesting," other candidate locations with those characteristics will be presented preferentially.

[1485] System details

[1486] Device behavior:

[1487] The device sends the desired conditions entered by the user to the server, as well as the user's emotional data recognized by the emotion engine.

[1488] The terminal displays the results (information and image graphics of candidate locations) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[1489] Server behavior:

[1490] The server analyzes the user's desired conditions and emotional data received from the terminal, and uses an identification device to collect and analyze GIS data for the specified area.

[1491] The server uses the conversation device to collect local information and classify characteristics.

[1492] The server combines the collected GIS data and regional characteristic data, and selects candidate sites while also taking into account the user's emotional data.

[1493] The server uses a generator to generate a 3D model of the building for the selected land, creating a visual image.

[1494] Specific examples

[1495] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[1496] 1. User input: The user inputs the above desired conditions into the terminal.

[1497] 2. Data collection: The server collects geographic information about Tokorozawa City using an identification device.

[1498] 3. Determining regional characteristics: Using the conversation device, we collect word-of-mouth information, bulletin boards, and weather information from Tokorozawa City and evaluate the living environment as "peaceful."

[1499] 4. Image generation: The generator simulates sunlight at the specified location, creates a 3D model of the building, and generates a visual image.

[1500] 5. Utilizing an emotion engine: If a user expresses emotion such as "interest" toward a proposed location, the server will reflect that information and prioritize the display of more attractive candidate locations.

[1501] 6. Displaying the results: The device displays the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[1502] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[1503] The processing flow will be explained below.

[1504] Step 1:

[1505] The user accesses the device interface and enters their desired conditions, including area, budget, family size, and lifestyle (e.g., Tokorozawa City, budget ¥50 million, family-friendly, quiet).

[1506] Step 2:

[1507] The terminal converts the entered desired conditions into JSON format data and sends it to the server.

[1508] Step 3:

[1509] The server uses the identification device to acquire geographic information system (GIS) data for the specified area (e.g., Tokorozawa City). The acquired data includes information on the location, area, elevation, and surrounding facilities of the land.

[1510] Step 4:

[1511] The server analyzes the acquired GIS data and uses an identification device to simulate the sunlight exposure of the specified area, including calculating the sunlight conditions by time of day, taking into account the movement of the sun and the shadows cast by surrounding buildings.

[1512] Step 5:

[1513] The server uses the conversation device to collect information on the Internet in the designated area, including information on living and educational environments from review sites, bulletin boards, weather information, etc.

[1514] Step 6:

[1515] The server analyzes the information collected using the conversation device to determine the characteristics of the area. Specifically, it uses natural language processing (NLP) technology to classify the data and categorize the area into attributes such as "active" or "calm."

[1516] Step 7:

[1517] The server combines the obtained GIS data and regional characteristic data to select candidate land, based on the user's desired conditions.

[1518] Step 8:

[1519] The server uses a generator to generate a 3D model of the building for the selected site, including generating a visual image that reflects simulated sunlight and views if the building were constructed on the proposed site.

[1520] Step 9:

[1521] The server uses an emotion engine to analyze the user's facial expressions, voice, input content, etc., and recognizes the user's emotions in real time.

[1522] Step 10:

[1523] The server uses an emotion engine to analyze the user's emotional data and customize the candidate locations and information it presents. For example, if the user has a positive reaction to a candidate location, it will prioritize other similar candidate locations.

[1524] Step 11:

[1525] The server transmits the generated 3D model and simulation results to the terminal.

[1526] Step 12:

[1527] The device displays the received data to the user, including land information, 3D models, sunlight simulation results, and visual images for each potential site.

[1528] Step 13:

[1529] Users compare the proposed locations and visual images presented and select the property that best meets their desired criteria.

[1530] Step 14:

[1531] The emotion engine learns from users' choices and reactions and uses them as feedback to improve the accuracy of future location suggestions.

[1532] Example 2

[1533] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1534] In the past, searching for the living environment and property information users desired required a lot of time and effort. Furthermore, the information obtained was difficult to understand visually, and was not customized based on the user's feelings or reactions, resulting in low convenience. Furthermore, there was a lack of evaluations based on detailed data on living and educational environments, or real-time sunlight simulations. These issues made it difficult for users to make an accurate and satisfactory property selection.

[1535] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1536] In this invention, the server includes a display device for inputting the user's desired conditions, an identification device for collecting and analyzing geographic information, a dialogue device for collecting data on the Internet and determining regional characteristics, a generation device for generating building structures and providing visual displays, an emotion engine for recognizing and analyzing the user's emotions, and a processing device for customizing and presenting property information based on the collected and analyzed information. This allows the user to obtain property information that meets their desired conditions in a visually easy-to-understand format without spending time and effort, and to receive information customized based on their emotions.

[1537] A "display device" is a device that provides an interface for users to input desired conditions.

[1538] An "identification device" is a device for collecting and analyzing geographic information.

[1539] An "interactive device" is a device for collecting data on the Internet and determining regional characteristics.

[1540] A "generator" is a device that generates a building structure based on collected data and provides a visual representation.

[1541] The "emotion engine means" is a system for recognizing and analyzing the user's emotions.

[1542] The "processing means" is a system for customizing and presenting property information based on collected and analyzed information.

[1543] MODE FOR CARRYING OUT THE INVENTION

[1544] The present invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and also recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, a display device, an identification device, a dialogue device, a generation device, and an emotion engine.

[1545] System Overview

[1546] 1. User Usage

[1547] The user inputs desired conditions using a terminal. Desired conditions include area, budget, family composition, lifestyle, etc. For example, a user can input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1548] 2. Data Collection and Analysis

[1549] The server uses an identification device to collect and analyze national and local geographic information, including the location, area, elevation difference, and information on surrounding facilities. Based on this data, a sunlight simulation is performed for the specified land.

[1550] 3. Collection and classification of local information

[1551] The server uses the interactive device to collect information from the Internet. Specifically, it acquires data on living and educational environments from review sites, bulletin boards, weather information, etc. This data is analyzed and regional characteristics are classified into categories such as "clam-filled" and "calm."

[1552] 4. Image Graphic Generation

[1553] The server uses a generation device to generate a 3D model of the building based on the data collected by the identification device and dialogue device, and provides a visual image. Images are created and displayed that include simulation results of specific sunlight and views.

[1554] 5. Emotional Engine Optimization

[1555] The server uses an emotion engine that analyzes the user's facial expressions, voice, and input to recognize the user's emotions in real time. This allows the system to evaluate the user's interest and satisfaction and customize the property information presented. For example, if the user responds positively to the information presented, such as "happy" or "interesting," the system will prioritize the presentation of other properties that share those characteristics.

[1556] 6. Displaying the results

[1557] The terminal displays the results (property information and image graphics) sent from the server to the user, and the emotion engine analyzes the user's reactions in real time.

[1558] Specific examples

[1559] For example, if a user enters conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "peaceful," the following actions will occur.

[1560] 1. User Input:

[1561] The user inputs the above desired conditions into the terminal.

[1562] 2. Data Collection:

[1563] The server collects geographic information about Tokorozawa City using an identification device.

[1564] 3. Determining regional characteristics:

[1565] The server uses an interactive device to collect word-of-mouth information, message boards, and weather information for Tokorozawa City, and evaluates the living environment as "peaceful."

[1566] 4. Image generation:

[1567] The server uses a generator to perform a sunlight simulation at the specified location, creating a 3D model of the building and generating a visual image.

[1568] 5. Leveraging the Emotion Engine:

[1569] If the user expresses an interest in the presented candidate locations, the server reflects this information and prioritizes the display of more attractive candidate locations.

[1570] 6. Displaying the results:

[1571] The device will then display the generated image along with information about the candidate location to the user, including the amount of sunlight in the garden and the view from the living room.

[1572] Specific examples of prompts to input to generative AI models

[1573] Start searching for properties in Tokorozawa City, with a budget of ¥50 million, suitable for families, close to schools, and a peaceful location. Display information and visual images of properties in Tokorozawa City that best fit these criteria. Also, analyze the user's facial expressions and voice to prioritize properties that the user is interested in.

[1574] This process allows users to view specific visual images of properties that meet their desired criteria, and obtain information that takes into account their emotions during the process. This reduces anxiety about purchasing and allows users to make a property selection with greater confidence.

[1575] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1576] Step 1: Enter user preferences

[1577] The user inputs desired conditions using a terminal.

[1578] The conditions you enter include the area, budget, family structure, lifestyle, etc. For example, you can enter conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1579] Input data: User's desired conditions (area, budget, family structure, lifestyle)

[1580] Output data: The entered desired conditions are sent to the server.

[1581] Step 2: Gather geographic information

[1582] The server uses the identification device to collect geographic information about the specified area.

[1583] The data collected includes information on the land's location, area, elevation difference, and surrounding facilities.

[1584] Input data: User's desired conditions (region)

[1585] Output data: Geographic information (location, area, elevation difference, surrounding facilities)

[1586] Step 3: Determine regional characteristics

[1587] The server uses the interactive device to collect relevant information on the Internet.

[1588] Specifically, data on living and educational environments is obtained from review sites, message boards, weather information, etc.

[1589] The acquired data is analyzed, regional characteristics are identified, and the area is classified as calm, etc.

[1590] Input data: User's desired conditions (region)

[1591] Output data: Regional characteristics data (living environment, educational environment, regional classification)

[1592] Step 4: Data analysis and customized property selection

[1593] The server selects candidate properties based on the data collected by the identification device and the dialogue device.

[1594] Input data: Geographical information, regional characteristics data, user preferences

[1595] Output data: List of candidate properties

[1596] Step 5: Creating a visual image

[1597] The server uses a generation device to generate a 3D model of the candidate property.

[1598] Also include sunlight simulations and view images.

[1599] Input data: candidate property list, geographic information

[1600] Output data: Visual image (3D model, sunlight simulation, view image)

[1601] Step 6: Sentiment Analysis and Customization

[1602] The server uses an emotion engine to analyze the user's facial expressions, voice, and input in real time.

[1603] Determine the user's emotional state (e.g., interested, happy, etc.) and customize the information provided.

[1604] Input data: visual images, user reactions

[1605] Output data: customized property information

[1606] Step 7: View the results

[1607] The device displays the results sent from the server to the user.

[1608] In addition to property information, the display includes visual images such as how sunny the garden is and the view from the living room.

[1609] Input data: customized property information, visual images

[1610] Output data: Property information and visual images displayed to the user

[1611] (Application example 2)

[1612] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1613] In traditional property selection, users must individually check multiple information sources, which takes a great deal of time and effort to find a property that meets their desired criteria. Furthermore, there are limited ways to check the property's visual image, specific sunlight, and view in advance, which often leaves users unsure about their satisfaction after purchasing. Furthermore, because customized suggestions that take user emotions into consideration are not made, there is a lack of systems that can optimally meet users' needs.

[1614] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting the user's desired conditions, an identification device for collecting and analyzing national and local geographic information, a conversation device for collecting information on the Internet and determining regional characteristics, a generation device for generating building models and providing visual images, and an emotion engine for recognizing and analyzing the user's emotions. This allows the user to efficiently search for property information that matches their desired conditions and check specific images of sunlight and views in advance. In addition, property information can be customized based on the user's emotional data, allowing them to receive optimal suggestions, thereby improving post-purchase satisfaction.

[1615] "User" refers to an individual or corporation who uses this system to search for and evaluate property information that meets their desired conditions.

[1616] A "terminal" is a device that allows users to input desired conditions and displays the system's processing results. Examples include smartphones, tablets, PCs, smart glasses, and head-mounted displays.

[1617] "Identification equipment" refers to equipment used to collect and analyze national and local geographic information. Specifically, it includes servers and related software that handle GIS data.

[1618] A "conversation device" is a device for collecting information on the Internet and determining regional characteristics. Specifically, it includes a server equipped with a web scraping tool or a natural language processing engine.

[1619] A "generator" is a device that generates a building model based on collected data and provides a visual image. Examples include 3D modeling software and rendering engines.

[1620] The "emotion engine" is a device that recognizes the user's emotions by analyzing their facial expressions and voice, and optimizes the system's operation. Specifically, it includes a server equipped with emotion recognition software and an AI model.

[1621] "Generative AI model" refers to an artificial intelligence model used to generate optimal property information and visual images based on collected data and user sentiment data.

[1622] A "prompt" is an input document that provides instructions to a generative AI model. Specifically, it is a document based on the user's desired conditions and emotions.

[1623] System configuration

[1624] This invention is a system that efficiently searches for the living environment and property information desired by the user, provides specific images of sunlight and views, and further recognizes the user's emotions and customizes the system based on those emotions. This system includes a terminal, an identification device, a conversation device, a generation device, and an emotion engine.

[1625] Hardware and software used

[1626] Devices: smartphones, tablets, PCs, smart glasses, head-mounted displays, etc.

[1627] Identification device: GIS data server and related software (e.g., Python, pandas, geopandas)

[1628] Conversational device: A server with a web scraping tool and a natural language processing engine (e.g., Scrapy, an NLP toolkit)

[1629] Generator: 3D modeling software and rendering engines (e.g. Unity, Blender)

[1630] Emotion engine: A server with emotion recognition software and AI models (e.g., Microsoft Azure Cognitive Services)

[1631] Generative AI model: An AI model that generates optimal property information and visual images based on collected data and user sentiment data.

[1632] Data acquisition and processing procedures

[1633] Enter the user's desired conditions

[1634] The user uses a terminal to input desired conditions (area, budget, family composition, lifestyle, etc.). For example, the user might input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet."

[1635] Data collection and analysis

[1636] The server uses the identification device to collect and analyze GIS data for the specified area, including information on the location, area, elevation, and surrounding facilities of the land.

[1637] Collection and classification of local information

[1638] The server uses the chat device to collect information from the Internet (such as review sites, message boards, and weather information) and acquires data to determine regional characteristics, which are then classified into categories such as "active" and "calm."

[1639] 3D model generation and visualization

[1640] The server uses a generator to generate a 3D model of the building based on the collected data and performs a sunlight simulation, creating a concrete visual image that is displayed on the device.

[1641] Optimization by Emotion Engine

[1642] The server uses an emotion engine to analyze the user's facial expressions and voice to recognize emotional data in real time, thereby evaluating the user's interests and satisfaction and optimizing the property information presented.

[1643] Example

[1644] If a user enters a prompt such as "I am looking for a property in Tokorozawa City within 50 million yen that is family-friendly and has a peaceful environment," the following actions will occur:

[1645] 1. The user enters the desired conditions into the terminal and sends them to the server.

[1646] 2. The server uses the identification device to collect and analyze GIS data for Tokorozawa City.

[1647] 3. The server uses the conversation device to collect information on the Internet about the living and educational environment in Tokorozawa City and evaluates it as "peaceful."

[1648] 4. The server uses the generator to simulate sunlight at the specified location and generate a 3D model of the building.

[1649] 5. The server uses an emotion engine to analyze the user's emotion data and customize the property information based on positive responses.

[1650] 6. The final result and 3D image are displayed on the user's device.

[1651] In this way, the user can obtain property information that matches his or her desired conditions along with a concrete visual image, and can receive proposals that are optimized based on emotional data.

[1652] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1653] Step 1:

[1654] The user inputs desired conditions into the terminal. Specifically, they input conditions such as "Tokorozawa City," "budget of 50 million yen," "family-friendly," "close to schools," and "quiet." This input is sent to the server as JSON format data.

[1655] Step 2:

[1656] The server analyzes the desired condition data it receives and uses an identification device to collect GIS data for the specified area (Tokorozawa City). This GIS data includes information on the location, area, elevation difference, and surrounding facilities of the land. As a result, the input is the user's desired condition data, and the output is GIS data for the specified area.

[1657] Step 3:

[1658] The server analyzes the collected GIS data and identifies promising property candidates based on the specified criteria. Specifically, it uses Python's pandas and geopandas libraries to filter and sort the data. As a result, the input is GIS data and the output is a list of potential properties.

[1659] Step 4:

[1660] The server uses a conversation device to collect information about the living and educational environment in Tokorozawa City from the Internet. Specifically, it uses Scrapy and an NLP toolkit to extract and analyze data from review sites and bulletin boards. As a result, the input is a list of candidate locations, and the output is regional characteristic data.

[1661] Step 5:

[1662] The server analyzes the collected area characteristic data and classifies the living environment of the candidate area into categories such as "active" or "calm." This determines whether the area meets the user's desired conditions. This determination is made using machine learning models and statistical analysis methods. The input is the area characteristic data, and the output is the category classification results.

[1663] Step 6:

[1664] The server uses a generator to perform a sunlight simulation of the candidate sites. Specifically, it uses Unity or Blender to generate a 3D model and create a visual image. The input is the candidate site list and GIS data, and the output is the sunlight simulation results and the 3D model.

[1665] Step 7:

[1666] The server uses an emotion engine to analyze the user's facial expressions and voice in real time to recognize emotional data. Specifically, it captures the user's facial expressions and tone of voice through a camera and microphone, and performs emotion analysis using Microsoft Azure Cognitive Services. The input is real-time audio and video data, and the output is emotional data.

[1667] Step 8:

[1668] The server uses a generative AI model to optimize the property listings based on the emotion data and desired conditions. Specifically, the AI ​​model analyzes the prompt text and regenerates property listings that match the user's preferences. The input is desired condition data and emotion data, and the output is an optimized property listing.

[1669] Step 9:

[1670] The final results and 3D images are displayed on the user's device. The device displays these results in real time, allowing the user to view property information directly through the interface. It also iterates based on the user's new responses to provide optimal suggestions. The input is the optimized property list and 3D model, and the output is the visual image and property information presented to the user.

[1671] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1672] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1673] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1674] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1675] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1676] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1677] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1678] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1679] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1680] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1681] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1682] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1683] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1684] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1685] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1686] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1687] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1688] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1689] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1690] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1691] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1692] The following is further disclosed regarding the above embodiment.

[1693] (Claim 1)

[1694] a terminal for inputting user's desired conditions;

[1695] Identification devices for collecting and analyzing national and local geographic information;

[1696] A conversation device that collects information on the Internet and determines regional characteristics;

[1697] a generating device that generates a building model and provides a visual image;

[1698] A system including:

[1699] (Claim 2)

[1700] 10. The system of claim 1, further comprising an identification device that performs a sunshine simulation for a location selected based on a user's desired conditions.

[1701] (Claim 3)

[1702] 10. The system of claim 1, further comprising a conversation device that collects and classifies data about the living and educational environment at a specified location.

[1703] "Example 1"

[1704] (Claim 1)

[1705] a terminal means for inputting desired conditions of a user;

[1706] an identification device means for collecting and analyzing national and local geographic information;

[1707] a conversation device means for collecting information on the Internet and determining regional characteristics;

[1708] a generator means for generating a three-dimensional model of the building to provide a visual image;

[1709] a server means for analyzing the user's desired conditions and collecting and analyzing geographic information system data for the designated area using an identification device means;

[1710] a server means for generating a three-dimensional model based on the collected data and creating a visual image;

[1711] A system including:

[1712] (Claim 2)

[1713] 10. The system of claim 1, further comprising an identification device means for performing a sunshine simulation for a selected location based on a user's desired conditions.

[1714] (Claim 3)

[1715] 10. The system of claim 1, further comprising conversation device means for collecting and classifying data on the living and educational environment at a specified location.

[1716] "Application Example 1"

[1717] (Claim 1)

[1718] a terminal for inputting user's desired conditions;

[1719] Identification devices for collecting and analyzing national and local geographic information;

[1720] A conversation device that collects information on the Internet and determines regional characteristics;

[1721] a generating device that generates a building model and provides a visual image;

[1722] We collect and analyze information about the area and property based on your desired conditions, and use 3D models to simulate specific views and sunlight.

[1723] means for providing a visual image to be displayed on a user device;

[1724] A system including:

[1725] (Claim 2)

[1726] 10. The system of claim 1, further comprising an identification device that performs a sunshine simulation for a location selected based on a user's desired conditions.

[1727] (Claim 3)

[1728] 10. The system of claim 1, further comprising a conversation device that collects and classifies data about the living and educational environment at a specified location.

[1729] "Example 2: Combining Emotion Engines"

[1730] (Claim 1)

[1731] a display device for inputting desired conditions of a user;

[1732] an identification device for collecting and analyzing geographic information;

[1733] a dialogue device that collects data on the Internet and determines regional characteristics;

[1734] a generator for generating a building structure and providing a visual representation thereof;

[1735] an emotion engine means for recognizing and analyzing the emotions of a user;

[1736] a processing means for customizing and presenting property information based on the collected and analyzed information;

[1737] A system including:

[1738] (Claim 2)

[1739] 10. The system of claim 1, further comprising an identification device that performs a sunshine simulation for a location selected based on a user's desired conditions.

[1740] (Claim 3)

[1741] 10. The system of claim 1, further comprising an interactive device that collects and classifies data about the living and educational environment at the specified location.

[1742] "Application example 2 when combining emotion engines"

[1743] (Claim 1)

[1744] a terminal for inputting user's desired conditions;

[1745] Identification devices for collecting and analyzing national and local geographic information;

[1746] A conversation device that collects information on the Internet and determines regional characteristics;

[1747] a generating device that generates a building model and provides a visual image;

[1748] An emotion engine that recognizes and analyzes the user's emotions;

[1749] A system including:

[1750] (Claim 2)

[1751] 10. The system of claim 1, further comprising an identification device that performs a sunshine simulation for a location selected based on a user's desired conditions.

[1752] (Claim 3)

[1753] 10. The system of claim 1, further comprising a conversation device that collects and classifies data about the living and educational environment at a specified location.

[1754] (Claim 4)

[1755] 10. The system of claim 1, further comprising a generative AI model and prompt sentences that optimize property information based on user sentiment data. [Explanation of symbols]

[1756] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a terminal for inputting user's desired conditions; Identification devices for collecting and analyzing national and local geographic information; A conversation device that collects information on the Internet and determines regional characteristics; a generating device that generates a building model and provides a visual image; A system including:

2. The system according to claim 1 , further comprising an identification device for performing a sunshine simulation for a location selected based on a user's desired conditions.

3. 10. The system of claim 1, further comprising a conversation device that collects and classifies data about the living and educational environment at a specified location.

Images