system

Abstract

Provide a system. A means for inputting desired conditions of a user; A means for searching property information based on the desired conditions and presenting relevant properties in real time; A means to automatically arrange viewings of the property; A means for conducting a virtual viewing based on the floor plan; A means for generating a furniture arrangement image based on the size and type of furniture input by a user; A means for generating a simulation image of what it would be like to actually live there; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] There is an increasing number of users who are unable to devote sufficient time to apartment hunting due to sudden job transfers or busy schedules. Furthermore, for users who are unable to view properties in person or who are planning to move far away, an efficient and effective means of apartment hunting is required. Another major problem for users is that they are unable to visualize how their existing furniture will be arranged in their new home. [Means for solving the problem]

[0005] This invention provides a system that allows users to input their desired conditions and search for and display property information in real time. It also automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on furniture sizes input by the user, and generates simulation images of what it would be like to actually live in the property. This allows users to efficiently and effectively search for a room and get a grasp of the specific living environment in advance.

[0006] "User" refers to an individual or corporation that uses the system to search for an apartment.

[0007] "Desired conditions" are the requirements and desired characteristics (floor plan, budget, area, etc.) that a user has for the property they want to live in.

[0008] "Property information" refers to detailed information about a residence or real estate (such as floor plan, rent, location, etc.).

[0009] "Real-time" refers to information being processed and results being provided almost simultaneously.

[0010] A "means" is a method, apparatus, or software part for performing a specific function within a system.

[0011] "Arranging a viewing" means setting up a viewing schedule to actually visit and check out the selected property.

[0012] "Automatic" means that the system performs a particular operation without human intervention.

[0013] A "floor plan" is a drawing that shows the layout and structure of rooms in a property.

[0014] "Virtual viewing" is a feature that virtually recreates the interior of a property and allows you to tour it online.

[0015] The "furniture layout image" is a visual simulation of what would happen if the user's furniture were arranged within the property.

[0016] A "simulation video" is a video or animation that visually recreates the living environment of an actual residence. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[0039] Program processing and specific examples

[0040] Input of user's desired conditions

[0041] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal then sends this input data to the server.

[0042] Property information search and presentation

[0043] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[0044] Automatic viewing arrangement

[0045] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. For example, a viewing date for the selected property is automatically set and reflected in the user's calendar.

[0046] Virtual viewing

[0047] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who can click it to begin the virtual viewing. The user can then view the 3D model through the device.

[0048] Generate furniture layout images

[0049] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[0050] Generating a simulation video of what it would be like to live in the property

[0051] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[0052] The present invention allows users to efficiently and effectively search for an apartment and understand the specific living environment in advance. It also accommodates cases where users are moving far away or viewing the property on-site is difficult, greatly improving user convenience.

[0053] The processing flow will be explained below.

[0054] Step 1:

[0055] User enters desired conditions

[0056] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[0057] Step 2:

[0058] The device sends data to the server

[0059] The terminal transmits the collected desired condition data to the server.

[0060] Step 3:

[0061] The server searches for properties

[0062] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[0063] Step 4:

[0064] The server sends the search results to the device

[0065] The server sends the generated property list to the terminal.

[0066] Step 5:

[0067] Your device will display the search results

[0068] The terminal displays the received property list to the user.

[0069] Step 6:

[0070] User selects property

[0071] The user selects the property they like on their device, and the device sends the selection information to the server.

[0072] Step 7:

[0073] The server arranges a viewing

[0074] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[0075] Step 8:

[0076] Viewing arrangements reflected on user calendar

[0077] The device will update the viewing schedule on the user's calendar.

[0078] Step 9:

[0079] User requests a virtual tour

[0080] The user selects the property they wish to virtually view on their device.

[0081] Step 10:

[0082] The device sends a request to the server

[0083] The device sends a virtual viewing request to the server.

[0084] Step 11:

[0085] The server converts the floor plan into a 3D model

[0086] The server generates a 3D model based on the floor plan and related information of the selected property.

[0087] Step 12:

[0088] The server sends a virtual preview link to the device.

[0089] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[0090] Step 13:

[0091] The device will display a virtual preview link

[0092] The device displays a virtual preview link to the user.

[0093] Step 14:

[0094] Users can conduct virtual viewings

[0095] Users click on the link and use their device to conduct a virtual viewing.

[0096] Step 15:

[0097] User inputs furniture size and type

[0098] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[0099] Step 16:

[0100] The device sends data to the server

[0101] The device sends the collected furniture size and type data to a server.

[0102] Step 17:

[0103] The server performs a furniture layout simulation

[0104] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[0105] Step 18:

[0106] The server sends the layout image to the device.

[0107] The server sends the generated layout image to the terminal.

[0108] Step 19:

[0109] The device displays an image of the furniture layout.

[0110] The terminal displays an image of the furniture arrangement to the user.

[0111] Step 20:

[0112] The server generates the simulation video

[0113] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[0114] Step 21:

[0115] The server sends the video data to the terminal

[0116] The server transmits the generated simulation video data to the terminal.

[0117] Step 22:

[0118] The device displays a link to play the video.

[0119] The terminal displays a link to play the simulation video to the user.

[0120] Step 23:

[0121] User checks the simulation video

[0122] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[0123] Example 1

[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0125] Conventional property search systems lacked the means to allow users to obtain desired property information in real time, and to conduct detailed viewings and simulations. This resulted in inefficient property searches and a heavy burden on users. Furthermore, they lacked the functionality to automatically arrange viewings, generate images of furniture layouts, and simulate living environments, making them inconvenient for users who are moving far away or find it difficult to view properties in person.

[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0127] In this invention, the server includes means for inputting the user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, and means for transmitting the generated data to a terminal and displaying it so that the user can visually confirm it. This makes it possible to efficiently and effectively search for property information and conduct detailed viewings and simulations.

[0128] "User" refers to any individual or legal entity that uses the System.

[0129] "Desired conditions" refers to data entered by the user regarding the conditions and requirements for the property they are looking for.

[0130] "Property information" refers to data including information such as the property's location, layout, price, and facilities.

[0131] "Real-time" means that data is processed immediately and results are provided to the user without delay.

[0132] "Arranging a viewing" refers to the process of arranging a date to actually visit and check out the property.

[0133] "Virtual viewing" refers to virtually touring the interior of a property via the Internet.

[0134] A "floor plan" refers to a drawing showing the layout of rooms in a property.

[0135] "Furniture arrangement image" refers to a visual image that simulates the arrangement of furniture within a property based on the size and type of furniture entered by the user.

[0136] "Simulation video" refers to video data that visually recreates the living environment of someone who actually lives in the property.

[0137] "Generated data" refers to data created by the system, including property information, virtual viewing links, furniture layout images, and simulation footage.

[0138] "Terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to operate the system.

[0139] A "server" refers to a group of computers that manages the entire system and performs processing.

[0140] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[0141] First, the user operates the terminal and inputs the desired conditions (e.g., 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo) into the search box. This input data is sent from the terminal to the server. As a concrete example, the prompt sentence "Please search for properties that meet the following criteria: 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" is based on the user's input.

[0142] The server analyzes the received desired conditions and sends a query to the database. This query searches for properties that meet the conditions of "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The search results are generated in list format and sent back to the terminal for display to the user. For example, the property list may be displayed on a GUI, with a link to view detailed information about each property.

[0143] When a user selects a specific property from the list, the device sends that information to the server. The server checks available viewing schedules based on the property information and automatically sets the most suitable date. This information is sent to the device, which adds the date to the user's calendar app. For example, the server can automatically update Google Calendar using a prompt such as "Please automatically schedule a viewing for the selected property."

[0144] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property. This generation process uses 3D modeling software such as Unity. A link to the completed 3D model is sent to the device, and the user can click on this link to start the virtual viewing in a web browser. For example, the prompt message used is, "Please generate a 3D model based on the floor plan of this property."

[0145] When a user inputs the dimensions of their furniture, the device sends that data to the server. The server then uses this data to simulate the placement of the furniture on the property's floor plan. This process uses tools such as Blender and AutoCAD. The simulation results are sent to the device and displayed visually to the user. For example, a prompt might be used: "Please generate an image of a sofa that is 200 cm wide, 100 cm deep, and 90 cm high placed on the floor plan."

[0146] The server integrates the virtual viewing data and furniture layout data to generate a simulation video of what it would be like for the user to live in the property. This video is created using video editing software such as After Effects or Cinema 4D to create a realistic living experience. The completed simulation video is sent to the device, and the user can view it by clicking on the video playback link. As an example, the prompt text used is, "Please generate a simulation video of what it would be like to live in this property."

[0147] This invention allows users to efficiently and effectively find their ideal property and to get a concrete image of their life through detailed viewings and simulations. It also accommodates cases where users are moving far away or viewing in person is difficult, greatly improving user convenience.

[0148] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0149] Step 1:

[0150] The user operates the device to input desired conditions into the search box. Specifically, the user enters "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" into the input field and clicks the search button. This input data is sent from the device to the server. The server receives this data and stores it as desired conditions. Input: Desired conditions data. Output: Storage of desired conditions.

[0151] Step 2:

[0152] The server sends a query to the database based on the desired conditions it has received. Specifically, the server searches the database using the conditions "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The database returns matching property information. Input: Desired conditions data. Output: List of properties in the search results.

[0153] Step 3:

[0154] The server generates a list of properties as search results and sends it back to the terminal. The terminal displays the list it receives on the screen and presents it to the user. Specifically, the property list is displayed on the GUI, and a link is provided to view detailed information about each property. Input: Property list as search results. Output: Property list displayed on the screen.

[0155] Step 4:

[0156] The user selects a specific property from the list. The terminal sends the selected property information to the server. Specifically, when the user clicks on a link, the property ID is sent to the server. The server generates candidate dates for the viewing schedule based on the property information and sends them back to the terminal. Input: Property ID. Output: Candidate dates for the viewing schedule.

[0157] Step 5:

[0158] The server automatically sets the optimal viewing date and sends that information to the device. The device then adds the received viewing date to the user's calendar app. Specifically, the server sets the viewing date as "October 25, 2023, 10:00" and automatically registers it in Google Calendar. Input: Candidate dates for the viewing schedule. Output: Automatic setting of viewing date.

[0159] Step 6:

[0160] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property and sends a virtual viewing link to the device. Specifically, the 3D model is generated using 3D modeling software such as Unity. Input: Virtual viewing request. Output: Virtual viewing link.

[0161] Step 7:

[0162] The user clicks on the virtual viewing link to view the 3D model in a web browser. Specifically, a real-time 3D model using WebGL is displayed in the browser. The user can use the 360-degree view and zoom functions to view the interior of the property. Input: Virtual viewing link. Output: Display of 3D model.

[0163] Step 8:

[0164] The user inputs the size of their furniture. The device sends this data to the server. The server then uses the furniture size data to simulate furniture placement on the property's floor plan. Specifically, the simulation is carried out using tools such as Blender or AutoCAD. Input: Furniture size data. Output: Furniture placement simulation results.

[0165] Step 9:

[0166] The simulation results are sent from the server to the terminal and displayed visually to the user. Specifically, a 3D rendered image of the room is displayed, allowing the user to see at a glance where the furniture is placed. Input: Furniture placement simulation results. Output: Display of a visual placement image.

[0167] Step 10:

[0168] The server combines the virtual viewing data and furniture layout data to generate a simulation video of what it would be like if the user lived in the property. Specifically, video editing software such as After Effects or Cinema 4D is used to create a simulation video that gives a realistic sense of life. Input: Virtual viewing data and furniture layout data. Output: Simulation video.

[0169] Step 11:

[0170] The completed simulation video is sent from the server to the device, and the user can view it by clicking the video playback link. As a specific example, the playback link is displayed on the device screen as an embedded YouTube (registered trademark) player, and the user can click to view it in full screen. Input: Simulation video. Output: Playback of simulation video.

[0171] (Application example 1)

[0172] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0173] Currently, when users search for properties or products that meet their specific requirements, it is not only time-consuming, but also difficult to provide real-time information or perform specific simulations. Furthermore, when on-site viewing is difficult, it is difficult to grasp the details, reducing user convenience. There is a need for a system that solves these issues and allows users to efficiently search for properties and products and form a concrete image.

[0174] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0175] In this invention, the server includes means for inputting user desired conditions, means for presenting search results in real time, means for automatically arranging previews, means for conducting virtual previews, means for generating furniture layout images, means for generating simulation images, means for searching for and presenting products in a virtual store in real time, and means for generating a virtual preview link from product information and sending it to the user's terminal, thereby enabling users to efficiently search for properties and products and get a concrete image of them.

[0176] "User desired conditions" are conditions (for example, location, layout, price, color, size, etc.) that a user specifies for a particular property or product.

[0177] "Property information" refers to detailed data about a specific property (e.g., location, floor plan, price, facilities, etc.).

[0178] "Search" is the process of finding the desired property or product based on the desired conditions entered by the user.

[0179] "Real-time" refers to instantaneous processing and response that occurs at the same time as the present.

[0180] "Presentation" refers to visually displaying search results and information to the user.

[0181] "Viewing arrangements" refers to scheduling a site visit or virtual viewing of a property or product that the user desires.

[0182] "Virtual viewing" is a system that virtually recreates an actual property or store, allowing users to tour the interior online.

[0183] A "floor plan" is a drawing showing the layout and dimensions of rooms inside a property.

[0184] A "furniture layout image" is a visual simulation of what the furniture will look like when it is arranged within a property based on the size and type of furniture specified by the user.

[0185] "Simulation footage" is footage that virtually recreates the conditions under which a property would actually be lived in or used.

[0186] A "virtual store" is a virtual store space built on the Internet where users can search for and purchase products.

[0187] "Product information" is detailed data about a specific product (for example, type, price, specifications, stock status, etc.).

[0188] A "link" is a hypertext link that directs a user to a particular web page or resource.

[0189] A "terminal" is a device (e.g., smartphone, tablet, computer) that a user uses to enter or view information.

[0190] This invention is a system that allows a user to input desired conditions and search for and display information on properties and products in real time. Specific embodiments of this system will be described below.

[0191] Program processing overview

[0192] Input of user's desired conditions

[0193] The user inputs their desired conditions (e.g., furniture color, size, price range, etc.) using smart glasses or a smartphone. This input data is sent from the device to the server.

[0194] Searching and presenting property and product information

[0195] The server searches the database in real time based on the received criteria. The searched information is compiled into a list and sent to the terminal. The terminal then displays a list of properties and products that match the user's criteria.

[0196] Automatic viewing arrangements and virtual viewings

[0197] When a user selects a specific property or product, the information is sent to the server and a viewing schedule is automatically set up. If the user requests a virtual viewing, a 3D model is generated based on the floor plan and product details, and a link is sent to the user's device.

[0198] Furniture layout image generation and simulation

[0199] When a user inputs the size and type of furniture they have, the data is sent to the server and a furniture layout simulation is performed. The simulation results are sent to the device and displayed as a concrete image. In addition, the furniture layout data and viewing data are integrated to generate and send a simulation video of what it would be like to actually live in the property.

[0200] Hardware and software used

[0201] Hardware: smart glasses, smartphones, tablets, computers

[0202] Software: Python, requests library, json library

[0203] Database: MySQL (registered trademark) or PostgreSQL

[0204] Specific examples

[0205] When a user searches for "a blue, two-meter-wide sofa" using the smart glasses, the search criteria are sent to the server, and matching sofa information is retrieved in real time from the database. The retrieved information is displayed as a list on the smart glasses, and the user can click a virtual preview link to view the 3D model.

[0206] Prompt Sentence Examples

[0207] "Please enter your desired furniture criteria (e.g. color, size, price range, etc.)"

[0208] This embodiment allows users to efficiently search for properties and products and get a concrete image of them, and in particular makes it easy to check the details through virtual viewings.

[0209] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0210] Step 1:

[0211] The user enters the desired conditions

[0212] Input: The user uses smart glasses or a smartphone to input desired criteria (e.g., furniture color, size, price range, etc.) in natural language.

[0213] Data processing: The terminal converts the entered conditions into JSON format and prepares to send it as an API request.

[0214] Output: The desired conditions data in JSON format is sent to the server.

[0215] Step 2:

[0216] Real-time search processing is performed on the server

[0217] Input: The server receives the user's desired conditions.

[0218] Data processing: Query the database based on your desired conditions and search for properties and products that fit your needs.

[0219] Output: A list of relevant property and product information is generated and sent to the terminal in JSON format.

[0220] Step 3:

[0221] View search results on your device

[0222] Input: Receives a list of property and product information in JSON format sent from the server.

[0223] Data processing: Converts received information into a format that is easy for the user to understand and displays it.

[0224] Output: The user views a list of properties and products on their device.

[0225] Step 4:

[0226] The user selects a specific property or product

[0227] Input: The user selects a particular property or product from a list.

[0228] Output: Information about the selected property or product is sent to the server.

[0229] Step 5:

[0230] Automatic viewing arrangement and virtual viewing link generation

[0231] Input: The server receives information about the property or product selected by the user.

[0232] Data processing: The server automatically schedules viewings and generates 3D models based on floor plans and detailed product information.

[0233] Output: Viewing schedule details and a virtual viewing link will be generated and sent to your device.

[0234] Step 6:

[0235] Viewing schedule and virtual viewing link on your device

[0236] Input: Receives the preview schedule and virtual preview link sent from the server.

[0237] Data processing: The received information is displayed in a format that is easy for the user to understand.

[0238] Output: User checks the viewing schedule and clicks the virtual viewing link to view the 3D model.

[0239] Step 7:

[0240] The user inputs the size and type of furniture

[0241] Input: The user inputs the size and type of furniture they have through the terminal.

[0242] Data processing: The terminal converts the input furniture data into JSON format and sends it to the server.

[0243] Output: Furniture data in JSON format is sent to the server.

[0244] Step 8:

[0245] Running a furniture layout simulation

[0246] Input: The server receives furniture sizes and types, and a floor plan of the property.

[0247] Data processing: The server runs a furniture layout simulation based on this data and generates the results.

[0248] Output: The results of the placement simulation are sent to the terminal.

[0249] Step 9:

[0250] Generating simulation images of homes

[0251] Input: The server receives virtual viewing data and furniture layout data.

[0252] Data processing: The server integrates this information and generates a simulation image of what it would be like to actually live there.

[0253] Output: The simulation video is sent to the device and a link is provided for the user to view.

[0254] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0255] This invention combines a system that searches for and displays property information in real time after a user inputs their desired conditions with an emotion engine. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on furniture sizes input by the user, and generates simulation images of what it would be like to actually live in the property. Furthermore, it provides a function that recognizes the user's emotions and dynamically adjusts property information and settings based on those emotions.

[0256] Program processing and specific examples

[0257] Input of user's desired conditions

[0258] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal sends this input data to the server.

[0259] Property information search and presentation

[0260] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[0261] Emotion recognition by emotion engine

[0262] The device analyzes the user's facial expressions and voice, and uses an emotion engine to recognize the user's emotions. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[0263] Prioritizing property listings based on emotions

[0264] The server receives the user's emotion data and re-prioritizes the property listings based on the recognized emotion, for example, displaying properties for which the user expressed "joy" at the top of the list.

[0265] Automatic viewing arrangement

[0266] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The viewing date for the selected property is automatically set and reflected in the user's calendar.

[0267] Virtual viewing and emotional regulation

[0268] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who clicks to begin the virtual viewing. The device recognizes the user's emotions during the virtual viewing and adjusts the display content accordingly. For example, if the user feels anxious, the emotion engine will change the lighting and interior colors.

[0269] Generate furniture layout images

[0270] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[0271] Simulation video generation

[0272] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[0273] Generating furniture arrangement images according to emotions

[0274] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. Based on this emotion data, the server proposes an optimal furniture arrangement and provides it to the user. For example, if the emotion "relaxed" is recognized, the server will propose a relaxing arrangement.

[0275] This invention allows users to search for rooms efficiently and effectively and understand the specific living environment in advance. In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, thereby realizing a more comfortable living environment.

[0276] The processing flow will be explained below.

[0277] Step 1:

[0278] User enters desired conditions

[0279] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[0280] Step 2:

[0281] The device sends data to the server

[0282] The terminal transmits the collected desired condition data to the server.

[0283] Step 3:

[0284] The server searches for properties

[0285] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[0286] Step 4:

[0287] The server sends the search results to the device

[0288] The server sends the generated property list to the terminal.

[0289] Step 5:

[0290] Your device will display the search results

[0291] The terminal displays the received property list to the user.

[0292] Step 6:

[0293] Emotion recognition by emotion engine

[0294] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotions.

[0295] Step 7:

[0296] The server receives the emotion data.

[0297] The server receives the user's emotion data and re-prioritizes the property information based on the recognized emotion.

[0298] Step 8:

[0299] The server sends the re-prioritized property list to the terminal.

[0300] The server sends the re-adjusted property list to the terminal.

[0301] Step 9:

[0302] Display the property list with your device recalibrated

[0303] The terminal displays the re-arranged property listings to the user.

[0304] Step 10:

[0305] User selects property

[0306] The user selects the property they like on their device, and the device sends the selection information to the server.

[0307] Step 11:

[0308] The server arranges a viewing

[0309] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[0310] Step 12:

[0311] The device updates the viewing schedule to the user's calendar

[0312] The device will update the viewing schedule on the user's calendar.

[0313] Step 13:

[0314] User requests a virtual tour

[0315] The user selects the property they wish to virtually view on their device.

[0316] Step 14:

[0317] The device sends a request to the server

[0318] The device sends a virtual viewing request to the server.

[0319] Step 15:

[0320] The server converts the floor plan into a 3D model

[0321] The server generates a 3D model based on the floor plan and related information of the selected property.

[0322] Step 16:

[0323] The server sends a virtual preview link to the device.

[0324] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[0325] Step 17:

[0326] The device will display a virtual preview link

[0327] The device displays a virtual preview link to the user.

[0328] Step 18:

[0329] Users can conduct virtual viewings

[0330] Users click on the link and use their device to conduct a virtual viewing.

[0331] Step 19:

[0332] Emotion recognition during virtual viewing

[0333] The terminal recognizes the user's emotions during the virtual preview and transmits the emotion data to the server.

[0334] Step 20:

[0335] The server adjusts the virtual viewing content

[0336] The server adjusts the virtual viewing environment (lighting, interior color, etc.) based on the user's emotional data and sends the results to the terminal.

[0337] Step 21:

[0338] User inputs furniture size and type

[0339] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[0340] Step 22:

[0341] The device sends data to the server

[0342] The device sends the collected furniture size and type data to a server.

[0343] Step 23:

[0344] The server performs a furniture layout simulation

[0345] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[0346] Step 24:

[0347] The server sends the furniture layout image to the terminal.

[0348] The server sends the furniture layout image it has created to the terminal.

[0349] Step 25:

[0350] The device displays an image of the furniture layout.

[0351] The terminal displays an image of the furniture arrangement to the user.

[0352] Step 26:

[0353] Emotion recognition during furniture layout simulation

[0354] The terminal analyzes the user's emotions during the furniture placement simulation and transmits the emotion data to the server.

[0355] Step 27:

[0356] The server suggests furniture arrangements based on emotions

[0357] The server proposes optimal furniture layout based on the emotional data and sends the results to the device.

[0358] Step 28:

[0359] The device displays furniture layout images based on emotions

[0360] The terminal displays to the user an image of furniture arrangement according to the user's emotions.

[0361] Step 29:

[0362] The server generates the simulation video

[0363] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[0364] Step 30:

[0365] The server sends the video data to the terminal

[0366] The server transmits the generated simulation video data to the terminal.

[0367] Step 31:

[0368] The device displays a link to play the video.

[0369] The terminal displays a link to play the simulation video to the user.

[0370] Step 32:

[0371] User checks the simulation video

[0372] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[0373] Example 2

[0374] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0375] Existing property search systems present property information without considering the user's emotions, making it difficult for users to efficiently find the property they truly desire. Furthermore, functions such as virtual viewings and furniture layout simulations are limited, making it difficult for users to visualize what it would be like to actually live in the property. Furthermore, they lack the functionality to automatically arrange viewings or adjust the environment based on the user's emotions during a virtual viewing. Technology that solves these issues is needed.

[0376] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0377] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, means for recognizing the user's emotions, means for preferentially presenting property information based on the recognized emotions, and means for analyzing the user's emotions during the virtual viewing and adjusting the display content. This makes it possible to present property information that takes the user's emotions into consideration and to provide a detailed experience in viewings, furniture layout, and simulations.

[0378] "User desired conditions" are conditions that a user inputs when searching for a specific property, and include information such as floor plan, budget, and area.

[0379] "Property information" refers to detailed data about a property, including, for example, information such as the layout, price, location, and age of the property.

[0380] "Arranging a viewing" is the procedure of setting up a schedule to actually visit the property and check the interior.

[0381] A floor plan is a drawing that shows the layout of rooms and facilities inside a property.

[0382] "Virtual viewing" is the act of visually experiencing the interior of a property online using virtual reality or 3D models.

[0383] A "furniture layout image" is a visual image that shows how furniture will be arranged within the property based on the size and type of furniture entered by the user.

[0384] A "simulation video" is a video that virtually recreates the living environment of someone who actually lives in a property.

[0385] "Means for recognizing emotions" refers to technology that analyzes a user's facial expressions and voice to detect emotions such as joy, sadness, and surprise.

[0386] The "means for preferentially presenting property information" is a method for adjusting the display order of property information based on the user's perceived emotions.

[0387] "Means for adjusting the displayed content" refers to technology that dynamically changes the displayed content, such as lighting and interior color, depending on the user's emotions during the virtual preview.

[0388] The present invention is a system that inputs a user's desired conditions, searches and displays property information in real time, and dynamically adjusts property information and settings based on the user's emotions. The system includes the following functions:

[0389] Input of user's desired conditions

[0390] The user inputs desired conditions using a device (such as a PC or smartphone). For example, they specify conditions such as "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo." The device then sends this input data to a server. The hardware used is a general-purpose computer or mobile device, and the software used is a dedicated application or web interface.

[0391] Property information search and presentation

[0392] The server searches the database for property information in real time based on the received user's desired conditions. It generates a list of relevant properties and sends it to the terminal. The terminal displays the property list to the user. The server can use a high-performance database management system (e.g., MySQL, PostgreSQL).

[0393] Emotion recognition by emotion engine

[0394] The device uses a built-in camera and microphone to analyze changes in the user's facial expressions and voice, and the emotion engine recognizes the user's emotions. The emotion engine can use advanced recognition systems such as the "AI Passion Engine." For example, if a user smiles while looking at a property listing, the emotion engine will recognize "joy."

[0395] Prioritizing property listings based on emotions

[0396] The server receives the emotion data from the device and adjusts the display order of the property information based on that emotion data. For example, properties for which the user expressed "joy" would be displayed at the top of the list.

[0397] Automatic viewing arrangement

[0398] When a user selects a property they like and requests a viewing, the device sends the request to the server. The server automatically schedules the viewing and sends the details to the device, which then updates the user's calendar with the viewing date.

[0399] Virtual viewing and emotional regulation

[0400] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related data, and sends a virtual viewing link to the device. During the virtual viewing, the device analyzes the user's emotions and adjusts the display content. For example, if the user feels anxious, the display content will be changed to help them relax.

[0401] Generate furniture layout images

[0402] When the user inputs the size of the furniture (e.g., a sofa 200cm wide x 90cm high), the device sends this data to the server. The server performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[0403] Simulation video generation

[0404] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. This video data is sent to the device, which then displays a link to the simulation video to the user. When the user clicks the link, the simulation video begins to play.

[0405] Generating furniture arrangement images according to emotions

[0406] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. The server then proposes an optimal furniture arrangement based on the emotions and sends the result to the device. For example, if the emotion "relaxed" is recognized, a relaxing arrangement will be proposed.

[0407] Prompt Sentence Examples

[0408] 1. "I'm looking for a 2LDK apartment in Tokyo. Can I find one for under 150,000 yen?"

[0409] 2. "These are the dimensions of a sofa. Please simulate a layout that is 200cm wide, 90cm high, and 100cm deep."

[0410] 3. "I'd like to see this property. Please let me know the specific date."

[0411] 4. "I'd like to start a virtual tour. Please provide the link."

[0412] This system allows users to search for properties efficiently and effectively, and allows them to understand the specific living environment in advance. It also constantly monitors the user's emotions and provides optimal property information and furniture arrangements accordingly, creating a more comfortable living environment.

[0413] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0414] Step 1:

[0415] The user operates the terminal and inputs the desired conditions.

[0416] Input: Floor plan (e.g., 2LDK), Budget (e.g., under 150,000 yen), Area (e.g., Shibuya-ku, Tokyo)

[0417] Operation: The terminal obtains the above conditions from the input form displayed on the screen, formats the data, and sends it to the server.

[0418] Output: The server receives the user's desired conditions.

[0419] Step 2:

[0420] The server searches for property information based on the desired conditions received.

[0421] Input: User's desired conditions (2LDK, under 150,000 yen, Shibuya-ku, Tokyo)

[0422] How it works: The server executes a database query to find matching properties in real time.

[0423] Output: The server generates a list of properties and sends it to the terminal.

[0424] Step 3:

[0425] The terminal displays the property listing to the user.

[0426] Input: Property list sent from the server

[0427] Action: The device displays the property listing on the user interface. The user views the listing.

[0428] Output: User reviews property listing and decides next action.

[0429] Step 4:

[0430] The device analyzes the user's facial expressions and voice, and the emotion engine recognizes the user's emotions.

[0431] Input: User's facial expression video data and voice data

[0432] How it works: The device's camera and microphone capture the user's face and voice, which the emotion engine analyzes to recognize the user's emotions.

[0433] Output: The device sends the recognized emotion data to the server.

[0434] Step 5:

[0435] The server readjusts the priority of property information based on the emotion data.

[0436] Input: Recognized user emotion data

[0437] How it works: The server uses emotion data to prioritize the property list, for example, placing properties that the user expresses joy about at the top of the list.

[0438] Output: Send the rebalanced property list to the device.

[0439] Step 6:

[0440] The terminal displays the recalibrated property listing to the user.

[0441] Input: Rebalanced property list sent from the server

[0442] Action: The terminal redisplays the new property listing on the user interface.

[0443] Output: User confirms the rebalanced property list.

[0444] Step 7:

[0445] The user selects a property they like and requests a viewing.

[0446] Input: Property information selected by the user and a request for a viewing

[0447] Operation: The terminal sends the user's selection information to the server.

[0448] Output: The server receives a request to schedule a preview.

[0449] Step 8:

[0450] The server automatically sets up a viewing schedule and sends the details to the terminal.

[0451] Input: User's viewing request

[0452] How it works: The server checks the availability schedule for the property, schedules an appropriate viewing date, and sends the details to the device.

[0453] Output: The preview schedule details are sent to the device and reflected in the user's calendar.

[0454] Step 9:

[0455] The user requests a virtual tour.

[0456] Input: User's virtual viewing request

[0457] How it works: The device sends a request to the server, which generates a 3D model and sends a link to it to the device.

[0458] Output: A virtual preview link is sent to the device and displayed to the user.

[0459] Step 10:

[0460] The device analyzes the user's emotions during the virtual viewing and adjusts the displayed content.

[0461] Input: facial expression video data and audio data of the user during the virtual viewing

[0462] How it works: The device's camera and microphone capture images in real time, which are then analyzed by the emotion engine. The lighting and interior color are then changed according to the emotion.

[0463] Output: The adjusted virtual preview display is provided to the user.

[0464] Step 11:

[0465] The user inputs the size of the furniture they have.

[0466] Input: Furniture size data such as width, depth, and height

[0467] Operation: The device sends input data to the server, which then performs a furniture layout simulation based on the furniture data and floor plan.

[0468] Output: The simulation results are sent to the terminal and displayed to the user.

[0469] Step 12:

[0470] The server integrates the virtual viewing data and furniture layout data to generate a simulation image.

[0471] Input: Virtual viewing data and furniture layout data

[0472] How it works: The server integrates this data and generates a simulation video of what it would be like to actually live there.

[0473] Output: A link to the simulation video is sent to the device and displayed to the user.

[0474] Step 13:

[0475] During the furniture layout simulation, the device analyzes the user's emotions and suggests the optimal furniture layout based on that.

[0476] Input: User emotion data during furniture layout simulation

[0477] Operation: The device sends emotion data to the server, and the server proposes the optimal furniture layout based on the emotion and sends it to the device.

[0478] Output: The proposed furniture layout image is displayed on the terminal and provided to the user.

[0479] (Application example 2)

[0480] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0481] Conventional property search systems make it difficult for users to efficiently search for properties that meet their desired conditions, and in particular, they have problems with low user satisfaction because they do not dynamically adjust according to the user's emotions during virtual viewings or furniture layout simulations.In addition, they lack emotion recognition functionality when providing property information, making it impossible to present optimal property information, resulting in a limited user experience.

[0482] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0483] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation video of what it would be like to actually live in the property, means for recognizing emotions from the user's facial expressions and voice, means for dynamically adjusting the priority of property information based on the recognized emotions, and means for visually adjusting the environment according to the emotions during the virtual viewing. This allows users to efficiently find properties that meet their needs and, by receiving optimal suggestions and environmental adjustments based on their emotions, can achieve a high level of satisfaction.

[0484] The "means for inputting the user's desired conditions" refers to a device or program that allows the user to input the conditions of the property he or she desires (for example, floor plan, budget, location, etc.) via an interface.

[0485] "Means for searching property information and presenting relevant properties in real time" refers to a device or program for searching a database for relevant property information based on the desired conditions entered by the user and displaying the results immediately.

[0486] The "means for automatically arranging a viewing of the property" is a device or program for automatically setting a viewing schedule for the selected property and providing that information to the user.

[0487] "Means for conducting a virtual viewing based on a floor plan" refers to a device or program that generates a 3D model based on the floor plan and related information of a property and provides the model to users as a virtual viewing.

[0488] "Means for generating a furniture arrangement image based on the size and type of furniture entered by the user" refers to a device or program for generating a simulation image of furniture arranged within a property based on the dimensions and type of furniture specified by the user.

[0489] "Means for generating a simulation video of what it would be like to actually live in a property" refers to a device or program for generating a simulation video of what it would be like to actually live in a property based on the property and furniture layout information selected by the user.

[0490] The "means for recognizing emotions from a user's facial expression and voice" refers to a device or program for analyzing a user's facial expression and voice and estimating their emotional state.

[0491] The "means for dynamically adjusting the priority of property information based on recognized emotions" is a device or program for rearranging the display order of property lists to prioritize them according to emotions based on the user's emotional data.

[0492] "Means for visually adjusting the environment according to emotions during a virtual viewing" refers to a device or program that analyzes the user's emotions during a virtual viewing and dynamically changes the lighting, interior color, etc. of the virtual environment according to those emotions.

[0493] The present invention combines a system that allows users to input their desired conditions and search and display property information in real time with an emotion engine. This system includes the following means.

[0494] First, the user inputs desired conditions (e.g., floor plan, budget, location) using a device such as a smartphone. The device then sends this input data to the server. Next, the server searches the property information in the database in real time based on the desired conditions received, and generates a list of matching properties. The generated property list is sent to the device and presented to the user.

[0495] One feature of the present invention is that it uses an emotion engine to recognize a user's emotions. While the user is operating the device, the device analyzes the user's facial expressions and voice and uses the emotion engine to recognize the user's emotional state in real time. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[0496] The server receives this emotion data and dynamically adjusts the priority of property listings based on the recognized emotion. For example, properties for which the user expressed "joy" may be displayed at the top of the list. This allows the server to provide the most suitable property information according to the user's preferences.

[0497] When a user selects a property they like, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The schedule information is also automatically updated on the user's calendar.

[0498] Furthermore, if the user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The user can start the virtual viewing by clicking the link. The system recognizes the user's emotions during the virtual viewing and makes visual adjustments (such as changes to lighting and interior colors) according to those emotions.

[0499] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the floor plan and sends an image of the layout to the device. It also generates a video of what it would be like to actually live in the home based on the simulation results and sends it to the device. The user can click on the video playback link to see the specific living environment.

[0500] This allows users to efficiently search for rooms and understand the specific living environment in advance.In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, making it possible to create a more comfortable living environment.

[0501] Example prompt:

[0502] "A user is looking for a 2LDK property with a budget of less than 150,000 yen in Shibuya Ward, Tokyo. If the emotion engine detects that the user's emotion is "joy," generate a list of properties to display preferentially. Furthermore, provide a virtual viewing for the selected property and simulate furniture placement based on the furniture size."

[0503] To implement this invention, programs such as an emotion engine, a virtual viewing system, and a furniture layout simulation are required, but these are all managed on a cloud-based server, and only the interface portion is provided to the user's terminal.

[0504] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0505] Step 1:

[0506] The user uses a terminal to input desired conditions (for example, floor plan, budget, location). The terminal sends this input data to the server. The input is the user's desired conditions, and the output is the data transfer to the server.

[0507] Step 2:

[0508] The server searches the database for property information in real time based on the received desired conditions. The searched data is property information, and the output is a list of matching properties.

[0509] Step 3:

[0510] The server generates a property list and sends it to the terminal. The list of properties is displayed on the user's terminal. The input is the property list, and the output is the data transmission and display to the terminal.

[0511] Step 4:

[0512] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotional state. The analysis targets the user's facial expressions and voice, and the output is the user's emotional data.

[0513] Step 5:

[0514] The server receives the emotion data and dynamically adjusts the priorities of the property information based on the recognized emotion. The input is the user's emotion data, and the output is the prioritized property list.

[0515] Step 6:

[0516] The server regenerates the adjusted property list and sends it to the terminal, where the property list with the priorities adjusted based on the emotion is displayed. The input is the adjusted property list, and the output is the retransmitted data and display.

[0517] Step 7:

[0518] When the user selects a property they like, the terminal sends the selection information to the server. The input is the user's property selection, and the output is the transfer of the selection data to the server.

[0519] Step 8:

[0520] The server automatically sets up a viewing schedule for the selected property and sends the details to the terminal. Furthermore, the schedule information is automatically reflected in the user's calendar. The input is the property selection information, and the output is the viewing schedule and the calendar update.

[0521] Step 9:

[0522] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a link to the virtual viewing to the device. The input is a request for a virtual viewing, and the output is the generation and transmission of a link to the virtual viewing.

[0523] Step 10:

[0524] The user starts the virtual preview, and the device recognizes the user's emotions during the preview and adjusts the visual environment accordingly. The input is the user's emotional data, and the output is the adjusted visual environment.

[0525] Step 11:

[0526] When a user inputs the size of their existing furniture, the device sends that data to the server. The server then performs a furniture layout simulation based on the floor plan and sends the resulting layout image to the device. The input is furniture size data, and the output is a simulated furniture layout image.

[0527] Step 12:

[0528] The server generates a simulation video of what it would be like to actually live in the home based on the results of the furniture layout simulation and sends the video to the device. When the user clicks on the link to play the video, they can see the actual living environment. The input is furniture layout data, and the output is the simulation video.

[0529] This allows users to efficiently find properties that meet their needs, and also receive optimal suggestions and environmental adjustments based on their emotions.

[0530] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0531] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0532] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0533] [Second embodiment]

[0534] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0535] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0536] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0537] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0538] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0539] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0540] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0541] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0542] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0543] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0544] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0545] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0546] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[0547] Program processing and specific examples

[0548] Input of user's desired conditions

[0549] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal then sends this input data to the server.

[0550] Property information search and presentation

[0551] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[0552] Automatic viewing arrangement

[0553] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. For example, a viewing date for the selected property is automatically set and reflected in the user's calendar.

[0554] Virtual viewing

[0555] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who can click it to begin the virtual viewing. The user can then view the 3D model through the device.

[0556] Generate furniture layout images

[0557] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[0558] Generating a simulation video of what it would be like to live in the property

[0559] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[0560] The present invention allows users to efficiently and effectively search for an apartment and understand the specific living environment in advance. It also accommodates cases where users are moving far away or viewing the property on-site is difficult, greatly improving user convenience.

[0561] The processing flow will be explained below.

[0562] Step 1:

[0563] User enters desired conditions

[0564] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[0565] Step 2:

[0566] The device sends data to the server

[0567] The terminal transmits the collected desired condition data to the server.

[0568] Step 3:

[0569] The server searches for properties

[0570] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[0571] Step 4:

[0572] The server sends the search results to the device

[0573] The server sends the generated property list to the terminal.

[0574] Step 5:

[0575] Your device will display the search results

[0576] The terminal displays the received property list to the user.

[0577] Step 6:

[0578] User selects property

[0579] The user selects the property they like on their device, and the device sends the selection information to the server.

[0580] Step 7:

[0581] The server arranges a viewing

[0582] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[0583] Step 8:

[0584] Viewing arrangements reflected on user calendar

[0585] The device will update the viewing schedule on the user's calendar.

[0586] Step 9:

[0587] User requests a virtual tour

[0588] The user selects the property they wish to virtually view on their device.

[0589] Step 10:

[0590] The device sends a request to the server

[0591] The device sends a virtual viewing request to the server.

[0592] Step 11:

[0593] The server converts the floor plan into a 3D model

[0594] The server generates a 3D model based on the floor plan and related information of the selected property.

[0595] Step 12:

[0596] The server sends a virtual preview link to the device.

[0597] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[0598] Step 13:

[0599] The device will display a virtual preview link

[0600] The device displays a virtual preview link to the user.

[0601] Step 14:

[0602] Users can conduct virtual viewings

[0603] Users click on the link and use their device to conduct a virtual viewing.

[0604] Step 15:

[0605] User inputs furniture size and type

[0606] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[0607] Step 16:

[0608] The device sends data to the server

[0609] The device sends the collected furniture size and type data to a server.

[0610] Step 17:

[0611] The server performs a furniture layout simulation

[0612] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[0613] Step 18:

[0614] The server sends the layout image to the device.

[0615] The server sends the generated layout image to the terminal.

[0616] Step 19:

[0617] The device displays an image of the furniture layout.

[0618] The terminal displays an image of the furniture arrangement to the user.

[0619] Step 20:

[0620] The server generates the simulation video

[0621] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[0622] Step 21:

[0623] The server sends the video data to the terminal

[0624] The server transmits the generated simulation video data to the terminal.

[0625] Step 22:

[0626] The device displays a link to play the video.

[0627] The terminal displays a link to play the simulation video to the user.

[0628] Step 23:

[0629] User checks the simulation video

[0630] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[0631] Example 1

[0632] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0633] Conventional property search systems lacked the means to allow users to obtain desired property information in real time, and to conduct detailed viewings and simulations. This resulted in inefficient property searches and a heavy burden on users. Furthermore, they lacked the functionality to automatically arrange viewings, generate images of furniture layouts, and simulate living environments, making them inconvenient for users who are moving far away or find it difficult to view properties in person.

[0634] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0635] In this invention, the server includes means for inputting the user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, and means for transmitting the generated data to a terminal and displaying it so that the user can visually confirm it. This makes it possible to efficiently and effectively search for property information and conduct detailed viewings and simulations.

[0636] "User" refers to any individual or legal entity that uses the System.

[0637] "Desired conditions" refers to data entered by the user regarding the conditions and requirements for the property they are looking for.

[0638] "Property information" refers to data including information such as the property's location, layout, price, and facilities.

[0639] "Real-time" means that data is processed immediately and results are provided to the user without delay.

[0640] "Arranging a viewing" refers to the process of arranging a date to actually visit and check out the property.

[0641] "Virtual viewing" refers to virtually touring the interior of a property via the Internet.

[0642] A "floor plan" refers to a drawing showing the layout of rooms in a property.

[0643] "Furniture arrangement image" refers to a visual image that simulates the arrangement of furniture within a property based on the size and type of furniture entered by the user.

[0644] "Simulation video" refers to video data that visually recreates the living environment of someone who actually lives in the property.

[0645] "Generated data" refers to data created by the system, including property information, virtual viewing links, furniture layout images, and simulation footage.

[0646] "Terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to operate the system.

[0647] A "server" refers to a group of computers that manages the entire system and performs processing.

[0648] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[0649] First, the user operates the terminal and inputs the desired conditions (e.g., 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo) into the search box. This input data is sent from the terminal to the server. As a concrete example, the prompt sentence "Please search for properties that meet the following criteria: 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" is based on the user's input.

[0650] The server analyzes the received desired conditions and sends a query to the database. This query searches for properties that meet the conditions of "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The search results are generated in list format and sent back to the terminal for display to the user. For example, the property list may be displayed on a GUI, with a link to view detailed information about each property.

[0651] When a user selects a specific property from the list, the device sends that information to the server. The server checks available viewing schedules based on the property information and automatically sets the most suitable date. This information is sent to the device, which adds the date to the user's calendar app. For example, the server can automatically update Google Calendar using a prompt such as "Please automatically schedule a viewing for the selected property."

[0652] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property. This generation process uses 3D modeling software such as Unity. A link to the completed 3D model is sent to the device, and the user can click on this link to start the virtual viewing in a web browser. For example, the prompt message used is, "Please generate a 3D model based on the floor plan of this property."

[0653] When a user inputs the dimensions of their furniture, the device sends that data to the server. The server then uses this data to simulate the placement of the furniture on the property's floor plan. This process uses tools such as Blender and AutoCAD. The simulation results are sent to the device and displayed visually to the user. For example, a prompt might be used: "Please generate an image of a sofa that is 200 cm wide, 100 cm deep, and 90 cm high placed on the floor plan."

[0654] The server integrates the virtual viewing data and furniture layout data to generate a simulation video of what it would be like for the user to live in the property. This video is created using video editing software such as After Effects or Cinema 4D to create a realistic living experience. The completed simulation video is sent to the device, and the user can view it by clicking on the video playback link. As an example, the prompt text used is, "Please generate a simulation video of what it would be like to live in this property."

[0655] This invention allows users to efficiently and effectively find their ideal property and to get a concrete image of their life through detailed viewings and simulations. It also accommodates cases where users are moving far away or viewing in person is difficult, greatly improving user convenience.

[0656] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0657] Step 1:

[0658] The user operates the device to input desired conditions into the search box. Specifically, the user enters "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" into the input field and clicks the search button. This input data is sent from the device to the server. The server receives this data and stores it as desired conditions. Input: Desired conditions data. Output: Storage of desired conditions.

[0659] Step 2:

[0660] The server sends a query to the database based on the desired conditions it has received. Specifically, the server searches the database using the conditions "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The database returns matching property information. Input: Desired conditions data. Output: List of properties in the search results.

[0661] Step 3:

[0662] The server generates a list of properties as search results and sends it back to the terminal. The terminal displays the list it receives on the screen and presents it to the user. Specifically, the property list is displayed on the GUI, and a link is provided to view detailed information about each property. Input: Property list as search results. Output: Property list displayed on the screen.

[0663] Step 4:

[0664] The user selects a specific property from the list. The terminal sends the selected property information to the server. Specifically, when the user clicks on a link, the property ID is sent to the server. The server generates candidate dates for the viewing schedule based on the property information and sends them back to the terminal. Input: Property ID. Output: Candidate dates for the viewing schedule.

[0665] Step 5:

[0666] The server automatically sets the optimal viewing date and sends that information to the device. The device then adds the received viewing date to the user's calendar app. Specifically, the server sets the viewing date as "October 25, 2023, 10:00" and automatically registers it in Google Calendar. Input: Candidate dates for the viewing schedule. Output: Automatic setting of viewing date.

[0667] Step 6:

[0668] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property and sends a virtual viewing link to the device. Specifically, the 3D model is generated using 3D modeling software such as Unity. Input: Virtual viewing request. Output: Virtual viewing link.

[0669] Step 7:

[0670] The user clicks on the virtual viewing link to view the 3D model in a web browser. Specifically, a real-time 3D model using WebGL is displayed in the browser. The user can use the 360-degree view and zoom functions to view the interior of the property. Input: Virtual viewing link. Output: Display of 3D model.

[0671] Step 8:

[0672] The user inputs the size of their furniture. The device sends this data to the server. The server then uses the furniture size data to simulate furniture placement on the property's floor plan. Specifically, the simulation is carried out using tools such as Blender or AutoCAD. Input: Furniture size data. Output: Furniture placement simulation results.

[0673] Step 9:

[0674] The simulation results are sent from the server to the terminal and displayed visually to the user. Specifically, a 3D rendered image of the room is displayed, allowing the user to see at a glance where the furniture is placed. Input: Furniture placement simulation results. Output: Display of a visual placement image.

[0675] Step 10:

[0676] The server combines the virtual viewing data and furniture layout data to generate a simulation video of what it would be like if the user lived in the property. Specifically, video editing software such as After Effects or Cinema 4D is used to create a simulation video that gives a realistic sense of life. Input: Virtual viewing data and furniture layout data. Output: Simulation video.

[0677] Step 11:

[0678] The completed simulation video is sent from the server to the device, and the user can view it by clicking the video playback link. For example, the playback link is displayed on the device screen as an embedded YouTube player, and the user can click to watch it in full screen. Input: Simulation video. Output: Playback of simulation video.

[0679] (Application example 1)

[0680] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0681] Currently, when users search for properties or products that meet their specific requirements, it is not only time-consuming, but also difficult to provide real-time information or perform specific simulations. Furthermore, when on-site viewing is difficult, it is difficult to grasp the details, reducing user convenience. There is a need for a system that solves these issues and allows users to efficiently search for properties and products and form a concrete image.

[0682] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0683] In this invention, the server includes means for inputting user desired conditions, means for presenting search results in real time, means for automatically arranging previews, means for conducting virtual previews, means for generating furniture layout images, means for generating simulation images, means for searching for and presenting products in a virtual store in real time, and means for generating a virtual preview link from product information and sending it to the user's terminal, thereby enabling users to efficiently search for properties and products and get a concrete image of them.

[0684] "User desired conditions" are conditions (for example, location, layout, price, color, size, etc.) that a user specifies for a particular property or product.

[0685] "Property information" refers to detailed data about a specific property (e.g., location, floor plan, price, facilities, etc.).

[0686] "Search" is the process of finding the desired property or product based on the desired conditions entered by the user.

[0687] "Real-time" refers to instantaneous processing and response that occurs at the same time as the present.

[0688] "Presentation" refers to visually displaying search results and information to the user.

[0689] "Viewing arrangements" refers to scheduling a site visit or virtual viewing of a property or product that the user desires.

[0690] "Virtual viewing" is a system that virtually recreates an actual property or store, allowing users to tour the interior online.

[0691] A "floor plan" is a drawing showing the layout and dimensions of rooms inside a property.

[0692] A "furniture layout image" is a visual simulation of what the furniture will look like when it is arranged within a property based on the size and type of furniture specified by the user.

[0693] "Simulation footage" is footage that virtually recreates the conditions under which a property would actually be lived in or used.

[0694] A "virtual store" is a virtual store space built on the Internet where users can search for and purchase products.

[0695] "Product information" is detailed data about a specific product (for example, type, price, specifications, stock status, etc.).

[0696] A "link" is a hypertext link that directs a user to a particular web page or resource.

[0697] A "terminal" is a device (e.g., smartphone, tablet, computer) that a user uses to enter or view information.

[0698] This invention is a system that allows a user to input desired conditions and search for and display information on properties and products in real time. Specific embodiments of this system will be described below.

[0699] Program processing overview

[0700] Input of user's desired conditions

[0701] The user inputs their desired conditions (e.g., furniture color, size, price range, etc.) using smart glasses or a smartphone. This input data is sent from the device to the server.

[0702] Searching and presenting property and product information

[0703] The server searches the database in real time based on the received criteria. The searched information is compiled into a list and sent to the terminal. The terminal then displays a list of properties and products that match the user's criteria.

[0704] Automatic viewing arrangements and virtual viewings

[0705] When a user selects a specific property or product, the information is sent to the server and a viewing schedule is automatically set up. If the user requests a virtual viewing, a 3D model is generated based on the floor plan and product details, and a link is sent to the user's device.

[0706] Furniture layout image generation and simulation

[0707] When a user inputs the size and type of furniture they have, the data is sent to the server and a furniture layout simulation is performed. The simulation results are sent to the device and displayed as a concrete image. In addition, the furniture layout data and viewing data are integrated to generate and send a simulation video of what it would be like to actually live in the property.

[0708] Hardware and software used

[0709] Hardware: smart glasses, smartphones, tablets, computers

[0710] Software: Python, requests library, json library

[0711] Database: MySQL or PostgreSQL

[0712] Specific examples

[0713] When a user searches for "a blue, two-meter-wide sofa" using the smart glasses, the search criteria are sent to the server, and matching sofa information is retrieved in real time from the database. The retrieved information is displayed as a list on the smart glasses, and the user can click a virtual preview link to view the 3D model.

[0714] Prompt Sentence Examples

[0715] "Please enter your desired furniture criteria (e.g. color, size, price range, etc.)"

[0716] This embodiment allows users to efficiently search for properties and products and get a concrete image of them, and in particular makes it easy to check the details through virtual viewings.

[0717] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0718] Step 1:

[0719] The user enters the desired conditions

[0720] Input: The user uses smart glasses or a smartphone to input desired criteria (e.g., furniture color, size, price range, etc.) in natural language.

[0721] Data processing: The terminal converts the entered conditions into JSON format and prepares to send it as an API request.

[0722] Output: The desired conditions data in JSON format is sent to the server.

[0723] Step 2:

[0724] Real-time search processing is performed on the server

[0725] Input: The server receives the user's desired conditions.

[0726] Data processing: Query the database based on your desired conditions and search for properties and products that fit your needs.

[0727] Output: A list of relevant property and product information is generated and sent to the terminal in JSON format.

[0728] Step 3:

[0729] View search results on your device

[0730] Input: Receives a list of property and product information in JSON format sent from the server.

[0731] Data processing: Converts received information into a format that is easy for the user to understand and displays it.

[0732] Output: The user views a list of properties and products on their device.

[0733] Step 4:

[0734] The user selects a specific property or product

[0735] Input: The user selects a particular property or product from a list.

[0736] Output: Information about the selected property or product is sent to the server.

[0737] Step 5:

[0738] Automatic viewing arrangement and virtual viewing link generation

[0739] Input: The server receives information about the property or product selected by the user.

[0740] Data processing: The server automatically schedules viewings and generates 3D models based on floor plans and detailed product information.

[0741] Output: Viewing schedule details and a virtual viewing link will be generated and sent to your device.

[0742] Step 6:

[0743] Viewing schedule and virtual viewing link on your device

[0744] Input: Receives the preview schedule and virtual preview link sent from the server.

[0745] Data processing: The received information is displayed in a format that is easy for the user to understand.

[0746] Output: User checks the viewing schedule and clicks the virtual viewing link to view the 3D model.

[0747] Step 7:

[0748] The user inputs the size and type of furniture

[0749] Input: The user inputs the size and type of furniture they have through the terminal.

[0750] Data processing: The terminal converts the input furniture data into JSON format and sends it to the server.

[0751] Output: Furniture data in JSON format is sent to the server.

[0752] Step 8:

[0753] Running a furniture layout simulation

[0754] Input: The server receives furniture sizes and types, and a floor plan of the property.

[0755] Data processing: The server runs a furniture layout simulation based on this data and generates the results.

[0756] Output: The results of the placement simulation are sent to the terminal.

[0757] Step 9:

[0758] Generating simulation images of homes

[0759] Input: The server receives virtual viewing data and furniture layout data.

[0760] Data processing: The server integrates this information and generates a simulation image of what it would be like to actually live there.

[0761] Output: The simulation video is sent to the device and a link is provided for the user to view.

[0762] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0763] This invention combines a system that searches for and displays property information in real time after a user inputs their desired conditions with an emotion engine. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on furniture sizes input by the user, and generates simulation images of what it would be like to actually live in the property. Furthermore, it provides a function that recognizes the user's emotions and dynamically adjusts property information and settings based on those emotions.

[0764] Program processing and specific examples

[0765] Input of user's desired conditions

[0766] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal sends this input data to the server.

[0767] Property information search and presentation

[0768] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[0769] Emotion recognition by emotion engine

[0770] The device analyzes the user's facial expressions and voice, and uses an emotion engine to recognize the user's emotions. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[0771] Prioritizing property listings based on emotions

[0772] The server receives the user's emotion data and re-prioritizes the property listings based on the recognized emotion, for example, displaying properties for which the user expressed "joy" at the top of the list.

[0773] Automatic viewing arrangement

[0774] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The viewing date for the selected property is automatically set and reflected in the user's calendar.

[0775] Virtual viewing and emotional regulation

[0776] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who clicks to begin the virtual viewing. The device recognizes the user's emotions during the virtual viewing and adjusts the display content accordingly. For example, if the user feels anxious, the emotion engine will change the lighting and interior colors.

[0777] Generate furniture layout images

[0778] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[0779] Simulation video generation

[0780] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[0781] Generating furniture arrangement images according to emotions

[0782] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. Based on this emotion data, the server proposes an optimal furniture arrangement and provides it to the user. For example, if the emotion "relaxed" is recognized, the server will propose a relaxing arrangement.

[0783] This invention allows users to search for rooms efficiently and effectively and understand the specific living environment in advance. In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, thereby realizing a more comfortable living environment.

[0784] The processing flow will be explained below.

[0785] Step 1:

[0786] User enters desired conditions

[0787] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[0788] Step 2:

[0789] The device sends data to the server

[0790] The terminal transmits the collected desired condition data to the server.

[0791] Step 3:

[0792] The server searches for properties

[0793] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[0794] Step 4:

[0795] The server sends the search results to the device

[0796] The server sends the generated property list to the terminal.

[0797] Step 5:

[0798] Your device will display the search results

[0799] The terminal displays the received property list to the user.

[0800] Step 6:

[0801] Emotion recognition by emotion engine

[0802] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotions.

[0803] Step 7:

[0804] The server receives the emotion data.

[0805] The server receives the user's emotion data and re-prioritizes the property information based on the recognized emotion.

[0806] Step 8:

[0807] The server sends the re-prioritized property list to the terminal.

[0808] The server sends the re-adjusted property list to the terminal.

[0809] Step 9:

[0810] Display the property list with your device recalibrated

[0811] The terminal displays the re-arranged property listings to the user.

[0812] Step 10:

[0813] User selects property

[0814] The user selects the property they like on their device, and the device sends the selection information to the server.

[0815] Step 11:

[0816] The server arranges a viewing

[0817] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[0818] Step 12:

[0819] The device updates the viewing schedule to the user's calendar

[0820] The device will update the viewing schedule on the user's calendar.

[0821] Step 13:

[0822] User requests a virtual tour

[0823] The user selects the property they wish to virtually view on their device.

[0824] Step 14:

[0825] The device sends a request to the server

[0826] The device sends a virtual viewing request to the server.

[0827] Step 15:

[0828] The server converts the floor plan into a 3D model

[0829] The server generates a 3D model based on the floor plan and related information of the selected property.

[0830] Step 16:

[0831] The server sends a virtual preview link to the device.

[0832] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[0833] Step 17:

[0834] The device will display a virtual preview link

[0835] The device displays a virtual preview link to the user.

[0836] Step 18:

[0837] Users can conduct virtual viewings

[0838] Users click on the link and use their device to conduct a virtual viewing.

[0839] Step 19:

[0840] Emotion recognition during virtual viewing

[0841] The terminal recognizes the user's emotions during the virtual preview and transmits the emotion data to the server.

[0842] Step 20:

[0843] The server adjusts the virtual viewing content

[0844] The server adjusts the virtual viewing environment (lighting, interior color, etc.) based on the user's emotional data and sends the results to the terminal.

[0845] Step 21:

[0846] User inputs furniture size and type

[0847] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[0848] Step 22:

[0849] The device sends data to the server

[0850] The device sends the collected furniture size and type data to a server.

[0851] Step 23:

[0852] The server performs a furniture layout simulation

[0853] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[0854] Step 24:

[0855] The server sends the furniture layout image to the terminal.

[0856] The server sends the furniture layout image it has created to the terminal.

[0857] Step 25:

[0858] The device displays an image of the furniture layout.

[0859] The terminal displays an image of the furniture arrangement to the user.

[0860] Step 26:

[0861] Emotion recognition during furniture layout simulation

[0862] The terminal analyzes the user's emotions during the furniture placement simulation and transmits the emotion data to the server.

[0863] Step 27:

[0864] The server suggests furniture arrangements based on emotions

[0865] The server proposes optimal furniture layout based on the emotional data and sends the results to the device.

[0866] Step 28:

[0867] The device displays furniture layout images based on emotions

[0868] The terminal displays to the user an image of furniture arrangement according to the user's emotions.

[0869] Step 29:

[0870] The server generates the simulation video

[0871] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[0872] Step 30:

[0873] The server sends the video data to the terminal

[0874] The server transmits the generated simulation video data to the terminal.

[0875] Step 31:

[0876] The device displays a link to play the video.

[0877] The terminal displays a link to play the simulation video to the user.

[0878] Step 32:

[0879] User checks the simulation video

[0880] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[0881] Example 2

[0882] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0883] Existing property search systems present property information without considering the user's emotions, making it difficult for users to efficiently find the property they truly desire. Furthermore, functions such as virtual viewings and furniture layout simulations are limited, making it difficult for users to visualize what it would be like to actually live in the property. Furthermore, they lack the functionality to automatically arrange viewings or adjust the environment based on the user's emotions during a virtual viewing. Technology that solves these issues is needed.

[0884] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0885] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, means for recognizing the user's emotions, means for preferentially presenting property information based on the recognized emotions, and means for analyzing the user's emotions during the virtual viewing and adjusting the display content. This makes it possible to present property information that takes the user's emotions into consideration and to provide a detailed experience in viewings, furniture layout, and simulations.

[0886] "User desired conditions" are conditions that a user inputs when searching for a specific property, and include information such as floor plan, budget, and area.

[0887] "Property information" refers to detailed data about a property, including, for example, information such as the layout, price, location, and age of the property.

[0888] "Arranging a viewing" is the procedure of setting up a schedule to actually visit the property and check the interior.

[0889] A floor plan is a drawing that shows the layout of rooms and facilities inside a property.

[0890] "Virtual viewing" is the act of visually experiencing the interior of a property online using virtual reality or 3D models.

[0891] A "furniture layout image" is a visual image that shows how furniture will be arranged within the property based on the size and type of furniture entered by the user.

[0892] A "simulation video" is a video that virtually recreates the living environment of someone who actually lives in a property.

[0893] "Means for recognizing emotions" refers to technology that analyzes a user's facial expressions and voice to detect emotions such as joy, sadness, and surprise.

[0894] The "means for preferentially presenting property information" is a method for adjusting the display order of property information based on the user's perceived emotions.

[0895] "Means for adjusting the displayed content" refers to technology that dynamically changes the displayed content, such as lighting and interior color, depending on the user's emotions during the virtual preview.

[0896] The present invention is a system that inputs a user's desired conditions, searches and displays property information in real time, and dynamically adjusts property information and settings based on the user's emotions. The system includes the following functions:

[0897] Input of user's desired conditions

[0898] The user inputs desired conditions using a device (such as a PC or smartphone). For example, they specify conditions such as "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo." The device then sends this input data to a server. The hardware used is a general-purpose computer or mobile device, and the software used is a dedicated application or web interface.

[0899] Property information search and presentation

[0900] The server searches the database for property information in real time based on the received user's desired conditions. It generates a list of relevant properties and sends it to the terminal. The terminal displays the property list to the user. The server can use a high-performance database management system (e.g., MySQL, PostgreSQL).

[0901] Emotion recognition by emotion engine

[0902] The device uses a built-in camera and microphone to analyze changes in the user's facial expressions and voice, and the emotion engine recognizes the user's emotions. The emotion engine can use advanced recognition systems such as the "AI Passion Engine." For example, if a user smiles while looking at a property listing, the emotion engine will recognize "joy."

[0903] Prioritizing property listings based on emotions

[0904] The server receives the emotion data from the device and adjusts the display order of the property information based on that emotion data. For example, properties for which the user expressed "joy" would be displayed at the top of the list.

[0905] Automatic viewing arrangement

[0906] When a user selects a property they like and requests a viewing, the device sends the request to the server. The server automatically schedules the viewing and sends the details to the device, which then updates the user's calendar with the viewing date.

[0907] Virtual viewing and emotional regulation

[0908] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related data, and sends a virtual viewing link to the device. During the virtual viewing, the device analyzes the user's emotions and adjusts the display content. For example, if the user feels anxious, the display content will be changed to help them relax.

[0909] Generate furniture layout images

[0910] When the user inputs the size of the furniture (e.g., a sofa 200cm wide x 90cm high), the device sends this data to the server. The server performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[0911] Simulation video generation

[0912] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. This video data is sent to the device, which then displays a link to the simulation video to the user. When the user clicks the link, the simulation video begins to play.

[0913] Generating furniture arrangement images according to emotions

[0914] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. The server then proposes an optimal furniture arrangement based on the emotions and sends the result to the device. For example, if the emotion "relaxed" is recognized, a relaxing arrangement will be proposed.

[0915] Prompt Sentence Examples

[0916] 1. "I'm looking for a 2LDK apartment in Tokyo. Can I find one for under 150,000 yen?"

[0917] 2. "These are the dimensions of a sofa. Please simulate a layout that is 200cm wide, 90cm high, and 100cm deep."

[0918] 3. "I'd like to see this property. Please let me know the specific date."

[0919] 4. "I'd like to start a virtual tour. Please provide the link."

[0920] This system allows users to search for properties efficiently and effectively, and allows them to understand the specific living environment in advance. It also constantly monitors the user's emotions and provides optimal property information and furniture arrangements accordingly, creating a more comfortable living environment.

[0921] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0922] Step 1:

[0923] The user operates the terminal and inputs the desired conditions.

[0924] Input: Floor plan (e.g., 2LDK), Budget (e.g., under 150,000 yen), Area (e.g., Shibuya-ku, Tokyo)

[0925] Operation: The terminal obtains the above conditions from the input form displayed on the screen, formats the data, and sends it to the server.

[0926] Output: The server receives the user's desired conditions.

[0927] Step 2:

[0928] The server searches for property information based on the desired conditions received.

[0929] Input: User's desired conditions (2LDK, under 150,000 yen, Shibuya-ku, Tokyo)

[0930] How it works: The server executes a database query to find matching properties in real time.

[0931] Output: The server generates a list of properties and sends it to the terminal.

[0932] Step 3:

[0933] The terminal displays the property listing to the user.

[0934] Input: Property list sent from the server

[0935] Action: The device displays the property listing on the user interface. The user views the listing.

[0936] Output: User reviews property listing and decides next action.

[0937] Step 4:

[0938] The device analyzes the user's facial expressions and voice, and the emotion engine recognizes the user's emotions.

[0939] Input: User's facial expression video data and voice data

[0940] How it works: The device's camera and microphone capture the user's face and voice, which the emotion engine analyzes to recognize the user's emotions.

[0941] Output: The device sends the recognized emotion data to the server.

[0942] Step 5:

[0943] The server readjusts the priority of property information based on the emotion data.

[0944] Input: Recognized user emotion data

[0945] How it works: The server uses emotion data to prioritize the property list, for example, placing properties that the user expresses joy about at the top of the list.

[0946] Output: Send the rebalanced property list to the device.

[0947] Step 6:

[0948] The terminal displays the recalibrated property listing to the user.

[0949] Input: Rebalanced property list sent from the server

[0950] Action: The terminal redisplays the new property listing on the user interface.

[0951] Output: User confirms the rebalanced property list.

[0952] Step 7:

[0953] The user selects a property they like and requests a viewing.

[0954] Input: Property information selected by the user and a request for a viewing

[0955] Operation: The terminal sends the user's selection information to the server.

[0956] Output: The server receives a request to schedule a preview.

[0957] Step 8:

[0958] The server automatically sets up a viewing schedule and sends the details to the terminal.

[0959] Input: User's viewing request

[0960] How it works: The server checks the availability schedule for the property, schedules an appropriate viewing date, and sends the details to the device.

[0961] Output: The preview schedule details are sent to the device and reflected in the user's calendar.

[0962] Step 9:

[0963] The user requests a virtual tour.

[0964] Input: User's virtual viewing request

[0965] How it works: The device sends a request to the server, which generates a 3D model and sends a link to it to the device.

[0966] Output: A virtual preview link is sent to the device and displayed to the user.

[0967] Step 10:

[0968] The device analyzes the user's emotions during the virtual viewing and adjusts the displayed content.

[0969] Input: facial expression video data and audio data of the user during the virtual viewing

[0970] How it works: The device's camera and microphone capture images in real time, which are then analyzed by the emotion engine. The lighting and interior color are then changed according to the emotion.

[0971] Output: The adjusted virtual preview display is provided to the user.

[0972] Step 11:

[0973] The user inputs the size of the furniture they have.

[0974] Input: Furniture size data such as width, depth, and height

[0975] Operation: The device sends input data to the server, which then performs a furniture layout simulation based on the furniture data and floor plan.

[0976] Output: The simulation results are sent to the terminal and displayed to the user.

[0977] Step 12:

[0978] The server integrates the virtual viewing data and furniture layout data to generate a simulation image.

[0979] Input: Virtual viewing data and furniture layout data

[0980] How it works: The server integrates this data and generates a simulation video of what it would be like to actually live there.

[0981] Output: A link to the simulation video is sent to the device and displayed to the user.

[0982] Step 13:

[0983] During the furniture layout simulation, the device analyzes the user's emotions and suggests the optimal furniture layout based on that.

[0984] Input: User emotion data during furniture layout simulation

[0985] Operation: The device sends emotion data to the server, and the server proposes the optimal furniture layout based on the emotion and sends it to the device.

[0986] Output: The proposed furniture layout image is displayed on the terminal and provided to the user.

[0987] (Application example 2)

[0988] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0989] Conventional property search systems make it difficult for users to efficiently search for properties that meet their desired conditions, and in particular, they have problems with low user satisfaction because they do not dynamically adjust according to the user's emotions during virtual viewings or furniture layout simulations.In addition, they lack emotion recognition functionality when providing property information, making it impossible to present optimal property information, resulting in a limited user experience.

[0990] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0991] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation video of what it would be like to actually live in the property, means for recognizing emotions from the user's facial expressions and voice, means for dynamically adjusting the priority of property information based on the recognized emotions, and means for visually adjusting the environment according to the emotions during the virtual viewing. This allows users to efficiently find properties that meet their needs and, by receiving optimal suggestions and environmental adjustments based on their emotions, can achieve a high level of satisfaction.

[0992] The "means for inputting the user's desired conditions" refers to a device or program that allows the user to input the conditions of the property he or she desires (for example, floor plan, budget, location, etc.) via an interface.

[0993] "Means for searching property information and presenting relevant properties in real time" refers to a device or program for searching a database for relevant property information based on the desired conditions entered by the user and displaying the results immediately.

[0994] The "means for automatically arranging a viewing of the property" is a device or program for automatically setting a viewing schedule for the selected property and providing that information to the user.

[0995] "Means for conducting a virtual viewing based on a floor plan" refers to a device or program that generates a 3D model based on the floor plan and related information of a property and provides the model to users as a virtual viewing.

[0996] "Means for generating a furniture arrangement image based on the size and type of furniture entered by the user" refers to a device or program for generating a simulation image of furniture arranged within a property based on the dimensions and type of furniture specified by the user.

[0997] "Means for generating a simulation video of what it would be like to actually live in a property" refers to a device or program for generating a simulation video of what it would be like to actually live in a property based on the property and furniture layout information selected by the user.

[0998] The "means for recognizing emotions from a user's facial expression and voice" refers to a device or program for analyzing a user's facial expression and voice and estimating their emotional state.

[0999] The "means for dynamically adjusting the priority of property information based on recognized emotions" is a device or program for rearranging the display order of property lists to prioritize them according to emotions based on the user's emotional data.

[1000] "Means for visually adjusting the environment according to emotions during a virtual viewing" refers to a device or program that analyzes the user's emotions during a virtual viewing and dynamically changes the lighting, interior color, etc. of the virtual environment according to those emotions.

[1001] The present invention combines a system that allows users to input their desired conditions and search and display property information in real time with an emotion engine. This system includes the following means.

[1002] First, the user inputs desired conditions (e.g., floor plan, budget, location) using a device such as a smartphone. The device then sends this input data to the server. Next, the server searches the property information in the database in real time based on the desired conditions received, and generates a list of matching properties. The generated property list is sent to the device and presented to the user.

[1003] One feature of the present invention is that it uses an emotion engine to recognize a user's emotions. While the user is operating the device, the device analyzes the user's facial expressions and voice and uses the emotion engine to recognize the user's emotional state in real time. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[1004] The server receives this emotion data and dynamically adjusts the priority of property listings based on the recognized emotion. For example, properties for which the user expressed "joy" may be displayed at the top of the list. This allows the server to provide the most suitable property information according to the user's preferences.

[1005] When a user selects a property they like, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The schedule information is also automatically updated on the user's calendar.

[1006] Furthermore, if the user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The user can start the virtual viewing by clicking the link. The system recognizes the user's emotions during the virtual viewing and makes visual adjustments (such as changes to lighting and interior colors) according to those emotions.

[1007] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the floor plan and sends an image of the layout to the device. It also generates a video of what it would be like to actually live in the home based on the simulation results and sends it to the device. The user can click on the video playback link to see the specific living environment.

[1008] This allows users to efficiently search for rooms and understand the specific living environment in advance.In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, making it possible to create a more comfortable living environment.

[1009] Example prompt:

[1010] "A user is looking for a 2LDK property with a budget of less than 150,000 yen in Shibuya Ward, Tokyo. If the emotion engine detects that the user's emotion is "joy," generate a list of properties to display preferentially. Furthermore, provide a virtual viewing for the selected property and simulate furniture placement based on the furniture size."

[1011] To implement this invention, programs such as an emotion engine, a virtual viewing system, and a furniture layout simulation are required, but these are all managed on a cloud-based server, and only the interface portion is provided to the user's terminal.

[1012] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1013] Step 1:

[1014] The user uses a terminal to input desired conditions (for example, floor plan, budget, location). The terminal sends this input data to the server. The input is the user's desired conditions, and the output is the data transfer to the server.

[1015] Step 2:

[1016] The server searches the database for property information in real time based on the received desired conditions. The searched data is property information, and the output is a list of matching properties.

[1017] Step 3:

[1018] The server generates a property list and sends it to the terminal. The list of properties is displayed on the user's terminal. The input is the property list, and the output is the data transmission and display to the terminal.

[1019] Step 4:

[1020] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotional state. The analysis targets the user's facial expressions and voice, and the output is the user's emotional data.

[1021] Step 5:

[1022] The server receives the emotion data and dynamically adjusts the priorities of the property information based on the recognized emotion. The input is the user's emotion data, and the output is the prioritized property list.

[1023] Step 6:

[1024] The server regenerates the adjusted property list and sends it to the terminal, where the property list with the priorities adjusted based on the emotion is displayed. The input is the adjusted property list, and the output is the retransmitted data and display.

[1025] Step 7:

[1026] When the user selects a property they like, the terminal sends the selection information to the server. The input is the user's property selection, and the output is the transfer of the selection data to the server.

[1027] Step 8:

[1028] The server automatically sets up a viewing schedule for the selected property and sends the details to the terminal. Furthermore, the schedule information is automatically reflected in the user's calendar. The input is the property selection information, and the output is the viewing schedule and the calendar update.

[1029] Step 9:

[1030] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a link to the virtual viewing to the device. The input is a request for a virtual viewing, and the output is the generation and transmission of a link to the virtual viewing.

[1031] Step 10:

[1032] The user starts the virtual preview, and the device recognizes the user's emotions during the preview and adjusts the visual environment accordingly. The input is the user's emotional data, and the output is the adjusted visual environment.

[1033] Step 11:

[1034] When a user inputs the size of their existing furniture, the device sends that data to the server. The server then performs a furniture layout simulation based on the floor plan and sends the resulting layout image to the device. The input is furniture size data, and the output is a simulated furniture layout image.

[1035] Step 12:

[1036] The server generates a simulation video of what it would be like to actually live in the home based on the results of the furniture layout simulation and sends the video to the device. When the user clicks on the link to play the video, they can see the actual living environment. The input is furniture layout data, and the output is the simulation video.

[1037] This allows users to efficiently find properties that meet their needs, and also receive optimal suggestions and environmental adjustments based on their emotions.

[1038] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1039] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1040] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1041] [Third embodiment]

[1042] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1043] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1044] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1045] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1046] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1047] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1048] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1049] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1050] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1051] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1052] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1053] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1054] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[1055] Program processing and specific examples

[1056] Input of user's desired conditions

[1057] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal then sends this input data to the server.

[1058] Property information search and presentation

[1059] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[1060] Automatic viewing arrangement

[1061] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. For example, a viewing date for the selected property is automatically set and reflected in the user's calendar.

[1062] Virtual viewing

[1063] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who can click it to begin the virtual viewing. The user can then view the 3D model through the device.

[1064] Generate furniture layout images

[1065] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[1066] Generating a simulation video of what it would be like to live in the property

[1067] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[1068] The present invention allows users to efficiently and effectively search for an apartment and understand the specific living environment in advance. It also accommodates cases where users are moving far away or viewing the property on-site is difficult, greatly improving user convenience.

[1069] The processing flow will be explained below.

[1070] Step 1:

[1071] User enters desired conditions

[1072] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[1073] Step 2:

[1074] The device sends data to the server

[1075] The terminal transmits the collected desired condition data to the server.

[1076] Step 3:

[1077] The server searches for properties

[1078] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[1079] Step 4:

[1080] The server sends the search results to the device

[1081] The server sends the generated property list to the terminal.

[1082] Step 5:

[1083] Your device will display the search results

[1084] The terminal displays the received property list to the user.

[1085] Step 6:

[1086] User selects property

[1087] The user selects the property they like on their device, and the device sends the selection information to the server.

[1088] Step 7:

[1089] The server arranges a viewing

[1090] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[1091] Step 8:

[1092] Viewing arrangements reflected on user calendar

[1093] The device will update the viewing schedule on the user's calendar.

[1094] Step 9:

[1095] User requests a virtual tour

[1096] The user selects the property they wish to virtually view on their device.

[1097] Step 10:

[1098] The device sends a request to the server

[1099] The device sends a virtual viewing request to the server.

[1100] Step 11:

[1101] The server converts the floor plan into a 3D model

[1102] The server generates a 3D model based on the floor plan and related information of the selected property.

[1103] Step 12:

[1104] The server sends a virtual preview link to the device.

[1105] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[1106] Step 13:

[1107] The device will display a virtual preview link

[1108] The device displays a virtual preview link to the user.

[1109] Step 14:

[1110] Users can conduct virtual viewings

[1111] Users click on the link and use their device to conduct a virtual viewing.

[1112] Step 15:

[1113] User inputs furniture size and type

[1114] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[1115] Step 16:

[1116] The device sends data to the server

[1117] The device sends the collected furniture size and type data to a server.

[1118] Step 17:

[1119] The server performs a furniture layout simulation

[1120] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[1121] Step 18:

[1122] The server sends the layout image to the device.

[1123] The server sends the generated layout image to the terminal.

[1124] Step 19:

[1125] The device displays an image of the furniture layout.

[1126] The terminal displays an image of the furniture arrangement to the user.

[1127] Step 20:

[1128] The server generates the simulation video

[1129] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[1130] Step 21:

[1131] The server sends the video data to the terminal

[1132] The server transmits the generated simulation video data to the terminal.

[1133] Step 22:

[1134] The device displays a link to play the video.

[1135] The terminal displays a link to play the simulation video to the user.

[1136] Step 23:

[1137] User checks the simulation video

[1138] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[1139] Example 1

[1140] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1141] Conventional property search systems lacked the means to allow users to obtain desired property information in real time, and to conduct detailed viewings and simulations. This resulted in inefficient property searches and a heavy burden on users. Furthermore, they lacked the functionality to automatically arrange viewings, generate images of furniture layouts, and simulate living environments, making them inconvenient for users who are moving far away or find it difficult to view properties in person.

[1142] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1143] In this invention, the server includes means for inputting the user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, and means for transmitting the generated data to a terminal and displaying it so that the user can visually confirm it. This makes it possible to efficiently and effectively search for property information and conduct detailed viewings and simulations.

[1144] "User" refers to any individual or legal entity that uses the System.

[1145] "Desired conditions" refers to data entered by the user regarding the conditions and requirements for the property they are looking for.

[1146] "Property information" refers to data including information such as the property's location, layout, price, and facilities.

[1147] "Real-time" means that data is processed immediately and results are provided to the user without delay.

[1148] "Arranging a viewing" refers to the process of arranging a date to actually visit and check out the property.

[1149] "Virtual viewing" refers to virtually touring the interior of a property via the Internet.

[1150] A "floor plan" refers to a drawing showing the layout of rooms in a property.

[1151] "Furniture arrangement image" refers to a visual image that simulates the arrangement of furniture within a property based on the size and type of furniture entered by the user.

[1152] "Simulation video" refers to video data that visually recreates the living environment of someone who actually lives in the property.

[1153] "Generated data" refers to data created by the system, including property information, virtual viewing links, furniture layout images, and simulation footage.

[1154] "Terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to operate the system.

[1155] A "server" refers to a group of computers that manages the entire system and performs processing.

[1156] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[1157] First, the user operates the terminal and inputs the desired conditions (e.g., 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo) into the search box. This input data is sent from the terminal to the server. As a concrete example, the prompt sentence "Please search for properties that meet the following criteria: 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" is based on the user's input.

[1158] The server analyzes the received desired conditions and sends a query to the database. This query searches for properties that meet the conditions of "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The search results are generated in list format and sent back to the terminal for display to the user. For example, the property list may be displayed on a GUI, with a link to view detailed information about each property.

[1159] When a user selects a specific property from the list, the device sends that information to the server. The server checks available viewing schedules based on the property information and automatically sets the most suitable date. This information is sent to the device, which adds the date to the user's calendar app. For example, the server can automatically update Google Calendar using a prompt such as "Please automatically schedule a viewing for the selected property."

[1160] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property. This generation process uses 3D modeling software such as Unity. A link to the completed 3D model is sent to the device, and the user can click on this link to start the virtual viewing in a web browser. For example, the prompt message used is, "Please generate a 3D model based on the floor plan of this property."

[1161] When a user inputs the dimensions of their furniture, the device sends that data to the server. The server then uses this data to simulate the placement of the furniture on the property's floor plan. This process uses tools such as Blender and AutoCAD. The simulation results are sent to the device and displayed visually to the user. For example, a prompt might be used: "Please generate an image of a sofa that is 200 cm wide, 100 cm deep, and 90 cm high placed on the floor plan."

[1162] The server integrates the virtual viewing data and furniture layout data to generate a simulation video of what it would be like for the user to live in the property. This video is created using video editing software such as After Effects or Cinema 4D to create a realistic living experience. The completed simulation video is sent to the device, and the user can view it by clicking on the video playback link. As an example, the prompt text used is, "Please generate a simulation video of what it would be like to live in this property."

[1163] This invention allows users to efficiently and effectively find their ideal property and to get a concrete image of their life through detailed viewings and simulations. It also accommodates cases where users are moving far away or viewing in person is difficult, greatly improving user convenience.

[1164] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1165] Step 1:

[1166] The user operates the device to input desired conditions into the search box. Specifically, the user enters "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" into the input field and clicks the search button. This input data is sent from the device to the server. The server receives this data and stores it as desired conditions. Input: Desired conditions data. Output: Storage of desired conditions.

[1167] Step 2:

[1168] The server sends a query to the database based on the desired conditions it has received. Specifically, the server searches the database using the conditions "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The database returns matching property information. Input: Desired conditions data. Output: List of properties in the search results.

[1169] Step 3:

[1170] The server generates a list of properties as search results and sends it back to the terminal. The terminal displays the list it receives on the screen and presents it to the user. Specifically, the property list is displayed on the GUI, and a link is provided to view detailed information about each property. Input: Property list as search results. Output: Property list displayed on the screen.

[1171] Step 4:

[1172] The user selects a specific property from the list. The terminal sends the selected property information to the server. Specifically, when the user clicks on a link, the property ID is sent to the server. The server generates candidate dates for the viewing schedule based on the property information and sends them back to the terminal. Input: Property ID. Output: Candidate dates for the viewing schedule.

[1173] Step 5:

[1174] The server automatically sets the optimal viewing date and sends that information to the device. The device then adds the received viewing date to the user's calendar app. Specifically, the server sets the viewing date as "October 25, 2023, 10:00" and automatically registers it in Google Calendar. Input: Candidate dates for the viewing schedule. Output: Automatic setting of viewing date.

[1175] Step 6:

[1176] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property and sends a virtual viewing link to the device. Specifically, the 3D model is generated using 3D modeling software such as Unity. Input: Virtual viewing request. Output: Virtual viewing link.

[1177] Step 7:

[1178] The user clicks on the virtual viewing link to view the 3D model in a web browser. Specifically, a real-time 3D model using WebGL is displayed in the browser. The user can use the 360-degree view and zoom functions to view the interior of the property. Input: Virtual viewing link. Output: Display of 3D model.

[1179] Step 8:

[1180] The user inputs the size of their furniture. The device sends this data to the server. The server then uses the furniture size data to simulate furniture placement on the property's floor plan. Specifically, the simulation is carried out using tools such as Blender or AutoCAD. Input: Furniture size data. Output: Furniture placement simulation results.

[1181] Step 9:

[1182] The simulation results are sent from the server to the terminal and displayed visually to the user. Specifically, a 3D rendered image of the room is displayed, allowing the user to see at a glance where the furniture is placed. Input: Furniture placement simulation results. Output: Display of a visual placement image.

[1183] Step 10:

[1184] The server combines the virtual viewing data and furniture layout data to generate a simulation video of what it would be like if the user lived in the property. Specifically, video editing software such as After Effects or Cinema 4D is used to create a simulation video that gives a realistic sense of life. Input: Virtual viewing data and furniture layout data. Output: Simulation video.

[1185] Step 11:

[1186] The completed simulation video is sent from the server to the device, and the user can view it by clicking the video playback link. For example, the playback link is displayed on the device screen as an embedded YouTube player, and the user can click to watch it in full screen. Input: Simulation video. Output: Playback of simulation video.

[1187] (Application example 1)

[1188] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1189] Currently, when users search for properties or products that meet their specific requirements, it is not only time-consuming, but also difficult to provide real-time information or perform specific simulations. Furthermore, when on-site viewing is difficult, it is difficult to grasp the details, reducing user convenience. There is a need for a system that solves these issues and allows users to efficiently search for properties and products and form a concrete image.

[1190] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1191] In this invention, the server includes means for inputting user desired conditions, means for presenting search results in real time, means for automatically arranging previews, means for conducting virtual previews, means for generating furniture layout images, means for generating simulation images, means for searching for and presenting products in a virtual store in real time, and means for generating a virtual preview link from product information and sending it to the user's terminal, thereby enabling users to efficiently search for properties and products and get a concrete image of them.

[1192] "User desired conditions" are conditions (for example, location, layout, price, color, size, etc.) that a user specifies for a particular property or product.

[1193] "Property information" refers to detailed data about a specific property (e.g., location, floor plan, price, facilities, etc.).

[1194] "Search" is the process of finding the desired property or product based on the desired conditions entered by the user.

[1195] "Real-time" refers to instantaneous processing and response that occurs at the same time as the present.

[1196] "Presentation" refers to visually displaying search results and information to the user.

[1197] "Viewing arrangements" refers to scheduling a site visit or virtual viewing of a property or product that the user desires.

[1198] "Virtual viewing" is a system that virtually recreates an actual property or store, allowing users to tour the interior online.

[1199] A "floor plan" is a drawing showing the layout and dimensions of rooms inside a property.

[1200] A "furniture layout image" is a visual simulation of what the furniture will look like when it is arranged within a property based on the size and type of furniture specified by the user.

[1201] "Simulation footage" is footage that virtually recreates the conditions under which a property would actually be lived in or used.

[1202] A "virtual store" is a virtual store space built on the Internet where users can search for and purchase products.

[1203] "Product information" is detailed data about a specific product (for example, type, price, specifications, stock status, etc.).

[1204] A "link" is a hypertext link that directs a user to a particular web page or resource.

[1205] A "terminal" is a device (e.g., smartphone, tablet, computer) that a user uses to enter or view information.

[1206] This invention is a system that allows a user to input desired conditions and search for and display information on properties and products in real time. Specific embodiments of this system will be described below.

[1207] Program processing overview

[1208] Input of user's desired conditions

[1209] The user inputs their desired conditions (e.g., furniture color, size, price range, etc.) using smart glasses or a smartphone. This input data is sent from the device to the server.

[1210] Searching and presenting property and product information

[1211] The server searches the database in real time based on the received criteria. The searched information is compiled into a list and sent to the terminal. The terminal then displays a list of properties and products that match the user's criteria.

[1212] Automatic viewing arrangements and virtual viewings

[1213] When a user selects a specific property or product, the information is sent to the server and a viewing schedule is automatically set up. If the user requests a virtual viewing, a 3D model is generated based on the floor plan and product details, and a link is sent to the user's device.

[1214] Furniture layout image generation and simulation

[1215] When a user inputs the size and type of furniture they have, the data is sent to the server and a furniture layout simulation is performed. The simulation results are sent to the device and displayed as a concrete image. In addition, the furniture layout data and viewing data are integrated to generate and send a simulation video of what it would be like to actually live in the property.

[1216] Hardware and software used

[1217] Hardware: smart glasses, smartphones, tablets, computers

[1218] Software: Python, requests library, json library

[1219] Database: MySQL or PostgreSQL

[1220] Specific examples

[1221] When a user searches for "a blue, two-meter-wide sofa" using the smart glasses, the search criteria are sent to the server, and matching sofa information is retrieved in real time from the database. The retrieved information is displayed as a list on the smart glasses, and the user can click a virtual preview link to view the 3D model.

[1222] Prompt Sentence Examples

[1223] "Please enter your desired furniture criteria (e.g. color, size, price range, etc.)"

[1224] This embodiment allows users to efficiently search for properties and products and get a concrete image of them, and in particular makes it easy to check the details through virtual viewings.

[1225] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1226] Step 1:

[1227] The user enters the desired conditions

[1228] Input: The user uses smart glasses or a smartphone to input desired criteria (e.g., furniture color, size, price range, etc.) in natural language.

[1229] Data processing: The terminal converts the entered conditions into JSON format and prepares to send it as an API request.

[1230] Output: The desired conditions data in JSON format is sent to the server.

[1231] Step 2:

[1232] Real-time search processing is performed on the server

[1233] Input: The server receives the user's desired conditions.

[1234] Data processing: Query the database based on your desired conditions and search for properties and products that fit your needs.

[1235] Output: A list of relevant property and product information is generated and sent to the terminal in JSON format.

[1236] Step 3:

[1237] View search results on your device

[1238] Input: Receives a list of property and product information in JSON format sent from the server.

[1239] Data processing: Converts received information into a format that is easy for the user to understand and displays it.

[1240] Output: The user views a list of properties and products on their device.

[1241] Step 4:

[1242] The user selects a specific property or product

[1243] Input: The user selects a particular property or product from a list.

[1244] Output: Information about the selected property or product is sent to the server.

[1245] Step 5:

[1246] Automatic viewing arrangement and virtual viewing link generation

[1247] Input: The server receives information about the property or product selected by the user.

[1248] Data processing: The server automatically schedules viewings and generates 3D models based on floor plans and detailed product information.

[1249] Output: Viewing schedule details and a virtual viewing link will be generated and sent to your device.

[1250] Step 6:

[1251] Viewing schedule and virtual viewing link on your device

[1252] Input: Receives the preview schedule and virtual preview link sent from the server.

[1253] Data processing: The received information is displayed in a format that is easy for the user to understand.

[1254] Output: User checks the viewing schedule and clicks the virtual viewing link to view the 3D model.

[1255] Step 7:

[1256] The user inputs the size and type of furniture

[1257] Input: The user inputs the size and type of furniture they have through the terminal.

[1258] Data processing: The terminal converts the input furniture data into JSON format and sends it to the server.

[1259] Output: Furniture data in JSON format is sent to the server.

[1260] Step 8:

[1261] Running a furniture layout simulation

[1262] Input: The server receives furniture sizes and types, and a floor plan of the property.

[1263] Data processing: The server runs a furniture layout simulation based on this data and generates the results.

[1264] Output: The results of the placement simulation are sent to the terminal.

[1265] Step 9:

[1266] Generating simulation images of homes

[1267] Input: The server receives virtual viewing data and furniture layout data.

[1268] Data processing: The server integrates this information and generates a simulation image of what it would be like to actually live there.

[1269] Output: The simulation video is sent to the device and a link is provided for the user to view.

[1270] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1271] This invention combines a system that searches for and displays property information in real time after a user inputs their desired conditions with an emotion engine. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on furniture sizes input by the user, and generates simulation images of what it would be like to actually live in the property. Furthermore, it provides a function that recognizes the user's emotions and dynamically adjusts property information and settings based on those emotions.

[1272] Program processing and specific examples

[1273] Input of user's desired conditions

[1274] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal sends this input data to the server.

[1275] Property information search and presentation

[1276] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[1277] Emotion recognition by emotion engine

[1278] The device analyzes the user's facial expressions and voice, and uses an emotion engine to recognize the user's emotions. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[1279] Prioritizing property listings based on emotions

[1280] The server receives the user's emotion data and re-prioritizes the property listings based on the recognized emotion, for example, displaying properties for which the user expressed "joy" at the top of the list.

[1281] Automatic viewing arrangement

[1282] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The viewing date for the selected property is automatically set and reflected in the user's calendar.

[1283] Virtual viewing and emotional regulation

[1284] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who clicks to begin the virtual viewing. The device recognizes the user's emotions during the virtual viewing and adjusts the display content accordingly. For example, if the user feels anxious, the emotion engine will change the lighting and interior colors.

[1285] Generate furniture layout images

[1286] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[1287] Simulation video generation

[1288] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[1289] Generating furniture arrangement images according to emotions

[1290] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. Based on this emotion data, the server proposes an optimal furniture arrangement and provides it to the user. For example, if the emotion "relaxed" is recognized, the server will propose a relaxing arrangement.

[1291] This invention allows users to search for rooms efficiently and effectively and understand the specific living environment in advance. In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, thereby realizing a more comfortable living environment.

[1292] The processing flow will be explained below.

[1293] Step 1:

[1294] User enters desired conditions

[1295] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[1296] Step 2:

[1297] The device sends data to the server

[1298] The terminal transmits the collected desired condition data to the server.

[1299] Step 3:

[1300] The server searches for properties

[1301] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[1302] Step 4:

[1303] The server sends the search results to the device

[1304] The server sends the generated property list to the terminal.

[1305] Step 5:

[1306] Your device will display the search results

[1307] The terminal displays the received property list to the user.

[1308] Step 6:

[1309] Emotion recognition by emotion engine

[1310] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotions.

[1311] Step 7:

[1312] The server receives the emotion data.

[1313] The server receives the user's emotion data and re-prioritizes the property information based on the recognized emotion.

[1314] Step 8:

[1315] The server sends the re-prioritized property list to the terminal.

[1316] The server sends the re-adjusted property list to the terminal.

[1317] Step 9:

[1318] Display the property list with your device recalibrated

[1319] The terminal displays the re-arranged property listings to the user.

[1320] Step 10:

[1321] User selects property

[1322] The user selects the property they like on their device, and the device sends the selection information to the server.

[1323] Step 11:

[1324] The server arranges a viewing

[1325] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[1326] Step 12:

[1327] The device updates the viewing schedule to the user's calendar

[1328] The device will update the viewing schedule on the user's calendar.

[1329] Step 13:

[1330] User requests a virtual tour

[1331] The user selects the property they wish to virtually view on their device.

[1332] Step 14:

[1333] The device sends a request to the server

[1334] The device sends a virtual viewing request to the server.

[1335] Step 15:

[1336] The server converts the floor plan into a 3D model

[1337] The server generates a 3D model based on the floor plan and related information of the selected property.

[1338] Step 16:

[1339] The server sends a virtual preview link to the device.

[1340] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[1341] Step 17:

[1342] The device will display a virtual preview link

[1343] The device displays a virtual preview link to the user.

[1344] Step 18:

[1345] Users can conduct virtual viewings

[1346] Users click on the link and use their device to conduct a virtual viewing.

[1347] Step 19:

[1348] Emotion recognition during virtual viewing

[1349] The terminal recognizes the user's emotions during the virtual preview and transmits the emotion data to the server.

[1350] Step 20:

[1351] The server adjusts the virtual viewing content

[1352] The server adjusts the virtual viewing environment (lighting, interior color, etc.) based on the user's emotional data and sends the results to the terminal.

[1353] Step 21:

[1354] User inputs furniture size and type

[1355] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[1356] Step 22:

[1357] The device sends data to the server

[1358] The device sends the collected furniture size and type data to a server.

[1359] Step 23:

[1360] The server performs a furniture layout simulation

[1361] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[1362] Step 24:

[1363] The server sends the furniture layout image to the terminal.

[1364] The server sends the furniture layout image it has created to the terminal.

[1365] Step 25:

[1366] The device displays an image of the furniture layout.

[1367] The terminal displays an image of the furniture arrangement to the user.

[1368] Step 26:

[1369] Emotion recognition during furniture layout simulation

[1370] The terminal analyzes the user's emotions during the furniture placement simulation and transmits the emotion data to the server.

[1371] Step 27:

[1372] The server suggests furniture arrangements based on emotions

[1373] The server proposes optimal furniture layout based on the emotional data and sends the results to the device.

[1374] Step 28:

[1375] The device displays furniture layout images based on emotions

[1376] The terminal displays to the user an image of furniture arrangement according to the user's emotions.

[1377] Step 29:

[1378] The server generates the simulation video

[1379] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[1380] Step 30:

[1381] The server sends the video data to the terminal

[1382] The server transmits the generated simulation video data to the terminal.

[1383] Step 31:

[1384] The device displays a link to play the video.

[1385] The terminal displays a link to play the simulation video to the user.

[1386] Step 32:

[1387] User checks the simulation video

[1388] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[1389] Example 2

[1390] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1391] Existing property search systems present property information without considering the user's emotions, making it difficult for users to efficiently find the property they truly desire. Furthermore, functions such as virtual viewings and furniture layout simulations are limited, making it difficult for users to visualize what it would be like to actually live in the property. Furthermore, they lack the functionality to automatically arrange viewings or adjust the environment based on the user's emotions during a virtual viewing. Technology that solves these issues is needed.

[1392] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1393] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, means for recognizing the user's emotions, means for preferentially presenting property information based on the recognized emotions, and means for analyzing the user's emotions during the virtual viewing and adjusting the display content. This makes it possible to present property information that takes the user's emotions into consideration and to provide a detailed experience in viewings, furniture layout, and simulations.

[1394] "User desired conditions" are conditions that a user inputs when searching for a specific property, and include information such as floor plan, budget, and area.

[1395] "Property information" refers to detailed data about a property, including, for example, information such as the layout, price, location, and age of the property.

[1396] "Arranging a viewing" is the procedure of setting up a schedule to actually visit the property and check the interior.

[1397] A floor plan is a drawing that shows the layout of rooms and facilities inside a property.

[1398] "Virtual viewing" is the act of visually experiencing the interior of a property online using virtual reality or 3D models.

[1399] A "furniture layout image" is a visual image that shows how furniture will be arranged within the property based on the size and type of furniture entered by the user.

[1400] A "simulation video" is a video that virtually recreates the living environment of someone who actually lives in a property.

[1401] "Means for recognizing emotions" refers to technology that analyzes a user's facial expressions and voice to detect emotions such as joy, sadness, and surprise.

[1402] The "means for preferentially presenting property information" is a method for adjusting the display order of property information based on the user's perceived emotions.

[1403] "Means for adjusting the displayed content" refers to technology that dynamically changes the displayed content, such as lighting and interior color, depending on the user's emotions during the virtual preview.

[1404] The present invention is a system that inputs a user's desired conditions, searches and displays property information in real time, and dynamically adjusts property information and settings based on the user's emotions. The system includes the following functions:

[1405] Input of user's desired conditions

[1406] The user inputs desired conditions using a device (such as a PC or smartphone). For example, they specify conditions such as "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo." The device then sends this input data to a server. The hardware used is a general-purpose computer or mobile device, and the software used is a dedicated application or web interface.

[1407] Property information search and presentation

[1408] The server searches the database for property information in real time based on the received user's desired conditions. It generates a list of relevant properties and sends it to the terminal. The terminal displays the property list to the user. The server can use a high-performance database management system (e.g., MySQL, PostgreSQL).

[1409] Emotion recognition by emotion engine

[1410] The device uses a built-in camera and microphone to analyze changes in the user's facial expressions and voice, and the emotion engine recognizes the user's emotions. The emotion engine can use advanced recognition systems such as the "AI Passion Engine." For example, if a user smiles while looking at a property listing, the emotion engine will recognize "joy."

[1411] Prioritizing property listings based on emotions

[1412] The server receives the emotion data from the device and adjusts the display order of the property information based on that emotion data. For example, properties for which the user expressed "joy" would be displayed at the top of the list.

[1413] Automatic viewing arrangement

[1414] When a user selects a property they like and requests a viewing, the device sends the request to the server. The server automatically schedules the viewing and sends the details to the device, which then updates the user's calendar with the viewing date.

[1415] Virtual viewing and emotional regulation

[1416] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related data, and sends a virtual viewing link to the device. During the virtual viewing, the device analyzes the user's emotions and adjusts the display content. For example, if the user feels anxious, the display content will be changed to help them relax.

[1417] Generate furniture layout images

[1418] When the user inputs the size of the furniture (e.g., a sofa 200cm wide x 90cm high), the device sends this data to the server. The server performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[1419] Simulation video generation

[1420] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. This video data is sent to the device, which then displays a link to the simulation video to the user. When the user clicks the link, the simulation video begins to play.

[1421] Generating furniture arrangement images according to emotions

[1422] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. The server then proposes an optimal furniture arrangement based on the emotions and sends the result to the device. For example, if the emotion "relaxed" is recognized, a relaxing arrangement will be proposed.

[1423] Prompt Sentence Examples

[1424] 1. "I'm looking for a 2LDK apartment in Tokyo. Can I find one for under 150,000 yen?"

[1425] 2. "These are the dimensions of a sofa. Please simulate a layout that is 200cm wide, 90cm high, and 100cm deep."

[1426] 3. "I'd like to see this property. Please let me know the specific date."

[1427] 4. "I'd like to start a virtual tour. Please provide the link."

[1428] This system allows users to search for properties efficiently and effectively, and allows them to understand the specific living environment in advance. It also constantly monitors the user's emotions and provides optimal property information and furniture arrangements accordingly, creating a more comfortable living environment.

[1429] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1430] Step 1:

[1431] The user operates the terminal and inputs the desired conditions.

[1432] Input: Floor plan (e.g., 2LDK), Budget (e.g., under 150,000 yen), Area (e.g., Shibuya-ku, Tokyo)

[1433] Operation: The terminal obtains the above conditions from the input form displayed on the screen, formats the data, and sends it to the server.

[1434] Output: The server receives the user's desired conditions.

[1435] Step 2:

[1436] The server searches for property information based on the desired conditions received.

[1437] Input: User's desired conditions (2LDK, under 150,000 yen, Shibuya-ku, Tokyo)

[1438] How it works: The server executes a database query to find matching properties in real time.

[1439] Output: The server generates a list of properties and sends it to the terminal.

[1440] Step 3:

[1441] The terminal displays the property listing to the user.

[1442] Input: Property list sent from the server

[1443] Action: The device displays the property listing on the user interface. The user views the listing.

[1444] Output: User reviews property listing and decides next action.

[1445] Step 4:

[1446] The device analyzes the user's facial expressions and voice, and the emotion engine recognizes the user's emotions.

[1447] Input: User's facial expression video data and voice data

[1448] How it works: The device's camera and microphone capture the user's face and voice, which the emotion engine analyzes to recognize the user's emotions.

[1449] Output: The device sends the recognized emotion data to the server.

[1450] Step 5:

[1451] The server readjusts the priority of property information based on the emotion data.

[1452] Input: Recognized user emotion data

[1453] How it works: The server uses emotion data to prioritize the property list, for example, placing properties that the user expresses joy about at the top of the list.

[1454] Output: Send the rebalanced property list to the device.

[1455] Step 6:

[1456] The terminal displays the recalibrated property listing to the user.

[1457] Input: Rebalanced property list sent from the server

[1458] Action: The terminal redisplays the new property listing on the user interface.

[1459] Output: User confirms the rebalanced property list.

[1460] Step 7:

[1461] The user selects a property they like and requests a viewing.

[1462] Input: Property information selected by the user and a request for a viewing

[1463] Operation: The terminal sends the user's selection information to the server.

[1464] Output: The server receives a request to schedule a preview.

[1465] Step 8:

[1466] The server automatically sets up a viewing schedule and sends the details to the terminal.

[1467] Input: User's viewing request

[1468] How it works: The server checks the availability schedule for the property, schedules an appropriate viewing date, and sends the details to the device.

[1469] Output: The preview schedule details are sent to the device and reflected in the user's calendar.

[1470] Step 9:

[1471] The user requests a virtual tour.

[1472] Input: User's virtual viewing request

[1473] How it works: The device sends a request to the server, which generates a 3D model and sends a link to it to the device.

[1474] Output: A virtual preview link is sent to the device and displayed to the user.

[1475] Step 10:

[1476] The device analyzes the user's emotions during the virtual viewing and adjusts the displayed content.

[1477] Input: facial expression video data and audio data of the user during the virtual viewing

[1478] How it works: The device's camera and microphone capture images in real time, which are then analyzed by the emotion engine. The lighting and interior color are then changed according to the emotion.

[1479] Output: The adjusted virtual preview display is provided to the user.

[1480] Step 11:

[1481] The user inputs the size of the furniture they have.

[1482] Input: Furniture size data such as width, depth, and height

[1483] Operation: The device sends input data to the server, which then performs a furniture layout simulation based on the furniture data and floor plan.

[1484] Output: The simulation results are sent to the terminal and displayed to the user.

[1485] Step 12:

[1486] The server integrates the virtual viewing data and furniture layout data to generate a simulation image.

[1487] Input: Virtual viewing data and furniture layout data

[1488] How it works: The server integrates this data and generates a simulation video of what it would be like to actually live there.

[1489] Output: A link to the simulation video is sent to the device and displayed to the user.

[1490] Step 13:

[1491] During the furniture layout simulation, the device analyzes the user's emotions and suggests the optimal furniture layout based on that.

[1492] Input: User emotion data during furniture layout simulation

[1493] Operation: The device sends emotion data to the server, and the server proposes the optimal furniture layout based on the emotion and sends it to the device.

[1494] Output: The proposed furniture layout image is displayed on the terminal and provided to the user.

[1495] (Application example 2)

[1496] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1497] Conventional property search systems make it difficult for users to efficiently search for properties that meet their desired conditions, and in particular, they have problems with low user satisfaction because they do not dynamically adjust according to the user's emotions during virtual viewings or furniture layout simulations.In addition, they lack emotion recognition functionality when providing property information, making it impossible to present optimal property information, resulting in a limited user experience.

[1498] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1499] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation video of what it would be like to actually live in the property, means for recognizing emotions from the user's facial expressions and voice, means for dynamically adjusting the priority of property information based on the recognized emotions, and means for visually adjusting the environment according to the emotions during the virtual viewing. This allows users to efficiently find properties that meet their needs and, by receiving optimal suggestions and environmental adjustments based on their emotions, can achieve a high level of satisfaction.

[1500] The "means for inputting the user's desired conditions" refers to a device or program that allows the user to input the conditions of the property he or she desires (for example, floor plan, budget, location, etc.) via an interface.

[1501] "Means for searching property information and presenting relevant properties in real time" refers to a device or program for searching a database for relevant property information based on the desired conditions entered by the user and displaying the results immediately.

[1502] The "means for automatically arranging a viewing of the property" is a device or program for automatically setting a viewing schedule for the selected property and providing that information to the user.

[1503] "Means for conducting a virtual viewing based on a floor plan" refers to a device or program that generates a 3D model based on the floor plan and related information of a property and provides the model to users as a virtual viewing.

[1504] "Means for generating a furniture arrangement image based on the size and type of furniture entered by the user" refers to a device or program for generating a simulation image of furniture arranged within a property based on the dimensions and type of furniture specified by the user.

[1505] "Means for generating a simulation video of what it would be like to actually live in a property" refers to a device or program for generating a simulation video of what it would be like to actually live in a property based on the property and furniture layout information selected by the user.

[1506] The "means for recognizing emotions from a user's facial expression and voice" refers to a device or program for analyzing a user's facial expression and voice and estimating their emotional state.

[1507] The "means for dynamically adjusting the priority of property information based on recognized emotions" is a device or program for rearranging the display order of property lists to prioritize them according to emotions based on the user's emotional data.

[1508] "Means for visually adjusting the environment according to emotions during a virtual viewing" refers to a device or program that analyzes the user's emotions during a virtual viewing and dynamically changes the lighting, interior color, etc. of the virtual environment according to those emotions.

[1509] The present invention combines a system that allows users to input their desired conditions and search and display property information in real time with an emotion engine. This system includes the following means.

[1510] First, the user inputs desired conditions (e.g., floor plan, budget, location) using a device such as a smartphone. The device then sends this input data to the server. Next, the server searches the property information in the database in real time based on the desired conditions received, and generates a list of matching properties. The generated property list is sent to the device and presented to the user.

[1511] One feature of the present invention is that it uses an emotion engine to recognize a user's emotions. While the user is operating the device, the device analyzes the user's facial expressions and voice and uses the emotion engine to recognize the user's emotional state in real time. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[1512] The server receives this emotion data and dynamically adjusts the priority of property listings based on the recognized emotion. For example, properties for which the user expressed "joy" may be displayed at the top of the list. This allows the server to provide the most suitable property information according to the user's preferences.

[1513] When a user selects a property they like, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The schedule information is also automatically updated on the user's calendar.

[1514] Furthermore, if the user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The user can start the virtual viewing by clicking the link. The system recognizes the user's emotions during the virtual viewing and makes visual adjustments (such as changes to lighting and interior colors) according to those emotions.

[1515] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the floor plan and sends an image of the layout to the device. It also generates a video of what it would be like to actually live in the home based on the simulation results and sends it to the device. The user can click on the video playback link to see the specific living environment.

[1516] This allows users to efficiently search for rooms and understand the specific living environment in advance.In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, making it possible to create a more comfortable living environment.

[1517] Example prompt:

[1518] "A user is looking for a 2LDK property with a budget of less than 150,000 yen in Shibuya Ward, Tokyo. If the emotion engine detects that the user's emotion is "joy," generate a list of properties to display preferentially. Furthermore, provide a virtual viewing for the selected property and simulate furniture placement based on the furniture size."

[1519] To implement this invention, programs such as an emotion engine, a virtual viewing system, and a furniture layout simulation are required, but these are all managed on a cloud-based server, and only the interface portion is provided to the user's terminal.

[1520] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1521] Step 1:

[1522] The user uses a terminal to input desired conditions (for example, floor plan, budget, location). The terminal sends this input data to the server. The input is the user's desired conditions, and the output is the data transfer to the server.

[1523] Step 2:

[1524] The server searches the database for property information in real time based on the received desired conditions. The searched data is property information, and the output is a list of matching properties.

[1525] Step 3:

[1526] The server generates a property list and sends it to the terminal. The list of properties is displayed on the user's terminal. The input is the property list, and the output is the data transmission and display to the terminal.

[1527] Step 4:

[1528] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotional state. The analysis targets the user's facial expressions and voice, and the output is the user's emotional data.

[1529] Step 5:

[1530] The server receives the emotion data and dynamically adjusts the priorities of the property information based on the recognized emotion. The input is the user's emotion data, and the output is the prioritized property list.

[1531] Step 6:

[1532] The server regenerates the adjusted property list and sends it to the terminal, where the property list with the priorities adjusted based on the emotion is displayed. The input is the adjusted property list, and the output is the retransmitted data and display.

[1533] Step 7:

[1534] When the user selects a property they like, the terminal sends the selection information to the server. The input is the user's property selection, and the output is the transfer of the selection data to the server.

[1535] Step 8:

[1536] The server automatically sets up a viewing schedule for the selected property and sends the details to the terminal. Furthermore, the schedule information is automatically reflected in the user's calendar. The input is the property selection information, and the output is the viewing schedule and the calendar update.

[1537] Step 9:

[1538] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a link to the virtual viewing to the device. The input is a request for a virtual viewing, and the output is the generation and transmission of a link to the virtual viewing.

[1539] Step 10:

[1540] The user starts the virtual preview, and the device recognizes the user's emotions during the preview and adjusts the visual environment accordingly. The input is the user's emotional data, and the output is the adjusted visual environment.

[1541] Step 11:

[1542] When a user inputs the size of their existing furniture, the device sends that data to the server. The server then performs a furniture layout simulation based on the floor plan and sends the resulting layout image to the device. The input is furniture size data, and the output is a simulated furniture layout image.

[1543] Step 12:

[1544] The server generates a simulation video of what it would be like to actually live in the home based on the results of the furniture layout simulation and sends the video to the device. When the user clicks on the link to play the video, they can see the actual living environment. The input is furniture layout data, and the output is the simulation video.

[1545] This allows users to efficiently find properties that meet their needs, and also receive optimal suggestions and environmental adjustments based on their emotions.

[1546] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1547] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1548] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1549] [Fourth embodiment]

[1550] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1551] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1552] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1553] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1554] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1555] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1556] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1557] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1558] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1559] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1560] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1561] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1562] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1563] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[1564] Program processing and specific examples

[1565] Input of user's desired conditions

[1566] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal then sends this input data to the server.

[1567] Property information search and presentation

[1568] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[1569] Automatic viewing arrangement

[1570] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. For example, a viewing date for the selected property is automatically set and reflected in the user's calendar.

[1571] Virtual viewing

[1572] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who can click it to begin the virtual viewing. The user can then view the 3D model through the device.

[1573] Generate furniture layout images

[1574] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[1575] Generating a simulation video of what it would be like to live in the property

[1576] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[1577] The present invention allows users to efficiently and effectively search for an apartment and understand the specific living environment in advance. It also accommodates cases where users are moving far away or viewing the property on-site is difficult, greatly improving user convenience.

[1578] The processing flow will be explained below.

[1579] Step 1:

[1580] User enters desired conditions

[1581] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[1582] Step 2:

[1583] The device sends data to the server

[1584] The terminal transmits the collected desired condition data to the server.

[1585] Step 3:

[1586] The server searches for properties

[1587] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[1588] Step 4:

[1589] The server sends the search results to the device

[1590] The server sends the generated property list to the terminal.

[1591] Step 5:

[1592] Your device will display the search results

[1593] The terminal displays the received property list to the user.

[1594] Step 6:

[1595] User selects property

[1596] The user selects the property they like on their device, and the device sends the selection information to the server.

[1597] Step 7:

[1598] The server arranges a viewing

[1599] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[1600] Step 8:

[1601] Viewing arrangements reflected on user calendar

[1602] The device will update the viewing schedule on the user's calendar.

[1603] Step 9:

[1604] User requests a virtual tour

[1605] The user selects the property they wish to virtually view on their device.

[1606] Step 10:

[1607] The device sends a request to the server

[1608] The device sends a virtual viewing request to the server.

[1609] Step 11:

[1610] The server converts the floor plan into a 3D model

[1611] The server generates a 3D model based on the floor plan and related information of the selected property.

[1612] Step 12:

[1613] The server sends a virtual preview link to the device.

[1614] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[1615] Step 13:

[1616] The device will display a virtual preview link

[1617] The device displays a virtual preview link to the user.

[1618] Step 14:

[1619] Users can conduct virtual viewings

[1620] Users click on the link and use their device to conduct a virtual viewing.

[1621] Step 15:

[1622] User inputs furniture size and type

[1623] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[1624] Step 16:

[1625] The device sends data to the server

[1626] The device sends the collected furniture size and type data to a server.

[1627] Step 17:

[1628] The server performs a furniture layout simulation

[1629] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[1630] Step 18:

[1631] The server sends the layout image to the device.

[1632] The server sends the generated layout image to the terminal.

[1633] Step 19:

[1634] The device displays an image of the furniture layout.

[1635] The terminal displays an image of the furniture arrangement to the user.

[1636] Step 20:

[1637] The server generates the simulation video

[1638] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[1639] Step 21:

[1640] The server sends the video data to the terminal

[1641] The server transmits the generated simulation video data to the terminal.

[1642] Step 22:

[1643] The device displays a link to play the video.

[1644] The terminal displays a link to play the simulation video to the user.

[1645] Step 23:

[1646] User checks the simulation video

[1647] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[1648] Example 1

[1649] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1650] Conventional property search systems lacked the means to allow users to obtain desired property information in real time, and to conduct detailed viewings and simulations. This resulted in inefficient property searches and a heavy burden on users. Furthermore, they lacked the functionality to automatically arrange viewings, generate images of furniture layouts, and simulate living environments, making them inconvenient for users who are moving far away or find it difficult to view properties in person.

[1651] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1652] In this invention, the server includes means for inputting the user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, and means for transmitting the generated data to a terminal and displaying it so that the user can visually confirm it. This makes it possible to efficiently and effectively search for property information and conduct detailed viewings and simulations.

[1653] "User" refers to any individual or legal entity that uses the System.

[1654] "Desired conditions" refers to data entered by the user regarding the conditions and requirements for the property they are looking for.

[1655] "Property information" refers to data including information such as the property's location, layout, price, and facilities.

[1656] "Real-time" means that data is processed immediately and results are provided to the user without delay.

[1657] "Arranging a viewing" refers to the process of arranging a date to actually visit and check out the property.

[1658] "Virtual viewing" refers to virtually touring the interior of a property via the Internet.

[1659] A "floor plan" refers to a drawing showing the layout of rooms in a property.

[1660] "Furniture arrangement image" refers to a visual image that simulates the arrangement of furniture within a property based on the size and type of furniture entered by the user.

[1661] "Simulation video" refers to video data that visually recreates the living environment of someone who actually lives in the property.

[1662] "Generated data" refers to data created by the system, including property information, virtual viewing links, furniture layout images, and simulation footage.

[1663] "Terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to operate the system.

[1664] A "server" refers to a group of computers that manages the entire system and performs processing.

[1665] This system searches for and displays property information in real time based on the user's desired conditions. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on the furniture sizes entered by the user, and generates a simulation video of what it would be like to actually live in the property.

[1666] First, the user operates the terminal and inputs the desired conditions (e.g., 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo) into the search box. This input data is sent from the terminal to the server. As a concrete example, the prompt sentence "Please search for properties that meet the following criteria: 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" is based on the user's input.

[1667] The server analyzes the received desired conditions and sends a query to the database. This query searches for properties that meet the conditions of "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The search results are generated in list format and sent back to the terminal for display to the user. For example, the property list may be displayed on a GUI, with a link to view detailed information about each property.

[1668] When a user selects a specific property from the list, the device sends that information to the server. The server checks available viewing schedules based on the property information and automatically sets the most suitable date. This information is sent to the device, which adds the date to the user's calendar app. For example, the server can automatically update Google Calendar using a prompt such as "Please automatically schedule a viewing for the selected property."

[1669] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property. This generation process uses 3D modeling software such as Unity. A link to the completed 3D model is sent to the device, and the user can click on this link to start the virtual viewing in a web browser. For example, the prompt message used is, "Please generate a 3D model based on the floor plan of this property."

[1670] When a user inputs the dimensions of their furniture, the device sends that data to the server. The server then uses this data to simulate the placement of the furniture on the property's floor plan. This process uses tools such as Blender and AutoCAD. The simulation results are sent to the device and displayed visually to the user. For example, a prompt might be used: "Please generate an image of a sofa that is 200 cm wide, 100 cm deep, and 90 cm high placed on the floor plan."

[1671] The server integrates the virtual viewing data and furniture layout data to generate a simulation video of what it would be like for the user to live in the property. This video is created using video editing software such as After Effects or Cinema 4D to create a realistic living experience. The completed simulation video is sent to the device, and the user can view it by clicking on the video playback link. As an example, the prompt text used is, "Please generate a simulation video of what it would be like to live in this property."

[1672] This invention allows users to efficiently and effectively find their ideal property and to get a concrete image of their life through detailed viewings and simulations. It also accommodates cases where users are moving far away or viewing in person is difficult, greatly improving user convenience.

[1673] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1674] Step 1:

[1675] The user operates the device to input desired conditions into the search box. Specifically, the user enters "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" into the input field and clicks the search button. This input data is sent from the device to the server. The server receives this data and stores it as desired conditions. Input: Desired conditions data. Output: Storage of desired conditions.

[1676] Step 2:

[1677] The server sends a query to the database based on the desired conditions it has received. Specifically, the server searches the database using the conditions "Tokyo," "Shibuya Ward," "2LDK," and "budget under 150,000 yen." The database returns matching property information. Input: Desired conditions data. Output: List of properties in the search results.

[1678] Step 3:

[1679] The server generates a list of properties as search results and sends it back to the terminal. The terminal displays the list it receives on the screen and presents it to the user. Specifically, the property list is displayed on the GUI, and a link is provided to view detailed information about each property. Input: Property list as search results. Output: Property list displayed on the screen.

[1680] Step 4:

[1681] The user selects a specific property from the list. The terminal sends the selected property information to the server. Specifically, when the user clicks on a link, the property ID is sent to the server. The server generates candidate dates for the viewing schedule based on the property information and sends them back to the terminal. Input: Property ID. Output: Candidate dates for the viewing schedule.

[1682] Step 5:

[1683] The server automatically sets the optimal viewing date and sends that information to the device. The device then adds the received viewing date to the user's calendar app. Specifically, the server sets the viewing date as "October 25, 2023, 10:00" and automatically registers it in Google Calendar. Input: Candidate dates for the viewing schedule. Output: Automatic setting of viewing date.

[1684] Step 6:

[1685] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan of the property and sends a virtual viewing link to the device. Specifically, the 3D model is generated using 3D modeling software such as Unity. Input: Virtual viewing request. Output: Virtual viewing link.

[1686] Step 7:

[1687] The user clicks on the virtual viewing link to view the 3D model in a web browser. Specifically, a real-time 3D model using WebGL is displayed in the browser. The user can use the 360-degree view and zoom functions to view the interior of the property. Input: Virtual viewing link. Output: Display of 3D model.

[1688] Step 8:

[1689] The user inputs the size of their furniture. The device sends this data to the server. The server then uses the furniture size data to simulate furniture placement on the property's floor plan. Specifically, the simulation is carried out using tools such as Blender or AutoCAD. Input: Furniture size data. Output: Furniture placement simulation results.

[1690] Step 9:

[1691] The simulation results are sent from the server to the terminal and displayed visually to the user. Specifically, a 3D rendered image of the room is displayed, allowing the user to see at a glance where the furniture is placed. Input: Furniture placement simulation results. Output: Display of a visual placement image.

[1692] Step 10:

[1693] The server combines the virtual viewing data and furniture layout data to generate a simulation video of what it would be like if the user lived in the property. Specifically, video editing software such as After Effects or Cinema 4D is used to create a simulation video that gives a realistic sense of life. Input: Virtual viewing data and furniture layout data. Output: Simulation video.

[1694] Step 11:

[1695] The completed simulation video is sent from the server to the device, and the user can view it by clicking the video playback link. For example, the playback link is displayed on the device screen as an embedded YouTube player, and the user can click to watch it in full screen. Input: Simulation video. Output: Playback of simulation video.

[1696] (Application example 1)

[1697] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1698] Currently, when users search for properties or products that meet their specific requirements, it is not only time-consuming, but also difficult to provide real-time information or perform specific simulations. Furthermore, when on-site viewing is difficult, it is difficult to grasp the details, reducing user convenience. There is a need for a system that solves these issues and allows users to efficiently search for properties and products and form a concrete image.

[1699] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1700] In this invention, the server includes means for inputting user desired conditions, means for presenting search results in real time, means for automatically arranging previews, means for conducting virtual previews, means for generating furniture layout images, means for generating simulation images, means for searching for and presenting products in a virtual store in real time, and means for generating a virtual preview link from product information and sending it to the user's terminal, thereby enabling users to efficiently search for properties and products and get a concrete image of them.

[1701] "User desired conditions" are conditions (for example, location, layout, price, color, size, etc.) that a user specifies for a particular property or product.

[1702] "Property information" refers to detailed data about a specific property (e.g., location, floor plan, price, facilities, etc.).

[1703] "Search" is the process of finding the desired property or product based on the desired conditions entered by the user.

[1704] "Real-time" refers to instantaneous processing and response that occurs at the same time as the present.

[1705] "Presentation" refers to visually displaying search results and information to the user.

[1706] "Viewing arrangements" refers to scheduling a site visit or virtual viewing of a property or product that the user desires.

[1707] "Virtual viewing" is a system that virtually recreates an actual property or store, allowing users to tour the interior online.

[1708] A "floor plan" is a drawing showing the layout and dimensions of rooms inside a property.

[1709] A "furniture layout image" is a visual simulation of what the furniture will look like when it is arranged within a property based on the size and type of furniture specified by the user.

[1710] "Simulation footage" is footage that virtually recreates the conditions under which a property would actually be lived in or used.

[1711] A "virtual store" is a virtual store space built on the Internet where users can search for and purchase products.

[1712] "Product information" is detailed data about a specific product (for example, type, price, specifications, stock status, etc.).

[1713] A "link" is a hypertext link that directs a user to a particular web page or resource.

[1714] A "terminal" is a device (e.g., smartphone, tablet, computer) that a user uses to enter or view information.

[1715] This invention is a system that allows a user to input desired conditions and search for and display information on properties and products in real time. Specific embodiments of this system will be described below.

[1716] Program processing overview

[1717] Input of user's desired conditions

[1718] The user inputs their desired conditions (e.g., furniture color, size, price range, etc.) using smart glasses or a smartphone. This input data is sent from the device to the server.

[1719] Searching and presenting property and product information

[1720] The server searches the database in real time based on the received criteria. The searched information is compiled into a list and sent to the terminal. The terminal then displays a list of properties and products that match the user's criteria.

[1721] Automatic viewing arrangements and virtual viewings

[1722] When a user selects a specific property or product, the information is sent to the server and a viewing schedule is automatically set up. If the user requests a virtual viewing, a 3D model is generated based on the floor plan and product details, and a link is sent to the user's device.

[1723] Furniture layout image generation and simulation

[1724] When a user inputs the size and type of furniture they have, the data is sent to the server and a furniture layout simulation is performed. The simulation results are sent to the device and displayed as a concrete image. In addition, the furniture layout data and viewing data are integrated to generate and send a simulation video of what it would be like to actually live in the property.

[1725] Hardware and software used

[1726] Hardware: smart glasses, smartphones, tablets, computers

[1727] Software: Python, requests library, json library

[1728] Database: MySQL or PostgreSQL

[1729] Specific examples

[1730] When a user searches for "a blue, two-meter-wide sofa" using the smart glasses, the search criteria are sent to the server, and matching sofa information is retrieved in real time from the database. The retrieved information is displayed as a list on the smart glasses, and the user can click a virtual preview link to view the 3D model.

[1731] Prompt Sentence Examples

[1732] "Please enter your desired furniture criteria (e.g. color, size, price range, etc.)"

[1733] This embodiment allows users to efficiently search for properties and products and get a concrete image of them, and in particular makes it easy to check the details through virtual viewings.

[1734] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1735] Step 1:

[1736] The user enters the desired conditions

[1737] Input: The user uses smart glasses or a smartphone to input desired criteria (e.g., furniture color, size, price range, etc.) in natural language.

[1738] Data processing: The terminal converts the entered conditions into JSON format and prepares to send it as an API request.

[1739] Output: The desired conditions data in JSON format is sent to the server.

[1740] Step 2:

[1741] Real-time search processing is performed on the server

[1742] Input: The server receives the user's desired conditions.

[1743] Data processing: Query the database based on your desired conditions and search for properties and products that fit your needs.

[1744] Output: A list of relevant property and product information is generated and sent to the terminal in JSON format.

[1745] Step 3:

[1746] View search results on your device

[1747] Input: Receives a list of property and product information in JSON format sent from the server.

[1748] Data processing: Converts received information into a format that is easy for the user to understand and displays it.

[1749] Output: The user views a list of properties and products on their device.

[1750] Step 4:

[1751] The user selects a specific property or product

[1752] Input: The user selects a particular property or product from a list.

[1753] Output: Information about the selected property or product is sent to the server.

[1754] Step 5:

[1755] Automatic viewing arrangement and virtual viewing link generation

[1756] Input: The server receives information about the property or product selected by the user.

[1757] Data processing: The server automatically schedules viewings and generates 3D models based on floor plans and detailed product information.

[1758] Output: Viewing schedule details and a virtual viewing link will be generated and sent to your device.

[1759] Step 6:

[1760] Viewing schedule and virtual viewing link on your device

[1761] Input: Receives the preview schedule and virtual preview link sent from the server.

[1762] Data processing: The received information is displayed in a format that is easy for the user to understand.

[1763] Output: User checks the viewing schedule and clicks the virtual viewing link to view the 3D model.

[1764] Step 7:

[1765] The user inputs the size and type of furniture

[1766] Input: The user inputs the size and type of furniture they have through the terminal.

[1767] Data processing: The terminal converts the input furniture data into JSON format and sends it to the server.

[1768] Output: Furniture data in JSON format is sent to the server.

[1769] Step 8:

[1770] Running a furniture layout simulation

[1771] Input: The server receives furniture sizes and types, and a floor plan of the property.

[1772] Data processing: The server runs a furniture layout simulation based on this data and generates the results.

[1773] Output: The results of the placement simulation are sent to the terminal.

[1774] Step 9:

[1775] Generating simulation images of homes

[1776] Input: The server receives virtual viewing data and furniture layout data.

[1777] Data processing: The server integrates this information and generates a simulation image of what it would be like to actually live there.

[1778] Output: The simulation video is sent to the device and a link is provided for the user to view.

[1779] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1780] This invention combines a system that searches for and displays property information in real time after a user inputs their desired conditions with an emotion engine. This system automatically arranges viewings of the property, allows virtual viewings based on floor plans, generates furniture layout images based on furniture sizes input by the user, and generates simulation images of what it would be like to actually live in the property. Furthermore, it provides a function that recognizes the user's emotions and dynamically adjusts property information and settings based on those emotions.

[1781] Program processing and specific examples

[1782] Input of user's desired conditions

[1783] The user operates the terminal and inputs the desired conditions (for example, 2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo). The terminal sends this input data to the server.

[1784] Property information search and presentation

[1785] The server searches the database for property information in real time based on the received desired conditions. For example, the server searches for properties that match the criteria "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo" and generates a list of properties that match. The server sends this list to the terminal, which displays it to the user.

[1786] Emotion recognition by emotion engine

[1787] The device analyzes the user's facial expressions and voice, and uses an emotion engine to recognize the user's emotions. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[1788] Prioritizing property listings based on emotions

[1789] The server receives the user's emotion data and re-prioritizes the property listings based on the recognized emotion, for example, displaying properties for which the user expressed "joy" at the top of the list.

[1790] Automatic viewing arrangement

[1791] When a user selects a property they like on their device, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The viewing date for the selected property is automatically set and reflected in the user's calendar.

[1792] Virtual viewing and emotional regulation

[1793] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The device displays the link to the user, who clicks to begin the virtual viewing. The device recognizes the user's emotions during the virtual viewing and adjusts the display content accordingly. For example, if the user feels anxious, the emotion engine will change the lighting and interior colors.

[1794] Generate furniture layout images

[1795] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[1796] Simulation video generation

[1797] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. The server sends this video data to the device, which then displays a link to play the video to the user. When the user clicks the link, the simulation video is played on the device, allowing them to see the actual living environment.

[1798] Generating furniture arrangement images according to emotions

[1799] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. Based on this emotion data, the server proposes an optimal furniture arrangement and provides it to the user. For example, if the emotion "relaxed" is recognized, the server will propose a relaxing arrangement.

[1800] This invention allows users to search for rooms efficiently and effectively and understand the specific living environment in advance. In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, thereby realizing a more comfortable living environment.

[1801] The processing flow will be explained below.

[1802] Step 1:

[1803] User enters desired conditions

[1804] The user operates the device and inputs desired conditions (floor plan, budget, area, etc.), and the device collects this input data.

[1805] Step 2:

[1806] The device sends data to the server

[1807] The terminal transmits the collected desired condition data to the server.

[1808] Step 3:

[1809] The server searches for properties

[1810] The server searches for property information in the database based on the desired conditions received and generates a list of properties that match the criteria.

[1811] Step 4:

[1812] The server sends the search results to the device

[1813] The server sends the generated property list to the terminal.

[1814] Step 5:

[1815] Your device will display the search results

[1816] The terminal displays the received property list to the user.

[1817] Step 6:

[1818] Emotion recognition by emotion engine

[1819] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotions.

[1820] Step 7:

[1821] The server receives the emotion data.

[1822] The server receives the user's emotion data and re-prioritizes the property information based on the recognized emotion.

[1823] Step 8:

[1824] The server sends the re-prioritized property list to the terminal.

[1825] The server sends the re-adjusted property list to the terminal.

[1826] Step 9:

[1827] Display the property list with your device recalibrated

[1828] The terminal displays the re-arranged property listings to the user.

[1829] Step 10:

[1830] User selects property

[1831] The user selects the property they like on their device, and the device sends the selection information to the server.

[1832] Step 11:

[1833] The server arranges a viewing

[1834] The server automatically sets up a viewing schedule for the selected property and sends the details of the viewing arrangement to the terminal.

[1835] Step 12:

[1836] The device updates the viewing schedule to the user's calendar

[1837] The device will update the viewing schedule on the user's calendar.

[1838] Step 13:

[1839] User requests a virtual tour

[1840] The user selects the property they wish to virtually view on their device.

[1841] Step 14:

[1842] The device sends a request to the server

[1843] The device sends a virtual viewing request to the server.

[1844] Step 15:

[1845] The server converts the floor plan into a 3D model

[1846] The server generates a 3D model based on the floor plan and related information of the selected property.

[1847] Step 16:

[1848] The server sends a virtual preview link to the device.

[1849] A virtual preview link for the 3D model generated by the server is sent to the terminal.

[1850] Step 17:

[1851] The device will display a virtual preview link

[1852] The device displays a virtual preview link to the user.

[1853] Step 18:

[1854] Users can conduct virtual viewings

[1855] Users click on the link and use their device to conduct a virtual viewing.

[1856] Step 19:

[1857] Emotion recognition during virtual viewing

[1858] The terminal recognizes the user's emotions during the virtual preview and transmits the emotion data to the server.

[1859] Step 20:

[1860] The server adjusts the virtual viewing content

[1861] The server adjusts the virtual viewing environment (lighting, interior color, etc.) based on the user's emotional data and sends the results to the terminal.

[1862] Step 21:

[1863] User inputs furniture size and type

[1864] The user inputs the size and type of furniture they have into the terminal, which then collects the input data.

[1865] Step 22:

[1866] The device sends data to the server

[1867] The device sends the collected furniture size and type data to a server.

[1868] Step 23:

[1869] The server performs a furniture layout simulation

[1870] The server performs a furniture layout simulation based on the furniture data and the property floor plan received, and generates the simulation results.

[1871] Step 24:

[1872] The server sends the furniture layout image to the terminal.

[1873] The server sends the furniture layout image it has created to the terminal.

[1874] Step 25:

[1875] The device displays an image of the furniture layout.

[1876] The terminal displays an image of the furniture arrangement to the user.

[1877] Step 26:

[1878] Emotion recognition during furniture layout simulation

[1879] The terminal analyzes the user's emotions during the furniture placement simulation and transmits the emotion data to the server.

[1880] Step 27:

[1881] The server suggests furniture arrangements based on emotions

[1882] The server proposes optimal furniture layout based on the emotional data and sends the results to the device.

[1883] Step 28:

[1884] The device displays furniture layout images based on emotions

[1885] The terminal displays to the user an image of furniture arrangement according to the user's emotions.

[1886] Step 29:

[1887] The server generates the simulation video

[1888] The server integrates the virtual viewing data and furniture layout data to generate a simulated image of the living environment.

[1889] Step 30:

[1890] The server sends the video data to the terminal

[1891] The server transmits the generated simulation video data to the terminal.

[1892] Step 31:

[1893] The device displays a link to play the video.

[1894] The terminal displays a link to play the simulation video to the user.

[1895] Step 32:

[1896] User checks the simulation video

[1897] The user clicks on the play link to play the simulation video on their device and sees what it would be like to actually live there.

[1898] Example 2

[1899] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1900] Existing property search systems present property information without considering the user's emotions, making it difficult for users to efficiently find the property they truly desire. Furthermore, functions such as virtual viewings and furniture layout simulations are limited, making it difficult for users to visualize what it would be like to actually live in the property. Furthermore, they lack the functionality to automatically arrange viewings or adjust the environment based on the user's emotions during a virtual viewing. Technology that solves these issues is needed.

[1901] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1902] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation image of what it would be like to actually live in the property, means for recognizing the user's emotions, means for preferentially presenting property information based on the recognized emotions, and means for analyzing the user's emotions during the virtual viewing and adjusting the display content. This makes it possible to present property information that takes the user's emotions into consideration and to provide a detailed experience in viewings, furniture layout, and simulations.

[1903] "User desired conditions" are conditions that a user inputs when searching for a specific property, and include information such as floor plan, budget, and area.

[1904] "Property information" refers to detailed data about a property, including, for example, information such as the layout, price, location, and age of the property.

[1905] "Arranging a viewing" is the procedure of setting up a schedule to actually visit the property and check the interior.

[1906] A floor plan is a drawing that shows the layout of rooms and facilities inside a property.

[1907] "Virtual viewing" is the act of visually experiencing the interior of a property online using virtual reality or 3D models.

[1908] A "furniture layout image" is a visual image that shows how furniture will be arranged within the property based on the size and type of furniture entered by the user.

[1909] A "simulation video" is a video that virtually recreates the living environment of someone who actually lives in a property.

[1910] "Means for recognizing emotions" refers to technology that analyzes a user's facial expressions and voice to detect emotions such as joy, sadness, and surprise.

[1911] The "means for preferentially presenting property information" is a method for adjusting the display order of property information based on the user's perceived emotions.

[1912] "Means for adjusting the displayed content" refers to technology that dynamically changes the displayed content, such as lighting and interior color, depending on the user's emotions during the virtual preview.

[1913] The present invention is a system that inputs a user's desired conditions, searches and displays property information in real time, and dynamically adjusts property information and settings based on the user's emotions. The system includes the following functions:

[1914] Input of user's desired conditions

[1915] The user inputs desired conditions using a device (such as a PC or smartphone). For example, they specify conditions such as "2LDK, budget under 150,000 yen, Shibuya-ku, Tokyo." The device then sends this input data to a server. The hardware used is a general-purpose computer or mobile device, and the software used is a dedicated application or web interface.

[1916] Property information search and presentation

[1917] The server searches the database for property information in real time based on the received user's desired conditions. It generates a list of relevant properties and sends it to the terminal. The terminal displays the property list to the user. The server can use a high-performance database management system (e.g., MySQL, PostgreSQL).

[1918] Emotion recognition by emotion engine

[1919] The device uses a built-in camera and microphone to analyze changes in the user's facial expressions and voice, and the emotion engine recognizes the user's emotions. The emotion engine can use advanced recognition systems such as the "AI Passion Engine." For example, if a user smiles while looking at a property listing, the emotion engine will recognize "joy."

[1920] Prioritizing property listings based on emotions

[1921] The server receives the emotion data from the device and adjusts the display order of the property information based on that emotion data. For example, properties for which the user expressed "joy" would be displayed at the top of the list.

[1922] Automatic viewing arrangement

[1923] When a user selects a property they like and requests a viewing, the device sends the request to the server. The server automatically schedules the viewing and sends the details to the device, which then updates the user's calendar with the viewing date.

[1924] Virtual viewing and emotional regulation

[1925] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related data, and sends a virtual viewing link to the device. During the virtual viewing, the device analyzes the user's emotions and adjusts the display content. For example, if the user feels anxious, the display content will be changed to help them relax.

[1926] Generate furniture layout images

[1927] When the user inputs the size of the furniture (e.g., a sofa 200cm wide x 90cm high), the device sends this data to the server. The server performs a furniture layout simulation based on the furniture data and the property's floor plan, and sends the results to the device. The device then displays an image of the layout to the user.

[1928] Simulation video generation

[1929] The server combines the virtual viewing data with the furniture layout data to generate a simulation video of what it would be like to actually live in the property. This video data is sent to the device, which then displays a link to the simulation video to the user. When the user clicks the link, the simulation video begins to play.

[1930] Generating furniture arrangement images according to emotions

[1931] During the furniture arrangement simulation, the device analyzes the user's emotions and sends the emotion data to the server. The server then proposes an optimal furniture arrangement based on the emotions and sends the result to the device. For example, if the emotion "relaxed" is recognized, a relaxing arrangement will be proposed.

[1932] Prompt Sentence Examples

[1933] 1. "I'm looking for a 2LDK apartment in Tokyo. Can I find one for under 150,000 yen?"

[1934] 2. "These are the dimensions of a sofa. Please simulate a layout that is 200cm wide, 90cm high, and 100cm deep."

[1935] 3. "I'd like to see this property. Please let me know the specific date."

[1936] 4. "I'd like to start a virtual tour. Please provide the link."

[1937] This system allows users to search for properties efficiently and effectively, and allows them to understand the specific living environment in advance. It also constantly monitors the user's emotions and provides optimal property information and furniture arrangements accordingly, creating a more comfortable living environment.

[1938] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1939] Step 1:

[1940] The user operates the terminal and inputs the desired conditions.

[1941] Input: Floor plan (e.g., 2LDK), Budget (e.g., under 150,000 yen), Area (e.g., Shibuya-ku, Tokyo)

[1942] Operation: The terminal obtains the above conditions from the input form displayed on the screen, formats the data, and sends it to the server.

[1943] Output: The server receives the user's desired conditions.

[1944] Step 2:

[1945] The server searches for property information based on the desired conditions received.

[1946] Input: User's desired conditions (2LDK, under 150,000 yen, Shibuya-ku, Tokyo)

[1947] How it works: The server executes a database query to find matching properties in real time.

[1948] Output: The server generates a list of properties and sends it to the terminal.

[1949] Step 3:

[1950] The terminal displays the property listing to the user.

[1951] Input: Property list sent from the server

[1952] Action: The device displays the property listing on the user interface. The user views the listing.

[1953] Output: User reviews property listing and decides next action.

[1954] Step 4:

[1955] The device analyzes the user's facial expressions and voice, and the emotion engine recognizes the user's emotions.

[1956] Input: User's facial expression video data and voice data

[1957] How it works: The device's camera and microphone capture the user's face and voice, which the emotion engine analyzes to recognize the user's emotions.

[1958] Output: The device sends the recognized emotion data to the server.

[1959] Step 5:

[1960] The server readjusts the priority of property information based on the emotion data.

[1961] Input: Recognized user emotion data

[1962] How it works: The server uses emotion data to prioritize the property list, for example, placing properties that the user expresses joy about at the top of the list.

[1963] Output: Send the rebalanced property list to the device.

[1964] Step 6:

[1965] The terminal displays the recalibrated property listing to the user.

[1966] Input: Rebalanced property list sent from the server

[1967] Action: The terminal redisplays the new property listing on the user interface.

[1968] Output: User confirms the rebalanced property list.

[1969] Step 7:

[1970] The user selects a property they like and requests a viewing.

[1971] Input: Property information selected by the user and a request for a viewing

[1972] Operation: The terminal sends the user's selection information to the server.

[1973] Output: The server receives a request to schedule a preview.

[1974] Step 8:

[1975] The server automatically sets up a viewing schedule and sends the details to the terminal.

[1976] Input: User's viewing request

[1977] How it works: The server checks the availability schedule for the property, schedules an appropriate viewing date, and sends the details to the device.

[1978] Output: The preview schedule details are sent to the device and reflected in the user's calendar.

[1979] Step 9:

[1980] The user requests a virtual tour.

[1981] Input: User's virtual viewing request

[1982] How it works: The device sends a request to the server, which generates a 3D model and sends a link to it to the device.

[1983] Output: A virtual preview link is sent to the device and displayed to the user.

[1984] Step 10:

[1985] The device analyzes the user's emotions during the virtual viewing and adjusts the displayed content.

[1986] Input: facial expression video data and audio data of the user during the virtual viewing

[1987] How it works: The device's camera and microphone capture images in real time, which are then analyzed by the emotion engine. The lighting and interior color are then changed according to the emotion.

[1988] Output: The adjusted virtual preview display is provided to the user.

[1989] Step 11:

[1990] The user inputs the size of the furniture they have.

[1991] Input: Furniture size data such as width, depth, and height

[1992] Operation: The device sends input data to the server, which then performs a furniture layout simulation based on the furniture data and floor plan.

[1993] Output: The simulation results are sent to the terminal and displayed to the user.

[1994] Step 12:

[1995] The server integrates the virtual viewing data and furniture layout data to generate a simulation image.

[1996] Input: Virtual viewing data and furniture layout data

[1997] How it works: The server integrates this data and generates a simulation video of what it would be like to actually live there.

[1998] Output: A link to the simulation video is sent to the device and displayed to the user.

[1999] Step 13:

[2000] During the furniture layout simulation, the device analyzes the user's emotions and suggests the optimal furniture layout based on that.

[2001] Input: User emotion data during furniture layout simulation

[2002] Operation: The device sends emotion data to the server, and the server proposes the optimal furniture layout based on the emotion and sends it to the device.

[2003] Output: The proposed furniture layout image is displayed on the terminal and provided to the user.

[2004] (Application example 2)

[2005] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2006] Conventional property search systems make it difficult for users to efficiently search for properties that meet their desired conditions, and in particular, they have problems with low user satisfaction because they do not dynamically adjust according to the user's emotions during virtual viewings or furniture layout simulations.In addition, they lack emotion recognition functionality when providing property information, making it impossible to present optimal property information, resulting in a limited user experience.

[2007] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2008] In this invention, the server includes means for inputting a user's desired conditions, means for searching for property information based on the desired conditions and presenting relevant properties in real time, means for automatically arranging a viewing of the relevant property, means for conducting a virtual viewing based on a floor plan, means for generating a furniture layout image based on the size and type of furniture input by the user, means for generating a simulation video of what it would be like to actually live in the property, means for recognizing emotions from the user's facial expressions and voice, means for dynamically adjusting the priority of property information based on the recognized emotions, and means for visually adjusting the environment according to the emotions during the virtual viewing. This allows users to efficiently find properties that meet their needs and, by receiving optimal suggestions and environmental adjustments based on their emotions, can achieve a high level of satisfaction.

[2009] The "means for inputting the user's desired conditions" refers to a device or program that allows the user to input the conditions of the property he or she desires (for example, floor plan, budget, location, etc.) via an interface.

[2010] "Means for searching property information and presenting relevant properties in real time" refers to a device or program for searching a database for relevant property information based on the desired conditions entered by the user and displaying the results immediately.

[2011] The "means for automatically arranging a viewing of the property" is a device or program for automatically setting a viewing schedule for the selected property and providing that information to the user.

[2012] "Means for conducting a virtual viewing based on a floor plan" refers to a device or program that generates a 3D model based on the floor plan and related information of a property and provides the model to users as a virtual viewing.

[2013] "Means for generating a furniture arrangement image based on the size and type of furniture entered by the user" refers to a device or program for generating a simulation image of furniture arranged within a property based on the dimensions and type of furniture specified by the user.

[2014] "Means for generating a simulation video of what it would be like to actually live in a property" refers to a device or program for generating a simulation video of what it would be like to actually live in a property based on the property and furniture layout information selected by the user.

[2015] The "means for recognizing emotions from a user's facial expression and voice" refers to a device or program for analyzing a user's facial expression and voice and estimating their emotional state.

[2016] The "means for dynamically adjusting the priority of property information based on recognized emotions" is a device or program for rearranging the display order of property lists to prioritize them according to emotions based on the user's emotional data.

[2017] "Means for visually adjusting the environment according to emotions during a virtual viewing" refers to a device or program that analyzes the user's emotions during a virtual viewing and dynamically changes the lighting, interior color, etc. of the virtual environment according to those emotions.

[2018] The present invention combines a system that allows users to input their desired conditions and search and display property information in real time with an emotion engine. This system includes the following means.

[2019] First, the user inputs desired conditions (e.g., floor plan, budget, location) using a device such as a smartphone. The device then sends this input data to the server. Next, the server searches the property information in the database in real time based on the desired conditions received, and generates a list of matching properties. The generated property list is sent to the device and presented to the user.

[2020] One feature of the present invention is that it uses an emotion engine to recognize a user's emotions. While the user is operating the device, the device analyzes the user's facial expressions and voice and uses the emotion engine to recognize the user's emotional state in real time. For example, if the user smiles while looking at a property listing, the emotion engine will recognize "joy."

[2021] The server receives this emotion data and dynamically adjusts the priority of property listings based on the recognized emotion. For example, properties for which the user expressed "joy" may be displayed at the top of the list. This allows the server to provide the most suitable property information according to the user's preferences.

[2022] When a user selects a property they like, the device sends the selection information to the server. The server automatically schedules a viewing for the selected property and sends the details to the device. The schedule information is also automatically updated on the user's calendar.

[2023] Furthermore, if the user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a virtual viewing link to the device. The user can start the virtual viewing by clicking the link. The system recognizes the user's emotions during the virtual viewing and makes visual adjustments (such as changes to lighting and interior colors) according to those emotions.

[2024] When a user inputs the dimensions of their existing furniture (e.g., a sofa 200cm wide, 100cm deep, and 90cm high), the device sends this data to the server. The server then performs a furniture layout simulation based on the floor plan and sends an image of the layout to the device. It also generates a video of what it would be like to actually live in the home based on the simulation results and sends it to the device. The user can click on the video playback link to see the specific living environment.

[2025] This allows users to efficiently search for rooms and understand the specific living environment in advance.In addition, the system constantly monitors the user's emotions and provides optimal property information and furniture layouts accordingly, making it possible to create a more comfortable living environment.

[2026] Example prompt:

[2027] "A user is looking for a 2LDK property with a budget of less than 150,000 yen in Shibuya Ward, Tokyo. If the emotion engine detects that the user's emotion is "joy," generate a list of properties to display preferentially. Furthermore, provide a virtual viewing for the selected property and simulate furniture placement based on the furniture size."

[2028] To implement this invention, programs such as an emotion engine, a virtual viewing system, and a furniture layout simulation are required, but these are all managed on a cloud-based server, and only the interface portion is provided to the user's terminal.

[2029] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2030] Step 1:

[2031] The user uses a terminal to input desired conditions (for example, floor plan, budget, location). The terminal sends this input data to the server. The input is the user's desired conditions, and the output is the data transfer to the server.

[2032] Step 2:

[2033] The server searches the database for property information in real time based on the received desired conditions. The searched data is property information, and the output is a list of matching properties.

[2034] Step 3:

[2035] The server generates a property list and sends it to the terminal. The list of properties is displayed on the user's terminal. The input is the property list, and the output is the data transmission and display to the terminal.

[2036] Step 4:

[2037] The device analyzes the user's facial expressions and voice and uses an emotion engine to recognize the user's emotional state. The analysis targets the user's facial expressions and voice, and the output is the user's emotional data.

[2038] Step 5:

[2039] The server receives the emotion data and dynamically adjusts the priorities of the property information based on the recognized emotion. The input is the user's emotion data, and the output is the prioritized property list.

[2040] Step 6:

[2041] The server regenerates the adjusted property list and sends it to the terminal, where the property list with the priorities adjusted based on the emotion is displayed. The input is the adjusted property list, and the output is the retransmitted data and display.

[2042] Step 7:

[2043] When the user selects a property they like, the terminal sends the selection information to the server. The input is the user's property selection, and the output is the transfer of the selection data to the server.

[2044] Step 8:

[2045] The server automatically sets up a viewing schedule for the selected property and sends the details to the terminal. Furthermore, the schedule information is automatically reflected in the user's calendar. The input is the property selection information, and the output is the viewing schedule and the calendar update.

[2046] Step 9:

[2047] When a user requests a virtual viewing, the device sends the request to the server. The server generates a 3D model based on the floor plan and related information and sends a link to the virtual viewing to the device. The input is a request for a virtual viewing, and the output is the generation and transmission of a link to the virtual viewing.

[2048] Step 10:

[2049] The user starts the virtual preview, and the device recognizes the user's emotions during the preview and adjusts the visual environment accordingly. The input is the user's emotional data, and the output is the adjusted visual environment.

[2050] Step 11:

[2051] When a user inputs the size of their existing furniture, the device sends that data to the server. The server then performs a furniture layout simulation based on the floor plan and sends the resulting layout image to the device. The input is furniture size data, and the output is a simulated furniture layout image.

[2052] Step 12:

[2053] The server generates a simulation video of what it would be like to actually live in the home based on the results of the furniture layout simulation and sends the video to the device. When the user clicks on the link to play the video, they can see the actual living environment. The input is furniture layout data, and the output is the simulation video.

[2054] This allows users to efficiently find properties that meet their needs, and also receive optimal suggestions and environmental adjustments based on their emotions.

[2055] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2056] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2057] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2058] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2059] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2060] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2061] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2062] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists...

Claims

1. A means for inputting user desired conditions; A means for searching property information based on the desired conditions and presenting relevant properties in real time; A means to automatically arrange viewings of the property; A means for conducting a virtual viewing based on the floor plan; A means for generating a furniture arrangement image based on the size and type of furniture input by a user; A means for generating a simulation image of what it would be like to actually live there; A system including:

2. The system according to claim 1, further comprising means for generating a link for a virtual preview and transmitting the link to the terminal.

3. 2. The system according to claim 1, further comprising means for reflecting the preview schedule in a user's calendar.

Images