System

Abstract

A system is provided.SOLUTION: A movement support system comprising: means for performing a preliminary inspection of a virtual property in a Metaverse space by a user; means for performing a price negotiation and a contract procedure with a real estate agent by a generation system artificial intelligence; means for performing various procedures of a public institution by the generation system artificial intelligence; means for generating a plurality of movement plans and presenting an optimal plan; and means for storing input information of the user in a database and automatically inputting necessary data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Moving typically requires a great deal of time and effort. Specifically, a wide range of tasks, such as viewing a property, negotiating a contract with a real estate agent, and completing various procedures at public institutions, are required, placing a significant burden on users. Furthermore, efficiently completing these procedures requires advanced specialized knowledge and ample experience, which can be extremely difficult, especially for users moving for the first time. Real estate agents also incur significant costs for each contract procedure and negotiation, which reduces their operational efficiency. The present invention aims to solve these problems and provide a system that allows users to move more easily and efficiently. [Means for solving the problem]

[0005] The present invention provides a moving assistance system that includes a means for a user to view a virtual property in a metaverse space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with a real estate agent, a means for using generative artificial intelligence to handle various procedures with public institutions, a means for generating multiple moving plans and presenting the most suitable plan, and a means for saving user input information in a database and automatically entering necessary data. Users can access the metaverse space using a mobile device and freely move around the property to view it. The generative artificial intelligence can also automatically process procedures with electricity, gas, water, and government offices and monitor progress. This allows users to complete the move smoothly without having to go through complicated procedures. This system also reduces costs and improves business efficiency for real estate agents.

[0006] A "metaverse space" is a computer-generated virtual reality environment in which users can view properties.

[0007] "Generative artificial intelligence" is a system that uses machine learning and natural language processing to automatically generate appropriate results from data, and handles negotiations with real estate agents and procedures with public institutions on your behalf.

[0008] A "real estate agent" is a company or individual that acts as an intermediary in the rental and purchase of properties, and is a business that introduces properties to users and handles contract procedures.

[0009] "Public institutions" are institutions that provide infrastructure and services necessary for users' lives, such as electricity, gas, water, and government offices.

[0010] A "moving plan" refers to multiple plans created based on conditions such as moving costs, time, and safety, and provides users with the best options.

[0011] A "database" is a system that stores and manages user input information and generated contract information, and allows this information to be retrieved and used as needed.

[0012] A "mobile terminal" is a computer device, such as a smartphone or tablet, that a user can easily carry with them, and which the user can use to access the system.

[0013] A "viewing" is the act of a user visually checking the interior and surrounding environment of a property, and plays an important role in selecting a place to move to. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention is a system that allows users to move efficiently, and has functions such as property viewing in the metaverse space, contract and procedure handling by generative artificial intelligence, and presentation of moving plans.

[0036] Metaverse preview function

[0037] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[0038] Contract agency function

[0039] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[0040] Procedure proxy function

[0041] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[0042] Plan presentation function

[0043] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[0044] Specific examples

[0045] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then view multiple properties in the metaverse space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for opening electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a specific plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[0046] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[0047] The processing flow will be explained below.

[0048] Metaverse preview function

[0049] Step 1:

[0050] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[0051] Step 2:

[0052] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[0053] Step 3:

[0054] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[0055] Step 4:

[0056] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[0057] Step 5:

[0058] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[0059] Step 6:

[0060] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[0061] Contract agency function

[0062] Step 1:

[0063] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[0064] Step 2:

[0065] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[0066] Step 3:

[0067] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[0068] Step 4:

[0069] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[0070] Step 5:

[0071] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[0072] Procedure proxy function

[0073] Step 1:

[0074] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[0075] Step 2:

[0076] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[0077] Step 3:

[0078] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[0079] Plan presentation function

[0080] Step 1:

[0081] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[0082] Step 2:

[0083] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[0084] Step 3:

[0085] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[0086] Step 4:

[0087] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[0088] Example 1

[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0090] Conventional moving procedures and property searches are extremely cumbersome for users, requiring many steps, such as viewing the property on-site, negotiating a contract, and completing various procedures. This consumes a lot of time and effort, and makes it difficult to plan an efficient move. Furthermore, viewing a property requires traveling to the property, making it difficult to search for a property from a remote location. Furthermore, procedures must be completed individually with various public institutions, creating the challenge of cumbersome progress management.

[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0092] In this invention, the server includes a means for users to view virtual properties in a virtual space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with agents, and a means for using generative artificial intelligence to handle procedures with public institutions. This allows users to efficiently search for properties and easily view them from remote locations. Furthermore, by using generative artificial intelligence to automatically handle contract procedures and procedures with public institutions, users can easily complete the complicated procedures associated with moving. This allows users to significantly save time and effort and realize a smooth move.

[0093] "User" refers to an individual or corporation who uses the system to view properties and complete contract procedures.

[0094] A "virtual space" is a three-dimensional digital environment generated on a computer system that serves as a stage for viewing and touring properties.

[0095] A "virtual property" is a digital model of a property visualized in a virtual space, which can be viewed in the same way as a real property.

[0096] "Viewing" refers to the act of a user visually checking a virtual property and understanding its internal layout and surrounding environment.

[0097] "Generative AI" refers to artificial intelligence technology that automatically negotiates prices and completes contract procedures with real estate agents based on information entered by the user.

[0098] "Business" refers to commercial organizations such as real estate agents and moving companies that provide properties and handle contract procedures.

[0099] "Price negotiation" refers to the act of generative artificial intelligence negotiating rent and contract terms with a contractor based on the user's desired conditions.

[0100] "Contract procedures" refers to the act of carrying out formal procedures for renting or purchasing a property.

[0101] "Public institutions" refers to companies that provide electricity, gas, and water, as well as government agencies such as government offices.

[0102] "Procedures" refers to the actions that users take with various public institutions when moving, such as turning on electricity, gas, and water services, and changing their address.

[0103] A "moving plan" refers to a moving plan that includes the work content and schedule when a user moves.

[0104] A "database" refers to a system that systematically stores user input information and contract information and retrieves that information as needed.

[0105] The present invention is a system that allows users to move efficiently, and includes functions such as viewing properties in a virtual space, using generative artificial intelligence to handle contracts and procedures, and presenting moving plans. Detailed embodiments of each function are described below.

[0106] Metaverse preview function

[0107] In this system, users first launch a dedicated app on their mobile device and view properties in a virtual space. The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device. Users can move freely around the virtual property using VR goggles or touch controls on their device, checking out each room and the surrounding environment. Specific hardware used is a smartphone, tablet, and VR goggles, while software uses 3D modeling engines such as Unity or Unreal Engine.

[0108] Contract agency function

[0109] Once the user finds the property they desire, the generative AI then negotiates the price with the agent and handles the contract procedures on their behalf. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the agent and delivers and signs the necessary documents online. Specific generative AI uses advanced natural language processing models such as GPT-4.

[0110] Procedure proxy function

[0111] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place using the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users select the necessary procedures from the list and enter the details through the app. The server then executes the procedures with each public agency, monitors the progress in real time, and notifies the user.

[0112] Plan presentation function

[0113] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[0114] Specific examples

[0115] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then browse multiple properties in a virtual space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a detailed plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[0116] Prompt Sentence Examples

[0117] "A user has entered their desired moving date as May 1st and a budget of 200,000 yen. Please use generative AI to suggest the optimal moving plan."

[0118] As described above, the moving assistance system of the present invention combines the functions of virtual space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[0119] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0120] Metaverse preview function

[0121] Step 1: Launch the app

[0122] The user launches the dedicated app on their mobile device.

[0123] Input: User taps smartphone icon

[0124] Output: The app starts and the initial screen is displayed.

[0125] Specific behavior:

[0126] The user taps the icon on their smartphone to open the app.

[0127] Step 2: Enter property information

[0128] The user enters the desired property information (e.g., area, budget, floor plan) into the app.

[0129] Input: The user enters the area name, rent range, and desired floor plan into the form on the screen.

[0130] Output: Input data is temporarily saved in the internal memory.

[0131] Specific behavior:

[0132] The user enters the required information into the form on the screen and presses the "Search" button.

[0133] Step 3: Submit your listing

[0134] The terminal transmits the entered property information to the server.

[0135] Input: Information entered by the user

[0136] Output: Data is sent over the internet to a server

[0137] Specific behavior:

[0138] The app makes a web request and sends information to the server.

[0139] Step 4: Creating a Metaverse Space

[0140] The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device.

[0141] Input: User property information received by the server

[0142] Output: The generated 3D model is streamed to your device.

[0143] Specific behavior:

[0144] The server generates virtual objects using a 3D modeling engine (such as Unity or Unreal Engine) and streams them in real time.

[0145] Step 5: Conduct a tour

[0146] Users can use VR goggles or a device to tour the virtual property and check each room and the surrounding environment.

[0147] Input: User operation (changing the viewpoint of the VR goggles or touching the device)

[0148] Output: Visual information of each room in the virtual property and the surrounding environment

[0149] Specific behavior:

[0150] The user can move the viewpoint using VR goggles or walk around the room using touch controls on the device.

[0151] Contract agency function

[0152] Step 1: Enter your desired conditions

[0153] The user enters the desired contract terms (e.g., rent, contract period) into the app.

[0154] Input: The user enters detailed information such as rent and contract period into a dedicated form.

[0155] Output: Input data is temporarily saved in the internal memory.

[0156] Specific behavior:

[0157] The user fills in the form with details and presses the "Submit" button.

[0158] Step 2: Sending conditions

[0159] The terminal transmits the input desired conditions to the server.

[0160] Input: Desired conditions entered by the user

[0161] Output: Data is sent over the internet to a server

[0162] Specific behavior:

[0163] The app makes a web request and sends information to the server.

[0164] Step 3: Negotiation begins with generative AI

[0165] Based on the conditions received by the server, the generation AI automatically begins negotiations with the vendor.

[0166] Input: Desired conditions received by the server

[0167] Output: The generation AI sends negotiation emails and chats to the vendor

[0168] Specific behavior:

[0169] The server uses a generative AI model (e.g., GPT-4) to automatically send emails and chats to real estate agents and negotiate.

[0170] Step 4: Present the terms and conditions

[0171] The server notifies the user of the best contract terms.

[0172] Input: Optimal contract terms obtained by the generation AI

[0173] Output: The terms of the contract are presented to the user's device.

[0174] Specific behavior:

[0175] The conditions are presented to the user's device via push notification and can be checked within the app.

[0176] Step 5: Contract Approval and Processing

[0177] The user accepts the terms and conditions, and the server proceeds with the online contract procedure with the vendor.

[0178] Input: User presses "Approve" button within the app

[0179] Output: Contract documents are generated and delivered / signed online

[0180] Specific behavior:

[0181] When you press the "Approve" button within the app, the server generates the contract document and sends a signing link to the user and the vendor.

[0182] Procedure proxy function

[0183] Step 1: Enter your processing information

[0184] The user selects from a list of various procedures required for moving in the app and enters the necessary information.

[0185] Input: The user checks the options for electricity, gas, water, and government procedures and enters the details for each.

[0186] Output: Input data is temporarily saved in the internal memory.

[0187] Specific behavior:

[0188] The user selects the procedure required for the checklist and enters the details.

[0189] Step 2: Submit your transaction information

[0190] The terminal transmits the entered procedure information to the server.

[0191] Input: Procedural information entered by the user

[0192] Output: Data is sent to the server

[0193] Specific behavior:

[0194] The app makes a web request and sends information to the server.

[0195] Step 3: Procedure execution by generative AI

[0196] Based on the information received by the server, the generating AI automatically carries out procedures with each public institution.

[0197] Input: Procedure information received by the server

[0198] Output: The generating AI executes the procedure for each public institution.

[0199] Specific behavior:

[0200] The server uses a generative AI model to automatically send online forms and emails to electric companies, gas companies, waterworks, and city halls.

[0201] Step 4: Procedural progress management

[0202] The server monitors the progress of the procedure in real time and notifies the user.

[0203] Input: Progress from each public institution

[0204] Output: Progress is displayed in real time on the user's device

[0205] Specific behavior:

[0206] The app will display the progress of the procedure and send push notifications with status updates.

[0207] Plan presentation function

[0208] Step 1: Enter the condition

[0209] The user enters the moving conditions (cost, time, safety) into the app.

[0210] Input: The user enters the moving budget and desired date into the form.

[0211] Output: Input data is temporarily saved in the internal memory.

[0212] Specific behavior:

[0213] The user enters details into the form and presses the "Search" button.

[0214] Step 2: Sending conditions

[0215] The terminal transmits the input conditions to the server.

[0216] Input: User-entered criteria

[0217] Output: Data is sent to the server

[0218] Specific behavior:

[0219] The app makes a web request and sends information to the server.

[0220] Step 3: Generative AI generates a plan

[0221] The server analyzes the conditions, and the generation AI generates multiple moving plans.

[0222] Input: The conditions received by the server

[0223] Output: A list of plans is generated

[0224] Specific behavior:

[0225] The server uses a generative AI model to generate a variety of moving plans.

[0226] Step 4: Present your plan

[0227] The server presents the generated plans to the user, who then makes a selection.

[0228] Input: Generated moving plan

[0229] Output: The user is presented with a plan to choose from

[0230] Specific behavior:

[0231] The plans will be displayed on the user's device, and when the user presses the "Select" button, they can check the details of the selected plan.

[0232] (Application example 1)

[0233] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0234] The modern moving process is extremely time-consuming and inconvenient, requiring many steps. It's particularly difficult to efficiently complete a wide variety of tasks simultaneously, including viewing real estate properties, negotiating prices, completing contracts, handling government procedures, and even selecting the optimal moving plan. This creates a growing need for a system that allows users to efficiently and smoothly complete the entire process of moving.

[0235] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0236] In this invention, the server includes a means for the user to view a virtual property in the metaverse space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with real estate agents, and a means for using generative artificial intelligence to handle various procedures with public institutions, thereby enabling the user to efficiently and smoothly complete a series of tasks related to moving.

[0237] A "metaverse space" is a virtual physical space on the Internet created using virtual reality technology.

[0238] A "virtual property" is a 3D model of a real estate property recreated within the metaverse space.

[0239] "Generative AI" is an AI technology that automatically creates and generates text and information based on input data.

[0240] A "mobile device" is a portable electronic device such as a smartphone or tablet.

[0241] A "virtual reality display device" is a device such as a head-mounted display that allows a user to experience virtual reality.

[0242] "Public institutions" are institutions and government agencies that provide infrastructure such as electricity, gas, and water.

[0243] A "generative AI model" is an artificial intelligence model that generates new data and information based on pre-trained data.

[0244] "Conditions" refer to specific criteria or requirements desired by the user.

[0245] A "moving plan" is a proposal that includes specific plans and schedules related to moving.

[0246] "Streaming display" is a technology that transfers data in a stream format and displays it in real time.

[0247] This invention is a system that allows users to efficiently move, and has functions such as virtual property viewing in a metaverse space, proxy contract and procedure handling using generative artificial intelligence, and presentation of moving plans. Specific embodiments of this system are described below.

[0248] Hardware and software used

[0249] The system uses the following hardware and software:

[0250] Hardware: Smartphone (iOS or Android), virtual reality display device (e.g., head-mounted display)

[0251] software:

[0252] Language: Python, Swift (for iOS), Kotlin (for Android)

[0253] Generative Artificial Intelligence: OpenAI's GPT-4 API

[0254] 3D modeling and streaming: Unity, AWS Lambda, AWS S3

[0255] System configuration and functions

[0256] 1. Metaverse preview function

[0257] The user launches the smartphone app and enters the desired property ID. The device sends a request to the backend server (AWS Lambda), which retrieves a 3D model of the specified property from AWS S3, and uses the Unity engine to stream the 3D model on the smartphone. The user then puts on the virtual reality display device and moves freely within the virtual space to view the property.

[0258] 2. Contract agency function

[0259] When a user enters the terms (rent, contract period, etc.) in the app, generative artificial intelligence (GPT-4 API) initiates chat-based negotiations with a real estate agent based on the terms. The optimal contract terms are presented to the user, and once the user approves, contract documents are automatically generated and electronically signed.

[0260] 3. Procedure proxy function

[0261] Users select the required government procedure and enter the details into the app. Generative AI monitors and automatically executes each procedure in the backend. Progress is tracked in real time and reported to users via push notifications.

[0262] 4. Plan presentation function

[0263] Users input their desired moving conditions (cost, time, safety) into the app, and a generative AI model (GPT-4) uses historical and real-time data to generate the optimal moving plan. Users are then provided with information on arranging moving companies and a list of household items they will need in their new home.

[0264] Specific examples

[0265] For example, if a user plans to move to a large city, they first launch the app and enter their desired conditions (rent, area, etc.). They can then view multiple properties in the metaverse space and select the one they like best. They then use generative AI to negotiate with a real estate agent and conclude a contract with optimal terms. Next, the generative AI automatically handles the procedures for electricity, gas, water, etc., and the user can check the progress in the app. Finally, the app will present the optimal moving plan based on the user's conditions, allowing them to complete the move smoothly.

[0266] Example prompt for GPT-4 AI:

[0267] The user is planning to move to Tokyo. He is looking for a property with a monthly rent of less than 200,000 yen, within a 10-minute walk from the station. Generate a 3D model of the property and conduct a VR tour. Please explain the process of automating the contract with the real estate agent and the procedures required for the move with public institutions. Also, please present the optimal moving plan.

[0268] In this way, the present invention allows a series of tasks related to moving to be efficiently progressed and managed, significantly reducing the burden on the user.

[0269] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0270] Step 1:

[0271] The user launches the smartphone app and enters the desired property ID. The entered property ID is sent from the device to the backend server. The server retrieves the 3D model data of the corresponding property from AWS S3 based on the property ID.

[0272] Step 2:

[0273] The server uses the Unity engine to stream the acquired 3D model data to a smartphone. The device then uses VR goggles to allow users to view the property in a virtual space. Users can move freely around the property, checking the room layout and surrounding environment.

[0274] Step 3:

[0275] Users select a property they like during a virtual tour and enter their desired conditions (rent, contract period, etc.) in the app. These conditions are sent from the device to the server. The server passes this data to generative artificial intelligence (GPT-4 API), which initiates price negotiations and contract procedures.

[0276] Step 4:

[0277] The generative AI negotiates with the real estate agent via chat. The generative AI proceeds with the negotiation based on the user's desired conditions and derives the optimal contract terms. The derive contract terms are sent from the server to the terminal and presented to the user.

[0278] Step 5:

[0279] The user approves the presented contract terms and conditions, and the contract documents are automatically generated. The server uses generative artificial intelligence to create the contract documents, which are then digitally signed. The contract documents are then sent online to the real estate agent.

[0280] Step 6:

[0281] After completing the contract, the user selects the public institution procedure within the app and enters the necessary information. This information is sent from the device to the server, which uses generative artificial intelligence to automatically process the electricity, gas, water, and other procedures and monitors their progress.

[0282] Step 7:

[0283] The progress of the transaction is tracked in real time and reported to the device via push notifications from the server, and the user can check in the app that the transaction is complete.

[0284] Step 8:

[0285] Users enter the conditions of their desired moving plan (cost, time, safety, etc.) into the app. The entered conditions are sent from the device to the server. The server uses a generative AI model (GPT-4) to analyze past and real-time data and generate the optimal moving plan.

[0286] Step 9:

[0287] The generated moving plan is sent from the server to the terminal and presented to the user. The user selects the most suitable moving plan and proceeds with specific preparations, such as arranging for a moving company and making a list of daily necessities.

[0288] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0289] The present invention is a system that enables users to move efficiently, and includes features such as property viewing in a metaverse space, contract and procedure handling by generative artificial intelligence, presentation of moving plans, and optimization functions using an emotion engine.

[0290] Metaverse preview function

[0291] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[0292] Contract agency function

[0293] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[0294] Procedure proxy function

[0295] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[0296] Plan presentation function

[0297] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[0298] Emotion engine combination function

[0299] Optimizing property proposals using an emotion engine

[0300] The emotion engine recognizes the user's emotional state through facial and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[0301] Changing negotiation strategies with emotion engines

[0302] The emotion engine detects the user's tension or anxiety and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[0303] Optimizing the moving process with an emotion engine

[0304] The emotion engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[0305] Specific examples

[0306] For example, if a user is planning to move to a big city for a new job, they first launch the app on their mobile device, input their desired area and conditions, and search for properties. They can then preview multiple properties in the metaverse space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan based on the user's stress level and desired conditions is generated and presented.

[0307] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, emotion engine, and automatic procedures based on user input information to provide an efficient and comfortable moving experience that significantly reduces the user's time and effort.

[0308] The processing flow will be explained below.

[0309] Metaverse preview function

[0310] Step 1:

[0311] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[0312] Step 2:

[0313] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[0314] Step 3:

[0315] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[0316] Step 4:

[0317] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[0318] Step 5:

[0319] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[0320] Step 6:

[0321] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[0322] Contract agency function

[0323] Step 1:

[0324] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[0325] Step 2:

[0326] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[0327] Step 3:

[0328] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[0329] Step 4:

[0330] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[0331] Step 5:

[0332] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[0333] Procedure proxy function

[0334] Step 1:

[0335] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[0336] Step 2:

[0337] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[0338] Step 3:

[0339] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[0340] Plan presentation function

[0341] Step 1:

[0342] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[0343] Step 2:

[0344] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[0345] Step 3:

[0346] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[0347] Step 4:

[0348] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[0349] Emotion engine combination function

[0350] Optimizing property proposals using an emotion engine

[0351] Step 1:

[0352] When a user launches the app on their mobile device and tours the metaverse, facial expressions and voice are collected using the device's camera and microphone.

[0353] Step 2:

[0354] The server analyzes the collected facial and voice data to determine the user's emotional state (happiness, excitement, frustration, stress, etc.).

[0355] Step 3:

[0356] The server uses an emotion engine to evaluate the property features based on the user's emotion information, for example, recording the property features for which the user expressed joy or excitement.

[0357] Step 4:

[0358] The next time a user views a property in the metaverse, the server will prioritize displaying the most suitable property based on the recorded emotional data.

[0359] Changing negotiation strategies with emotion engines

[0360] Step 1:

[0361] The user enters their desired conditions and begins contract negotiations. At that time, the device's camera and microphone collect the user's facial expressions and voice.

[0362] Step 2:

[0363] The server analyzes the collected facial and voice data to determine the user's level of tension or anxiety.

[0364] Step 3:

[0365] The server uses generative artificial intelligence to select the optimal negotiation strategy based on the user's emotional state. For example, if the user is feeling stressed, the server will pause the negotiation and provide advice on how to relax.

[0366] Step 4:

[0367] The negotiation can resume when the user is relaxed, or intensify if the user is satisfied.

[0368] Optimizing the moving process with an emotion engine

[0369] Step 1:

[0370] When a user uses the plan presentation function, facial expressions and voice are collected using the device's camera and microphone.

[0371] Step 2:

[0372] The server analyzes the collected facial and voice data to determine the user's stress level.

[0373] Step 3:

[0374] The server uses generative artificial intelligence to automatically adjust the plan based on the user's stress level and desired conditions. For example, if the user is in a high-stress state, it will present a plan that includes services that help them relax.

[0375] Step 4:

[0376] The user selects the most suitable plan from the presented plans, and the server proceeds with the specific moving procedures.

[0377] Through the above specific processing steps, the moving assistance system according to the present invention provides the user with an optimal moving experience while taking into consideration the user's emotional state.

[0378] Example 2

[0379] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0380] Moving requires many procedures and choices, placing a significant burden on users. However, conventional moving assistance systems have difficulty efficiently handling property selection, contract procedures, and procedures with public institutions. In particular, they lack the flexibility to respond to the user's emotional state, which makes it difficult to reduce the user's stress. The present invention aims to solve these problems and provide users with an efficient and comfortable moving experience.

[0381] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to view a virtual property in a virtual reality space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with a real estate agent, a means for using generative artificial intelligence to handle various procedures at public institutions, a means for generating multiple moving plans and presenting the most suitable plan, a means for saving information input by the user and automatically inputting necessary data, and a means for analyzing the user's emotional data using an emotion recognition engine and optimizing property proposals, negotiation strategies, and moving plans based on the results. This allows the user to consistently perform all procedures and selections related to moving, and further enables flexible responses according to the user's emotional state, thereby significantly reducing stress.

[0382] A "virtual reality space" is a virtual environment that resembles the real world and is generated using computer technology.

[0383] "Generative AI" is an AI technology that has the ability to self-learn based on massive amounts of data and automatically generate new data and results.

[0384] An "emotion recognition engine" is a computer program that analyzes a user's facial expressions and voice data to identify their emotional state.

[0385] The "negotiation process" is the process of discussing and reaching an agreement on terms and contractual content with real estate agents and public agencies.

[0386] "Public institutions" are organizations and facilities that provide electricity, gas, water, and administrative services.

[0387] A "moving plan" is a plan that includes optimal moving procedures and arrangements based on the user's conditions and wishes.

[0388] "User input information" refers to data indicating personal information and desired conditions for moving that the user provides to the system.

[0389] This invention is a system that allows users to move efficiently and comfortably. This system features features such as property viewing in a virtual reality space, negotiation and contract procedures handled by generative artificial intelligence, handling procedures at public institutions, generating and presenting moving plans, and optimization functions using an emotion recognition engine.

[0390] Metaverse preview function

[0391] In this system, the user first launches a dedicated app on their mobile device and tours a virtual property in a virtual reality space. Based on the property information specified by the user, the server uses a 3D engine (e.g., Unity) to generate a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[0392] Contract agency function

[0393] Once a user finds a property they desire, generative AI then negotiates the price with the real estate agent and handles the contract procedures. When a user enters their desired conditions through the app, the server receives the information and automatically begins negotiations with the real estate agent using generative AI (e.g., OpenAI GPT model). It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[0394] Procedure proxy function

[0395] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and government agencies. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[0396] Plan presentation function

[0397] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[0398] Emotion engine combination function

[0399] Optimizing property proposals using an emotion engine

[0400] The emotion recognition engine recognizes the user's emotional state through facial expressions and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[0401] Changing negotiation strategies with emotion engines

[0402] The emotion recognition engine detects the user's tension or anxiety, and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[0403] Optimizing the moving process with an emotion engine

[0404] The emotion recognition engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[0405] Specific examples

[0406] For example, if a user is planning to move to a big city for a new job, they first launch an app on their mobile device, input their desired area and conditions, and search for properties. The user can then preview multiple properties in a virtual reality space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion recognition engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan is generated and presented based on the user's stress level and desired conditions.

[0407] Example prompt sentence:

[0408] "I'm looking for the perfect property to move into. I'd like a 2LDK property in Tokyo with rent under 100,000 yen. I'd also like it to be within a 30-minute commute and have a supermarket or park nearby."

[0409] As described above, the moving assistance system of the present invention combines the functions of a virtual reality space, generative artificial intelligence, an emotion recognition engine, and automatic procedures based on user input information, providing the user with an efficient and comfortable moving experience that significantly reduces time and effort.

[0410] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0411] Step 1:

[0412] The user inputs desired conditions on a mobile device.

[0413] The user launches a dedicated app on their mobile device and inputs information about the desired property, such as the area, rent, and layout. The input information is sent to the server. Input data may include, for example, "Tokyo, rent under 100,000 yen, 2LDK, pets allowed."

[0414] Step 2:

[0415] The server receives property information and generates a 3D model

[0416] The server searches the database for relevant property information based on the desired conditions received from the user. Based on the search results, a 3D model of the virtual property is generated using a 3D engine (e.g., Unity). The generated 3D model is streamed to the user's device. The input data is the desired conditions for the property, and the output data is a 3D virtual property model.

[0417] Step 3:

[0418] A user conducts a virtual tour

[0419] Users can freely move around the virtual property using their device or VR goggles to view it. They can also check information about each room and the surrounding environment. The input data is the user's operational information, and the output data is the user's visual perception and the results of their operations.

[0420] Step 4:

[0421] The user selects the desired property and enters the contract terms.

[0422] After the user has completed the virtual viewing, they select the property they want and enter their desired contract terms (e.g., maximum monthly rent, contract period, etc.). The server receives this information. The input data is the property selected by the user and their desired contract terms, and the output data is the received contract terms.

[0423] Step 5:

[0424] Generative AI begins negotiations

[0425] Based on the desired contract terms received by the server, a generative AI (e.g., OpenAI GPT model) initiates direct negotiations with the real estate agent. The generative AI performs complex calculations and data analysis to derive optimal contract terms, and feeds the results back to the server. The input data is the desired contract terms, and the output data is the result of negotiations with the real estate agent.

[0426] Step 6:

[0427] The server presents the optimal contract terms to the user

[0428] The server presents the optimal contract terms derived by the generative AI to the user. The user then checks the details in the app and decides whether to approve the contract. The input data is the negotiation results, and the output data is the contract terms presented to the user.

[0429] Step 7:

[0430] Proceed with the online contract procedure

[0431] If the user approves the contract terms, the server proceeds with the online contract procedure. A contract with the real estate agent is generated and delivered to the user online. The user then signs the contract online. The input data is the approved contract terms, and the output data is the signed contract.

[0432] Step 8:

[0433] The user enters the procedure information

[0434] After completing the contract, the user enters detailed information through the app to complete procedures for electricity, gas, and water, change address, etc. The input data is a list of necessary procedures and detailed information, and the output data is the procedure information sent to the server.

[0435] Step 9:

[0436] Generative AI will handle the procedures

[0437] Based on the procedure information received by the server, generative AI automatically executes procedures with electricity, gas, water, and government agencies. Progress is monitored in real time, and the results are notified to the user. The input data is the procedure information, and the output data is the procedure progress and completion notification.

[0438] Step 10:

[0439] The user enters the moving conditions.

[0440] The user inputs moving conditions (cost, time, safety, etc.) into the app. The input data is the moving conditions, and the output data is the condition information sent to the server.

[0441] Step 11:

[0442] The server generates and presents a moving plan

[0443] The server uses generative artificial intelligence to generate multiple moving plans based on the received moving conditions and presents them to the user. The user selects the most suitable plan. The input data is the moving conditions, and the output data is the generated moving plan.

[0444] Step 12:

[0445] Emotion recognition engine analyzes user emotions

[0446] The emotion recognition engine analyzes the user's facial expression and voice data and provides information about the user's emotional state to the server. The input data is the user's facial expression and voice data, and the output data is the analysis result.

[0447] Step 13:

[0448] Optimize based on emotional data

[0449] The server uses the emotional data to optimize property proposals, negotiation strategies, and moving plans. If the user's stress level is high, it provides a relaxing service and presents the optimal plan. The input data is emotional data, and the output data is the optimized proposals and plans.

[0450] Through the above processing steps, the entire moving process proceeds efficiently and smoothly, realizing a system that significantly reduces the burden on the user.

[0451] (Application example 2)

[0452] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0453] Conventional moving assistance systems require users to inspect and select properties, complete contract procedures, and handle all procedures with public institutions themselves, which requires a great deal of time and effort. Furthermore, users must select and install the appropriate security system for their new home, which can be difficult to do without specialized knowledge. Furthermore, these systems do not take into consideration psychological stress management during the moving process, making it difficult to improve the user experience.

[0454] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0455] In this invention, the server includes: a means for a user to view virtual properties in the metaverse space; a means for using generative artificial intelligence to negotiate prices and complete contract procedures with real estate agents; a means for using generative artificial intelligence to complete various procedures with public institutions; a means for generating multiple moving plans and presenting the optimal plan; a means for storing user input information in a database and automatically entering necessary data; a means for using generative artificial intelligence to propose security systems and present security device installation plans; and a means for analyzing the user's emotional state using an emotion engine and optimizing the entire moving process according to the user's emotions. This significantly reduces the user's time and effort and provides an efficient and comfortable moving experience. Users can also select an appropriate system without specialized security knowledge and obtain an optimal moving plan that also takes psychological stress management into consideration.

[0456] The "metaverse space" is a virtual world constructed using virtual reality technology, which users can access via the Internet and where they can engage in various activities.

[0457] "Generative AI" is an AI technology that can automatically make optimal suggestions and decisions based on the user's wishes and conditions.

[0458] A "database" is a system for efficiently managing, storing, searching, and updating multiple pieces of data.

[0459] A "security system" is a combination of devices and software that protects data and property from risks such as unauthorized access and information leaks.

[0460] The "emotion engine" is a technology that analyzes a user's emotional state from their facial expressions, voice, and other biometric data, and provides appropriate feedback.

[0461] A "moving plan" is a set of multiple options generated based on the user's desired conditions for moving, and is a plan that takes into consideration factors such as cost, time, and safety.

[0462] "Public institutions" are organizations that provide infrastructure such as electricity, gas, and water, and government offices that provide administrative services.

[0463] The system of this invention allows users to efficiently move by viewing virtual properties in a metaverse space, automating various procedures using generative artificial intelligence, and managing user stress using an emotion engine.

[0464] Metaverse preview function

[0465] The server generates a 3D model of the virtual property based on the property information specified by the user and streams it to the user's device. This allows the user to freely view the virtual property within the metaverse space using VR goggles or a mobile device. For example, if a user is looking for a new home, they can enter their desired area and conditions to instantly visually check related virtual properties.

[0466] Contract agency function

[0467] When a user finds a property they like, the generative AI handles price negotiations and contract procedures with the real estate agent. When the user enters their desired conditions through the app, the server receives the information and automatically begins negotiations with the real estate agent. For example, by inputting a prompt such as "Please negotiate the rent" into the generative AI model, the AI ​​will propose the optimal conditions.

[0468] Procedure proxy function

[0469] After the contract is completed, the generative AI handles various procedures with public institutions, such as electricity, gas, and water. The user selects the necessary procedures in the app and enters the necessary information. The server then executes the procedures with each public institution, monitors the progress in real time, and notifies the user. For example, it uses prompts such as, "Please complete the procedures to turn on the water service following your move."

[0470] Security system proposal function

[0471] Generative AI proposes the optimal security system based on the user's desired conditions and presents a security device installation plan. When the user inputs the required security features, the AI ​​proposes the appropriate devices and presents an installation plan. For example, it generates a prompt such as, "Please propose the optimal plan for installing smart locks and CCTV."

[0472] Emotion engine optimization function

[0473] The emotion engine analyzes the user's facial expressions, voice, and other biometric data to recognize their emotional state. The server then uses this emotional information to optimize the entire moving process. For example, if the user is under high stress, the engine will provide advice on how to relax or suggest changes to the plan to reduce tension.

[0474] Specific examples

[0475] For example, if a user is moving to a new city, they launch an app on their mobile device and search for properties by entering their desired area and other conditions. They can then preview virtual properties in the metaverse space, and once they find one they like, generative AI will negotiate a rental contract. The following prompt sentences are used:

[0476] "Please negotiate the rent."

[0477] After the contract is completed, the generative AI will handle the electricity, gas, and water service activation procedures, using prompts such as the following:

[0478] "Please complete the procedures to get your water service turned on when I move."

[0479] Furthermore, the following prompt sentences are used in proposing security systems:

[0480] "Please suggest the best plan for installing smart locks and CCTV."

[0481] Finally, the emotion engine analyzes the user's emotions and provides feedback for stress management, for example:

[0482] "Relax, we'll take care of everything."

[0483] As described above, the present invention is a system that efficiently automates the various procedures that users face when moving, improving the user experience.

[0484] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0485] Step 1:

[0486] Users access the metaverse space using their devices and search for properties by entering the desired area and other conditions. The server searches the database based on the entered conditions and retrieves relevant property information. The server generates a 3D model of the virtual property and streams it to the user's device. The user can then freely view the virtual property using VR goggles.

[0487] Step 2:

[0488] After viewing the property and selecting one they like, the user sends the property information to the server via their device. The server then uses generative AI to negotiate the price and begin the contract process with the real estate agent. The generative AI calculates the optimal terms based on the user's desired conditions and presents them to the real estate agent. Once negotiations are successful, the server generates the contract documents and completes the contract through an electronic signature.

[0489] Step 3:

[0490] After completing the contract, the user uses their device to select a list of procedures that need to be completed with public institutions. The server receives this and uses generative artificial intelligence to automatically complete procedures for electricity, gas, water, etc. The server then processes the applications with each public institution, monitors the progress in real time, and notifies the user.

[0491] Step 4:

[0492] When a user inputs their security requirements for their new home into a terminal, the server uses generative AI to propose the optimal security system. Based on the user's requirements, the generative AI considers options such as smart locks and CCTV, and generates the optimal security plan. The server then presents this plan to the user and provides an installation plan.

[0493] Step 5:

[0494] Throughout the moving process, the server uses an emotion engine to analyze the user's facial expressions and voice to recognize their emotional state. Based on this emotional information, the server generates feedback to optimize the moving process. For example, if the user is in a high-stress state, the server will provide advice on how to relax and adjust the plan as necessary.

[0495] Step 6:

[0496] Once all procedures are completed, the server stores the user's input information in a database so that the necessary data can be automatically entered for future procedures, allowing the user to easily perform similar procedures the next time they move.

[0497] Through the above processing steps, the present invention is a system that significantly reduces the many procedures and labor that users face when moving, and provides an efficient and comfortable moving experience.

[0498] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0499] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0500] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0501] [Second embodiment]

[0502] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0503] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0504] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0505] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0506] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0507] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0508] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0509] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0510] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0511] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0512] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0513] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0514] The present invention is a system that allows users to move efficiently, and has functions such as property viewing in the metaverse space, contract and procedure handling by generative artificial intelligence, and presentation of moving plans.

[0515] Metaverse preview function

[0516] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[0517] Contract agency function

[0518] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[0519] Procedure proxy function

[0520] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[0521] Plan presentation function

[0522] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[0523] Specific examples

[0524] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then view multiple properties in the metaverse space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for opening electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a specific plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[0525] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[0526] The processing flow will be explained below.

[0527] Metaverse preview function

[0528] Step 1:

[0529] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[0530] Step 2:

[0531] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[0532] Step 3:

[0533] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[0534] Step 4:

[0535] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[0536] Step 5:

[0537] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[0538] Step 6:

[0539] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[0540] Contract agency function

[0541] Step 1:

[0542] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[0543] Step 2:

[0544] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[0545] Step 3:

[0546] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[0547] Step 4:

[0548] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[0549] Step 5:

[0550] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[0551] Procedure proxy function

[0552] Step 1:

[0553] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[0554] Step 2:

[0555] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[0556] Step 3:

[0557] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[0558] Plan presentation function

[0559] Step 1:

[0560] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[0561] Step 2:

[0562] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[0563] Step 3:

[0564] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[0565] Step 4:

[0566] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[0567] Example 1

[0568] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0569] Conventional moving procedures and property searches are extremely cumbersome for users, requiring many steps, such as viewing the property on-site, negotiating a contract, and completing various procedures. This consumes a lot of time and effort, and makes it difficult to plan an efficient move. Furthermore, viewing a property requires traveling to the property, making it difficult to search for a property from a remote location. Furthermore, procedures must be completed individually with various public institutions, creating the challenge of cumbersome progress management.

[0570] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0571] In this invention, the server includes a means for users to view virtual properties in a virtual space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with agents, and a means for using generative artificial intelligence to handle procedures with public institutions. This allows users to efficiently search for properties and easily view them from remote locations. Furthermore, by using generative artificial intelligence to automatically handle contract procedures and procedures with public institutions, users can easily complete the complicated procedures associated with moving. This allows users to significantly save time and effort and realize a smooth move.

[0572] "User" refers to an individual or corporation who uses the system to view properties and complete contract procedures.

[0573] A "virtual space" is a three-dimensional digital environment generated on a computer system that serves as a stage for viewing and touring properties.

[0574] A "virtual property" is a digital model of a property visualized in a virtual space, which can be viewed in the same way as a real property.

[0575] "Viewing" refers to the act of a user visually checking a virtual property and understanding its internal layout and surrounding environment.

[0576] "Generative AI" refers to artificial intelligence technology that automatically negotiates prices and completes contract procedures with real estate agents based on information entered by the user.

[0577] "Business" refers to commercial organizations such as real estate agents and moving companies that provide properties and handle contract procedures.

[0578] "Price negotiation" refers to the act of generative artificial intelligence negotiating rent and contract terms with a contractor based on the user's desired conditions.

[0579] "Contract procedures" refers to the act of carrying out formal procedures for renting or purchasing a property.

[0580] "Public institutions" refers to companies that provide electricity, gas, and water, as well as government agencies such as government offices.

[0581] "Procedures" refers to the actions that users take with various public institutions when moving, such as turning on electricity, gas, and water services, and changing their address.

[0582] A "moving plan" refers to a moving plan that includes the work content and schedule when a user moves.

[0583] A "database" refers to a system that systematically stores user input information and contract information and retrieves that information as needed.

[0584] The present invention is a system that allows users to move efficiently, and includes functions such as viewing properties in a virtual space, using generative artificial intelligence to handle contracts and procedures, and presenting moving plans. Detailed embodiments of each function are described below.

[0585] Metaverse preview function

[0586] In this system, users first launch a dedicated app on their mobile device and view properties in a virtual space. The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device. Users can move freely around the virtual property using VR goggles or touch controls on their device, checking out each room and the surrounding environment. Specific hardware used is a smartphone, tablet, and VR goggles, while software uses 3D modeling engines such as Unity or Unreal Engine.

[0587] Contract agency function

[0588] Once the user finds the property they desire, the generative AI then negotiates the price with the agent and handles the contract procedures on their behalf. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the agent and delivers and signs the necessary documents online. Specific generative AI uses advanced natural language processing models such as GPT-4.

[0589] Procedure proxy function

[0590] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place using the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users select the necessary procedures from the list and enter the details through the app. The server then executes the procedures with each public agency, monitors the progress in real time, and notifies the user.

[0591] Plan presentation function

[0592] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[0593] Specific examples

[0594] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then browse multiple properties in a virtual space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a detailed plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[0595] Prompt Sentence Examples

[0596] "A user has entered their desired moving date as May 1st and a budget of 200,000 yen. Please use generative AI to suggest the optimal moving plan."

[0597] As described above, the moving assistance system of the present invention combines the functions of virtual space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[0598] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0599] Metaverse preview function

[0600] Step 1: Launch the app

[0601] The user launches the dedicated app on their mobile device.

[0602] Input: User taps smartphone icon

[0603] Output: The app starts and the initial screen is displayed.

[0604] Specific behavior:

[0605] The user taps the icon on their smartphone to open the app.

[0606] Step 2: Enter property information

[0607] The user enters the desired property information (e.g., area, budget, floor plan) into the app.

[0608] Input: The user enters the area name, rent range, and desired floor plan into the form on the screen.

[0609] Output: Input data is temporarily saved in the internal memory.

[0610] Specific behavior:

[0611] The user enters the required information into the form on the screen and presses the "Search" button.

[0612] Step 3: Submit your listing

[0613] The terminal transmits the entered property information to the server.

[0614] Input: Information entered by the user

[0615] Output: Data is sent over the internet to a server

[0616] Specific behavior:

[0617] The app makes a web request and sends information to the server.

[0618] Step 4: Creating a Metaverse Space

[0619] The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device.

[0620] Input: User property information received by the server

[0621] Output: The generated 3D model is streamed to your device.

[0622] Specific behavior:

[0623] The server generates virtual objects using a 3D modeling engine (such as Unity or Unreal Engine) and streams them in real time.

[0624] Step 5: Conduct a tour

[0625] Users can use VR goggles or a device to tour the virtual property and check each room and the surrounding environment.

[0626] Input: User operation (changing the viewpoint of the VR goggles or touching the device)

[0627] Output: Visual information of each room in the virtual property and the surrounding environment

[0628] Specific behavior:

[0629] The user can move the viewpoint using VR goggles or walk around the room using touch controls on the device.

[0630] Contract agency function

[0631] Step 1: Enter your desired conditions

[0632] The user enters the desired contract terms (e.g., rent, contract period) into the app.

[0633] Input: The user enters detailed information such as rent and contract period into a dedicated form.

[0634] Output: Input data is temporarily saved in the internal memory.

[0635] Specific behavior:

[0636] The user fills in the form with details and presses the "Submit" button.

[0637] Step 2: Sending conditions

[0638] The terminal transmits the input desired conditions to the server.

[0639] Input: Desired conditions entered by the user

[0640] Output: Data is sent over the internet to a server

[0641] Specific behavior:

[0642] The app makes a web request and sends information to the server.

[0643] Step 3: Negotiation begins with generative AI

[0644] Based on the conditions received by the server, the generation AI automatically begins negotiations with the vendor.

[0645] Input: Desired conditions received by the server

[0646] Output: The generation AI sends negotiation emails and chats to the vendor

[0647] Specific behavior:

[0648] The server uses a generative AI model (e.g., GPT-4) to automatically send emails and chats to real estate agents and negotiate.

[0649] Step 4: Present the terms and conditions

[0650] The server notifies the user of the best contract terms.

[0651] Input: Optimal contract terms obtained by the generation AI

[0652] Output: The terms of the contract are presented to the user's device.

[0653] Specific behavior:

[0654] The conditions are presented to the user's device via push notification and can be checked within the app.

[0655] Step 5: Contract Approval and Processing

[0656] The user accepts the terms and conditions, and the server proceeds with the online contract procedure with the vendor.

[0657] Input: User presses "Approve" button within the app

[0658] Output: Contract documents are generated and delivered / signed online

[0659] Specific behavior:

[0660] When you press the "Approve" button within the app, the server generates the contract document and sends a signing link to the user and the vendor.

[0661] Procedure proxy function

[0662] Step 1: Enter your processing information

[0663] The user selects from a list of various procedures required for moving in the app and enters the necessary information.

[0664] Input: The user checks the options for electricity, gas, water, and government procedures and enters the details for each.

[0665] Output: Input data is temporarily saved in the internal memory.

[0666] Specific behavior:

[0667] The user selects the procedure required for the checklist and enters the details.

[0668] Step 2: Submit your transaction information

[0669] The terminal transmits the entered procedure information to the server.

[0670] Input: Procedural information entered by the user

[0671] Output: Data is sent to the server

[0672] Specific behavior:

[0673] The app makes a web request and sends information to the server.

[0674] Step 3: Procedure execution by generative AI

[0675] Based on the information received by the server, the generating AI automatically carries out procedures with each public institution.

[0676] Input: Procedure information received by the server

[0677] Output: The generating AI executes the procedure for each public institution.

[0678] Specific behavior:

[0679] The server uses a generative AI model to automatically send online forms and emails to electric companies, gas companies, waterworks, and city halls.

[0680] Step 4: Procedural progress management

[0681] The server monitors the progress of the procedure in real time and notifies the user.

[0682] Input: Progress from each public institution

[0683] Output: Progress is displayed in real time on the user's device

[0684] Specific behavior:

[0685] The app will display the progress of the procedure and send push notifications with status updates.

[0686] Plan presentation function

[0687] Step 1: Enter the condition

[0688] The user enters the moving conditions (cost, time, safety) into the app.

[0689] Input: The user enters the moving budget and desired date into the form.

[0690] Output: Input data is temporarily saved in the internal memory.

[0691] Specific behavior:

[0692] The user enters details into the form and presses the "Search" button.

[0693] Step 2: Sending conditions

[0694] The terminal transmits the input conditions to the server.

[0695] Input: User-entered criteria

[0696] Output: Data is sent to the server

[0697] Specific behavior:

[0698] The app makes a web request and sends information to the server.

[0699] Step 3: Generative AI generates a plan

[0700] The server analyzes the conditions, and the generation AI generates multiple moving plans.

[0701] Input: The conditions received by the server

[0702] Output: A list of plans is generated

[0703] Specific behavior:

[0704] The server uses a generative AI model to generate a variety of moving plans.

[0705] Step 4: Present your plan

[0706] The server presents the generated plans to the user, who then makes a selection.

[0707] Input: Generated moving plan

[0708] Output: The user is presented with a plan to choose from

[0709] Specific behavior:

[0710] The plans will be displayed on the user's device, and when the user presses the "Select" button, they can check the details of the selected plan.

[0711] (Application example 1)

[0712] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0713] The modern moving process is extremely time-consuming and inconvenient, requiring many steps. It's particularly difficult to efficiently complete a wide variety of tasks simultaneously, including viewing real estate properties, negotiating prices, completing contracts, handling government procedures, and even selecting the optimal moving plan. This creates a growing need for a system that allows users to efficiently and smoothly complete the entire process of moving.

[0714] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0715] In this invention, the server includes a means for the user to view a virtual property in the metaverse space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with real estate agents, and a means for using generative artificial intelligence to handle various procedures with public institutions, thereby enabling the user to efficiently and smoothly complete a series of tasks related to moving.

[0716] A "metaverse space" is a virtual physical space on the Internet created using virtual reality technology.

[0717] A "virtual property" is a 3D model of a real estate property recreated within the metaverse space.

[0718] "Generative AI" is an AI technology that automatically creates and generates text and information based on input data.

[0719] A "mobile device" is a portable electronic device such as a smartphone or tablet.

[0720] A "virtual reality display device" is a device such as a head-mounted display that allows a user to experience virtual reality.

[0721] "Public institutions" are institutions and government agencies that provide infrastructure such as electricity, gas, and water.

[0722] A "generative AI model" is an artificial intelligence model that generates new data and information based on pre-trained data.

[0723] "Conditions" refer to specific criteria or requirements desired by the user.

[0724] A "moving plan" is a proposal that includes specific plans and schedules related to moving.

[0725] "Streaming display" is a technology that transfers data in a stream format and displays it in real time.

[0726] This invention is a system that allows users to efficiently move, and has functions such as virtual property viewing in a metaverse space, proxy contract and procedure handling using generative artificial intelligence, and presentation of moving plans. Specific embodiments of this system are described below.

[0727] Hardware and software used

[0728] The system uses the following hardware and software:

[0729] Hardware: Smartphone (iOS or Android), virtual reality display device (e.g., head-mounted display)

[0730] software:

[0731] Language: Python, Swift (for iOS), Kotlin (for Android)

[0732] Generative Artificial Intelligence: OpenAI's GPT-4 API

[0733] 3D modeling and streaming: Unity, AWS Lambda, AWS S3

[0734] System configuration and functions

[0735] 1. Metaverse preview function

[0736] The user launches the smartphone app and enters the desired property ID. The device sends a request to the backend server (AWS Lambda), which retrieves a 3D model of the specified property from AWS S3, and uses the Unity engine to stream the 3D model on the smartphone. The user then puts on the virtual reality display device and moves freely within the virtual space to view the property.

[0737] 2. Contract agency function

[0738] When a user enters the terms (rent, contract period, etc.) in the app, generative artificial intelligence (GPT-4 API) initiates chat-based negotiations with a real estate agent based on the terms. The optimal contract terms are presented to the user, and once the user approves, contract documents are automatically generated and electronically signed.

[0739] 3. Procedure proxy function

[0740] Users select the required government procedure and enter the details into the app. Generative AI monitors and automatically executes each procedure in the backend. Progress is tracked in real time and reported to users via push notifications.

[0741] 4. Plan presentation function

[0742] Users input their desired moving conditions (cost, time, safety) into the app, and a generative AI model (GPT-4) uses historical and real-time data to generate the optimal moving plan. Users are then provided with information on arranging moving companies and a list of household items they will need in their new home.

[0743] Specific examples

[0744] For example, if a user plans to move to a large city, they first launch the app and enter their desired conditions (rent, area, etc.). They can then view multiple properties in the metaverse space and select the one they like best. They then use generative AI to negotiate with a real estate agent and conclude a contract with optimal terms. Next, the generative AI automatically handles the procedures for electricity, gas, water, etc., and the user can check the progress in the app. Finally, the app will present the optimal moving plan based on the user's conditions, allowing them to complete the move smoothly.

[0745] Example prompt for GPT-4 AI:

[0746] The user is planning to move to Tokyo. He is looking for a property with a monthly rent of less than 200,000 yen, within a 10-minute walk from the station. Generate a 3D model of the property and conduct a VR tour. Please explain the process of automating the contract with the real estate agent and the procedures required for the move with public institutions. Also, please present the optimal moving plan.

[0747] In this way, the present invention allows a series of tasks related to moving to be efficiently progressed and managed, significantly reducing the burden on the user.

[0748] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0749] Step 1:

[0750] The user launches the smartphone app and enters the desired property ID. The entered property ID is sent from the device to the backend server. The server retrieves the 3D model data of the corresponding property from AWS S3 based on the property ID.

[0751] Step 2:

[0752] The server uses the Unity engine to stream the acquired 3D model data to a smartphone. The device then uses VR goggles to allow users to view the property in a virtual space. Users can move freely around the property, checking the room layout and surrounding environment.

[0753] Step 3:

[0754] Users select a property they like during a virtual tour and enter their desired conditions (rent, contract period, etc.) in the app. These conditions are sent from the device to the server. The server passes this data to generative artificial intelligence (GPT-4 API), which initiates price negotiations and contract procedures.

[0755] Step 4:

[0756] The generative AI negotiates with the real estate agent via chat. The generative AI proceeds with the negotiation based on the user's desired conditions and derives the optimal contract terms. The derive contract terms are sent from the server to the terminal and presented to the user.

[0757] Step 5:

[0758] The user approves the presented contract terms and conditions, and the contract documents are automatically generated. The server uses generative artificial intelligence to create the contract documents, which are then digitally signed. The contract documents are then sent online to the real estate agent.

[0759] Step 6:

[0760] After completing the contract, the user selects the public institution procedure within the app and enters the necessary information. This information is sent from the device to the server, which uses generative artificial intelligence to automatically process the electricity, gas, water, and other procedures and monitors their progress.

[0761] Step 7:

[0762] The progress of the transaction is tracked in real time and reported to the device via push notifications from the server, and the user can check in the app that the transaction is complete.

[0763] Step 8:

[0764] Users enter the conditions of their desired moving plan (cost, time, safety, etc.) into the app. The entered conditions are sent from the device to the server. The server uses a generative AI model (GPT-4) to analyze past and real-time data and generate the optimal moving plan.

[0765] Step 9:

[0766] The generated moving plan is sent from the server to the terminal and presented to the user. The user selects the most suitable moving plan and proceeds with specific preparations, such as arranging for a moving company and making a list of daily necessities.

[0767] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0768] The present invention is a system that enables users to move efficiently, and includes features such as property viewing in a metaverse space, contract and procedure handling by generative artificial intelligence, presentation of moving plans, and optimization functions using an emotion engine.

[0769] Metaverse preview function

[0770] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[0771] Contract agency function

[0772] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[0773] Procedure proxy function

[0774] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[0775] Plan presentation function

[0776] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[0777] Emotion engine combination function

[0778] Optimizing property proposals using an emotion engine

[0779] The emotion engine recognizes the user's emotional state through facial and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[0780] Changing negotiation strategies with emotion engines

[0781] The emotion engine detects the user's tension or anxiety and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[0782] Optimizing the moving process with an emotion engine

[0783] The emotion engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[0784] Specific examples

[0785] For example, if a user is planning to move to a big city for a new job, they first launch the app on their mobile device, input their desired area and conditions, and search for properties. They can then preview multiple properties in the metaverse space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan based on the user's stress level and desired conditions is generated and presented.

[0786] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, emotion engine, and automatic procedures based on user input information to provide an efficient and comfortable moving experience that significantly reduces the user's time and effort.

[0787] The processing flow will be explained below.

[0788] Metaverse preview function

[0789] Step 1:

[0790] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[0791] Step 2:

[0792] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[0793] Step 3:

[0794] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[0795] Step 4:

[0796] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[0797] Step 5:

[0798] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[0799] Step 6:

[0800] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[0801] Contract agency function

[0802] Step 1:

[0803] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[0804] Step 2:

[0805] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[0806] Step 3:

[0807] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[0808] Step 4:

[0809] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[0810] Step 5:

[0811] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[0812] Procedure proxy function

[0813] Step 1:

[0814] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[0815] Step 2:

[0816] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[0817] Step 3:

[0818] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[0819] Plan presentation function

[0820] Step 1:

[0821] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[0822] Step 2:

[0823] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[0824] Step 3:

[0825] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[0826] Step 4:

[0827] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[0828] Emotion engine combination function

[0829] Optimizing property proposals using an emotion engine

[0830] Step 1:

[0831] When a user launches the app on their mobile device and tours the metaverse, facial expressions and voice are collected using the device's camera and microphone.

[0832] Step 2:

[0833] The server analyzes the collected facial and voice data to determine the user's emotional state (happiness, excitement, frustration, stress, etc.).

[0834] Step 3:

[0835] The server uses an emotion engine to evaluate the property features based on the user's emotion information, for example, recording the property features for which the user expressed joy or excitement.

[0836] Step 4:

[0837] The next time a user views a property in the metaverse, the server will prioritize displaying the most suitable property based on the recorded emotional data.

[0838] Changing negotiation strategies with emotion engines

[0839] Step 1:

[0840] The user enters their desired conditions and begins contract negotiations. At that time, the device's camera and microphone collect the user's facial expressions and voice.

[0841] Step 2:

[0842] The server analyzes the collected facial and voice data to determine the user's level of tension or anxiety.

[0843] Step 3:

[0844] The server uses generative artificial intelligence to select the optimal negotiation strategy based on the user's emotional state. For example, if the user is feeling stressed, the server will pause the negotiation and provide advice on how to relax.

[0845] Step 4:

[0846] The negotiation can resume when the user is relaxed, or intensify if the user is satisfied.

[0847] Optimizing the moving process with an emotion engine

[0848] Step 1:

[0849] When a user uses the plan presentation function, facial expressions and voice are collected using the device's camera and microphone.

[0850] Step 2:

[0851] The server analyzes the collected facial and voice data to determine the user's stress level.

[0852] Step 3:

[0853] The server uses generative artificial intelligence to automatically adjust the plan based on the user's stress level and desired conditions. For example, if the user is in a high-stress state, it will present a plan that includes services that help them relax.

[0854] Step 4:

[0855] The user selects the most suitable plan from the presented plans, and the server proceeds with the specific moving procedures.

[0856] Through the above specific processing steps, the moving assistance system according to the present invention provides the user with an optimal moving experience while taking into consideration the user's emotional state.

[0857] Example 2

[0858] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0859] Moving requires many procedures and choices, placing a significant burden on users. However, conventional moving assistance systems have difficulty efficiently handling property selection, contract procedures, and procedures with public institutions. In particular, they lack the flexibility to respond to the user's emotional state, which makes it difficult to reduce the user's stress. The present invention aims to solve these problems and provide users with an efficient and comfortable moving experience.

[0860] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to view a virtual property in a virtual reality space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with a real estate agent, a means for using generative artificial intelligence to handle various procedures at public institutions, a means for generating multiple moving plans and presenting the most suitable plan, a means for saving information input by the user and automatically inputting necessary data, and a means for analyzing the user's emotional data using an emotion recognition engine and optimizing property proposals, negotiation strategies, and moving plans based on the results. This allows the user to consistently perform all procedures and selections related to moving, and further enables flexible responses according to the user's emotional state, thereby significantly reducing stress.

[0861] A "virtual reality space" is a virtual environment that resembles the real world and is generated using computer technology.

[0862] "Generative AI" is an AI technology that has the ability to self-learn based on massive amounts of data and automatically generate new data and results.

[0863] An "emotion recognition engine" is a computer program that analyzes a user's facial expressions and voice data to identify their emotional state.

[0864] The "negotiation process" is the process of discussing and reaching an agreement on terms and contractual content with real estate agents and public agencies.

[0865] "Public institutions" are organizations and facilities that provide electricity, gas, water, and administrative services.

[0866] A "moving plan" is a plan that includes optimal moving procedures and arrangements based on the user's conditions and wishes.

[0867] "User input information" refers to data indicating personal information and desired conditions for moving that the user provides to the system.

[0868] This invention is a system that allows users to move efficiently and comfortably. This system features features such as property viewing in a virtual reality space, negotiation and contract procedures handled by generative artificial intelligence, handling procedures at public institutions, generating and presenting moving plans, and optimization functions using an emotion recognition engine.

[0869] Metaverse preview function

[0870] In this system, the user first launches a dedicated app on their mobile device and tours a virtual property in a virtual reality space. Based on the property information specified by the user, the server uses a 3D engine (e.g., Unity) to generate a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[0871] Contract agency function

[0872] Once a user finds a property they desire, generative AI then negotiates the price with the real estate agent and handles the contract procedures. When a user enters their desired conditions through the app, the server receives the information and automatically begins negotiations with the real estate agent using generative AI (e.g., OpenAI GPT model). It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[0873] Procedure proxy function

[0874] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and government agencies. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[0875] Plan presentation function

[0876] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[0877] Emotion engine combination function

[0878] Optimizing property proposals using an emotion engine

[0879] The emotion recognition engine recognizes the user's emotional state through facial expressions and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[0880] Changing negotiation strategies with emotion engines

[0881] The emotion recognition engine detects the user's tension or anxiety, and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[0882] Optimizing the moving process with an emotion engine

[0883] The emotion recognition engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[0884] Specific examples

[0885] For example, if a user is planning to move to a big city for a new job, they first launch an app on their mobile device, input their desired area and conditions, and search for properties. The user can then preview multiple properties in a virtual reality space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion recognition engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan is generated and presented based on the user's stress level and desired conditions.

[0886] Example prompt sentence:

[0887] "I'm looking for the perfect property to move into. I'd like a 2LDK property in Tokyo with rent under 100,000 yen. I'd also like it to be within a 30-minute commute and have a supermarket or park nearby."

[0888] As described above, the moving assistance system of the present invention combines the functions of a virtual reality space, generative artificial intelligence, an emotion recognition engine, and automatic procedures based on user input information, providing the user with an efficient and comfortable moving experience that significantly reduces time and effort.

[0889] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0890] Step 1:

[0891] The user inputs desired conditions on a mobile device.

[0892] The user launches a dedicated app on their mobile device and inputs information about the desired property, such as the area, rent, and layout. The input information is sent to the server. Input data may include, for example, "Tokyo, rent under 100,000 yen, 2LDK, pets allowed."

[0893] Step 2:

[0894] The server receives property information and generates a 3D model

[0895] The server searches the database for relevant property information based on the desired conditions received from the user. Based on the search results, a 3D model of the virtual property is generated using a 3D engine (e.g., Unity). The generated 3D model is streamed to the user's device. The input data is the desired conditions for the property, and the output data is a 3D virtual property model.

[0896] Step 3:

[0897] A user conducts a virtual tour

[0898] Users can freely move around the virtual property using their device or VR goggles to view it. They can also check information about each room and the surrounding environment. The input data is the user's operational information, and the output data is the user's visual perception and the results of their operations.

[0899] Step 4:

[0900] The user selects the desired property and enters the contract terms.

[0901] After the user has completed the virtual viewing, they select the property they want and enter their desired contract terms (e.g., maximum monthly rent, contract period, etc.). The server receives this information. The input data is the property selected by the user and their desired contract terms, and the output data is the received contract terms.

[0902] Step 5:

[0903] Generative AI begins negotiations

[0904] Based on the desired contract terms received by the server, a generative AI (e.g., OpenAI GPT model) initiates direct negotiations with the real estate agent. The generative AI performs complex calculations and data analysis to derive optimal contract terms, and feeds the results back to the server. The input data is the desired contract terms, and the output data is the result of negotiations with the real estate agent.

[0905] Step 6:

[0906] The server presents the optimal contract terms to the user

[0907] The server presents the optimal contract terms derived by the generative AI to the user. The user then checks the details in the app and decides whether to approve the contract. The input data is the negotiation results, and the output data is the contract terms presented to the user.

[0908] Step 7:

[0909] Proceed with the online contract procedure

[0910] If the user approves the contract terms, the server proceeds with the online contract procedure. A contract with the real estate agent is generated and delivered to the user online. The user then signs the contract online. The input data is the approved contract terms, and the output data is the signed contract.

[0911] Step 8:

[0912] The user enters the procedure information

[0913] After completing the contract, the user enters detailed information through the app to complete procedures for electricity, gas, and water, change address, etc. The input data is a list of necessary procedures and detailed information, and the output data is the procedure information sent to the server.

[0914] Step 9:

[0915] Generative AI will handle the procedures

[0916] Based on the procedure information received by the server, generative AI automatically executes procedures with electricity, gas, water, and government agencies. Progress is monitored in real time, and the results are notified to the user. The input data is the procedure information, and the output data is the procedure progress and completion notification.

[0917] Step 10:

[0918] The user enters the moving conditions.

[0919] The user inputs moving conditions (cost, time, safety, etc.) into the app. The input data is the moving conditions, and the output data is the condition information sent to the server.

[0920] Step 11:

[0921] The server generates and presents a moving plan

[0922] The server uses generative artificial intelligence to generate multiple moving plans based on the received moving conditions and presents them to the user. The user selects the most suitable plan. The input data is the moving conditions, and the output data is the generated moving plan.

[0923] Step 12:

[0924] Emotion recognition engine analyzes user emotions

[0925] The emotion recognition engine analyzes the user's facial expression and voice data and provides information about the user's emotional state to the server. The input data is the user's facial expression and voice data, and the output data is the analysis result.

[0926] Step 13:

[0927] Optimize based on emotional data

[0928] The server uses the emotional data to optimize property proposals, negotiation strategies, and moving plans. If the user's stress level is high, it provides a relaxing service and presents the optimal plan. The input data is emotional data, and the output data is the optimized proposals and plans.

[0929] Through the above processing steps, the entire moving process proceeds efficiently and smoothly, realizing a system that significantly reduces the burden on the user.

[0930] (Application example 2)

[0931] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0932] Conventional moving assistance systems require users to inspect and select properties, complete contract procedures, and handle all procedures with public institutions themselves, which requires a great deal of time and effort. Furthermore, users must select and install the appropriate security system for their new home, which can be difficult to do without specialized knowledge. Furthermore, these systems do not take into consideration psychological stress management during the moving process, making it difficult to improve the user experience.

[0933] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0934] In this invention, the server includes: a means for a user to view virtual properties in the metaverse space; a means for using generative artificial intelligence to negotiate prices and complete contract procedures with real estate agents; a means for using generative artificial intelligence to complete various procedures with public institutions; a means for generating multiple moving plans and presenting the optimal plan; a means for storing user input information in a database and automatically entering necessary data; a means for using generative artificial intelligence to propose security systems and present security device installation plans; and a means for analyzing the user's emotional state using an emotion engine and optimizing the entire moving process according to the user's emotions. This significantly reduces the user's time and effort and provides an efficient and comfortable moving experience. Users can also select an appropriate system without specialized security knowledge and obtain an optimal moving plan that also takes psychological stress management into consideration.

[0935] The "metaverse space" is a virtual world constructed using virtual reality technology, which users can access via the Internet and where they can engage in various activities.

[0936] "Generative AI" is an AI technology that can automatically make optimal suggestions and decisions based on the user's wishes and conditions.

[0937] A "database" is a system for efficiently managing, storing, searching, and updating multiple pieces of data.

[0938] A "security system" is a combination of devices and software that protects data and property from risks such as unauthorized access and information leaks.

[0939] The "emotion engine" is a technology that analyzes a user's emotional state from their facial expressions, voice, and other biometric data, and provides appropriate feedback.

[0940] A "moving plan" is a set of multiple options generated based on the user's desired conditions for moving, and is a plan that takes into consideration factors such as cost, time, and safety.

[0941] "Public institutions" are organizations that provide infrastructure such as electricity, gas, and water, and government offices that provide administrative services.

[0942] The system of this invention allows users to efficiently move by viewing virtual properties in a metaverse space, automating various procedures using generative artificial intelligence, and managing user stress using an emotion engine.

[0943] Metaverse preview function

[0944] The server generates a 3D model of the virtual property based on the property information specified by the user and streams it to the user's device. This allows the user to freely view the virtual property within the metaverse space using VR goggles or a mobile device. For example, if a user is looking for a new home, they can enter their desired area and conditions to instantly visually check related virtual properties.

[0945] Contract agency function

[0946] When a user finds a property they like, the generative AI handles price negotiations and contract procedures with the real estate agent. When the user enters their desired conditions through the app, the server receives the information and automatically begins negotiations with the real estate agent. For example, by inputting a prompt such as "Please negotiate the rent" into the generative AI model, the AI ​​will propose the optimal conditions.

[0947] Procedure proxy function

[0948] After the contract is completed, the generative AI handles various procedures with public institutions, such as electricity, gas, and water. The user selects the necessary procedures in the app and enters the necessary information. The server then executes the procedures with each public institution, monitors the progress in real time, and notifies the user. For example, it uses prompts such as, "Please complete the procedures to turn on the water service following your move."

[0949] Security system proposal function

[0950] Generative AI proposes the optimal security system based on the user's desired conditions and presents a security device installation plan. When the user inputs the required security features, the AI ​​proposes the appropriate devices and presents an installation plan. For example, it generates a prompt such as, "Please propose the optimal plan for installing smart locks and CCTV."

[0951] Emotion engine optimization function

[0952] The emotion engine analyzes the user's facial expressions, voice, and other biometric data to recognize their emotional state. The server then uses this emotional information to optimize the entire moving process. For example, if the user is under high stress, the engine will provide advice on how to relax or suggest changes to the plan to reduce tension.

[0953] Specific examples

[0954] For example, if a user is moving to a new city, they launch an app on their mobile device and search for properties by entering their desired area and other conditions. They can then preview virtual properties in the metaverse space, and once they find one they like, generative AI will negotiate a rental contract. The following prompt sentences are used:

[0955] "Please negotiate the rent."

[0956] After the contract is completed, the generative AI will handle the electricity, gas, and water service activation procedures, using prompts such as the following:

[0957] "Please complete the procedures to get your water service turned on when I move."

[0958] Furthermore, the following prompt sentences are used in proposing security systems:

[0959] "Please suggest the best plan for installing smart locks and CCTV."

[0960] Finally, the emotion engine analyzes the user's emotions and provides feedback for stress management, for example:

[0961] "Relax, we'll take care of everything."

[0962] As described above, the present invention is a system that efficiently automates the various procedures that users face when moving, improving the user experience.

[0963] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0964] Step 1:

[0965] Users access the metaverse space using their devices and search for properties by entering the desired area and other conditions. The server searches the database based on the entered conditions and retrieves relevant property information. The server generates a 3D model of the virtual property and streams it to the user's device. The user can then freely view the virtual property using VR goggles.

[0966] Step 2:

[0967] After viewing the property and selecting one they like, the user sends the property information to the server via their device. The server then uses generative AI to negotiate the price and begin the contract process with the real estate agent. The generative AI calculates the optimal terms based on the user's desired conditions and presents them to the real estate agent. Once negotiations are successful, the server generates the contract documents and completes the contract through an electronic signature.

[0968] Step 3:

[0969] After completing the contract, the user uses their device to select a list of procedures that need to be completed with public institutions. The server receives this and uses generative artificial intelligence to automatically complete procedures for electricity, gas, water, etc. The server then processes the applications with each public institution, monitors the progress in real time, and notifies the user.

[0970] Step 4:

[0971] When a user inputs their security requirements for their new home into a terminal, the server uses generative AI to propose the optimal security system. Based on the user's requirements, the generative AI considers options such as smart locks and CCTV, and generates the optimal security plan. The server then presents this plan to the user and provides an installation plan.

[0972] Step 5:

[0973] Throughout the moving process, the server uses an emotion engine to analyze the user's facial expressions and voice to recognize their emotional state. Based on this emotional information, the server generates feedback to optimize the moving process. For example, if the user is in a high-stress state, the server will provide advice on how to relax and adjust the plan as necessary.

[0974] Step 6:

[0975] Once all procedures are completed, the server stores the user's input information in a database so that the necessary data can be automatically entered for future procedures, allowing the user to easily perform similar procedures the next time they move.

[0976] Through the above processing steps, the present invention is a system that significantly reduces the many procedures and labor that users face when moving, and provides an efficient and comfortable moving experience.

[0977] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0978] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0979] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0980] [Third embodiment]

[0981] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0982] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0983] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0984] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0985] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0986] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0987] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0988] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0989] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0990] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0991] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0992] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0993] The present invention is a system that allows users to move efficiently, and has functions such as property viewing in the metaverse space, contract and procedure handling by generative artificial intelligence, and presentation of moving plans.

[0994] Metaverse preview function

[0995] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[0996] Contract agency function

[0997] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[0998] Procedure proxy function

[0999] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[1000] Plan presentation function

[1001] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[1002] Specific examples

[1003] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then view multiple properties in the metaverse space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for opening electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a specific plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[1004] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[1005] The processing flow will be explained below.

[1006] Metaverse preview function

[1007] Step 1:

[1008] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[1009] Step 2:

[1010] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[1011] Step 3:

[1012] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[1013] Step 4:

[1014] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[1015] Step 5:

[1016] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[1017] Step 6:

[1018] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[1019] Contract agency function

[1020] Step 1:

[1021] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[1022] Step 2:

[1023] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[1024] Step 3:

[1025] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[1026] Step 4:

[1027] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[1028] Step 5:

[1029] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[1030] Procedure proxy function

[1031] Step 1:

[1032] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[1033] Step 2:

[1034] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[1035] Step 3:

[1036] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[1037] Plan presentation function

[1038] Step 1:

[1039] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[1040] Step 2:

[1041] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[1042] Step 3:

[1043] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[1044] Step 4:

[1045] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[1046] Example 1

[1047] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1048] Conventional moving procedures and property searches are extremely cumbersome for users, requiring many steps, such as viewing the property on-site, negotiating a contract, and completing various procedures. This consumes a lot of time and effort, and makes it difficult to plan an efficient move. Furthermore, viewing a property requires traveling to the property, making it difficult to search for a property from a remote location. Furthermore, procedures must be completed individually with various public institutions, creating the challenge of cumbersome progress management.

[1049] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1050] In this invention, the server includes a means for users to view virtual properties in a virtual space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with agents, and a means for using generative artificial intelligence to handle procedures with public institutions. This allows users to efficiently search for properties and easily view them from remote locations. Furthermore, by using generative artificial intelligence to automatically handle contract procedures and procedures with public institutions, users can easily complete the complicated procedures associated with moving. This allows users to significantly save time and effort and realize a smooth move.

[1051] "User" refers to an individual or corporation who uses the system to view properties and complete contract procedures.

[1052] A "virtual space" is a three-dimensional digital environment generated on a computer system that serves as a stage for viewing and touring properties.

[1053] A "virtual property" is a digital model of a property visualized in a virtual space, which can be viewed in the same way as a real property.

[1054] "Viewing" refers to the act of a user visually checking a virtual property and understanding its internal layout and surrounding environment.

[1055] "Generative AI" refers to artificial intelligence technology that automatically negotiates prices and completes contract procedures with real estate agents based on information entered by the user.

[1056] "Business" refers to commercial organizations such as real estate agents and moving companies that provide properties and handle contract procedures.

[1057] "Price negotiation" refers to the act of generative artificial intelligence negotiating rent and contract terms with a contractor based on the user's desired conditions.

[1058] "Contract procedures" refers to the act of carrying out formal procedures for renting or purchasing a property.

[1059] "Public institutions" refers to companies that provide electricity, gas, and water, as well as government agencies such as government offices.

[1060] "Procedures" refers to the actions that users take with various public institutions when moving, such as turning on electricity, gas, and water services, and changing their address.

[1061] A "moving plan" refers to a moving plan that includes the work content and schedule when a user moves.

[1062] A "database" refers to a system that systematically stores user input information and contract information and retrieves that information as needed.

[1063] The present invention is a system that allows users to move efficiently, and includes functions such as viewing properties in a virtual space, using generative artificial intelligence to handle contracts and procedures, and presenting moving plans. Detailed embodiments of each function are described below.

[1064] Metaverse preview function

[1065] In this system, users first launch a dedicated app on their mobile device and view properties in a virtual space. The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device. Users can move freely around the virtual property using VR goggles or touch controls on their device, checking out each room and the surrounding environment. Specific hardware used is a smartphone, tablet, and VR goggles, while software uses 3D modeling engines such as Unity or Unreal Engine.

[1066] Contract agency function

[1067] Once the user finds the property they desire, the generative AI then negotiates the price with the agent and handles the contract procedures on their behalf. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the agent and delivers and signs the necessary documents online. Specific generative AI uses advanced natural language processing models such as GPT-4.

[1068] Procedure proxy function

[1069] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place using the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users select the necessary procedures from the list and enter the details through the app. The server then executes the procedures with each public agency, monitors the progress in real time, and notifies the user.

[1070] Plan presentation function

[1071] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[1072] Specific examples

[1073] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then browse multiple properties in a virtual space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a detailed plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[1074] Prompt Sentence Examples

[1075] "A user has entered their desired moving date as May 1st and a budget of 200,000 yen. Please use generative AI to suggest the optimal moving plan."

[1076] As described above, the moving assistance system of the present invention combines the functions of virtual space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[1077] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1078] Metaverse preview function

[1079] Step 1: Launch the app

[1080] The user launches the dedicated app on their mobile device.

[1081] Input: User taps smartphone icon

[1082] Output: The app starts and the initial screen is displayed.

[1083] Specific behavior:

[1084] The user taps the icon on their smartphone to open the app.

[1085] Step 2: Enter property information

[1086] The user enters the desired property information (e.g., area, budget, floor plan) into the app.

[1087] Input: The user enters the area name, rent range, and desired floor plan into the form on the screen.

[1088] Output: Input data is temporarily saved in the internal memory.

[1089] Specific behavior:

[1090] The user enters the required information into the form on the screen and presses the "Search" button.

[1091] Step 3: Submit your listing

[1092] The terminal transmits the entered property information to the server.

[1093] Input: Information entered by the user

[1094] Output: Data is sent over the internet to a server

[1095] Specific behavior:

[1096] The app makes a web request and sends information to the server.

[1097] Step 4: Creating a Metaverse Space

[1098] The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device.

[1099] Input: User property information received by the server

[1100] Output: The generated 3D model is streamed to your device.

[1101] Specific behavior:

[1102] The server generates virtual objects using a 3D modeling engine (such as Unity or Unreal Engine) and streams them in real time.

[1103] Step 5: Conduct a tour

[1104] Users can use VR goggles or a device to tour the virtual property and check each room and the surrounding environment.

[1105] Input: User operation (changing the viewpoint of the VR goggles or touching the device)

[1106] Output: Visual information of each room in the virtual property and the surrounding environment

[1107] Specific behavior:

[1108] The user can move the viewpoint using VR goggles or walk around the room using touch controls on the device.

[1109] Contract agency function

[1110] Step 1: Enter your desired conditions

[1111] The user enters the desired contract terms (e.g., rent, contract period) into the app.

[1112] Input: The user enters detailed information such as rent and contract period into a dedicated form.

[1113] Output: Input data is temporarily saved in the internal memory.

[1114] Specific behavior:

[1115] The user fills in the form with details and presses the "Submit" button.

[1116] Step 2: Sending conditions

[1117] The terminal transmits the input desired conditions to the server.

[1118] Input: Desired conditions entered by the user

[1119] Output: Data is sent over the internet to a server

[1120] Specific behavior:

[1121] The app makes a web request and sends information to the server.

[1122] Step 3: Negotiation begins with generative AI

[1123] Based on the conditions received by the server, the generation AI automatically begins negotiations with the vendor.

[1124] Input: Desired conditions received by the server

[1125] Output: The generation AI sends negotiation emails and chats to the vendor

[1126] Specific behavior:

[1127] The server uses a generative AI model (e.g., GPT-4) to automatically send emails and chats to real estate agents and negotiate.

[1128] Step 4: Present the terms and conditions

[1129] The server notifies the user of the best contract terms.

[1130] Input: Optimal contract terms obtained by the generation AI

[1131] Output: The terms of the contract are presented to the user's device.

[1132] Specific behavior:

[1133] The conditions are presented to the user's device via push notification and can be checked within the app.

[1134] Step 5: Contract Approval and Processing

[1135] The user accepts the terms and conditions, and the server proceeds with the online contract procedure with the vendor.

[1136] Input: User presses "Approve" button within the app

[1137] Output: Contract documents are generated and delivered / signed online

[1138] Specific behavior:

[1139] When you press the "Approve" button within the app, the server generates the contract document and sends a signing link to the user and the vendor.

[1140] Procedure proxy function

[1141] Step 1: Enter your processing information

[1142] The user selects from a list of various procedures required for moving in the app and enters the necessary information.

[1143] Input: The user checks the options for electricity, gas, water, and government procedures and enters the details for each.

[1144] Output: Input data is temporarily saved in the internal memory.

[1145] Specific behavior:

[1146] The user selects the procedure required from the checklist and enters the details.

[1147] Step 2: Submit your transaction information

[1148] The terminal transmits the entered procedure information to the server.

[1149] Input: Procedural information entered by the user

[1150] Output: Data is sent to the server

[1151] Specific behavior:

[1152] The app makes a web request and sends information to the server.

[1153] Step 3: Procedure execution by generative AI

[1154] Based on the information received by the server, the generating AI automatically carries out procedures with each public institution.

[1155] Input: Procedure information received by the server

[1156] Output: The generating AI executes the procedure for each public institution.

[1157] Specific behavior:

[1158] The server uses a generative AI model to automatically send online forms and emails to electric companies, gas companies, waterworks, and city halls.

[1159] Step 4: Procedural progress management

[1160] The server monitors the progress of the procedure in real time and notifies the user.

[1161] Input: Progress from each public institution

[1162] Output: Progress is displayed in real time on the user's device

[1163] Specific behavior:

[1164] The app will display the progress of the procedure and send push notifications with status updates.

[1165] Plan presentation function

[1166] Step 1: Enter the condition

[1167] The user enters the moving conditions (cost, time, safety) into the app.

[1168] Input: The user enters the moving budget and desired date into the form.

[1169] Output: Input data is temporarily saved in the internal memory.

[1170] Specific behavior:

[1171] The user enters details into the form and presses the "Search" button.

[1172] Step 2: Sending conditions

[1173] The terminal transmits the input conditions to the server.

[1174] Input: User-entered criteria

[1175] Output: Data is sent to the server

[1176] Specific behavior:

[1177] The app makes a web request and sends information to the server.

[1178] Step 3: Generative AI generates a plan

[1179] The server analyzes the conditions, and the generation AI generates multiple moving plans.

[1180] Input: The conditions received by the server

[1181] Output: A list of plans is generated

[1182] Specific behavior:

[1183] The server uses a generative AI model to generate a variety of moving plans.

[1184] Step 4: Present your plan

[1185] The server presents the generated plans to the user, who then makes a selection.

[1186] Input: Generated moving plan

[1187] Output: The user is presented with a plan to choose from

[1188] Specific behavior:

[1189] The plans will be displayed on the user's device, and when the user presses the "Select" button, they can check the details of the selected plan.

[1190] (Application example 1)

[1191] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1192] The modern moving process is extremely time-consuming and inconvenient, requiring many steps. It's particularly difficult to efficiently complete a wide variety of tasks simultaneously, including viewing real estate properties, negotiating prices, completing contracts, handling government procedures, and even selecting the optimal moving plan. This creates a growing need for a system that allows users to efficiently and smoothly complete the entire process of moving.

[1193] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1194] In this invention, the server includes a means for the user to view a virtual property in the metaverse space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with real estate agents, and a means for using generative artificial intelligence to handle various procedures with public institutions, thereby enabling the user to efficiently and smoothly complete a series of tasks related to moving.

[1195] A "metaverse space" is a virtual physical space on the Internet created using virtual reality technology.

[1196] A "virtual property" is a 3D model of a real estate property recreated within the metaverse space.

[1197] "Generative AI" is an AI technology that automatically creates and generates text and information based on input data.

[1198] A "mobile device" is a portable electronic device such as a smartphone or tablet.

[1199] A "virtual reality display device" is a device such as a head-mounted display that allows a user to experience virtual reality.

[1200] "Public institutions" are institutions and government agencies that provide infrastructure such as electricity, gas, and water.

[1201] A "generative AI model" is an artificial intelligence model that generates new data and information based on pre-trained data.

[1202] "Conditions" refer to specific criteria or requirements desired by the user.

[1203] A "moving plan" is a proposal that includes specific plans and schedules related to moving.

[1204] "Streaming display" is a technology that transfers data in a stream format and displays it in real time.

[1205] This invention is a system that allows users to efficiently move, and has functions such as virtual property viewing in a metaverse space, proxy contract and procedure handling using generative artificial intelligence, and presentation of moving plans. Specific embodiments of this system are described below.

[1206] Hardware and software used

[1207] The system uses the following hardware and software:

[1208] Hardware: Smartphone (iOS or Android), virtual reality display device (e.g., head-mounted display)

[1209] software:

[1210] Language: Python, Swift (for iOS), Kotlin (for Android)

[1211] Generative Artificial Intelligence: OpenAI's GPT-4 API

[1212] 3D modeling and streaming: Unity, AWS Lambda, AWS S3

[1213] System configuration and functions

[1214] 1. Metaverse preview function

[1215] The user launches the smartphone app and enters the desired property ID. The device sends a request to the backend server (AWS Lambda), which retrieves a 3D model of the specified property from AWS S3, and uses the Unity engine to stream the 3D model on the smartphone. The user then puts on the virtual reality display device and moves freely within the virtual space to view the property.

[1216] 2. Contract agency function

[1217] When a user enters the terms (rent, contract period, etc.) in the app, generative artificial intelligence (GPT-4 API) initiates chat-based negotiations with a real estate agent based on the terms. The optimal contract terms are presented to the user, and once the user approves, contract documents are automatically generated and electronically signed.

[1218] 3. Procedure proxy function

[1219] Users select the required government procedure and enter the details into the app. Generative AI monitors and automatically executes each procedure in the backend. Progress is tracked in real time and reported to users via push notifications.

[1220] 4. Plan presentation function

[1221] Users input their desired moving conditions (cost, time, safety) into the app, and a generative AI model (GPT-4) uses historical and real-time data to generate the optimal moving plan. Users are then provided with information on arranging moving companies and a list of household items they will need in their new home.

[1222] Specific examples

[1223] For example, if a user plans to move to a large city, they first launch the app and enter their desired conditions (rent, area, etc.). They can then view multiple properties in the metaverse space and select the one they like best. They then use generative AI to negotiate with a real estate agent and conclude a contract with optimal terms. Next, the generative AI automatically handles the procedures for electricity, gas, water, etc., and the user can check the progress in the app. Finally, the app will present the optimal moving plan based on the user's conditions, allowing them to complete the move smoothly.

[1224] Example prompt for GPT-4 AI:

[1225] The user is planning to move to Tokyo. He is looking for a property with a monthly rent of less than 200,000 yen, within a 10-minute walk from the station. Generate a 3D model of the property and conduct a VR tour. Please explain the process of automating the contract with the real estate agent and the procedures required for the move with public institutions. Also, please present the optimal moving plan.

[1226] In this way, the present invention allows a series of tasks related to moving to be efficiently progressed and managed, significantly reducing the burden on the user.

[1227] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1228] Step 1:

[1229] The user launches the smartphone app and enters the desired property ID. The entered property ID is sent from the device to the backend server. The server retrieves the 3D model data of the corresponding property from AWS S3 based on the property ID.

[1230] Step 2:

[1231] The server uses the Unity engine to stream the acquired 3D model data to a smartphone. The device then uses VR goggles to allow users to view the property in a virtual space. Users can move freely around the property, checking the room layout and surrounding environment.

[1232] Step 3:

[1233] Users select a property they like during a virtual tour and enter their desired conditions (rent, contract period, etc.) in the app. These conditions are sent from the device to the server. The server passes this data to generative artificial intelligence (GPT-4 API), which initiates price negotiations and contract procedures.

[1234] Step 4:

[1235] The generative AI negotiates with the real estate agent via chat. The generative AI proceeds with the negotiation based on the user's desired conditions and derives the optimal contract terms. The derive contract terms are sent from the server to the terminal and presented to the user.

[1236] Step 5:

[1237] The user approves the presented contract terms and conditions, and the contract documents are automatically generated. The server uses generative artificial intelligence to create the contract documents, which are then digitally signed. The contract documents are then sent online to the real estate agent.

[1238] Step 6:

[1239] After completing the contract, the user selects the public institution procedure within the app and enters the necessary information. This information is sent from the device to the server, which uses generative artificial intelligence to automatically process the electricity, gas, water, and other procedures and monitors their progress.

[1240] Step 7:

[1241] The progress of the transaction is tracked in real time and reported to the device via push notifications from the server, and the user can check in the app that the transaction is complete.

[1242] Step 8:

[1243] Users enter the conditions of their desired moving plan (cost, time, safety, etc.) into the app. The entered conditions are sent from the device to the server. The server uses a generative AI model (GPT-4) to analyze past and real-time data and generate the optimal moving plan.

[1244] Step 9:

[1245] The generated moving plan is sent from the server to the terminal and presented to the user. The user selects the most suitable moving plan and proceeds with specific preparations, such as arranging for a moving company and making a list of daily necessities.

[1246] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1247] The present invention is a system that enables users to move efficiently, and includes features such as property viewing in a metaverse space, contract and procedure handling by generative artificial intelligence, presentation of moving plans, and optimization functions using an emotion engine.

[1248] Metaverse preview function

[1249] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[1250] Contract agency function

[1251] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[1252] Procedure proxy function

[1253] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[1254] Plan presentation function

[1255] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[1256] Emotion engine combination function

[1257] Optimizing property proposals using an emotion engine

[1258] The emotion engine recognizes the user's emotional state through facial and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[1259] Changing negotiation strategies with emotion engines

[1260] The emotion engine detects the user's tension or anxiety and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[1261] Optimizing the moving process with an emotion engine

[1262] The emotion engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[1263] Specific examples

[1264] For example, if a user is planning to move to a big city for a new job, they first launch the app on their mobile device, input their desired area and conditions, and search for properties. They can then preview multiple properties in the metaverse space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan based on the user's stress level and desired conditions is generated and presented.

[1265] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, emotion engine, and automatic procedures based on user input information to provide an efficient and comfortable moving experience that significantly reduces the user's time and effort.

[1266] The processing flow will be explained below.

[1267] Metaverse preview function

[1268] Step 1:

[1269] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[1270] Step 2:

[1271] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[1272] Step 3:

[1273] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[1274] Step 4:

[1275] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[1276] Step 5:

[1277] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[1278] Step 6:

[1279] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[1280] Contract agency function

[1281] Step 1:

[1282] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[1283] Step 2:

[1284] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[1285] Step 3:

[1286] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[1287] Step 4:

[1288] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[1289] Step 5:

[1290] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[1291] Procedure proxy function

[1292] Step 1:

[1293] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[1294] Step 2:

[1295] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[1296] Step 3:

[1297] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[1298] Plan presentation function

[1299] Step 1:

[1300] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[1301] Step 2:

[1302] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[1303] Step 3:

[1304] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[1305] Step 4:

[1306] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[1307] Emotion engine combination function

[1308] Optimizing property proposals using an emotion engine

[1309] Step 1:

[1310] When a user launches the app on their mobile device and tours the metaverse, facial expressions and voice are collected using the device's camera and microphone.

[1311] Step 2:

[1312] The server analyzes the collected facial and voice data to determine the user's emotional state (happiness, excitement, frustration, stress, etc.).

[1313] Step 3:

[1314] The server uses an emotion engine to evaluate the property features based on the user's emotion information, for example, recording the property features for which the user expressed joy or excitement.

[1315] Step 4:

[1316] The next time a user views a property in the metaverse, the server will prioritize displaying the most suitable property based on the recorded emotional data.

[1317] Changing negotiation strategies with emotion engines

[1318] Step 1:

[1319] The user enters their desired conditions and begins contract negotiations. At that time, the device's camera and microphone collect the user's facial expressions and voice.

[1320] Step 2:

[1321] The server analyzes the collected facial and voice data to determine the user's level of tension or anxiety.

[1322] Step 3:

[1323] The server uses generative artificial intelligence to select the optimal negotiation strategy based on the user's emotional state. For example, if the user is feeling stressed, the server will pause the negotiation and provide advice on how to relax.

[1324] Step 4:

[1325] The negotiation can resume when the user is relaxed, or intensify if the user is satisfied.

[1326] Optimizing the moving process with an emotion engine

[1327] Step 1:

[1328] When a user uses the plan presentation function, facial expressions and voice are collected using the device's camera and microphone.

[1329] Step 2:

[1330] The server analyzes the collected facial and voice data to determine the user's stress level.

[1331] Step 3:

[1332] The server uses generative artificial intelligence to automatically adjust the plan based on the user's stress level and desired conditions. For example, if the user is in a high-stress state, it will present a plan that includes services that help them relax.

[1333] Step 4:

[1334] The user selects the most suitable plan from the presented plans, and the server proceeds with the specific moving procedures.

[1335] Through the above specific processing steps, the moving assistance system according to the present invention provides the user with an optimal moving experience while taking into consideration the user's emotional state.

[1336] Example 2

[1337] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1338] Moving requires many procedures and choices, placing a significant burden on users. However, conventional moving assistance systems have difficulty efficiently handling property selection, contract procedures, and procedures with public institutions. In particular, they lack the flexibility to respond to the user's emotional state, which makes it difficult to reduce the user's stress. The present invention aims to solve these problems and provide users with an efficient and comfortable moving experience.

[1339] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to view a virtual property in a virtual reality space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with a real estate agent, a means for using generative artificial intelligence to handle various procedures at public institutions, a means for generating multiple moving plans and presenting the most suitable plan, a means for saving information input by the user and automatically inputting necessary data, and a means for analyzing the user's emotional data using an emotion recognition engine and optimizing property proposals, negotiation strategies, and moving plans based on the results. This allows the user to consistently perform all procedures and selections related to moving, and further enables flexible responses according to the user's emotional state, thereby significantly reducing stress.

[1340] A "virtual reality space" is a virtual environment that resembles the real world and is generated using computer technology.

[1341] "Generative AI" is an AI technology that has the ability to self-learn based on massive amounts of data and automatically generate new data and results.

[1342] An "emotion recognition engine" is a computer program that analyzes a user's facial expressions and voice data to identify their emotional state.

[1343] The "negotiation process" is the process of discussing and reaching an agreement on terms and contractual content with real estate agents and public agencies.

[1344] "Public institutions" are organizations and facilities that provide electricity, gas, water, and administrative services.

[1345] A "moving plan" is a plan that includes optimal moving procedures and arrangements based on the user's conditions and wishes.

[1346] "User input information" refers to data indicating personal information and desired conditions for moving that the user provides to the system.

[1347] This invention is a system that allows users to move efficiently and comfortably. This system features features such as property viewing in a virtual reality space, negotiation and contract procedures handled by generative artificial intelligence, handling procedures at public institutions, generating and presenting moving plans, and optimization functions using an emotion recognition engine.

[1348] Metaverse preview function

[1349] In this system, the user first launches a dedicated app on their mobile device and tours a virtual property in a virtual reality space. Based on the property information specified by the user, the server uses a 3D engine (e.g., Unity) to generate a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[1350] Contract agency function

[1351] Once a user finds a property they desire, generative AI then negotiates the price with the real estate agent and handles the contract procedures. When a user enters their desired conditions through the app, the server receives the information and automatically begins negotiations with the real estate agent using generative AI (e.g., OpenAI GPT model). It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[1352] Procedure proxy function

[1353] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and government agencies. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[1354] Plan presentation function

[1355] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[1356] Emotion engine combination function

[1357] Optimizing property proposals using an emotion engine

[1358] The emotion recognition engine recognizes the user's emotional state through facial expressions and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[1359] Changing negotiation strategies with emotion engines

[1360] The emotion recognition engine detects the user's tension or anxiety, and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[1361] Optimizing the moving process with an emotion engine

[1362] The emotion recognition engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[1363] Specific examples

[1364] For example, if a user is planning to move to a big city for a new job, they first launch an app on their mobile device, input their desired area and conditions, and search for properties. The user can then preview multiple properties in a virtual reality space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion recognition engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan is generated and presented based on the user's stress level and desired conditions.

[1365] Example prompt sentence:

[1366] "I'm looking for the perfect property to move into. I'd like a 2LDK property in Tokyo with rent under 100,000 yen. I'd also like it to be within a 30-minute commute and have a supermarket or park nearby."

[1367] As described above, the moving assistance system of the present invention combines the functions of a virtual reality space, generative artificial intelligence, an emotion recognition engine, and automatic procedures based on user input information, providing the user with an efficient and comfortable moving experience that significantly reduces time and effort.

[1368] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1369] Step 1:

[1370] The user inputs desired conditions on a mobile device.

[1371] The user launches a dedicated app on their mobile device and inputs information about the desired property, such as the area, rent, and layout. The input information is sent to the server. Input data may include, for example, "Tokyo, rent under 100,000 yen, 2LDK, pets allowed."

[1372] Step 2:

[1373] The server receives property information and generates a 3D model

[1374] The server searches the database for relevant property information based on the desired conditions received from the user. Based on the search results, a 3D model of the virtual property is generated using a 3D engine (e.g., Unity). The generated 3D model is streamed to the user's device. The input data is the desired conditions for the property, and the output data is a 3D virtual property model.

[1375] Step 3:

[1376] A user conducts a virtual tour

[1377] Users can freely move around the virtual property using their device or VR goggles to view it. They can also check information about each room and the surrounding environment. The input data is the user's operational information, and the output data is the user's visual perception and the results of their operations.

[1378] Step 4:

[1379] The user selects the desired property and enters the contract terms.

[1380] After the user has completed the virtual viewing, they select the property they want and enter their desired contract terms (e.g., maximum monthly rent, contract period, etc.). The server receives this information. The input data is the property selected by the user and their desired contract terms, and the output data is the received contract terms.

[1381] Step 5:

[1382] Generative AI begins negotiations

[1383] Based on the desired contract terms received by the server, a generative AI (e.g., OpenAI GPT model) initiates direct negotiations with the real estate agent. The generative AI performs complex calculations and data analysis to derive optimal contract terms, and feeds the results back to the server. The input data is the desired contract terms, and the output data is the result of negotiations with the real estate agent.

[1384] Step 6:

[1385] The server presents the optimal contract terms to the user

[1386] The server presents the optimal contract terms derived by the generative AI to the user. The user then checks the details in the app and decides whether to approve the contract. The input data is the negotiation results, and the output data is the contract terms presented to the user.

[1387] Step 7:

[1388] Proceed with the online contract procedure

[1389] If the user approves the contract terms, the server proceeds with the online contract procedure. A contract with the real estate agent is generated and delivered to the user online. The user then signs the contract online. The input data is the approved contract terms, and the output data is the signed contract.

[1390] Step 8:

[1391] The user enters the procedure information

[1392] After completing the contract, the user enters detailed information through the app to complete procedures for electricity, gas, and water, change address, etc. The input data is a list of necessary procedures and detailed information, and the output data is the procedure information sent to the server.

[1393] Step 9:

[1394] Generative AI will handle the procedures

[1395] Based on the procedure information received by the server, generative AI automatically executes procedures with electricity, gas, water, and government agencies. Progress is monitored in real time, and the results are notified to the user. The input data is the procedure information, and the output data is the procedure progress and completion notification.

[1396] Step 10:

[1397] The user enters the moving conditions.

[1398] The user inputs moving conditions (cost, time, safety, etc.) into the app. The input data is the moving conditions, and the output data is the condition information sent to the server.

[1399] Step 11:

[1400] The server generates and presents a moving plan

[1401] The server uses generative artificial intelligence to generate multiple moving plans based on the received moving conditions and presents them to the user. The user selects the most suitable plan. The input data is the moving conditions, and the output data is the generated moving plan.

[1402] Step 12:

[1403] Emotion recognition engine analyzes user emotions

[1404] The emotion recognition engine analyzes the user's facial expression and voice data and provides information about the user's emotional state to the server. The input data is the user's facial expression and voice data, and the output data is the analysis result.

[1405] Step 13:

[1406] Optimize based on emotional data

[1407] The server uses the emotional data to optimize property proposals, negotiation strategies, and moving plans. If the user's stress level is high, it provides a relaxing service and presents the optimal plan. The input data is emotional data, and the output data is the optimized proposals and plans.

[1408] Through the above processing steps, the entire moving process proceeds efficiently and smoothly, realizing a system that significantly reduces the burden on the user.

[1409] (Application example 2)

[1410] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1411] Conventional moving assistance systems require users to inspect and select properties, complete contract procedures, and handle all procedures with public institutions themselves, which requires a great deal of time and effort. Furthermore, users must select and install the appropriate security system for their new home, which can be difficult to do without specialized knowledge. Furthermore, these systems do not take into consideration psychological stress management during the moving process, making it difficult to improve the user experience.

[1412] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1413] In this invention, the server includes: a means for a user to view virtual properties in the metaverse space; a means for using generative artificial intelligence to negotiate prices and complete contract procedures with real estate agents; a means for using generative artificial intelligence to complete various procedures with public institutions; a means for generating multiple moving plans and presenting the optimal plan; a means for storing user input information in a database and automatically entering necessary data; a means for using generative artificial intelligence to propose security systems and present security device installation plans; and a means for analyzing the user's emotional state using an emotion engine and optimizing the entire moving process according to the user's emotions. This significantly reduces the user's time and effort and provides an efficient and comfortable moving experience. Users can also select an appropriate system without specialized security knowledge and obtain an optimal moving plan that also takes psychological stress management into consideration.

[1414] The "metaverse space" is a virtual world constructed using virtual reality technology, which users can access via the Internet and where they can engage in various activities.

[1415] "Generative AI" is an AI technology that can automatically make optimal suggestions and decisions based on the user's wishes and conditions.

[1416] A "database" is a system for efficiently managing, storing, searching, and updating multiple pieces of data.

[1417] A "security system" is a combination of devices and software that protects data and property from risks such as unauthorized access and information leaks.

[1418] The "emotion engine" is a technology that analyzes a user's emotional state from their facial expressions, voice, and other biometric data, and provides appropriate feedback.

[1419] A "moving plan" is a set of multiple options generated based on the user's desired conditions for moving, and is a plan that takes into consideration factors such as cost, time, and safety.

[1420] "Public institutions" are organizations that provide infrastructure such as electricity, gas, and water, and government offices that provide administrative services.

[1421] The system of this invention allows users to efficiently move by viewing virtual properties in a metaverse space, automating various procedures using generative artificial intelligence, and managing user stress using an emotion engine.

[1422] Metaverse preview function

[1423] The server generates a 3D model of the virtual property based on the property information specified by the user and streams it to the user's device. This allows the user to freely view the virtual property within the metaverse space using VR goggles or a mobile device. For example, if a user is looking for a new home, they can enter their desired area and conditions to instantly visually check related virtual properties.

[1424] Contract agency function

[1425] When a user finds a property they like, the generative AI handles price negotiations and contract procedures with the real estate agent. When the user enters their desired conditions through the app, the server receives the information and automatically begins negotiations with the real estate agent. For example, by inputting a prompt such as "Please negotiate the rent" into the generative AI model, the AI ​​will propose the optimal conditions.

[1426] Procedure proxy function

[1427] After the contract is completed, the generative AI handles various procedures with public institutions, such as electricity, gas, and water. The user selects the necessary procedures in the app and enters the necessary information. The server then executes the procedures with each public institution, monitors the progress in real time, and notifies the user. For example, it uses prompts such as, "Please complete the procedures to turn on the water service following your move."

[1428] Security system proposal function

[1429] Generative AI proposes the optimal security system based on the user's desired conditions and presents a security device installation plan. When the user inputs the required security features, the AI ​​proposes the appropriate devices and presents an installation plan. For example, it generates a prompt such as, "Please propose the optimal plan for installing smart locks and CCTV."

[1430] Emotion engine optimization function

[1431] The emotion engine analyzes the user's facial expressions, voice, and other biometric data to recognize their emotional state. The server then uses this emotional information to optimize the entire moving process. For example, if the user is under high stress, the engine will provide advice on how to relax or suggest changes to the plan to reduce tension.

[1432] Specific examples

[1433] For example, if a user is moving to a new city, they launch an app on their mobile device and search for properties by entering their desired area and other conditions. They can then preview virtual properties in the metaverse space, and once they find one they like, generative AI will negotiate a rental contract. The following prompt sentences are used:

[1434] "Please negotiate the rent."

[1435] After the contract is completed, the generative AI will handle the electricity, gas, and water service activation procedures, using prompts such as the following:

[1436] "Please complete the procedures to get your water service turned on when I move."

[1437] Furthermore, the following prompt sentences are used in proposing security systems:

[1438] "Please suggest the best plan for installing smart locks and CCTV."

[1439] Finally, the emotion engine analyzes the user's emotions and provides feedback for stress management, for example:

[1440] "Relax, we'll take care of everything."

[1441] As described above, the present invention is a system that efficiently automates the various procedures that users face when moving, improving the user experience.

[1442] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1443] Step 1:

[1444] Users access the metaverse space using their devices and search for properties by entering the desired area and other conditions. The server searches the database based on the entered conditions and retrieves relevant property information. The server generates a 3D model of the virtual property and streams it to the user's device. The user can then freely view the virtual property using VR goggles.

[1445] Step 2:

[1446] After viewing the property and selecting one they like, the user sends the property information to the server via their device. The server then uses generative AI to negotiate the price and begin the contract process with the real estate agent. The generative AI calculates the optimal terms based on the user's desired conditions and presents them to the real estate agent. Once negotiations are successful, the server generates the contract documents and completes the contract through an electronic signature.

[1447] Step 3:

[1448] After completing the contract, the user uses their device to select a list of procedures that need to be completed with public institutions. The server receives this and uses generative artificial intelligence to automatically complete procedures for electricity, gas, water, etc. The server then processes the applications with each public institution, monitors the progress in real time, and notifies the user.

[1449] Step 4:

[1450] When a user inputs their security requirements for their new home into a terminal, the server uses generative AI to propose the optimal security system. Based on the user's requirements, the generative AI considers options such as smart locks and CCTV, and generates the optimal security plan. The server then presents this plan to the user and provides an installation plan.

[1451] Step 5:

[1452] Throughout the moving process, the server uses an emotion engine to analyze the user's facial expressions and voice to recognize their emotional state. Based on this emotional information, the server generates feedback to optimize the moving process. For example, if the user is in a high-stress state, the server will provide advice on how to relax and adjust the plan as necessary.

[1453] Step 6:

[1454] Once all procedures are completed, the server stores the user's input information in a database so that the necessary data can be automatically entered for future procedures, allowing the user to easily perform similar procedures the next time they move.

[1455] Through the above processing steps, the present invention is a system that significantly reduces the many procedures and labor that users face when moving, and provides an efficient and comfortable moving experience.

[1456] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1457] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1458] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1459] [Fourth embodiment]

[1460] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1461] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1462] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1463] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1464] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1465] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1466] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1467] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1468] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1469] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1470] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1471] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1472] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1473] The present invention is a system that allows users to move efficiently, and has functions such as property viewing in the metaverse space, contract and procedure handling by generative artificial intelligence, and presentation of moving plans.

[1474] Metaverse preview function

[1475] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[1476] Contract agency function

[1477] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[1478] Procedure proxy function

[1479] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[1480] Plan presentation function

[1481] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[1482] Specific examples

[1483] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then view multiple properties in the metaverse space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for opening electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a specific plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[1484] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[1485] The processing flow will be explained below.

[1486] Metaverse preview function

[1487] Step 1:

[1488] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[1489] Step 2:

[1490] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[1491] Step 3:

[1492] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[1493] Step 4:

[1494] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[1495] Step 5:

[1496] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[1497] Step 6:

[1498] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[1499] Contract agency function

[1500] Step 1:

[1501] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[1502] Step 2:

[1503] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[1504] Step 3:

[1505] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[1506] Step 4:

[1507] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[1508] Step 5:

[1509] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[1510] Procedure proxy function

[1511] Step 1:

[1512] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[1513] Step 2:

[1514] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[1515] Step 3:

[1516] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[1517] Plan presentation function

[1518] Step 1:

[1519] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[1520] Step 2:

[1521] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[1522] Step 3:

[1523] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[1524] Step 4:

[1525] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[1526] Example 1

[1527] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1528] Conventional moving procedures and property searches are extremely cumbersome for users, requiring many steps, such as viewing the property on-site, negotiating a contract, and completing various procedures. This consumes a lot of time and effort, and makes it difficult to plan an efficient move. Furthermore, viewing a property requires traveling to the property, making it difficult to search for a property from a remote location. Furthermore, procedures must be completed individually with various public institutions, creating the challenge of cumbersome progress management.

[1529] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1530] In this invention, the server includes a means for users to view virtual properties in a virtual space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with agents, and a means for using generative artificial intelligence to handle procedures with public institutions. This allows users to efficiently search for properties and easily view them from remote locations. Furthermore, by using generative artificial intelligence to automatically handle contract procedures and procedures with public institutions, users can easily complete the complicated procedures associated with moving. This allows users to significantly save time and effort and realize a smooth move.

[1531] "User" refers to an individual or corporation who uses the system to view properties and complete contract procedures.

[1532] A "virtual space" is a three-dimensional digital environment generated on a computer system that serves as a stage for viewing and touring properties.

[1533] A "virtual property" is a digital model of a property visualized in a virtual space, which can be viewed in the same way as a real property.

[1534] "Viewing" refers to the act of a user visually checking a virtual property and understanding its internal layout and surrounding environment.

[1535] "Generative AI" refers to artificial intelligence technology that automatically negotiates prices and completes contract procedures with real estate agents based on information entered by the user.

[1536] "Business" refers to commercial organizations such as real estate agents and moving companies that provide properties and handle contract procedures.

[1537] "Price negotiation" refers to the act of generative artificial intelligence negotiating rent and contract terms with a contractor based on the user's desired conditions.

[1538] "Contract procedures" refers to the act of carrying out formal procedures for renting or purchasing a property.

[1539] "Public institutions" refers to companies that provide electricity, gas, and water, as well as government agencies such as government offices.

[1540] "Procedures" refers to the actions that users take with various public institutions when moving, such as turning on electricity, gas, and water services, and changing their address.

[1541] A "moving plan" refers to a moving plan that includes the work content and schedule when a user moves.

[1542] A "database" refers to a system that systematically stores user input information and contract information and retrieves that information as needed.

[1543] The present invention is a system that allows users to move efficiently, and includes functions such as viewing properties in a virtual space, using generative artificial intelligence to handle contracts and procedures, and presenting moving plans. Detailed embodiments of each function are described below.

[1544] Metaverse preview function

[1545] In this system, users first launch a dedicated app on their mobile device and view properties in a virtual space. The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device. Users can move freely around the virtual property using VR goggles or touch controls on their device, checking out each room and the surrounding environment. Specific hardware used is a smartphone, tablet, and VR goggles, while software uses 3D modeling engines such as Unity or Unreal Engine.

[1546] Contract agency function

[1547] Once the user finds the property they desire, the generative AI then negotiates the price with the agent and handles the contract procedures on their behalf. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the agent and delivers and signs the necessary documents online. Specific generative AI uses advanced natural language processing models such as GPT-4.

[1548] Procedure proxy function

[1549] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place using the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users select the necessary procedures from the list and enter the details through the app. The server then executes the procedures with each public agency, monitors the progress in real time, and notifies the user.

[1550] Plan presentation function

[1551] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, allowing the user to select the most suitable one.

[1552] Specific examples

[1553] For example, suppose a user is planning to move to a big city for a new job. In this case, the user first launches an app on their mobile device and searches for properties by entering the desired area and other conditions. They then browse multiple properties in a virtual space and select one they like. Next, they use generative AI to negotiate a rental contract with a real estate agent, and once the terms are agreed upon, they complete the contract online. The generative AI then handles the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, the generative AI presents a detailed plan for the move (for example, arranging for a moving company and necessary daily necessities), allowing the user to smoothly complete the entire process.

[1554] Prompt Sentence Examples

[1555] "A user has entered their desired moving date as May 1st and a budget of 200,000 yen. Please use generative AI to suggest the optimal moving plan."

[1556] As described above, the moving assistance system of the present invention combines the functions of virtual space, generative artificial intelligence, and automatic procedures based on user input information to provide users with an efficient moving experience that significantly reduces time and effort.

[1557] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1558] Metaverse preview function

[1559] Step 1: Launch the app

[1560] The user launches the dedicated app on their mobile device.

[1561] Input: User taps smartphone icon

[1562] Output: The app starts and the initial screen is displayed.

[1563] Specific behavior:

[1564] The user taps the icon on their smartphone to open the app.

[1565] Step 2: Enter property information

[1566] The user enters the desired property information (e.g., area, budget, floor plan) into the app.

[1567] Input: The user enters the area name, rent range, and desired floor plan into the form on the screen.

[1568] Output: Input data is temporarily saved in the internal memory.

[1569] Specific behavior:

[1570] The user enters the required information into the form on the screen and presses the "Search" button.

[1571] Step 3: Submit your listing

[1572] The terminal transmits the entered property information to the server.

[1573] Input: Information entered by the user

[1574] Output: Data is sent over the internet to a server

[1575] Specific behavior:

[1576] The app makes a web request and sends information to the server.

[1577] Step 4: Creating a Metaverse Space

[1578] The server generates a 3D model of the virtual property based on the specified property information and streams it to the user's device.

[1579] Input: User property information received by the server

[1580] Output: The generated 3D model is streamed to your device.

[1581] Specific behavior:

[1582] The server generates virtual objects using a 3D modeling engine (such as Unity or Unreal Engine) and streams them in real time.

[1583] Step 5: Conduct a tour

[1584] Users can use VR goggles or a device to tour the virtual property and check each room and the surrounding environment.

[1585] Input: User operation (changing the viewpoint of the VR goggles or touching the device)

[1586] Output: Visual information of each room in the virtual property and the surrounding environment

[1587] Specific behavior:

[1588] The user can move the viewpoint using VR goggles or walk around the room using touch controls on the device.

[1589] Contract agency function

[1590] Step 1: Enter your desired conditions

[1591] The user enters the desired contract terms (e.g., rent, contract period) into the app.

[1592] Input: The user enters detailed information such as rent and contract period into a dedicated form.

[1593] Output: Input data is temporarily saved in the internal memory.

[1594] Specific behavior:

[1595] The user fills in the form with details and presses the "Submit" button.

[1596] Step 2: Sending conditions

[1597] The terminal transmits the input desired conditions to the server.

[1598] Input: Desired conditions entered by the user

[1599] Output: Data is sent over the internet to a server

[1600] Specific behavior:

[1601] The app makes a web request and sends information to the server.

[1602] Step 3: Negotiation begins with generative AI

[1603] Based on the conditions received by the server, the generation AI automatically begins negotiations with the vendor.

[1604] Input: Desired conditions received by the server

[1605] Output: The generation AI sends negotiation emails and chats to the vendor

[1606] Specific behavior:

[1607] The server uses a generative AI model (e.g., GPT-4) to automatically send emails and chats to real estate agents and negotiate.

[1608] Step 4: Present the terms and conditions

[1609] The server notifies the user of the best contract terms.

[1610] Input: Optimal contract terms obtained by the generation AI

[1611] Output: The terms of the contract are presented to the user's device.

[1612] Specific behavior:

[1613] The conditions are presented to the user's device via push notification and can be checked within the app.

[1614] Step 5: Contract Approval and Processing

[1615] The user accepts the terms and conditions, and the server proceeds with the online contract procedure with the vendor.

[1616] Input: User presses "Approve" button within the app

[1617] Output: Contract documents are generated and delivered / signed online

[1618] Specific behavior:

[1619] When you press the "Approve" button within the app, the server generates the contract document and sends a signing link to the user and the vendor.

[1620] Procedure proxy function

[1621] Step 1: Enter your processing information

[1622] The user selects from a list of various procedures required for moving in the app and enters the necessary information.

[1623] Input: The user checks the options for electricity, gas, water, and government procedures and enters the details for each.

[1624] Output: Input data is temporarily saved in the internal memory.

[1625] Specific behavior:

[1626] The user selects the procedure required for the checklist and enters the details.

[1627] Step 2: Submit your transaction information

[1628] The terminal transmits the entered procedure information to the server.

[1629] Input: Procedural information entered by the user

[1630] Output: Data is sent to the server

[1631] Specific behavior:

[1632] The app makes a web request and sends information to the server.

[1633] Step 3: Procedure execution by generative AI

[1634] Based on the information received by the server, the generating AI automatically carries out procedures with each public institution.

[1635] Input: Procedure information received by the server

[1636] Output: The generating AI executes the procedure for each public institution.

[1637] Specific behavior:

[1638] The server uses a generative AI model to automatically send online forms and emails to electric companies, gas companies, waterworks, and city halls.

[1639] Step 4: Procedural progress management

[1640] The server monitors the progress of the procedure in real time and notifies the user.

[1641] Input: Progress from each public institution

[1642] Output: Progress is displayed in real time on the user's device

[1643] Specific behavior:

[1644] The app will display the progress of the procedure and send push notifications with status updates.

[1645] Plan presentation function

[1646] Step 1: Enter the condition

[1647] The user enters the moving conditions (cost, time, safety) into the app.

[1648] Input: The user enters the moving budget and desired date into the form.

[1649] Output: Input data is temporarily saved in the internal memory.

[1650] Specific behavior:

[1651] The user enters details into the form and presses the "Search" button.

[1652] Step 2: Sending conditions

[1653] The terminal transmits the input conditions to the server.

[1654] Input: User-entered criteria

[1655] Output: Data is sent to the server

[1656] Specific behavior:

[1657] The app makes a web request and sends information to the server.

[1658] Step 3: Generative AI generates a plan

[1659] The server analyzes the conditions, and the generation AI generates multiple moving plans.

[1660] Input: The conditions received by the server

[1661] Output: A list of plans is generated

[1662] Specific behavior:

[1663] The server uses a generative AI model to generate a variety of moving plans.

[1664] Step 4: Present your plan

[1665] The server presents the generated plans to the user, who then makes a selection.

[1666] Input: Generated moving plan

[1667] Output: The user is presented with a plan to choose from

[1668] Specific behavior:

[1669] The plans will be displayed on the user's device, and when the user presses the "Select" button, they can check the details of the selected plan.

[1670] (Application example 1)

[1671] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1672] The modern moving process is extremely time-consuming and inconvenient, requiring many steps. It's particularly difficult to efficiently complete a wide variety of tasks simultaneously, including viewing real estate properties, negotiating prices, completing contracts, handling government procedures, and even selecting the optimal moving plan. This creates a growing need for a system that allows users to efficiently and smoothly complete the entire process of moving.

[1673] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1674] In this invention, the server includes a means for the user to view a virtual property in the metaverse space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with real estate agents, and a means for using generative artificial intelligence to handle various procedures with public institutions, thereby enabling the user to efficiently and smoothly complete a series of tasks related to moving.

[1675] A "metaverse space" is a virtual physical space on the Internet created using virtual reality technology.

[1676] A "virtual property" is a 3D model of a real estate property recreated within the metaverse space.

[1677] "Generative AI" is an AI technology that automatically creates and generates text and information based on input data.

[1678] A "mobile device" is a portable electronic device such as a smartphone or tablet.

[1679] A "virtual reality display device" is a device such as a head-mounted display that allows a user to experience virtual reality.

[1680] "Public institutions" are institutions and government agencies that provide infrastructure such as electricity, gas, and water.

[1681] A "generative AI model" is an artificial intelligence model that generates new data and information based on pre-trained data.

[1682] "Conditions" refer to specific criteria or requirements desired by the user.

[1683] A "moving plan" is a proposal that includes specific plans and schedules related to moving.

[1684] "Streaming display" is a technology that transfers data in a stream format and displays it in real time.

[1685] This invention is a system that allows users to efficiently move, and has functions such as virtual property viewing in a metaverse space, proxy contract and procedure handling using generative artificial intelligence, and presentation of moving plans. Specific embodiments of this system are described below.

[1686] Hardware and software used

[1687] The system uses the following hardware and software:

[1688] Hardware: Smartphone (iOS or Android), virtual reality display device (e.g., head-mounted display)

[1689] software:

[1690] Language: Python, Swift (for iOS), Kotlin (for Android)

[1691] Generative Artificial Intelligence: OpenAI's GPT-4 API

[1692] 3D modeling and streaming: Unity, AWS Lambda, AWS S3

[1693] System configuration and functions

[1694] 1. Metaverse preview function

[1695] The user launches the smartphone app and enters the desired property ID. The device sends a request to the backend server (AWS Lambda), which retrieves a 3D model of the specified property from AWS S3, and uses the Unity engine to stream the 3D model on the smartphone. The user then puts on the virtual reality display device and moves freely within the virtual space to view the property.

[1696] 2. Contract agency function

[1697] When a user enters the terms (rent, contract period, etc.) in the app, generative artificial intelligence (GPT-4 API) initiates chat-based negotiations with a real estate agent based on the terms. The optimal contract terms are presented to the user, and once the user approves, contract documents are automatically generated and electronically signed.

[1698] 3. Procedure proxy function

[1699] Users select the required government procedure and enter the details into the app. Generative AI monitors and automatically executes each procedure in the backend. Progress is tracked in real time and reported to users via push notifications.

[1700] 4. Plan presentation function

[1701] Users input their desired moving conditions (cost, time, safety) into the app, and a generative AI model (GPT-4) uses historical and real-time data to generate the optimal moving plan. Users are then provided with information on arranging moving companies and a list of household items they will need in their new home.

[1702] Specific examples

[1703] For example, if a user plans to move to a large city, they first launch the app and enter their desired conditions (rent, area, etc.). They can then view multiple properties in the metaverse space and select the one they like best. They then use generative AI to negotiate with a real estate agent and conclude a contract with optimal terms. Next, the generative AI automatically handles the procedures for electricity, gas, water, etc., and the user can check the progress in the app. Finally, the app will present the optimal moving plan based on the user's conditions, allowing them to complete the move smoothly.

[1704] Example prompt for GPT-4 AI:

[1705] The user is planning to move to Tokyo. He is looking for a property with a monthly rent of less than 200,000 yen, within a 10-minute walk from the station. Generate a 3D model of the property and conduct a VR tour. Please explain the process of automating the contract with the real estate agent and the procedures required for the move with public institutions. Also, please present the optimal moving plan.

[1706] In this way, the present invention allows a series of tasks related to moving to be efficiently progressed and managed, significantly reducing the burden on the user.

[1707] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1708] Step 1:

[1709] The user launches the smartphone app and enters the desired property ID. The entered property ID is sent from the device to the backend server. The server retrieves the 3D model data of the corresponding property from AWS S3 based on the property ID.

[1710] Step 2:

[1711] The server uses the Unity engine to stream the acquired 3D model data to a smartphone. The device then uses VR goggles to allow users to view the property in a virtual space. Users can move freely around the property, checking the room layout and surrounding environment.

[1712] Step 3:

[1713] The user selects a property they like during a virtual tour and enters their desired conditions (rent, contract period, etc.) in the app. These conditions are sent from the device to the server. The server passes this data to generative artificial intelligence (GPT-4 API), which initiates price negotiations and contract procedures.

[1714] Step 4:

[1715] The generative AI negotiates with the real estate agent via chat. The generative AI proceeds with the negotiation based on the user's desired conditions and derives the optimal contract terms. The derive contract terms are sent from the server to the terminal and presented to the user.

[1716] Step 5:

[1717] The user approves the presented contract terms and conditions, and the contract documents are automatically generated. The server uses generative artificial intelligence to create the contract documents, which are then digitally signed. The contract documents are then sent online to the real estate agent.

[1718] Step 6:

[1719] After completing the contract, the user selects the public institution procedure within the app and enters the necessary information. This information is sent from the device to the server, which uses generative artificial intelligence to automatically process the procedures for electricity, gas, water, etc. and monitors their progress.

[1720] Step 7:

[1721] The progress of the transaction is tracked in real time and reported to the device via push notifications from the server, and the user can check in the app that the transaction is complete.

[1722] Step 8:

[1723] Users enter the conditions of their desired moving plan (cost, time, safety, etc.) into the app. The entered conditions are sent from the device to the server. The server uses a generative AI model (GPT-4) to analyze past and real-time data and generate the optimal moving plan.

[1724] Step 9:

[1725] The generated moving plan is sent from the server to the terminal and presented to the user. The user selects the most suitable moving plan and proceeds with specific preparations, such as arranging for a moving company and making a list of daily necessities.

[1726] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1727] The present invention is a system that enables users to move efficiently, and includes features such as property viewing in a metaverse space, contract and procedure handling by generative artificial intelligence, presentation of moving plans, and optimization functions using an emotion engine.

[1728] Metaverse preview function

[1729] In this system, users first launch a dedicated app on their mobile device and view a property in the metaverse space. Based on the property information specified by the user, the server generates a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[1730] Contract agency function

[1731] Once the user finds a property they desire, the generative AI then negotiates the price with the real estate agent and handles the contract procedures. When the user enters their desired conditions through the app, the server receives the information and the generative AI automatically begins negotiations with the real estate agent. It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[1732] Procedure proxy function

[1733] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and local government offices. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[1734] Plan presentation function

[1735] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[1736] Emotion engine combination function

[1737] Optimizing property proposals using an emotion engine

[1738] The emotion engine recognizes the user's emotional state through facial and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[1739] Changing negotiation strategies with emotion engines

[1740] The emotion engine detects the user's tension or anxiety and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[1741] Optimizing the moving process with an emotion engine

[1742] The emotion engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[1743] Specific examples

[1744] For example, if a user is planning to move to a big city for a new job, they first launch the app on their mobile device, input their desired area and conditions, and search for properties. They can then preview multiple properties in the metaverse space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan based on the user's stress level and desired conditions is generated and presented.

[1745] As described above, the moving assistance system of the present invention combines the functions of the metaverse space, generative artificial intelligence, emotion engine, and automatic procedures based on user input information to provide an efficient and comfortable moving experience that significantly reduces the user's time and effort.

[1746] The processing flow will be explained below.

[1747] Metaverse preview function

[1748] Step 1:

[1749] The user launches the app on their mobile device and accesses the login screen, where they enter their authentication information and press the login button.

[1750] Step 2:

[1751] The server receives the user's authentication information and checks it against the database. If authentication is successful, it starts a user session, generates a main menu screen, and sends it to the terminal.

[1752] Step 3:

[1753] The user selects the "Start Viewing" option from the main menu screen, which takes them to the property search screen, where they enter criteria such as the desired area, layout, and price range, and then presses the "Search" button to submit the property information.

[1754] Step 4:

[1755] Based on the received conditions, the server retrieves relevant property information from the database and generates a 3D model in the metaverse based on the retrieved property information.

[1756] Step 5:

[1757] The generated 3D model data is streamed to the device, and the user puts on VR goggles and can freely move around and view the property. The user can check information about each room and the surrounding environment.

[1758] Step 6:

[1759] The user presses the "Interested" button to mark the property they like. The saved information is sent to the server and linked to the user's account information.

[1760] Contract agency function

[1761] Step 1:

[1762] The user selects the "Contract Negotiation" option on the terminal, enters the desired rent, contract period, additional conditions, etc., and presses the "Submit" button.

[1763] Step 2:

[1764] The server receives the user's desired conditions, and the generative AI starts optimal contract negotiations based on the conditions. The generative AI automatically proceeds with negotiations with the real estate agent.

[1765] Step 3:

[1766] The server notifies the user of the negotiation results (optimal rent, contract terms, etc.) derived by the generative AI. The server presents this information as a plan.

[1767] Step 4:

[1768] The user checks the details of the plan and decides whether to approve it. If they approve it, they press the "Approve" button to notify the server.

[1769] Step 5:

[1770] The server receives the user's approval, notifies the real estate agent, and proceeds with the contract procedure. The contract documents are generated, the user signs online, and the server sends them to the real estate agent.

[1771] Procedure proxy function

[1772] Step 1:

[1773] The user selects the "Procedure Proxy" option on the terminal, selects procedures for electricity, gas, water, and government offices from a list, enters the necessary information, and presses the "Next" button.

[1774] Step 2:

[1775] The server receives the selected procedure details, and the generative AI automatically executes the procedures with each public institution, collecting the necessary documents and information and sending them to each public institution.

[1776] Step 3:

[1777] The server monitors the progress of each procedure in real time and notifies the user of the progress. When the procedure is completed, a completion notification is sent to the user.

[1778] Plan presentation function

[1779] Step 1:

[1780] The user selects the "Plan Selection" option on the device, inputs conditions such as cost, time, and safety, and presses the "Generate Optimal Plan" button.

[1781] Step 2:

[1782] The server analyzes the received conditions, and the generative artificial intelligence generates multiple moving plans (e.g., minimum cost plan, short-time plan, safe plan, etc.).

[1783] Step 3:

[1784] The server presents the generated plans to the user, who then checks the details of the plans and selects the most suitable one.

[1785] Step 4:

[1786] The user selects the most suitable plan and presses the "Confirm" button to notify the server, which then proceeds with the specific moving procedures based on the selected plan.

[1787] Emotion engine combination function

[1788] Optimizing property proposals using an emotion engine

[1789] Step 1:

[1790] When a user launches the app on their mobile device and tours the metaverse, facial expressions and voice are collected using the device's camera and microphone.

[1791] Step 2:

[1792] The server analyzes the collected facial and voice data to determine the user's emotional state (happiness, excitement, frustration, stress, etc.).

[1793] Step 3:

[1794] The server uses an emotion engine to evaluate the property features based on the user's emotion information, for example, recording the property features for which the user expressed joy or excitement.

[1795] Step 4:

[1796] The next time a user views a property in the metaverse, the server will prioritize displaying the most suitable property based on the recorded emotional data.

[1797] Changing negotiation strategies with emotion engines

[1798] Step 1:

[1799] The user enters their desired conditions and begins contract negotiations. At that time, the device's camera and microphone collect the user's facial expressions and voice.

[1800] Step 2:

[1801] The server analyzes the collected facial and voice data to determine the user's level of tension or anxiety.

[1802] Step 3:

[1803] The server uses generative artificial intelligence to select the optimal negotiation strategy based on the user's emotional state. For example, if the user is feeling stressed, the server will pause the negotiation and provide advice on how to relax.

[1804] Step 4:

[1805] The negotiation can resume when the user is relaxed, or intensify if the user is satisfied.

[1806] Optimizing the moving process with an emotion engine

[1807] Step 1:

[1808] When a user uses the plan presentation function, facial expressions and voice are collected using the device's camera and microphone.

[1809] Step 2:

[1810] The server analyzes the collected facial and voice data to determine the user's stress level.

[1811] Step 3:

[1812] The server uses generative artificial intelligence to automatically adjust the plan based on the user's stress level and desired conditions. For example, if the user is in a high-stress state, it will present a plan that includes services that help them relax.

[1813] Step 4:

[1814] The user selects the most suitable plan from the presented plans, and the server proceeds with the specific moving procedures.

[1815] Through the above specific processing steps, the moving assistance system according to the present invention provides the user with an optimal moving experience while taking into consideration the user's emotional state.

[1816] Example 2

[1817] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1818] Moving requires many procedures and choices, placing a significant burden on users. However, conventional moving assistance systems have difficulty efficiently handling property selection, contract procedures, and procedures with public institutions. In particular, they lack the flexibility to respond to the user's emotional state, which makes it difficult to reduce the user's stress. The present invention aims to solve these problems and provide users with an efficient and comfortable moving experience.

[1819] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to view a virtual property in a virtual reality space, a means for using generative artificial intelligence to negotiate prices and handle contract procedures with a real estate agent, a means for using generative artificial intelligence to handle various procedures at public institutions, a means for generating multiple moving plans and presenting the most suitable plan, a means for saving information input by the user and automatically inputting necessary data, and a means for analyzing the user's emotional data using an emotion recognition engine and optimizing property proposals, negotiation strategies, and moving plans based on the results. This allows the user to consistently perform all procedures and selections related to moving, and further enables flexible responses according to the user's emotional state, thereby significantly reducing stress.

[1820] A "virtual reality space" is a virtual environment that resembles the real world and is generated using computer technology.

[1821] "Generative AI" is an AI technology that has the ability to self-learn based on massive amounts of data and automatically generate new data and results.

[1822] An "emotion recognition engine" is a computer program that analyzes a user's facial expressions and voice data to identify their emotional state.

[1823] The "negotiation process" is the process of discussing and reaching an agreement on terms and contractual content with real estate agents and public agencies.

[1824] "Public institutions" are organizations and facilities that provide electricity, gas, water, and administrative services.

[1825] A "moving plan" is a plan that includes optimal moving procedures and arrangements based on the user's conditions and wishes.

[1826] "User input information" refers to data indicating personal information and desired conditions for moving that the user provides to the system.

[1827] This invention is a system that allows users to move efficiently and comfortably. This system features features such as property viewing in a virtual reality space, negotiation and contract procedures handled by generative artificial intelligence, handling procedures at public institutions, generating and presenting moving plans, and optimization functions using an emotion recognition engine.

[1828] Metaverse preview function

[1829] In this system, the user first launches a dedicated app on their mobile device and tours a virtual property in a virtual reality space. Based on the property information specified by the user, the server uses a 3D engine (e.g., Unity) to generate a 3D model of the virtual property and streams it to the user's device. The user can move freely around the virtual property using VR goggles or their device, checking information about each room and the surrounding environment.

[1830] Contract agency function

[1831] Once a user finds a property they desire, generative AI then negotiates the price with the real estate agent and handles the contract procedures. When a user enters their desired conditions through the app, the server receives the information and automatically begins negotiations with the real estate agent using generative AI (e.g., OpenAI GPT model). It then derives the optimal contract terms and presents them to the user. If the user approves the proposed contract plan, the server proceeds with the actual contract procedures with the real estate agent and delivers and signs the necessary documents online.

[1832] Procedure proxy function

[1833] After completing the contract, users can complete all the necessary procedures with various public agencies related to their move all in one place through the app. This feature uses generative AI to automatically handle procedures with electricity, gas, water, and government agencies. Users simply select the necessary procedures through the app and enter the details. The server then immediately processes the procedures with each public agency, monitoring the progress in real time and notifying the user.

[1834] Plan presentation function

[1835] Once the moving process is underway or complete, the user will be presented with the optimal moving plan based on their criteria by a generative AI. With this plan suggestion function, the user enters criteria such as cost, time, and safety through the app, and the server analyzes the information and generates multiple plans. The server then presents the generated plans to the user, who can then select the most suitable one.

[1836] Emotion engine combination function

[1837] Optimizing property proposals using an emotion engine

[1838] The emotion recognition engine recognizes the user's emotional state through facial expressions and voice analysis. Based on this emotional information, the server learns and analyzes the characteristics of properties that the user prefers, and suggests more suitable properties the next time the user searches. For example, the server can record the characteristics of properties that the user expressed joy or excitement about during a viewing, and prioritize the display of similar properties.

[1839] Changing negotiation strategies with emotion engines

[1840] The emotion recognition engine detects the user's tension or anxiety, and automatically adjusts the appropriate negotiation strategy using generative artificial intelligence. If the user is feeling stressed, the server temporarily halts the negotiation and provides advice on how to relax. If the user is satisfied, the server intensifies the negotiation to further improve the terms.

[1841] Optimizing the moving process with an emotion engine

[1842] The emotion recognition engine monitors the user's stress level and automatically adjusts the plan to optimize the entire moving process. If the user is in a high-stress state, the server will offer relaxation services (e.g., packing assistance or rest plans) and present plans that prioritize safety and comfort.

[1843] Specific examples

[1844] For example, if a user is planning to move to a big city for a new job, they first launch an app on their mobile device, input their desired area and conditions, and search for properties. The user can then preview multiple properties in a virtual reality space, and once they find one they like, generative AI will negotiate the rental contract. During this process, an emotion recognition engine monitors the user's emotions and automatically selects the optimal negotiation strategy. The generative AI then handles all the procedures for activating electricity, gas, and water services and changing their address, and the user can check the progress in the app. Finally, a moving plan is generated and presented based on the user's stress level and desired conditions.

[1845] Example prompt sentence:

[1846] "I'm looking for the perfect property to move into. I'd like a 2LDK property in Tokyo with rent under 100,000 yen. I'd also like it to be within a 30-minute commute and have a supermarket or park nearby."

[1847] As described above, the moving assistance system of the present invention combines the functions of a virtual reality space, generative artificial intelligence, an emotion recognition engine, and automatic procedures based on user input information, providing the user with an efficient and comfortable moving experience that significantly reduces time and effort.

[1848] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1849] Step 1:

[1850] The user inputs desired conditions on a mobile device.

[1851] The user launches a dedicated app on their mobile device and inputs information about the desired property, such as the area, rent, and layout. The input information is sent to the server. Input data may include, for example, "Tokyo, rent under 100,000 yen, 2LDK, pets allowed."

[1852] Step 2:

[1853] The server receives property information and generates a 3D model

[1854] The server searches the database for relevant property information based on the desired conditions received from the user. Based on the search results, a 3D model of the virtual property is generated using a 3D engine (e.g., Unity). The generated 3D model is streamed to the user's device. The input data is the desired conditions for the property, and the output data is a 3D virtual property model.

[1855] Step 3:

[1856] A user conducts a virtual tour

[1857] Users can freely move around the virtual property using their device or VR goggles to view it. They can also check information about each room and the surrounding environment. The input data is the user's operational information, and the output data is the user's visual perception and the results of their operations.

[1858] Step 4:

[1859] The user selects the desired property and enters the contract terms.

[1860] After the user has completed the virtual viewing, they select the property they want and enter their desired contract terms (e.g., maximum monthly rent, contract period, etc.). The server receives this information. The input data is the property selected by the user and their desired contract terms, and the output data is the received contract terms.

[1861] Step 5:

[1862] Generative AI begins negotiations

[1863] Based on the desired contract terms received by the server, a generative AI (e.g., OpenAI GPT model) initiates direct negotiations with the real estate agent. The generative AI performs complex calculations and data analysis to derive optimal contract terms, and feeds the results back to the server. The input data is the desired contract terms, and the output data is the result of negotiations with the real estate agent.

[1864] Step 6:

[1865] The server presents the optimal contract terms to the user

[1866] The server presents the optimal contract terms derived by the generative AI to the user. The user then checks the details in the app and decides whether to approve the contract. The input data is the negotiation results, and the output data is the contract terms presented to the user.

[1867] Step 7:

[1868] Proceed with the online contract procedure

[1869] If the user approves the contract terms, the server proceeds with the online contract procedure. A contract with the real estate agent is generated and delivered to the user online. The user then signs the contract online. The input data is the approved contract terms, and the output data is the signed contract.

[1870] Step 8:

[1871] The user enters the procedure information

[1872] After completing the contract, the user enters detailed information through the app to complete procedures for electricity, gas, and water, change address, etc. The input data is a list of necessary procedures and detailed information, and the output data is the procedure information sent to the server.

[1873] Step 9:

[1874] Generative AI will handle the procedures

[1875] Based on the procedure information r...

Claims

1. A means for users to preview virtual properties in the metaverse space; A means of using generative artificial intelligence to negotiate prices and handle contract procedures with real estate agents, A means of using generative artificial intelligence to act on behalf of public institutions in various procedures, A means for generating multiple moving plans and presenting the optimal plan; A means for storing user input information in a database and automatically inputting required data; A moving assistance system including:

2. The moving assistance system according to claim 1, further comprising a means for a user to access the metaverse space using a mobile terminal and freely move around the property to view it.

3. 10. The moving assistance system of claim 1, wherein the generative artificial intelligence automatically executes procedures with electricity, gas, water, and government offices and includes means for monitoring progress.

Images