System
A system for managing moving procedures by receiving user information, generating procedure lists, and sending reminders, addresses the challenge of cumbersome moving processes, enhancing efficiency and privacy.
Patent Information
- Application Number
- JP2024131439
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-07
- Publication Date
- 2026-02-20
AI Technical Summary
Moving involves numerous procedures that are cumbersome and difficult to manage centrally, especially for first-time movers or busy individuals, leading to potential omissions and challenges in tracking documents and deadlines.
A system that receives detailed moving information, automatically generates a list of necessary procedures, provides a guide for orderly execution, tracks progress, and sends reminders, while protecting personal information and ensuring secure data transmission.
The system allows users to efficiently and reliably manage moving procedures, preventing omissions and ensuring privacy by providing customized guidance and real-time tracking.
Smart Images

Figure 2026028823000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Moving involves a wide range of procedures, including changing residence registration, changing public service contracts, and mail forwarding procedures, requiring numerous steps. Centrally managing these procedures and ensuring they are completed without any omissions is a significant burden, especially for users moving for the first time or busy business people. Furthermore, it is difficult to keep track of the documents and deadlines required for these procedures, making it easy for omissions to occur. Therefore, there is a need for a system that can efficiently support these procedures and reduce the burden on users. [Means for solving the problem]
[0005] To solve this problem, we provide a system that includes the following means: a means for receiving detailed moving-related information entered by a user, a means for automatically generating a list of necessary procedures based on the detailed information, a means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, a means for tracking the progress of the procedures and sending reminders for incomplete procedures, and a means for strictly protecting the user's personal information. This allows users to centrally manage moving-related procedures and efficiently proceed with the procedures. Furthermore, the progress of the procedures can be checked in real time, preventing omissions. Furthermore, by providing a list of procedures that can be customized according to the user's lifestyle and specific needs, we can support each individual user in the optimal procedures.
[0006] "User" refers to an individual or corporation that uses this system to carry out moving procedures.
[0007] "Terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to access the System and input or confirm information.
[0008] "Server" refers to a network computer that acts as the central point of this system, receiving, analyzing, and saving information entered by users, and managing various procedures.
[0009] "Detailed information about the move" refers to information that the user inputs into the system, such as the date and time of the move, addresses before and after the move, and family composition.
[0010] The "list of necessary procedures" refers to a list of procedures that a user must carry out when moving.
[0011] "Progress of procedure" refers to status information that indicates how much of the procedure that the user is required to perform has been completed.
[0012] A "reminder" is a message that notifies the user that there is an incomplete procedure.
[0013] "Personal information" refers to information related to privacy, such as a user's name, address, and contact details.
[0014] "Guide" means a written or electronic guide containing instructions or information necessary for a User to systematically perform a required procedure.
[0015] "Customization" refers to tailoring the procedure list and guide content to the user's lifestyle and specific needs.
[0016] "Means for receiving" refers to the function of collecting information entered by the user and incorporating it into the system.
[0017] "Means for generating" refers to the ability to automatically create the necessary lists and guides based on the information received.
[0018] "Tracking means" refers to the ability to monitor the progress of a procedure and identify any incomplete items.
[0019] "Protection measures" refers to security features to ensure the safety of user information and prevent unauthorized access or leakage. [Brief explanation of the drawings]
[0020] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0021] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0022] First, the terms used in the following description will be explained.
[0023] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0024] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0025] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0026] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0028] [First embodiment]
[0029] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0030] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0031] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0032] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0033] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0035] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0036] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0037] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0038] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0039] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0040] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0041] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage procedures related to moving. This system is mainly composed of a user, a terminal, and a server.
[0042] User Registration
[0043] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server.
[0044] The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal indicating that registration was successful.
[0045] Enter moving information
[0046] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal, which collects this information and sends it to the server.
[0047] The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures, including changing residence registration, changing electricity, gas, and water contracts, mail forwarding procedures, and changing internet and cable TV settings.
[0048] Generate guides
[0049] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0050] Procedure progress tracking and reminders
[0051] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0052] Protection of Personal Information
[0053] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0054] Specific examples
[0055] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0056] In this way, the system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably.
[0057] The processing flow will be explained below.
[0058] User Registration
[0059] Step 1:
[0060] The user enters basic information such as name, email address, and password on the device.
[0061] Step 2:
[0062] The device checks the format of the information entered, for example, checking the format of an email address or the strength of a password.
[0063] Step 3:
[0064] The terminal checks the format and then sends the input information to the server.
[0065] Step 4:
[0066] The server receives the input and hashes the password.
[0067] Step 5:
[0068] The server registers the new user in its user database, including their name, email address, and hashed password.
[0069] Step 6:
[0070] After registration is complete, the server will send a confirmation email to the user.
[0071] Step 7:
[0072] The server returns a registration completion message to the user terminal.
[0073] Enter moving information
[0074] Step 1:
[0075] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[0076] Step 2:
[0077] The terminal checks the input information and sends it to the server.
[0078] Step 3:
[0079] The server receives the input information and stores it in a database.
[0080] Step 4:
[0081] The server analyzes the moving information and automatically generates a list of necessary procedures.
[0082] Step 5:
[0083] The server stores the generated procedure list in a database.
[0084] Generate guides
[0085] Step 1:
[0086] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[0087] Step 2:
[0088] The server sends the generated guide to the user.
[0089] Step 3:
[0090] The user receives the guide and proceeds with the procedure.
[0091] Procedure progress tracking and reminders
[0092] Step 1:
[0093] The server periodically checks the database to see how the procedure is progressing.
[0094] Step 2:
[0095] The server detects an incomplete procedure.
[0096] Step 3:
[0097] The server generates reminders for outstanding transactions.
[0098] Step 4:
[0099] The server sends the reminder to the user.
[0100] Step 5:
[0101] Users receive reminders to complete any outstanding tasks.
[0102] Protection of Personal Information
[0103] Step 1:
[0104] When the terminal sends input information to the server, the communication is encrypted.
[0105] Step 2:
[0106] The server stores the received information in an encrypted form in a database.
[0107] Step 3:
[0108] The server sets access restrictions to prevent unauthorized access to user information.
[0109] Example 1
[0110] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0111] The moving procedures are extensive and extremely cumbersome for users. Furthermore, there is a risk that some information may be overlooked, which results in users spending a great deal of time and effort. Furthermore, protecting users' privacy is a major issue when going through these procedures, which involve a lot of personal information.
[0112] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0113] In this invention, the server includes means for receiving basic information entered by the user, checking the format of the information, and sending it to the server, means for analyzing the basic information, registering the user as a new user in a user database, and hashing the password to ensure security, means for receiving detailed moving-related information entered by the user and sending it to the server, means for saving the detailed information in a database and automatically generating a list of necessary procedures, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, and means for encrypting and sending and receiving the user's personal information and protecting it by restricting access to the database. This allows the user to centrally manage the complicated procedures related to moving, preventing oversight of procedures, and ensuring the protection of personal information.
[0114] "Basic information" refers to personal data such as name, email address, and password that a user enters when creating a new account.
[0115] "Format check" is the process of verifying whether the entered information complies with the specified format.
[0116] A "server" is a computer system that analyzes information sent by users, stores it in a database, and executes various procedures.
[0117] A "user database" is a data storage device for storing and managing basic user information, moving information, etc.
[0118] "Hashing" is a technology that increases security by converting data such as passwords using a one-way encryption algorithm.
[0119] "Detailed information" refers to specific data entered by the user regarding their move (e.g., old address, new address, moving date).
[0120] The "procedure list" is an automatically generated list of various procedures required for moving.
[0121] A "guide" is a document that contains detailed instructions and information to help a user systematically complete the necessary procedures for moving.
[0122] "Tracking progress" means regularly checking the status of each step and keeping up to date with the latest developments.
[0123] A "reminder" is a message that notifies the user about an incomplete procedure.
[0124] "Encryption" is a security technology that converts data into a format that cannot be deciphered by third parties.
[0125] "Access restriction" is a security setting that allows only users who have passed specific authentication to access data.
[0126] This system allows users to centrally manage procedures related to moving. The system is mainly composed of users, terminals, and a server.
[0127] User Registration
[0128] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. Format checks include whether the entered email address is in the correct format and whether the password meets the required number of characters.
[0129] The server analyzes the received information and registers the new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the device indicating that registration was successful.
[0130] Enter moving information
[0131] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server, which stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures.
[0132] Generate guides
[0133] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0134] Procedure progress tracking and reminders
[0135] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0136] Protection of Personal Information
[0137] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0138] Hardware and software used
[0139] The system runs on cloud-based servers, users' devices (PCs, smartphones, etc.), and SSL / TLS encryption protocols. The database employs a secure storage system to safely store user and migration information.
[0140] Specific examples
[0141] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0142] Prompt Sentence Examples
[0143] "Please design a system to efficiently manage moving information. I would like to create a system where the user can enter the information necessary for moving, and based on that, the system will automatically guide them through all the procedures. Please also include a list of specific procedures, progress management, and reminder functions."
[0144] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0145] Step 1:
[0146] A user accesses the system using a terminal and registers a new account. Basic information to be entered includes name, email address, and password. This information is entered and received by the terminal.
[0147] Input: User's basic information (name, email address, password)
[0148] Output: Basic information data for format checking
[0149] Specific behavior: The user enters "Name: Yamada Taro", "Email: taro@example.com", and "Password: password123" into the form.
[0150] Step 2:
[0151] The device receives the information entered by the user and checks its format, for example, whether the email address is in the correct format or whether the password meets a certain number of characters.
[0152] Input: Basic information data for format check
[0153] Output: Basic information data that is judged to be in the correct format
[0154] Specific behavior: The device checks whether the email address contains an "@" and whether the password is at least 8 characters long.
[0155] Step 3:
[0156] After the format check is complete, the device sends the information to the server, which analyzes the received data and registers the user as a new user in the database.
[0157] Input: Basic information data that is determined to be in the correct format
[0158] Output: New user information registered in the user database
[0159] Specific operation: The device sends data to the server, and the server registers it in the database as "Yamada Taro", "taro@example.com", and "hashed_password123".
[0160] Step 4:
[0161] Once registration is complete, the server will send a confirmation email to the user and return a message to the terminal indicating successful registration.
[0162] Input: New user information registered in the user database
[0163] Output: A confirmation email sent to the user and a successful registration message displayed on the device.
[0164] Specific operation: The server sends a confirmation email to "taro@example.com" and displays "Registration completed" on the device.
[0165] Step 5:
[0166] Next, the user inputs detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal. The input information is received by the terminal.
[0167] Input: Moving details (old address, new address, moving date)
[0168] Output: Detailed information data to send to the server
[0169] Specific operation: The user enters "Pre-move address: Minato-ku, Tokyo", "Post-move address: Shibuya-ku, Tokyo", and "Moving date: October 15, 2023".
[0170] Step 6:
[0171] The device collects the entered moving information and sends it to the server, which stores the received data in a database.
[0172] Input: Detailed information data to send to the server
[0173] Output: Moving information stored in the database
[0174] Specific operation: The device sends the moving information to the server, which stores it in a database.
[0175] Step 7:
[0176] The server analyzes the received moving information and automatically generates a list of necessary procedures, including the documents required for each procedure, deadlines, and procedures.
[0177] Input: Moving information stored in the database
[0178] Output: Generated procedure list
[0179] Specific operations: Analyzes moving information and creates a procedure list for "changing residence registration," "forwarding mail," and "changing electricity, gas, and water contracts."
[0180] Step 8:
[0181] After the procedure list is generated, the server generates and sends the user a guide to help the user perform the required procedures in an orderly manner.
[0182] Input: Generated procedure list
[0183] Output: Guide sent to the user
[0184] Specific operation: The server adds information to the guide such as "A copy of your residence certificate and identification are required to change your residence certificate. The deadline for this procedure is within 14 days of the moving date." The server sends the guide to the user's email address and displays "The guide has been sent" on the device.
[0185] Step 9:
[0186] The server periodically checks the progress of the transaction and updates it based on the information stored in the database. If the transaction is not completed, the server sends a reminder to the user about the incomplete transaction.
[0187] Input: Procedure information and progress status stored in the database
[0188] Output: Reminder sent to user
[0189] Specific operation: The server retrieves progress information from the database and sends a reminder to the user's email address stating, "The residence registration change procedure has not yet been completed. Please complete the procedure as soon as possible."
[0190] Step 10:
[0191] Users' personal information is strictly protected, and all transmissions of information are encrypted. Access to the database is restricted so that only authorized users can access it.
[0192] Input: Personal information sent and received and requests to access databases
[0193] Output: Encrypted data and authentication result based on access restrictions
[0194] Specific operation: All data is encrypted using SSL / TLS certificates for data communication between the server and the device. The server also records access logs and monitors for unauthorized access.
[0195] (Application example 1)
[0196] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0197] In modern society, it is important to efficiently manage the multiple procedures that users undergo. In particular, procedures closely related to daily life, such as moving and food delivery, are complex, making it difficult to manage procedures and progress. For this reason, there is a demand for a system that can centrally manage user procedures and ensure that they are completed efficiently and without omissions.
[0198] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0199] In this invention, the server includes means for receiving detailed moving or delivery information entered by the user, means for automatically generating a list of necessary procedures or a delivery guide based on the detailed information, and means for generating a guide based on the list of procedures or the delivery guide so that the user can carry out the necessary procedures in an orderly manner. This allows the user to centrally manage various procedures and proceed efficiently and reliably.
[0200] "Detailed Information" refers to specific moving and delivery data entered by the user.
[0201] A "procedure list" refers to a list of specific actions that a user must take in order to move or perform other procedures.
[0202] "Delivery Guide" refers to a guide that compiles instructions to enable a user to carry out delivery procedures in an orderly manner.
[0203] "Reminder" means an alert or reminder message that notifies a User of an outstanding transaction or delivery status.
[0204] "Personal information" refers to any information that can identify an individual user (for example, name, address, email address, etc.).
[0205] "Server" refers to a central system for receiving, processing and storing data.
[0206] "Tracking" refers to the activity of continuously monitoring and updating the progress of a transaction or delivery.
[0207] "Automatically generated" means that the system performs processing based on a program and generates a result without manual operation by the user.
[0208] "Guide" refers to materials or information that provide instructions or procedures to enable a user to perform a required procedure in an orderly manner.
[0209] "Customization" refers to changing settings and content to suit a user's specific needs and lifestyle.
[0210] "Lifestyle" refers to the activities and behavioral patterns that a user engages in in their daily life.
[0211] "Specific needs" refers to individual conditions or requirements that differ from general requirements.
[0212] This invention is a system for efficiently carrying out moving and delivery procedures. This system is composed of users, terminals, and a server, and is intended to centrally manage procedures carried out by users.
[0213] User Registration
[0214] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0215] Entering moving and delivery information
[0216] Next, the user enters details about the move and delivery (e.g., address, date, etc.) into the device. The device collects this information and sends it to the server, which stores it in a database. As part of the service, the server then analyzes this information and automatically generates a list of necessary procedures and delivery instructions.
[0217] Generate guides
[0218] After the procedure list or delivery guide is generated, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0219] Procedure progress tracking and reminders
[0220] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[0221] Protection of Personal Information
[0222] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0223] Hardware and software used
[0224] Server: Any cloud-based server (e.g. AWS, Google Cloud)
[0225] Client: Smartphone
[0226] Framework: Flask (Python web framework)
[0227] Security: werkzeug.security (password hashing)
[0228] Email service: smtplib (simple email sending; in practice, we recommend using an email API such as SendGrid)
[0229] Specific examples
[0230] For example, if a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023," the server will use this information to generate a list including procedures for changing residence certificates and create a guide. The guide will contain detailed information about the documents and methods required for each procedure and will be sent to the user.
[0231] Prompt Sentence Examples
[0232] "A user has placed a new food delivery order. Please use the details below to generate a delivery guide.
[0233] Delivery address: 1-1-1 Shibuya, Shibuya-ku, Tokyo
[0234] Desired delivery date and time: December 20, 2023, 6:00 PM
[0235] In this way, the system reduces the burden on users and helps them carry out procedures related to moving and delivery efficiently and reliably.
[0236] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0237] Step 1:
[0238] A user uses a terminal to register a new account. The user enters their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the information and registers the new user in the user database. The password is hashed to ensure security. The server then sends a confirmation email to the user and returns a message to the terminal indicating that the registration was successful.
[0239] Input: User's name, email address, and password
[0240] Output: New account creation confirmation email
[0241] Step 2:
[0242] The user enters details about the move or delivery into the device, such as the old address, new address, move date, delivery address, and desired delivery date and time. The device collects this information and sends it to the server, which stores it in a database.
[0243] Input: Moving or delivery details (old address, new address, moving date, delivery address, desired delivery date and time, etc.)
[0244] Output: Save detailed information to a database
[0245] Step 3:
[0246] The server analyzes the moving or delivery information stored in the database and automatically generates a list of necessary procedures or a delivery guide. The list of procedures includes changes to residence registration and changes to electricity, gas, and water contracts, while the delivery guide includes delivery address instructions and important points. This list of procedures or guide details all the actions required for the user.
[0247] Input: Details stored in the database
[0248] Output: Procedure list or delivery guide
[0249] Step 4:
[0250] The server generates a guide based on the generated procedure list or delivery guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The server then sends this to the user.
[0251] Input: Generated procedure list or delivery guide
[0252] Output: Detailed procedure guide
[0253] Step 5:
[0254] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[0255] Input: Procedure progress information stored in the database
[0256] Output: Reminder email or notification
[0257] Step 6:
[0258] To strictly protect users' personal information, the server encrypts the transmission and reception of information and sets access restrictions to the database, thereby minimizing the risk of user data being leaked to third parties.
[0259] Input: User's personal information
[0260] Output: Encrypted personal information, access restriction settings
[0261] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0262] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[0263] User Registration
[0264] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0265] Enter moving information
[0266] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0267] Generate guides
[0268] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0269] Procedure progress tracking and reminders
[0270] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0271] Protection of Personal Information
[0272] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0273] Introducing the Emotion Engine
[0274] The system also incorporates an emotion engine to recognize the user's emotions. For example, when a user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to a server in real time, and the emotion engine on the server analyzes the user's stress level, satisfaction, confusion, etc.
[0275] Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows high stress levels, the system can re-explain how to proceed or refer them to support staff. If the user is satisfied, the system can send a message praising the smoothness of the process.
[0276] Specific examples
[0277] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0278] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[0279] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[0280] The processing flow will be explained below.
[0281] User Registration
[0282] Step 1:
[0283] The user enters basic information such as name, email address, and password on the device.
[0284] Step 2:
[0285] The device checks the format of the information entered, checking the format of email addresses and the strength of passwords.
[0286] Step 3:
[0287] The terminal checks the format and sends the information to the server.
[0288] Step 4:
[0289] The server receives the input and hashes the password.
[0290] Step 5:
[0291] The server registers the new user in its user database, storing their name, email address, and hashed password.
[0292] Step 6:
[0293] The server sends a confirmation email to the user.
[0294] Step 7:
[0295] The server returns a registration completion message to the user terminal.
[0296] Enter moving information
[0297] Step 1:
[0298] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[0299] Step 2:
[0300] The terminal checks the input information and sends it to the server.
[0301] Step 3:
[0302] The server receives the input information and stores it in a database.
[0303] Step 4:
[0304] The server analyzes the moving information and automatically generates a list of necessary procedures.
[0305] Step 5:
[0306] The server stores the generated procedure list in a database.
[0307] Generate guides
[0308] Step 1:
[0309] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[0310] Step 2:
[0311] The server sends the generated guide to the user.
[0312] Step 3:
[0313] The user receives the guide and proceeds with the procedure.
[0314] Procedure progress tracking and reminders
[0315] Step 1:
[0316] The server periodically checks the database to see how the procedure is progressing.
[0317] Step 2:
[0318] The server detects an incomplete procedure.
[0319] Step 3:
[0320] The server generates reminders for outstanding transactions.
[0321] Step 4:
[0322] The server sends the reminder to the user.
[0323] Step 5:
[0324] Users receive reminders to complete any outstanding tasks.
[0325] Protection of Personal Information
[0326] Step 1:
[0327] When the device sends input information to the server, the communication is encrypted.
[0328] Step 2:
[0329] The server stores the received information in an encrypted form in a database.
[0330] Step 3:
[0331] The server sets access restrictions to prevent unauthorized access to user information.
[0332] Introducing the Emotion Engine
[0333] Step 1:
[0334] While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice.
[0335] Step 2:
[0336] The device transmits this data to the server in real time.
[0337] Step 3:
[0338] The server's emotion engine analyzes the user's facial expression and voice data to evaluate their stress level, satisfaction, and confusion.
[0339] Step 4:
[0340] Based on the analysis results, the emotion engine suggests guidance and support that corresponds to the user's emotions.
[0341] Step 5:
[0342] If the user exhibits high stress levels, the server may provide detailed re-explaining of how to proceed or refer the user to support staff.
[0343] Step 6:
[0344] If the user is satisfied, the server sends a message praising the smoothness of the process.
[0345] Specific examples
[0346] For example, suppose a user creates a new account and enters "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0347] If a user shows a confused expression through the camera while entering moving information, the device detects this and sends it to the server. If the server's emotion engine detects confusion, it provides the user with additional explanations or support messages.
[0348] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[0349] Example 2
[0350] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0351] Conventional moving procedures involve a wide range of complicated steps, making it difficult for users to manage the process efficiently. Furthermore, they lacked a reminder function to track the progress of the process and ensure that any incomplete steps are completed. Furthermore, they did not provide support that took into account the user's emotional state, which could lead to stressful situations for the user. It is necessary to provide a system that solves these issues and makes the moving process efficient and user-friendly.
[0352] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0353] In this invention, the server includes means for receiving detailed moving-related information entered by a user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for analyzing the user's emotions and providing support based on the analysis, and means for strictly protecting the user's personal information. This makes it possible to efficiently manage the moving procedures and provide flexible support according to the user's emotional state.
[0354] "User" means an individual or corporation that uses the system.
[0355] A "terminal" is a device such as a computer or smartphone that a user uses to access the system.
[0356] A "server" is a central system that receives and processes information from users.
[0357] "Detailed information about moving" refers to information related to moving, such as old address, new address, moving date, etc., entered by the user.
[0358] The "procedure list" is a list of the procedures required when moving.
[0359] A "guide" is a document or display that allows a user to perform necessary procedures in an orderly manner based on a procedure list.
[0360] "Progress" refers to information indicating how much of the procedures that the user is to perform has been completed.
[0361] "Reminder" is a function that notifies the user of incomplete procedures.
[0362] "Emotions" refers to the user's state of mind, such as stress level, satisfaction, and confusion.
[0363] "Means for analyzing emotions" refers to technology that analyzes a user's facial expressions and voice to determine their emotional state.
[0364] "Personal information" refers to information about an individual, such as a user's name, address, and contact details.
[0365] "Strict protection measures" refer to security measures, such as data encryption and access restrictions, to prevent users' personal information from being leaked to the outside.
[0366] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[0367] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0368] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0369] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0370] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0371] In addition, users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0372] The system also incorporates an emotion engine to recognize the user's emotions. For example, while the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows a high stress level, the system can explain how to proceed with the procedure again or introduce a support staff member. Also, if the user is satisfied, it can send a message praising the smoothness of the procedure.
[0373] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0374] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[0375] This system uses prompts based on a generative AI model to efficiently manage moving procedures, reducing the burden on users and supporting them in carrying out moving-related procedures efficiently and reliably. In addition, an emotion engine enables flexible support based on the user's emotions.
[0376] Example prompt sentence:
[0377] Please explain the program's processing for the migration system in natural language. The subject should be either the server, the terminal, or the user. Please use plain sentence endings.
[0378] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0379] Step 1: User Registration
[0380] 1.1. The user accesses the system using a terminal and opens the registration page for a new account.
[0381] 1.2. The user enters basic information such as name, email address, and password (Input: Name, Email Address, Password).
[0382] 1.3. The terminal checks the format of the entered information (Process: Format Check).
[0383] 1.4. The terminal encrypts the information that has passed the format check and sends it to the server (output: encrypted user information).
[0384] Step 2: Register user data on the server
[0385] 2.1. The server receives the encrypted user information (Input: Encrypted user information).
[0386] 2.2. The server hashes the password (process: hash).
[0387] 2.3. The server saves the user information in the user database (Output: User information saved in the database).
[0388] 2.4. The server sends a confirmation email to the user's email address and returns a registration completion message to the terminal (output: confirmation email, registration completion message).
[0389] Step 3: Enter your moving information
[0390] 3.1. The user uses the device to open the moving information input page.
[0391] 3.2. The user enters details such as the old address, new address, and moving date (input: address, moving date).
[0392] 3.3. The terminal checks the format of the entered information (Process: Format Check).
[0393] 3.4. The device encrypts the information that has passed the format check and sends it to the server (output: encrypted moving information).
[0394] Step 4: Registering the moving data on the server
[0395] 4.1. The server receives the encrypted moving information (Input: Encrypted moving information).
[0396] 4.2. The server saves the moving information in the database (Output: Moving information saved in the database).
[0397] 4.3. The server analyzes the moving information and automatically generates a list of necessary procedures (Processing: Data Analysis, Procedure List Generation).
[0398] 4.4. The server saves the generated procedure list in the database (Output: Procedure list saved in the database).
[0399] Step 5: Generate guides
[0400] 5.1. The server generates a guide based on the procedure list to help the user perform the procedures in an orderly manner (process: guide generation).
[0401] 5.2. The guide will clearly state the required documents, deadlines and procedures for each procedure (Process: Entering required information).
[0402] 5.3. The server encrypts the generated guide and sends it to the user's device (Output: Encrypted guide).
[0403] Step 6: Track progress and send reminders
[0404] 6.1. The server periodically checks the progress of the procedure stored in the database (Input: Progress information in database, Action: Periodic check).
[0405] 6.2. Update the status based on any new information (Action: Update Status).
[0406] 6.3. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure (Output: Reminder notification).
[0407] Step 7: Collect emotion data
[0408] 7.1. While the user is entering moving information, the device will use the camera and microphone to collect the user's facial expressions and voice (input: facial expression data, voice data).
[0409] 7.2. The collected data is encrypted in real time and sent to the server (output: encrypted emotion data).
[0410] Step 8: Sentiment analysis and appropriate support
[0411] 8.1. The server analyzes the received emotion data (input: encrypted emotion data, processing: emotion analysis).
[0412] 8.2. The server determines the user's emotional state based on the analysis results (Process: Determine Emotional State).
[0413] 8.3. Provide guidance and support according to the user's emotions (Output: Guidance and support message).
[0414] For example, if a user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it can provide additional explanations or support messages to the user, allowing them to proceed more smoothly.
[0415] In this way, the entire system efficiently supports users' relocation procedures.
[0416] (Application example 2)
[0417] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0418] Conventional moving procedure systems lack a means for users to centrally manage the procedures, and it takes a great deal of time and effort for users to remember to complete the various procedures associated with moving. Furthermore, they lack the functionality to track the progress of procedures or to provide flexible guidance that responds to the user's emotions, placing a heavy burden on users. Furthermore, the lack of a navigation guide to help users navigate efficiently through stores is also an issue for everyday shopping.
[0419] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0420] In this invention, the server includes means for receiving detailed moving information entered by the user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to enable the user to perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for strictly protecting the user's personal information, means for analyzing the user's facial expressions and voice and providing adaptive guidance according to their emotions, and means for receiving a shopping list and store information and generating a navigation guide to enable efficient shopping. This enables the user to efficiently complete moving procedures and daily shopping and provides emotional support, thereby reducing the burden on the user.
[0421] "Detailed information" refers to specific information related to the move that is input by the user, such as the old address, new address, and moving date.
[0422] The "procedure list" is a list of the individual procedures that users must carry out when they move, including changing their residence registration and changing their electricity, gas, and water contracts.
[0423] The "guide" is a document that guides the user to carry out the procedures in an orderly manner based on the procedure list.
[0424] A "reminder" is a message that notifies the user of incomplete procedures and reminds them to complete the necessary steps.
[0425] "Personal information" refers to information about a user that can identify a specific individual, such as the user's name, address, telephone number, and email address.
[0426] "Facial expression" refers to the facial expression of the user, and refers to facial movements that express emotions.
[0427] "Voice" refers to information collected as sound, such as the content of a user's speech and tone of voice.
[0428] "Adaptive guidance" refers to support messages and explanations that are customized based on the user's emotions and situation.
[0429] A "shopping list" is a list of items a user plans to purchase, including groceries, clothing, electronics, and other items.
[0430] "Store information" is information about the store that the user visits, including the location, business hours, sale information, and the like.
[0431] "Navigation Guide" is route guidance that enables users to shop efficiently based on their shopping list and store information.
[0432] This invention is a system for enabling users to efficiently carry out procedures related to moving and daily shopping, and a specific embodiment thereof will be described. This system is mainly composed of a user, a terminal, a server, and an emotion engine.
[0433] User Registration
[0434] A user accesses the system using a terminal and registers a new account. They enter basic information such as their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the new user in the user database. The password is also hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0435] Enter moving information
[0436] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0437] Generate guides
[0438] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0439] Procedure progress tracking and reminders
[0440] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0441] Introducing the Emotion Engine
[0442] The emotion engine is used to recognize the user's emotions. While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine can provide guidance and support according to the user's emotions.
[0443] Generate navigation guides
[0444] Shopping lists and store information are also entered in the same way. Users input a list of products they plan to purchase and information about stores they plan to visit into their terminal. Based on this information, the server generates a navigation guide to help users shop efficiently. This guide includes information on efficient routes and special sales at each store.
[0445] Protection of Personal Information
[0446] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0447] Specific examples
[0448] For example, suppose a user creates a new account and enters moving information such as "Old address: Tokyo wards," "New address: Tokyo wards," and "Moving date: October 15, 2023." Based on this information, the server detects the need for procedures such as changing residence registration and changing electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user. Furthermore, if the user shows a confused expression, the server can provide additional explanations or support messages based on the facial expression data sent to the server in real time.
[0449] Hardware and software used
[0450] The hardware used includes the devices used by users (smartphones, tablets, etc.). The server has powerful information processing capabilities and runs a database management system, emotion analysis system, etc. The emotion engine also uses facial expression analysis software and voice analysis software.
[0451] Prompt Sentence Examples
[0452] As an example of input to a generative AI model, use the following prompt:
[0453] "Recognize emotions while users are using a shopping guide app and generate code to provide supportive messages when stress levels are high. Key functionality requires a complete application flow including user registration, shopping list input, and generation of navigation guides based on emotions."
[0454] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0455] Step 1:
[0456] A user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the entered information and registers the user as a new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0457] Input: Name, Email Address, Password
[0458] Output: Confirmation email, registration success message, database entry in hashed password
[0459] Step 2:
[0460] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0461] Input: Old address, New address, Moving date
[0462] Output: Procedure list, saved moving information
[0463] Step 3:
[0464] Based on the procedure list, the server generates a guide to help users perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0465] Input: Procedure list
[0466] Output: Procedural guide, messages sent to the user
[0467] Step 4:
[0468] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0469] Input: Procedure progress, incomplete procedures
[0470] Output: Reminder message, progress update
[0471] Step 5:
[0472] The device analyzes the user's facial expressions and voice to provide adaptive guidance based on their emotions. As the user enters their moving information, the device uses a camera and microphone to collect facial and voice data. This data is sent to the server in real time, and the emotion engine analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides the user with optimal guidance and support messages.
[0473] Input: facial expression data, voice data
[0474] Output: Sentiment analysis results, adaptive guidance messages
[0475] Step 6:
[0476] The user inputs a shopping list and store information into the device. The device then sends this information to the server, which then generates a navigation guide based on the received information to help the user shop efficiently. This guide includes information on efficient routes and special sales at each store.
[0477] Input: Shopping list, store information
[0478] Output: Navigation guide, special offers
[0479] Step 7:
[0480] To strictly protect users' personal information, the transmission of information is encrypted. The server limits access to personal information stored in the database to prevent data leakage.
[0481] Input: Personal Information
[0482] Output: Encrypted data, access restriction log
[0483] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0484] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0485] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0486] [Second embodiment]
[0487] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0488] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0489] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0490] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0491] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0492] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0493] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0494] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0495] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0496] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0497] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0498] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0499] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage procedures related to moving. This system is mainly composed of a user, a terminal, and a server.
[0500] User Registration
[0501] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server.
[0502] The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal indicating that registration was successful.
[0503] Enter moving information
[0504] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal, which collects this information and sends it to the server.
[0505] The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures, including changing residence registration, changing electricity, gas, and water contracts, mail forwarding procedures, and changing internet and cable TV settings.
[0506] Generate guides
[0507] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0508] Procedure progress tracking and reminders
[0509] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0510] Protection of Personal Information
[0511] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0512] Specific examples
[0513] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0514] In this way, the system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably.
[0515] The processing flow will be explained below.
[0516] User Registration
[0517] Step 1:
[0518] The user enters basic information such as name, email address, and password on the device.
[0519] Step 2:
[0520] The device checks the format of the information entered, for example, checking the format of an email address or the strength of a password.
[0521] Step 3:
[0522] The terminal checks the format and then sends the input information to the server.
[0523] Step 4:
[0524] The server receives the input and hashes the password.
[0525] Step 5:
[0526] The server registers the new user in its user database, including their name, email address, and hashed password.
[0527] Step 6:
[0528] After registration is complete, the server will send a confirmation email to the user.
[0529] Step 7:
[0530] The server returns a registration completion message to the user terminal.
[0531] Enter moving information
[0532] Step 1:
[0533] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[0534] Step 2:
[0535] The terminal checks the input information and sends it to the server.
[0536] Step 3:
[0537] The server receives the input information and stores it in a database.
[0538] Step 4:
[0539] The server analyzes the moving information and automatically generates a list of necessary procedures.
[0540] Step 5:
[0541] The server stores the generated procedure list in a database.
[0542] Generate guides
[0543] Step 1:
[0544] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[0545] Step 2:
[0546] The server sends the generated guide to the user.
[0547] Step 3:
[0548] The user receives the guide and proceeds with the procedure.
[0549] Procedure progress tracking and reminders
[0550] Step 1:
[0551] The server periodically checks the database to see how the procedure is progressing.
[0552] Step 2:
[0553] The server detects an incomplete procedure.
[0554] Step 3:
[0555] The server generates reminders for outstanding transactions.
[0556] Step 4:
[0557] The server sends the reminder to the user.
[0558] Step 5:
[0559] Users receive reminders to complete any outstanding tasks.
[0560] Protection of Personal Information
[0561] Step 1:
[0562] When the terminal sends input information to the server, the communication is encrypted.
[0563] Step 2:
[0564] The server stores the received information in an encrypted form in a database.
[0565] Step 3:
[0566] The server sets access restrictions to prevent unauthorized access to user information.
[0567] Example 1
[0568] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0569] The moving procedures are extensive and extremely cumbersome for users. Furthermore, there is a risk that some information may be overlooked, which results in users spending a great deal of time and effort. Furthermore, protecting users' privacy is a major issue when going through these procedures, which involve a lot of personal information.
[0570] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0571] In this invention, the server includes means for receiving basic information entered by the user, checking the format of the information, and sending it to the server, means for analyzing the basic information, registering the user as a new user in a user database, and hashing the password to ensure security, means for receiving detailed moving-related information entered by the user and sending it to the server, means for saving the detailed information in a database and automatically generating a list of necessary procedures, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, and means for encrypting and sending and receiving the user's personal information and protecting it by restricting access to the database. This allows the user to centrally manage the complicated procedures related to moving, preventing oversight of procedures, and ensuring the protection of personal information.
[0572] "Basic information" refers to personal data such as name, email address, and password that a user enters when creating a new account.
[0573] "Format check" is the process of verifying whether the entered information complies with the specified format.
[0574] A "server" is a computer system that analyzes information sent by users, stores it in a database, and executes various procedures.
[0575] A "user database" is a data storage device for storing and managing basic user information, moving information, etc.
[0576] "Hashing" is a technology that increases security by converting data such as passwords using a one-way encryption algorithm.
[0577] "Detailed information" refers to specific data entered by the user regarding their move (e.g., old address, new address, moving date).
[0578] The "procedure list" is an automatically generated list of various procedures required for moving.
[0579] A "guide" is a document that contains detailed instructions and information to help a user systematically complete the necessary procedures for moving.
[0580] "Tracking progress" means regularly checking the status of each step and keeping up to date with the latest developments.
[0581] A "reminder" is a message that notifies the user about an incomplete procedure.
[0582] "Encryption" is a security technology that converts data into a format that cannot be deciphered by third parties.
[0583] "Access restriction" is a security setting that allows only users who have passed specific authentication to access data.
[0584] This system allows users to centrally manage procedures related to moving. The system is mainly composed of users, terminals, and a server.
[0585] User Registration
[0586] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. Format checks include whether the entered email address is in the correct format and whether the password meets the required number of characters.
[0587] The server analyzes the received information and registers the new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the device indicating that registration was successful.
[0588] Enter moving information
[0589] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server, which stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures.
[0590] Generate guides
[0591] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0592] Procedure progress tracking and reminders
[0593] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0594] Protection of Personal Information
[0595] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0596] Hardware and software used
[0597] The system runs on cloud-based servers, users' devices (PCs, smartphones, etc.), and SSL / TLS encryption protocols. The database employs a secure storage system to safely store user and migration information.
[0598] Specific examples
[0599] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0600] Prompt Sentence Examples
[0601] "Please design a system to efficiently manage moving information. I would like to create a system where the user can enter the information necessary for moving, and based on that, the system will automatically guide them through all the procedures. Please also include a list of specific procedures, progress management, and reminder functions."
[0602] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0603] Step 1:
[0604] A user accesses the system using a terminal and registers a new account. Basic information to be entered includes name, email address, and password. This information is entered and received by the terminal.
[0605] Input: User's basic information (name, email address, password)
[0606] Output: Basic information data for format checking
[0607] Specific behavior: The user enters "Name: Yamada Taro", "Email: taro@example.com", and "Password: password123" into the form.
[0608] Step 2:
[0609] The device receives the information entered by the user and checks its format, for example, whether the email address is in the correct format or whether the password meets a certain number of characters.
[0610] Input: Basic information data for format check
[0611] Output: Basic information data that is judged to be in the correct format
[0612] Specific behavior: The device checks whether the email address contains an "@" and whether the password is at least 8 characters long.
[0613] Step 3:
[0614] After the format check is complete, the device sends the information to the server, which analyzes the received data and registers the user as a new user in the database.
[0615] Input: Basic information data that is determined to be in the correct format
[0616] Output: New user information registered in the user database
[0617] Specific operation: The device sends data to the server, and the server registers it in the database as "Yamada Taro", "taro@example.com", and "hashed_password123".
[0618] Step 4:
[0619] Once registration is complete, the server will send a confirmation email to the user and return a message to the terminal indicating successful registration.
[0620] Input: New user information registered in the user database
[0621] Output: A confirmation email sent to the user and a successful registration message displayed on the device.
[0622] Specific operation: The server sends a confirmation email to "taro@example.com" and displays "Registration completed" on the device.
[0623] Step 5:
[0624] Next, the user inputs detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal. The input information is received by the terminal.
[0625] Input: Moving details (old address, new address, moving date)
[0626] Output: Detailed information data to send to the server
[0627] Specific operation: The user enters "Pre-move address: Minato-ku, Tokyo", "Post-move address: Shibuya-ku, Tokyo", and "Moving date: October 15, 2023".
[0628] Step 6:
[0629] The device collects the entered moving information and sends it to the server, which stores the received data in a database.
[0630] Input: Detailed information data to send to the server
[0631] Output: Moving information stored in the database
[0632] Specific operation: The device sends the moving information to the server, which stores it in a database.
[0633] Step 7:
[0634] The server analyzes the received moving information and automatically generates a list of necessary procedures, including the documents required for each procedure, deadlines, and procedures.
[0635] Input: Moving information stored in the database
[0636] Output: Generated procedure list
[0637] Specific operations: Analyzes moving information and creates a procedure list for "changing residence registration," "forwarding mail," and "changing electricity, gas, and water contracts."
[0638] Step 8:
[0639] After the procedure list is generated, the server generates and sends the user a guide to help the user perform the required procedures in an orderly manner.
[0640] Input: Generated procedure list
[0641] Output: Guide sent to the user
[0642] Specific operation: The server adds information to the guide such as "A copy of your residence certificate and identification are required to change your residence certificate. The deadline for this procedure is within 14 days of the moving date." The server sends the guide to the user's email address and displays "The guide has been sent" on the device.
[0643] Step 9:
[0644] The server periodically checks the progress of the transaction and updates it based on the information stored in the database. If the transaction is not completed, the server sends a reminder to the user about the incomplete transaction.
[0645] Input: Procedure information and progress status stored in the database
[0646] Output: Reminder sent to user
[0647] Specific operation: The server retrieves progress information from the database and sends a reminder to the user's email address stating, "The residence registration change procedure has not yet been completed. Please complete the procedure as soon as possible."
[0648] Step 10:
[0649] Users' personal information is strictly protected, and all transmissions of information are encrypted. Access to the database is restricted so that only authorized users can access it.
[0650] Input: Personal information sent and received and requests to access databases
[0651] Output: Encrypted data and authentication result based on access restrictions
[0652] Specific operation: All data is encrypted using SSL / TLS certificates for data communication between the server and the device. The server also records access logs and monitors for unauthorized access.
[0653] (Application example 1)
[0654] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0655] In modern society, it is important to efficiently manage the multiple procedures that users undergo. In particular, procedures closely related to daily life, such as moving and food delivery, are complex, making it difficult to manage procedures and progress. For this reason, there is a demand for a system that can centrally manage user procedures and ensure that they are completed efficiently and without omissions.
[0656] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0657] In this invention, the server includes means for receiving detailed moving or delivery information entered by the user, means for automatically generating a list of necessary procedures or a delivery guide based on the detailed information, and means for generating a guide based on the list of procedures or the delivery guide so that the user can carry out the necessary procedures in an orderly manner. This allows the user to centrally manage various procedures and proceed efficiently and reliably.
[0658] "Detailed Information" refers to specific moving and delivery data entered by the user.
[0659] A "procedure list" refers to a list of specific actions that a user must take in order to move or perform other procedures.
[0660] "Delivery Guide" refers to a guide that compiles instructions to enable a user to carry out delivery procedures in an orderly manner.
[0661] "Reminder" means an alert or reminder message that notifies a User of an outstanding transaction or delivery status.
[0662] "Personal information" refers to any information that can identify an individual user (for example, name, address, email address, etc.).
[0663] "Server" refers to a central system for receiving, processing and storing data.
[0664] "Tracking" refers to the activity of continuously monitoring and updating the progress of a transaction or delivery.
[0665] "Automatically generated" means that the system performs processing based on a program and generates a result without manual operation by the user.
[0666] "Guide" refers to materials or information that provide instructions or procedures to enable a user to perform a required procedure in an orderly manner.
[0667] "Customization" refers to changing settings and content to suit a user's specific needs and lifestyle.
[0668] "Lifestyle" refers to the activities and behavioral patterns that a user engages in in their daily life.
[0669] "Specific needs" refers to individual conditions or requirements that differ from general requirements.
[0670] This invention is a system for efficiently carrying out moving and delivery procedures. This system is composed of users, terminals, and a server, and is intended to centrally manage procedures carried out by users.
[0671] User Registration
[0672] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0673] Entering moving and delivery information
[0674] Next, the user enters details about the move and delivery (e.g., address, date, etc.) into the device. The device collects this information and sends it to the server, which stores it in a database. As part of the service, the server then analyzes this information and automatically generates a list of necessary procedures and delivery instructions.
[0675] Generate guides
[0676] After the procedure list or delivery guide is generated, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0677] Procedure progress tracking and reminders
[0678] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[0679] Protection of Personal Information
[0680] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0681] Hardware and software used
[0682] Server: Any cloud-based server (e.g. AWS, Google Cloud)
[0683] Client: Smartphone
[0684] Framework: Flask (Python web framework)
[0685] Security: werkzeug.security (password hashing)
[0686] Email service: smtplib (simple email sending; in practice, we recommend using an email API such as SendGrid)
[0687] Specific examples
[0688] For example, if a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023," the server will use this information to generate a list including procedures for changing residence certificates and create a guide. The guide will contain detailed information about the documents and methods required for each procedure and will be sent to the user.
[0689] Prompt Sentence Examples
[0690] "A user has placed a new food delivery order. Please use the details below to generate a delivery guide.
[0691] Delivery address: 1-1-1 Shibuya, Shibuya-ku, Tokyo
[0692] Desired delivery date and time: December 20, 2023, 6:00 PM
[0693] In this way, the system reduces the burden on users and helps them carry out procedures related to moving and delivery efficiently and reliably.
[0694] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0695] Step 1:
[0696] A user uses a terminal to register a new account. The user enters their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the information and registers the new user in the user database. The password is hashed to ensure security. The server then sends a confirmation email to the user and returns a message to the terminal indicating that the registration was successful.
[0697] Input: User's name, email address, and password
[0698] Output: New account creation confirmation email
[0699] Step 2:
[0700] The user enters details about the move or delivery into the device, such as the old address, new address, move date, delivery address, and desired delivery date and time. The device collects this information and sends it to the server, which stores it in a database.
[0701] Input: Moving or delivery details (old address, new address, moving date, delivery address, desired delivery date and time, etc.)
[0702] Output: Save detailed information to a database
[0703] Step 3:
[0704] The server analyzes the moving or delivery information stored in the database and automatically generates a list of necessary procedures or a delivery guide. The list of procedures includes changes to residence registration and changes to electricity, gas, and water contracts, while the delivery guide includes delivery address instructions and important points. This list of procedures or guide details all the actions required for the user.
[0705] Input: Details stored in the database
[0706] Output: Procedure list or delivery guide
[0707] Step 4:
[0708] The server generates a guide based on the generated procedure list or delivery guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The server then sends this to the user.
[0709] Input: Generated procedure list or delivery guide
[0710] Output: Detailed procedure guide
[0711] Step 5:
[0712] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[0713] Input: Procedure progress information stored in the database
[0714] Output: Reminder email or notification
[0715] Step 6:
[0716] To strictly protect users' personal information, the server encrypts the transmission and reception of information and sets access restrictions to the database, thereby minimizing the risk of user data being leaked to third parties.
[0717] Input: User's personal information
[0718] Output: Encrypted personal information, access restriction settings
[0719] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0720] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[0721] User Registration
[0722] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0723] Enter moving information
[0724] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0725] Generate guides
[0726] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0727] Procedure progress tracking and reminders
[0728] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0729] Protection of Personal Information
[0730] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0731] Introducing the Emotion Engine
[0732] The system also incorporates an emotion engine to recognize the user's emotions. For example, when a user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to a server in real time, and the emotion engine on the server analyzes the user's stress level, satisfaction, confusion, etc.
[0733] Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows high stress levels, the system can re-explain how to proceed or refer them to support staff. If the user is satisfied, the system can send a message praising the smoothness of the process.
[0734] Specific examples
[0735] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0736] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[0737] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[0738] The processing flow will be explained below.
[0739] User Registration
[0740] Step 1:
[0741] The user enters basic information such as name, email address, and password on the device.
[0742] Step 2:
[0743] The device checks the format of the information entered, checking the format of email addresses and the strength of passwords.
[0744] Step 3:
[0745] The terminal checks the format and sends the information to the server.
[0746] Step 4:
[0747] The server receives the input and hashes the password.
[0748] Step 5:
[0749] The server registers the new user in its user database, storing their name, email address, and hashed password.
[0750] Step 6:
[0751] The server sends a confirmation email to the user.
[0752] Step 7:
[0753] The server returns a registration completion message to the user terminal.
[0754] Enter moving information
[0755] Step 1:
[0756] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[0757] Step 2:
[0758] The terminal checks the input information and sends it to the server.
[0759] Step 3:
[0760] The server receives the input information and stores it in a database.
[0761] Step 4:
[0762] The server analyzes the moving information and automatically generates a list of necessary procedures.
[0763] Step 5:
[0764] The server stores the generated procedure list in a database.
[0765] Generate guides
[0766] Step 1:
[0767] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[0768] Step 2:
[0769] The server sends the generated guide to the user.
[0770] Step 3:
[0771] The user receives the guide and proceeds with the procedure.
[0772] Procedure progress tracking and reminders
[0773] Step 1:
[0774] The server periodically checks the database to see how the procedure is progressing.
[0775] Step 2:
[0776] The server detects an incomplete procedure.
[0777] Step 3:
[0778] The server generates reminders for outstanding transactions.
[0779] Step 4:
[0780] The server sends the reminder to the user.
[0781] Step 5:
[0782] Users receive reminders to complete any outstanding tasks.
[0783] Protection of Personal Information
[0784] Step 1:
[0785] When the device sends input information to the server, the communication is encrypted.
[0786] Step 2:
[0787] The server stores the received information in an encrypted form in a database.
[0788] Step 3:
[0789] The server sets access restrictions to prevent unauthorized access to user information.
[0790] Introducing the Emotion Engine
[0791] Step 1:
[0792] While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice.
[0793] Step 2:
[0794] The device transmits this data to the server in real time.
[0795] Step 3:
[0796] The server's emotion engine analyzes the user's facial expression and voice data to evaluate their stress level, satisfaction, and confusion.
[0797] Step 4:
[0798] Based on the analysis results, the emotion engine suggests guidance and support that corresponds to the user's emotions.
[0799] Step 5:
[0800] If the user exhibits high stress levels, the server may provide detailed re-explaining of how to proceed or refer the user to support staff.
[0801] Step 6:
[0802] If the user is satisfied, the server sends a message praising the smoothness of the process.
[0803] Specific examples
[0804] For example, suppose a user creates a new account and enters "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0805] If a user shows a confused expression through the camera while entering moving information, the device detects this and sends it to the server. If the server's emotion engine detects confusion, it provides the user with additional explanations or support messages.
[0806] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[0807] Example 2
[0808] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0809] Conventional moving procedures involve a wide range of complicated steps, making it difficult for users to manage the process efficiently. Furthermore, they lacked a reminder function to track the progress of the process and ensure that any incomplete steps are completed. Furthermore, they did not provide support that took into account the user's emotional state, which could lead to stressful situations for the user. It is necessary to provide a system that solves these issues and makes the moving process efficient and user-friendly.
[0810] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0811] In this invention, the server includes means for receiving detailed moving-related information entered by a user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for analyzing the user's emotions and providing support based on the analysis, and means for strictly protecting the user's personal information. This makes it possible to efficiently manage the moving procedures and provide flexible support according to the user's emotional state.
[0812] "User" means an individual or corporation that uses the system.
[0813] A "terminal" is a device such as a computer or smartphone that a user uses to access the system.
[0814] A "server" is a central system that receives and processes information from users.
[0815] "Detailed information about moving" refers to information related to moving, such as old address, new address, moving date, etc., entered by the user.
[0816] The "procedure list" is a list of the procedures required when moving.
[0817] A "guide" is a document or display that allows a user to perform necessary procedures in an orderly manner based on a procedure list.
[0818] "Progress" refers to information indicating how much of the procedures that the user is to perform has been completed.
[0819] "Reminder" is a function that notifies the user of incomplete procedures.
[0820] "Emotions" refers to the user's state of mind, such as stress level, satisfaction, and confusion.
[0821] "Means for analyzing emotions" refers to technology that analyzes a user's facial expressions and voice to determine their emotional state.
[0822] "Personal information" refers to information about an individual, such as a user's name, address, and contact details.
[0823] "Strict protection measures" refer to security measures, such as data encryption and access restrictions, to prevent users' personal information from being leaked to the outside.
[0824] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[0825] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0826] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0827] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0828] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0829] In addition, users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0830] The system also incorporates an emotion engine to recognize the user's emotions. For example, while the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows a high stress level, the system can explain how to proceed with the procedure again or introduce a support staff member. Also, if the user is satisfied, it can send a message praising the smoothness of the procedure.
[0831] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0832] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[0833] This system uses prompts based on a generative AI model to efficiently manage moving procedures, reducing the burden on users and supporting them in carrying out moving-related procedures efficiently and reliably. In addition, an emotion engine enables flexible support based on the user's emotions.
[0834] Example prompt sentence:
[0835] Please explain the program's processing for the migration system in natural language. The subject should be either the server, the terminal, or the user. Please use plain sentence endings.
[0836] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0837] Step 1: User Registration
[0838] 1.1. The user accesses the system using a terminal and opens the registration page for a new account.
[0839] 1.2. The user enters basic information such as name, email address, and password (Input: Name, Email Address, Password).
[0840] 1.3. The terminal checks the format of the entered information (Process: Format Check).
[0841] 1.4. The terminal encrypts the information that has passed the format check and sends it to the server (output: encrypted user information).
[0842] Step 2: Register user data on the server
[0843] 2.1. The server receives the encrypted user information (Input: Encrypted user information).
[0844] 2.2. The server hashes the password (process: hash).
[0845] 2.3. The server saves the user information in the user database (Output: User information saved in the database).
[0846] 2.4. The server sends a confirmation email to the user's email address and returns a registration completion message to the terminal (output: confirmation email, registration completion message).
[0847] Step 3: Enter your moving information
[0848] 3.1. The user uses the device to open the moving information input page.
[0849] 3.2. The user enters details such as the old address, new address, and moving date (input: address, moving date).
[0850] 3.3. The terminal checks the format of the entered information (Process: Format Check).
[0851] 3.4. The device encrypts the information that has passed the format check and sends it to the server (output: encrypted moving information).
[0852] Step 4: Registering the moving data on the server
[0853] 4.1. The server receives the encrypted moving information (Input: Encrypted moving information).
[0854] 4.2. The server saves the moving information in the database (Output: Moving information saved in the database).
[0855] 4.3. The server analyzes the moving information and automatically generates a list of necessary procedures (Processing: Data Analysis, Procedure List Generation).
[0856] 4.4. The server saves the generated procedure list in the database (Output: Procedure list saved in the database).
[0857] Step 5: Generate guides
[0858] 5.1. The server generates a guide based on the procedure list to help the user perform the procedures in an orderly manner (process: guide generation).
[0859] 5.2. The guide will clearly state the required documents, deadlines and procedures for each procedure (Process: Entering required information).
[0860] 5.3. The server encrypts the generated guide and sends it to the user's device (Output: Encrypted guide).
[0861] Step 6: Track progress and send reminders
[0862] 6.1. The server periodically checks the progress of the procedure stored in the database (Input: Progress information in database, Action: Periodic check).
[0863] 6.2. Update the status based on any new information (Action: Update Status).
[0864] 6.3. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure (Output: Reminder notification).
[0865] Step 7: Collect emotion data
[0866] 7.1. While the user is entering moving information, the device will use the camera and microphone to collect the user's facial expressions and voice (input: facial expression data, voice data).
[0867] 7.2. The collected data is encrypted in real time and sent to the server (output: encrypted emotion data).
[0868] Step 8: Sentiment analysis and appropriate support
[0869] 8.1. The server analyzes the received emotion data (input: encrypted emotion data, processing: emotion analysis).
[0870] 8.2. The server determines the user's emotional state based on the analysis results (Process: Determine Emotional State).
[0871] 8.3. Provide guidance and support according to the user's emotions (Output: Guidance and support message).
[0872] For example, if a user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it can provide additional explanations or support messages to the user, allowing them to proceed more smoothly.
[0873] In this way, the entire system efficiently supports users' relocation procedures.
[0874] (Application example 2)
[0875] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0876] Conventional moving procedure systems lack a means for users to centrally manage the procedures, and it takes a great deal of time and effort for users to remember to complete the various procedures associated with moving. Furthermore, they lack the functionality to track the progress of procedures or to provide flexible guidance that responds to the user's emotions, placing a heavy burden on users. Furthermore, the lack of a navigation guide to help users navigate efficiently through stores is also an issue for everyday shopping.
[0877] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0878] In this invention, the server includes means for receiving detailed moving information entered by the user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to enable the user to perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for strictly protecting the user's personal information, means for analyzing the user's facial expressions and voice and providing adaptive guidance according to their emotions, and means for receiving a shopping list and store information and generating a navigation guide to enable efficient shopping. This enables the user to efficiently complete moving procedures and daily shopping and provides emotional support, thereby reducing the burden on the user.
[0879] "Detailed information" refers to specific information related to the move that is input by the user, such as the old address, new address, and moving date.
[0880] The "procedure list" is a list of the individual procedures that users must carry out when they move, including changing their residence registration and changing their electricity, gas, and water contracts.
[0881] The "guide" is a document that guides the user to carry out the procedures in an orderly manner based on the procedure list.
[0882] A "reminder" is a message that notifies the user of incomplete procedures and reminds them to complete the necessary steps.
[0883] "Personal information" refers to information about a user that can identify a specific individual, such as the user's name, address, telephone number, and email address.
[0884] "Facial expression" refers to the facial expression of the user, and refers to facial movements that express emotions.
[0885] "Voice" refers to information collected as sound, such as the content of a user's speech and tone of voice.
[0886] "Adaptive guidance" refers to support messages and explanations that are customized based on the user's emotions and situation.
[0887] A "shopping list" is a list of items a user plans to purchase, including groceries, clothing, electronics, and other items.
[0888] "Store information" is information about the store that the user visits, including the location, business hours, sale information, and the like.
[0889] "Navigation Guide" is route guidance that enables users to shop efficiently based on their shopping list and store information.
[0890] This invention is a system for enabling users to efficiently carry out procedures related to moving and daily shopping, and a specific embodiment thereof will be described. This system is mainly composed of a user, a terminal, a server, and an emotion engine.
[0891] User Registration
[0892] A user accesses the system using a terminal and registers a new account. They enter basic information such as their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the new user in the user database. The password is also hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0893] Enter moving information
[0894] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0895] Generate guides
[0896] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0897] Procedure progress tracking and reminders
[0898] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0899] Introducing the Emotion Engine
[0900] The emotion engine is used to recognize the user's emotions. While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine can provide guidance and support according to the user's emotions.
[0901] Generate navigation guides
[0902] Shopping lists and store information are also entered in the same way. Users input a list of products they plan to purchase and information about stores they plan to visit into their terminal. Based on this information, the server generates a navigation guide to help users shop efficiently. This guide includes information on efficient routes and special sales at each store.
[0903] Protection of Personal Information
[0904] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0905] Specific examples
[0906] For example, suppose a user creates a new account and enters moving information such as "Old address: Tokyo wards," "New address: Tokyo wards," and "Moving date: October 15, 2023." Based on this information, the server detects the need for procedures such as changing residence registration and changing electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user. Furthermore, if the user shows a confused expression, the server can provide additional explanations or support messages based on the facial expression data sent to the server in real time.
[0907] Hardware and software used
[0908] The hardware used includes the devices used by users (smartphones, tablets, etc.). The server has powerful information processing capabilities and runs a database management system, emotion analysis system, etc. The emotion engine also uses facial expression analysis software and voice analysis software.
[0909] Prompt Sentence Examples
[0910] As an example of input to a generative AI model, use the following prompt:
[0911] "Recognize emotions while users are using a shopping guide app and generate code to provide supportive messages when stress levels are high. Key functionality requires a complete application flow including user registration, shopping list input, and generation of navigation guides based on emotions."
[0912] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0913] Step 1:
[0914] A user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the entered information and registers the user as a new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[0915] Input: Name, Email Address, Password
[0916] Output: Confirmation email, registration success message, database entry in hashed password
[0917] Step 2:
[0918] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[0919] Input: Old address, New address, Moving date
[0920] Output: Procedure list, saved moving information
[0921] Step 3:
[0922] Based on the procedure list, the server generates a guide to help users perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0923] Input: Procedure list
[0924] Output: Procedural guide, messages sent to the user
[0925] Step 4:
[0926] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0927] Input: Procedure progress, incomplete procedures
[0928] Output: Reminder message, progress update
[0929] Step 5:
[0930] The device analyzes the user's facial expressions and voice to provide adaptive guidance based on their emotions. As the user enters their moving information, the device uses a camera and microphone to collect facial and voice data. This data is sent to the server in real time, and the emotion engine analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides the user with optimal guidance and support messages.
[0931] Input: facial expression data, voice data
[0932] Output: Sentiment analysis results, adaptive guidance messages
[0933] Step 6:
[0934] The user inputs a shopping list and store information into the device. The device then sends this information to the server, which then generates a navigation guide based on the received information to help the user shop efficiently. This guide includes information on efficient routes and special sales at each store.
[0935] Input: Shopping list, store information
[0936] Output: Navigation guide, special offers
[0937] Step 7:
[0938] To strictly protect users' personal information, the transmission of information is encrypted. The server limits access to personal information stored in the database to prevent data leakage.
[0939] Input: Personal Information
[0940] Output: Encrypted data, access restriction log
[0941] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0942] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0943] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0944] [Third embodiment]
[0945] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0946] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0947] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0948] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0949] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0950] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0951] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0952] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0953] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0954] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0955] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0956] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0957] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage procedures related to moving. This system is mainly composed of a user, a terminal, and a server.
[0958] User Registration
[0959] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server.
[0960] The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal indicating that registration was successful.
[0961] Enter moving information
[0962] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal, which collects this information and sends it to the server.
[0963] The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures, including changing residence registration, changing electricity, gas, and water contracts, mail forwarding procedures, and changing internet and cable TV settings.
[0964] Generate guides
[0965] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[0966] Procedure progress tracking and reminders
[0967] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[0968] Protection of Personal Information
[0969] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[0970] Specific examples
[0971] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[0972] In this way, the system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably.
[0973] The processing flow will be explained below.
[0974] User Registration
[0975] Step 1:
[0976] The user enters basic information such as name, email address, and password on the device.
[0977] Step 2:
[0978] The device checks the format of the information entered, for example, checking the format of an email address or the strength of a password.
[0979] Step 3:
[0980] The terminal checks the format and then sends the input information to the server.
[0981] Step 4:
[0982] The server receives the input and hashes the password.
[0983] Step 5:
[0984] The server registers the new user in its user database, including their name, email address, and hashed password.
[0985] Step 6:
[0986] After registration is complete, the server will send a confirmation email to the user.
[0987] Step 7:
[0988] The server returns a registration completion message to the user terminal.
[0989] Enter moving information
[0990] Step 1:
[0991] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[0992] Step 2:
[0993] The terminal checks the input information and sends it to the server.
[0994] Step 3:
[0995] The server receives the input information and stores it in a database.
[0996] Step 4:
[0997] The server analyzes the moving information and automatically generates a list of necessary procedures.
[0998] Step 5:
[0999] The server stores the generated procedure list in a database.
[1000] Generate guides
[1001] Step 1:
[1002] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[1003] Step 2:
[1004] The server sends the generated guide to the user.
[1005] Step 3:
[1006] The user receives the guide and proceeds with the procedure.
[1007] Procedure progress tracking and reminders
[1008] Step 1:
[1009] The server periodically checks the database to see how the procedure is progressing.
[1010] Step 2:
[1011] The server detects an incomplete procedure.
[1012] Step 3:
[1013] The server generates reminders for outstanding transactions.
[1014] Step 4:
[1015] The server sends the reminder to the user.
[1016] Step 5:
[1017] Users receive reminders to complete any outstanding tasks.
[1018] Protection of Personal Information
[1019] Step 1:
[1020] When the terminal sends input information to the server, the communication is encrypted.
[1021] Step 2:
[1022] The server stores the received information in an encrypted form in a database.
[1023] Step 3:
[1024] The server sets access restrictions to prevent unauthorized access to user information.
[1025] Example 1
[1026] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1027] The moving procedures are extensive and extremely cumbersome for users. Furthermore, there is a risk that some information may be overlooked, which results in users spending a great deal of time and effort. Furthermore, protecting users' privacy is a major issue when going through these procedures, which involve a lot of personal information.
[1028] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1029] In this invention, the server includes means for receiving basic information entered by the user, checking the format of the information, and sending it to the server, means for analyzing the basic information, registering the user as a new user in a user database, and hashing the password to ensure security, means for receiving detailed moving-related information entered by the user and sending it to the server, means for saving the detailed information in a database and automatically generating a list of necessary procedures, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, and means for encrypting and sending and receiving the user's personal information and protecting it by restricting access to the database. This allows the user to centrally manage the complicated procedures related to moving, preventing oversight of procedures, and ensuring the protection of personal information.
[1030] "Basic information" refers to personal data such as name, email address, and password that a user enters when creating a new account.
[1031] "Format check" is the process of verifying whether the entered information complies with the specified format.
[1032] A "server" is a computer system that analyzes information sent by users, stores it in a database, and executes various procedures.
[1033] A "user database" is a data storage device for storing and managing basic user information, moving information, etc.
[1034] "Hashing" is a technology that increases security by converting data such as passwords using a one-way encryption algorithm.
[1035] "Detailed information" refers to specific data entered by the user regarding their move (e.g., old address, new address, moving date).
[1036] The "procedure list" is an automatically generated list of various procedures required for moving.
[1037] A "guide" is a document that contains detailed instructions and information to help a user systematically complete the necessary procedures for moving.
[1038] "Tracking progress" means regularly checking the status of each step and keeping up to date with the latest developments.
[1039] A "reminder" is a message that notifies the user about an incomplete procedure.
[1040] "Encryption" is a security technology that converts data into a format that cannot be deciphered by third parties.
[1041] "Access restriction" is a security setting that allows only users who have passed specific authentication to access data.
[1042] This system allows users to centrally manage procedures related to moving. The system is mainly composed of users, terminals, and a server.
[1043] User Registration
[1044] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. Format checks include whether the entered email address is in the correct format and whether the password meets the required number of characters.
[1045] The server analyzes the received information and registers the new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the device indicating that registration was successful.
[1046] Enter moving information
[1047] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server, which stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures.
[1048] Generate guides
[1049] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1050] Procedure progress tracking and reminders
[1051] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1052] Protection of Personal Information
[1053] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1054] Hardware and software used
[1055] The system runs on cloud-based servers, users' devices (PCs, smartphones, etc.), and SSL / TLS encryption protocols. The database employs a secure storage system to safely store user and migration information.
[1056] Specific examples
[1057] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1058] Prompt Sentence Examples
[1059] "Please design a system to efficiently manage moving information. I would like to create a system where the user can enter the information necessary for moving, and based on that, the system will automatically guide them through all the procedures. Please also include a list of specific procedures, progress management, and reminder functions."
[1060] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1061] Step 1:
[1062] A user accesses the system using a terminal and registers a new account. Basic information to be entered includes name, email address, and password. This information is entered and received by the terminal.
[1063] Input: User's basic information (name, email address, password)
[1064] Output: Basic information data for format checking
[1065] Specific behavior: The user enters "Name: Yamada Taro", "Email: taro@example.com", and "Password: password123" into the form.
[1066] Step 2:
[1067] The device receives the information entered by the user and checks its format, for example, whether the email address is in the correct format or whether the password meets a certain number of characters.
[1068] Input: Basic information data for format check
[1069] Output: Basic information data that is judged to be in the correct format
[1070] Specific behavior: The device checks whether the email address contains an "@" and whether the password is at least 8 characters long.
[1071] Step 3:
[1072] After the format check is complete, the device sends the information to the server, which analyzes the received data and registers the user as a new user in the database.
[1073] Input: Basic information data that is determined to be in the correct format
[1074] Output: New user information registered in the user database
[1075] Specific operation: The device sends data to the server, and the server registers it in the database as "Yamada Taro", "taro@example.com", and "hashed_password123".
[1076] Step 4:
[1077] Once registration is complete, the server will send a confirmation email to the user and return a message to the terminal indicating successful registration.
[1078] Input: New user information registered in the user database
[1079] Output: A confirmation email sent to the user and a successful registration message displayed on the device.
[1080] Specific operation: The server sends a confirmation email to "taro@example.com" and displays "Registration completed" on the device.
[1081] Step 5:
[1082] Next, the user inputs detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal. The input information is received by the terminal.
[1083] Input: Moving details (old address, new address, moving date)
[1084] Output: Detailed information data to send to the server
[1085] Specific operation: The user enters "Pre-move address: Minato-ku, Tokyo", "Post-move address: Shibuya-ku, Tokyo", and "Moving date: October 15, 2023".
[1086] Step 6:
[1087] The device collects the entered moving information and sends it to the server, which stores the received data in a database.
[1088] Input: Detailed information data to send to the server
[1089] Output: Moving information stored in the database
[1090] Specific operation: The device sends the moving information to the server, which stores it in a database.
[1091] Step 7:
[1092] The server analyzes the received moving information and automatically generates a list of necessary procedures, including the documents required for each procedure, deadlines, and procedures.
[1093] Input: Moving information stored in the database
[1094] Output: Generated procedure list
[1095] Specific operations: Analyzes moving information and creates a procedure list for "changing residence registration," "forwarding mail," and "changing electricity, gas, and water contracts."
[1096] Step 8:
[1097] After the procedure list is generated, the server generates and sends the user a guide to help the user perform the required procedures in an orderly manner.
[1098] Input: Generated procedure list
[1099] Output: Guide sent to the user
[1100] Specific operation: The server adds information to the guide such as "A copy of your residence certificate and identification are required to change your residence certificate. The deadline for this procedure is within 14 days of the moving date." The server sends the guide to the user's email address and displays "The guide has been sent" on the device.
[1101] Step 9:
[1102] The server periodically checks the progress of the transaction and updates it based on the information stored in the database. If the transaction is not completed, the server sends a reminder to the user about the incomplete transaction.
[1103] Input: Procedure information and progress status stored in the database
[1104] Output: Reminder sent to user
[1105] Specific operation: The server retrieves progress information from the database and sends a reminder to the user's email address stating, "The residence registration change procedure has not yet been completed. Please complete the procedure as soon as possible."
[1106] Step 10:
[1107] Users' personal information is strictly protected, and all transmissions of information are encrypted. Access to the database is restricted so that only authorized users can access it.
[1108] Input: Personal information sent and received and requests to access databases
[1109] Output: Encrypted data and authentication result based on access restrictions
[1110] Specific operation: All data is encrypted using SSL / TLS certificates for data communication between the server and the device. The server also records access logs and monitors for unauthorized access.
[1111] (Application example 1)
[1112] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1113] In modern society, it is important to efficiently manage the multiple procedures that users undergo. In particular, procedures closely related to daily life, such as moving and food delivery, are complex, making it difficult to manage procedures and progress. For this reason, there is a demand for a system that can centrally manage user procedures and ensure that they are completed efficiently and without omissions.
[1114] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1115] In this invention, the server includes means for receiving detailed moving or delivery information entered by the user, means for automatically generating a list of necessary procedures or a delivery guide based on the detailed information, and means for generating a guide based on the list of procedures or the delivery guide so that the user can carry out the necessary procedures in an orderly manner. This allows the user to centrally manage various procedures and proceed efficiently and reliably.
[1116] "Detailed Information" refers to specific moving and delivery data entered by the user.
[1117] A "procedure list" refers to a list of specific actions that a user must take in order to move or perform other procedures.
[1118] "Delivery Guide" refers to a guide that compiles instructions to enable a user to carry out delivery procedures in an orderly manner.
[1119] "Reminder" means an alert or reminder message that notifies a User of an outstanding transaction or delivery status.
[1120] "Personal information" refers to any information that can identify an individual user (for example, name, address, email address, etc.).
[1121] "Server" refers to a central system for receiving, processing and storing data.
[1122] "Tracking" refers to the activity of continuously monitoring and updating the progress of a transaction or delivery.
[1123] "Automatically generated" means that the system performs processing based on a program and generates a result without manual operation by the user.
[1124] "Guide" refers to materials or information that provide instructions or procedures to enable a user to perform a required procedure in an orderly manner.
[1125] "Customization" refers to changing settings and content to suit a user's specific needs and lifestyle.
[1126] "Lifestyle" refers to the activities and behavioral patterns that a user engages in in their daily life.
[1127] "Specific needs" refers to individual conditions or requirements that differ from general requirements.
[1128] This invention is a system for efficiently carrying out moving and delivery procedures. This system is composed of users, terminals, and a server, and is intended to centrally manage procedures carried out by users.
[1129] User Registration
[1130] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1131] Entering moving and delivery information
[1132] Next, the user enters details about the move and delivery (e.g., address, date, etc.) into the device. The device collects this information and sends it to the server, which stores it in a database. As part of the service, the server then analyzes this information and automatically generates a list of necessary procedures and delivery instructions.
[1133] Generate guides
[1134] After the procedure list or delivery guide is generated, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1135] Procedure progress tracking and reminders
[1136] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[1137] Protection of Personal Information
[1138] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1139] Hardware and software used
[1140] Server: Any cloud-based server (e.g. AWS, Google Cloud)
[1141] Client: Smartphone
[1142] Framework: Flask (Python web framework)
[1143] Security: werkzeug.security (password hashing)
[1144] Email service: smtplib (simple email sending; in practice, we recommend using an email API such as SendGrid)
[1145] Specific examples
[1146] For example, if a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023," the server will use this information to generate a list including procedures for changing residence certificates and create a guide. The guide will contain detailed information about the documents and methods required for each procedure and will be sent to the user.
[1147] Prompt Sentence Examples
[1148] "A user has placed a new food delivery order. Please use the details below to generate a delivery guide.
[1149] Delivery address: 1-1-1 Shibuya, Shibuya-ku, Tokyo
[1150] Desired delivery date and time: December 20, 2023, 6:00 PM
[1151] In this way, the system reduces the burden on users and helps them carry out procedures related to moving and delivery efficiently and reliably.
[1152] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1153] Step 1:
[1154] A user uses a terminal to register a new account. The user enters their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the information and registers the new user in the user database. The password is hashed to ensure security. The server then sends a confirmation email to the user and returns a message to the terminal indicating that the registration was successful.
[1155] Input: User's name, email address, and password
[1156] Output: New account creation confirmation email
[1157] Step 2:
[1158] The user enters details about the move or delivery into the device, such as the old address, new address, move date, delivery address, and desired delivery date and time. The device collects this information and sends it to the server, which stores it in a database.
[1159] Input: Moving or delivery details (old address, new address, moving date, delivery address, desired delivery date and time, etc.)
[1160] Output: Save detailed information to a database
[1161] Step 3:
[1162] The server analyzes the moving or delivery information stored in the database and automatically generates a list of necessary procedures or a delivery guide. The list of procedures includes changes to residence registration and changes to electricity, gas, and water contracts, while the delivery guide includes delivery address instructions and important points. This list of procedures or guide details all the actions required for the user.
[1163] Input: Details stored in the database
[1164] Output: Procedure list or delivery guide
[1165] Step 4:
[1166] The server generates a guide based on the generated procedure list or delivery guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The server then sends this to the user.
[1167] Input: Generated procedure list or delivery guide
[1168] Output: Detailed procedure guide
[1169] Step 5:
[1170] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[1171] Input: Procedure progress information stored in the database
[1172] Output: Reminder email or notification
[1173] Step 6:
[1174] To strictly protect users' personal information, the server encrypts the transmission and reception of information and sets access restrictions to the database, thereby minimizing the risk of user data being leaked to third parties.
[1175] Input: User's personal information
[1176] Output: Encrypted personal information, access restriction settings
[1177] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1178] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[1179] User Registration
[1180] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1181] Enter moving information
[1182] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1183] Generate guides
[1184] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1185] Procedure progress tracking and reminders
[1186] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1187] Protection of Personal Information
[1188] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1189] Introducing the Emotion Engine
[1190] The system also incorporates an emotion engine to recognize the user's emotions. For example, when a user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to a server in real time, and the emotion engine on the server analyzes the user's stress level, satisfaction, confusion, etc.
[1191] Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows high stress levels, the system can re-explain how to proceed or refer them to support staff. If the user is satisfied, the system can send a message praising the smoothness of the process.
[1192] Specific examples
[1193] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1194] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[1195] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[1196] The processing flow will be explained below.
[1197] User Registration
[1198] Step 1:
[1199] The user enters basic information such as name, email address, and password on the device.
[1200] Step 2:
[1201] The device checks the format of the information entered, checking the format of email addresses and the strength of passwords.
[1202] Step 3:
[1203] The terminal checks the format and sends the information to the server.
[1204] Step 4:
[1205] The server receives the input and hashes the password.
[1206] Step 5:
[1207] The server registers the new user in its user database, storing their name, email address, and hashed password.
[1208] Step 6:
[1209] The server sends a confirmation email to the user.
[1210] Step 7:
[1211] The server returns a registration completion message to the user terminal.
[1212] Enter moving information
[1213] Step 1:
[1214] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[1215] Step 2:
[1216] The terminal checks the input information and sends it to the server.
[1217] Step 3:
[1218] The server receives the input information and stores it in a database.
[1219] Step 4:
[1220] The server analyzes the moving information and automatically generates a list of necessary procedures.
[1221] Step 5:
[1222] The server stores the generated procedure list in a database.
[1223] Generate guides
[1224] Step 1:
[1225] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[1226] Step 2:
[1227] The server sends the generated guide to the user.
[1228] Step 3:
[1229] The user receives the guide and proceeds with the procedure.
[1230] Procedure progress tracking and reminders
[1231] Step 1:
[1232] The server periodically checks the database to see how the procedure is progressing.
[1233] Step 2:
[1234] The server detects an incomplete procedure.
[1235] Step 3:
[1236] The server generates reminders for outstanding transactions.
[1237] Step 4:
[1238] The server sends the reminder to the user.
[1239] Step 5:
[1240] Users receive reminders to complete any outstanding tasks.
[1241] Protection of Personal Information
[1242] Step 1:
[1243] When the device sends input information to the server, the communication is encrypted.
[1244] Step 2:
[1245] The server stores the received information in an encrypted form in a database.
[1246] Step 3:
[1247] The server sets access restrictions to prevent unauthorized access to user information.
[1248] Introducing the Emotion Engine
[1249] Step 1:
[1250] While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice.
[1251] Step 2:
[1252] The device transmits this data to the server in real time.
[1253] Step 3:
[1254] The server's emotion engine analyzes the user's facial expression and voice data to evaluate their stress level, satisfaction, and confusion.
[1255] Step 4:
[1256] Based on the analysis results, the emotion engine suggests guidance and support that corresponds to the user's emotions.
[1257] Step 5:
[1258] If the user exhibits high stress levels, the server may provide detailed re-explaining of how to proceed or refer the user to support staff.
[1259] Step 6:
[1260] If the user is satisfied, the server sends a message praising the smoothness of the process.
[1261] Specific examples
[1262] For example, suppose a user creates a new account and enters "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1263] If a user shows a confused expression through the camera while entering moving information, the device detects this and sends it to the server. If the server's emotion engine detects confusion, it provides the user with additional explanations or support messages.
[1264] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[1265] Example 2
[1266] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1267] Conventional moving procedures involve a wide range of complicated steps, making it difficult for users to manage the process efficiently. Furthermore, they lacked a reminder function to track the progress of the process and ensure that any incomplete steps are completed. Furthermore, they did not provide support that took into account the user's emotional state, which could lead to stressful situations for the user. It is necessary to provide a system that solves these issues and makes the moving process efficient and user-friendly.
[1268] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1269] In this invention, the server includes means for receiving detailed moving-related information entered by a user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for analyzing the user's emotions and providing support based on the analysis, and means for strictly protecting the user's personal information. This makes it possible to efficiently manage the moving procedures and provide flexible support according to the user's emotional state.
[1270] "User" means an individual or corporation that uses the system.
[1271] A "terminal" is a device such as a computer or smartphone that a user uses to access the system.
[1272] A "server" is a central system that receives and processes information from users.
[1273] "Detailed information about moving" refers to information related to moving, such as old address, new address, moving date, etc., entered by the user.
[1274] The "procedure list" is a list of the procedures required when moving.
[1275] A "guide" is a document or display that allows a user to perform necessary procedures in an orderly manner based on a procedure list.
[1276] "Progress" refers to information indicating how much of the procedures that the user is to perform has been completed.
[1277] "Reminder" is a function that notifies the user of incomplete procedures.
[1278] "Emotions" refers to the user's state of mind, such as stress level, satisfaction, and confusion.
[1279] "Means for analyzing emotions" refers to technology that analyzes a user's facial expressions and voice to determine their emotional state.
[1280] "Personal information" refers to information about an individual, such as a user's name, address, and contact details.
[1281] "Strict protection measures" refer to security measures, such as data encryption and access restrictions, to prevent users' personal information from being leaked to the outside.
[1282] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[1283] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1284] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1285] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1286] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1287] In addition, users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1288] The system also incorporates an emotion engine to recognize the user's emotions. For example, while the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows a high stress level, the system can explain how to proceed with the procedure again or introduce a support staff member. Also, if the user is satisfied, it can send a message praising the smoothness of the procedure.
[1289] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1290] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[1291] This system uses prompts based on a generative AI model to efficiently manage moving procedures, reducing the burden on users and supporting them in carrying out moving-related procedures efficiently and reliably. In addition, an emotion engine enables flexible support based on the user's emotions.
[1292] Example prompt sentence:
[1293] Please explain the program's processing for the migration system in natural language. The subject should be either the server, the terminal, or the user. Please use plain sentence endings.
[1294] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1295] Step 1: User Registration
[1296] 1.1. The user accesses the system using a terminal and opens the registration page for a new account.
[1297] 1.2. The user enters basic information such as name, email address, and password (Input: Name, Email Address, Password).
[1298] 1.3. The terminal checks the format of the entered information (Process: Format Check).
[1299] 1.4. The terminal encrypts the information that has passed the format check and sends it to the server (output: encrypted user information).
[1300] Step 2: Register user data on the server
[1301] 2.1. The server receives the encrypted user information (Input: Encrypted user information).
[1302] 2.2. The server hashes the password (process: hash).
[1303] 2.3. The server saves the user information in the user database (Output: User information saved in the database).
[1304] 2.4. The server sends a confirmation email to the user's email address and returns a registration completion message to the terminal (output: confirmation email, registration completion message).
[1305] Step 3: Enter your moving information
[1306] 3.1. The user uses the device to open the moving information input page.
[1307] 3.2. The user enters details such as the old address, new address, and moving date (input: address, moving date).
[1308] 3.3. The terminal checks the format of the entered information (Process: Format Check).
[1309] 3.4. The device encrypts the information that has passed the format check and sends it to the server (output: encrypted moving information).
[1310] Step 4: Registering the moving data on the server
[1311] 4.1. The server receives the encrypted moving information (Input: Encrypted moving information).
[1312] 4.2. The server saves the moving information in the database (Output: Moving information saved in the database).
[1313] 4.3. The server analyzes the moving information and automatically generates a list of necessary procedures (Processing: Data Analysis, Procedure List Generation).
[1314] 4.4. The server saves the generated procedure list in the database (Output: Procedure list saved in the database).
[1315] Step 5: Generate guides
[1316] 5.1. The server generates a guide based on the procedure list to help the user perform the procedures in an orderly manner (process: guide generation).
[1317] 5.2. The guide will clearly state the required documents, deadlines and procedures for each procedure (Process: Entering required information).
[1318] 5.3. The server encrypts the generated guide and sends it to the user's device (Output: Encrypted guide).
[1319] Step 6: Track progress and send reminders
[1320] 6.1. The server periodically checks the progress of the procedure stored in the database (Input: Progress information in database, Action: Periodic check).
[1321] 6.2. Update the status based on any new information (Action: Update Status).
[1322] 6.3. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure (Output: Reminder notification).
[1323] Step 7: Collect emotion data
[1324] 7.1. While the user is entering moving information, the device will use the camera and microphone to collect the user's facial expressions and voice (input: facial expression data, voice data).
[1325] 7.2. The collected data is encrypted in real time and sent to the server (output: encrypted emotion data).
[1326] Step 8: Sentiment analysis and appropriate support
[1327] 8.1. The server analyzes the received emotion data (input: encrypted emotion data, processing: emotion analysis).
[1328] 8.2. The server determines the user's emotional state based on the analysis results (Process: Determine Emotional State).
[1329] 8.3. Provide guidance and support according to the user's emotions (Output: Guidance and support message).
[1330] For example, if a user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it can provide additional explanations or support messages to the user, allowing them to proceed more smoothly.
[1331] In this way, the entire system efficiently supports users' relocation procedures.
[1332] (Application example 2)
[1333] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1334] Conventional moving procedure systems lack a means for users to centrally manage the procedures, and it takes a great deal of time and effort for users to remember to complete the various procedures associated with moving. Furthermore, they lack the functionality to track the progress of procedures or to provide flexible guidance that responds to the user's emotions, placing a heavy burden on users. Furthermore, the lack of a navigation guide to help users navigate efficiently through stores is also an issue for everyday shopping.
[1335] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1336] In this invention, the server includes means for receiving detailed moving information entered by the user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to enable the user to perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for strictly protecting the user's personal information, means for analyzing the user's facial expressions and voice and providing adaptive guidance according to their emotions, and means for receiving a shopping list and store information and generating a navigation guide to enable efficient shopping. This enables the user to efficiently complete moving procedures and daily shopping and provides emotional support, thereby reducing the burden on the user.
[1337] "Detailed information" refers to specific information related to the move that is input by the user, such as the old address, new address, and moving date.
[1338] The "procedure list" is a list of the individual procedures that users must carry out when they move, including changing their residence registration and changing their electricity, gas, and water contracts.
[1339] The "guide" is a document that guides the user to carry out the procedures in an orderly manner based on the procedure list.
[1340] A "reminder" is a message that notifies the user of incomplete procedures and reminds them to complete the necessary steps.
[1341] "Personal information" refers to information about a user that can identify a specific individual, such as the user's name, address, telephone number, and email address.
[1342] "Facial expression" refers to the facial expression of the user, and refers to facial movements that express emotions.
[1343] "Voice" refers to information collected as sound, such as the content of a user's speech and tone of voice.
[1344] "Adaptive guidance" refers to support messages and explanations that are customized based on the user's emotions and situation.
[1345] A "shopping list" is a list of items a user plans to purchase, including groceries, clothing, electronics, and other items.
[1346] "Store information" is information about the store that the user visits, including the location, business hours, sale information, and the like.
[1347] "Navigation Guide" is route guidance that enables users to shop efficiently based on their shopping list and store information.
[1348] This invention is a system for enabling users to efficiently carry out procedures related to moving and daily shopping, and a specific embodiment thereof will be described. This system is mainly composed of a user, a terminal, a server, and an emotion engine.
[1349] User Registration
[1350] A user accesses the system using a terminal and registers a new account. They enter basic information such as their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the new user in the user database. The password is also hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1351] Enter moving information
[1352] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1353] Generate guides
[1354] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1355] Procedure progress tracking and reminders
[1356] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1357] Introducing the Emotion Engine
[1358] The emotion engine is used to recognize the user's emotions. While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine can provide guidance and support according to the user's emotions.
[1359] Generate navigation guides
[1360] Shopping lists and store information are also entered in the same way. Users input a list of products they plan to purchase and information about stores they plan to visit into their terminal. Based on this information, the server generates a navigation guide to help users shop efficiently. This guide includes information on efficient routes and special sales at each store.
[1361] Protection of Personal Information
[1362] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1363] Specific examples
[1364] For example, suppose a user creates a new account and enters moving information such as "Old address: Tokyo wards," "New address: Tokyo wards," and "Moving date: October 15, 2023." Based on this information, the server detects the need for procedures such as changing residence registration and changing electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user. Furthermore, if the user shows a confused expression, the server can provide additional explanations or support messages based on the facial expression data sent to the server in real time.
[1365] Hardware and software used
[1366] The hardware used includes the devices used by users (smartphones, tablets, etc.). The server has powerful information processing capabilities and runs a database management system, emotion analysis system, etc. The emotion engine also uses facial expression analysis software and voice analysis software.
[1367] Prompt Sentence Examples
[1368] As an example of input to a generative AI model, use the following prompt:
[1369] "Recognize emotions while users are using a shopping guide app and generate code to provide supportive messages when stress levels are high. Key functionality requires a complete application flow including user registration, shopping list input, and generation of navigation guides based on emotions."
[1370] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1371] Step 1:
[1372] A user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the entered information and registers the user as a new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1373] Input: Name, Email Address, Password
[1374] Output: Confirmation email, registration success message, database entry in hashed password
[1375] Step 2:
[1376] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1377] Input: Old address, New address, Moving date
[1378] Output: Procedure list, saved moving information
[1379] Step 3:
[1380] Based on the procedure list, the server generates a guide to help users perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1381] Input: Procedure list
[1382] Output: Procedural guide, messages sent to the user
[1383] Step 4:
[1384] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1385] Input: Procedure progress, incomplete procedures
[1386] Output: Reminder message, progress update
[1387] Step 5:
[1388] The device analyzes the user's facial expressions and voice to provide adaptive guidance based on their emotions. As the user enters their moving information, the device uses a camera and microphone to collect facial and voice data. This data is sent to the server in real time, and the emotion engine analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides the user with optimal guidance and support messages.
[1389] Input: facial expression data, voice data
[1390] Output: Sentiment analysis results, adaptive guidance messages
[1391] Step 6:
[1392] The user inputs a shopping list and store information into the device. The device then sends this information to the server, which then generates a navigation guide based on the received information to help the user shop efficiently. This guide includes information on efficient routes and special sales at each store.
[1393] Input: Shopping list, store information
[1394] Output: Navigation guide, special offers
[1395] Step 7:
[1396] To strictly protect users' personal information, the transmission of information is encrypted. The server limits access to personal information stored in the database to prevent data leakage.
[1397] Input: Personal Information
[1398] Output: Encrypted data, access restriction log
[1399] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1400] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1401] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1402] [Fourth embodiment]
[1403] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1404] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1405] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1406] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1407] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1408] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1409] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1410] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1411] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1412] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1413] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1414] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1415] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1416] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage procedures related to moving. This system is mainly composed of a user, a terminal, and a server.
[1417] User Registration
[1418] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server.
[1419] The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal indicating that registration was successful.
[1420] Enter moving information
[1421] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal, which collects this information and sends it to the server.
[1422] The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures, including changing residence registration, changing electricity, gas, and water contracts, mail forwarding procedures, and changing internet and cable TV settings.
[1423] Generate guides
[1424] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1425] Procedure progress tracking and reminders
[1426] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1427] Protection of Personal Information
[1428] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1429] Specific examples
[1430] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1431] In this way, the system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably.
[1432] The processing flow will be explained below.
[1433] User Registration
[1434] Step 1:
[1435] The user enters basic information such as name, email address, and password on the device.
[1436] Step 2:
[1437] The device checks the format of the information entered, for example, checking the format of an email address or the strength of a password.
[1438] Step 3:
[1439] The terminal checks the format and then sends the input information to the server.
[1440] Step 4:
[1441] The server receives the input and hashes the password.
[1442] Step 5:
[1443] The server registers the new user in its user database, including their name, email address, and hashed password.
[1444] Step 6:
[1445] After registration is complete, the server will send a confirmation email to the user.
[1446] Step 7:
[1447] The server returns a registration completion message to the user terminal.
[1448] Enter moving information
[1449] Step 1:
[1450] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[1451] Step 2:
[1452] The terminal checks the input information and sends it to the server.
[1453] Step 3:
[1454] The server receives the input information and stores it in a database.
[1455] Step 4:
[1456] The server analyzes the moving information and automatically generates a list of necessary procedures.
[1457] Step 5:
[1458] The server stores the generated procedure list in a database.
[1459] Generate guides
[1460] Step 1:
[1461] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[1462] Step 2:
[1463] The server sends the generated guide to the user.
[1464] Step 3:
[1465] The user receives the guide and proceeds with the procedure.
[1466] Procedure progress tracking and reminders
[1467] Step 1:
[1468] The server periodically checks the database to see how the procedure is progressing.
[1469] Step 2:
[1470] The server detects an incomplete procedure.
[1471] Step 3:
[1472] The server generates reminders for outstanding transactions.
[1473] Step 4:
[1474] The server sends the reminder to the user.
[1475] Step 5:
[1476] Users receive reminders to complete any outstanding tasks.
[1477] Protection of Personal Information
[1478] Step 1:
[1479] When the terminal sends input information to the server, the communication is encrypted.
[1480] Step 2:
[1481] The server stores the received information in an encrypted form in a database.
[1482] Step 3:
[1483] The server sets access restrictions to prevent unauthorized access to user information.
[1484] Example 1
[1485] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1486] The moving procedures are extensive and extremely cumbersome for users. Furthermore, there is a risk that some information may be overlooked, which results in users spending a great deal of time and effort. Furthermore, protecting users' privacy is a major issue when going through these procedures, which involve a lot of personal information.
[1487] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1488] In this invention, the server includes means for receiving basic information entered by the user, checking the format of the information, and sending it to the server, means for analyzing the basic information, registering the user as a new user in a user database, and hashing the password to ensure security, means for receiving detailed moving-related information entered by the user and sending it to the server, means for saving the detailed information in a database and automatically generating a list of necessary procedures, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, and means for encrypting and sending and receiving the user's personal information and protecting it by restricting access to the database. This allows the user to centrally manage the complicated procedures related to moving, preventing oversight of procedures, and ensuring the protection of personal information.
[1489] "Basic information" refers to personal data such as name, email address, and password that a user enters when creating a new account.
[1490] "Format check" is the process of verifying whether the entered information complies with the specified format.
[1491] A "server" is a computer system that analyzes information sent by users, stores it in a database, and executes various procedures.
[1492] A "user database" is a data storage device for storing and managing basic user information, moving information, etc.
[1493] "Hashing" is a technology that increases security by converting data such as passwords using a one-way encryption algorithm.
[1494] "Detailed information" refers to specific data entered by the user regarding their move (e.g., old address, new address, moving date).
[1495] The "procedure list" is an automatically generated list of various procedures required for moving.
[1496] A "guide" is a document that contains detailed instructions and information to help a user systematically complete the necessary procedures for moving.
[1497] "Tracking progress" means regularly checking the status of each step and keeping up to date with the latest developments.
[1498] A "reminder" is a message that notifies the user about an incomplete procedure.
[1499] "Encryption" is a security technology that converts data into a format that cannot be deciphered by third parties.
[1500] "Access restriction" is a security setting that allows only users who have passed specific authentication to access data.
[1501] This system allows users to centrally manage procedures related to moving. The system is mainly composed of users, terminals, and a server.
[1502] User Registration
[1503] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. Format checks include whether the entered email address is in the correct format and whether the password meets the required number of characters.
[1504] The server analyzes the received information and registers the new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the device indicating that registration was successful.
[1505] Enter moving information
[1506] Next, the user enters details about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server, which stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures.
[1507] Generate guides
[1508] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1509] Procedure progress tracking and reminders
[1510] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1511] Protection of Personal Information
[1512] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1513] Hardware and software used
[1514] The system runs on cloud-based servers, users' devices (PCs, smartphones, etc.), and SSL / TLS encryption protocols. The database employs a secure storage system to safely store user and migration information.
[1515] Specific examples
[1516] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1517] Prompt Sentence Examples
[1518] "Please design a system to efficiently manage moving information. I would like to create a system where the user can enter the information necessary for moving, and based on that, the system will automatically guide them through all the procedures. Please also include a list of specific procedures, progress management, and reminder functions."
[1519] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1520] Step 1:
[1521] A user accesses the system using a terminal and registers a new account. Basic information to be entered includes name, email address, and password. This information is entered and received by the terminal.
[1522] Input: User's basic information (name, email address, password)
[1523] Output: Basic information data for format checking
[1524] Specific behavior: The user enters "Name: Yamada Taro", "Email: taro@example.com", and "Password: password123" into the form.
[1525] Step 2:
[1526] The device receives the information entered by the user and checks its format, for example, whether the email address is in the correct format or whether the password meets a certain number of characters.
[1527] Input: Basic information data for format check
[1528] Output: Basic information data that is judged to be in the correct format
[1529] Specific behavior: The device checks whether the email address contains an "@" and whether the password is at least 8 characters long.
[1530] Step 3:
[1531] After the format check is complete, the device sends the information to the server, which analyzes the received data and registers the user as a new user in the database.
[1532] Input: Basic information data that is determined to be in the correct format
[1533] Output: New user information registered in the user database
[1534] Specific operation: The device sends data to the server, and the server registers it in the database as "Yamada Taro", "taro@example.com", and "hashed_password123".
[1535] Step 4:
[1536] Once registration is complete, the server will send a confirmation email to the user and return a message to the terminal indicating successful registration.
[1537] Input: New user information registered in the user database
[1538] Output: A confirmation email sent to the user and a successful registration message displayed on the device.
[1539] Specific operation: The server sends a confirmation email to "taro@example.com" and displays "Registration completed" on the device.
[1540] Step 5:
[1541] Next, the user inputs detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the terminal. The input information is received by the terminal.
[1542] Input: Moving details (old address, new address, moving date)
[1543] Output: Detailed information data to send to the server
[1544] Specific operation: The user enters "Pre-move address: Minato-ku, Tokyo", "Post-move address: Shibuya-ku, Tokyo", and "Moving date: October 15, 2023".
[1545] Step 6:
[1546] The device collects the entered moving information and sends it to the server, which stores the received data in a database.
[1547] Input: Detailed information data to send to the server
[1548] Output: Moving information stored in the database
[1549] Specific operation: The device sends the moving information to the server, which stores it in a database.
[1550] Step 7:
[1551] The server analyzes the received moving information and automatically generates a list of necessary procedures, including the documents required for each procedure, deadlines, and procedures.
[1552] Input: Moving information stored in the database
[1553] Output: Generated procedure list
[1554] Specific operations: Analyzes moving information and creates a procedure list for "changing residence registration," "forwarding mail," and "changing electricity, gas, and water contracts."
[1555] Step 8:
[1556] After the procedure list is generated, the server generates and sends the user a guide to help the user perform the required procedures in an orderly manner.
[1557] Input: Generated procedure list
[1558] Output: Guide sent to the user
[1559] Specific operation: The server adds information to the guide such as "A copy of your residence certificate and identification are required to change your residence certificate. The deadline for this procedure is within 14 days of the moving date." The server sends the guide to the user's email address and displays "The guide has been sent" on the device.
[1560] Step 9:
[1561] The server periodically checks the progress of the transaction and updates it based on the information stored in the database. If the transaction is not completed, the server sends a reminder to the user about the incomplete transaction.
[1562] Input: Procedure information and progress status stored in the database
[1563] Output: Reminder sent to user
[1564] Specific operation: The server retrieves progress information from the database and sends a reminder to the user's email address stating, "The residence registration change procedure has not yet been completed. Please complete the procedure as soon as possible."
[1565] Step 10:
[1566] Users' personal information is strictly protected, and all transmissions of information are encrypted. Access to the database is restricted so that only authorized users can access it.
[1567] Input: Personal information sent and received and requests to access databases
[1568] Output: Encrypted data and authentication result based on access restrictions
[1569] Specific operation: All data is encrypted using SSL / TLS certificates for data communication between the server and the device. The server also records access logs and monitors for unauthorized access.
[1570] (Application example 1)
[1571] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1572] In modern society, it is important to efficiently manage the multiple procedures that users undergo. In particular, procedures closely related to daily life, such as moving and food delivery, are complex, making it difficult to manage procedures and progress. For this reason, there is a demand for a system that can centrally manage user procedures and ensure that they are completed efficiently and without omissions.
[1573] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1574] In this invention, the server includes means for receiving detailed moving or delivery information entered by the user, means for automatically generating a list of necessary procedures or a delivery guide based on the detailed information, and means for generating a guide based on the list of procedures or the delivery guide so that the user can carry out the necessary procedures in an orderly manner. This allows the user to centrally manage various procedures and proceed efficiently and reliably.
[1575] "Detailed Information" refers to specific moving and delivery data entered by the user.
[1576] A "procedure list" refers to a list of specific actions that a user must take in order to move or perform other procedures.
[1577] "Delivery Guide" refers to a guide that compiles instructions to enable a user to carry out delivery procedures in an orderly manner.
[1578] "Reminder" means an alert or reminder message that notifies a User of an outstanding transaction or delivery status.
[1579] "Personal information" refers to any information that can identify an individual user (for example, name, address, email address, etc.).
[1580] "Server" refers to a central system for receiving, processing and storing data.
[1581] "Tracking" refers to the activity of continuously monitoring and updating the progress of a transaction or delivery.
[1582] "Automatically generated" means that the system performs processing based on a program and generates a result without manual operation by the user.
[1583] "Guide" refers to materials or information that provide instructions or procedures to enable a user to perform a required procedure in an orderly manner.
[1584] "Customization" refers to changing settings and content to suit a user's specific needs and lifestyle.
[1585] "Lifestyle" refers to the activities and behavioral patterns that a user engages in in their daily life.
[1586] "Specific needs" refers to individual conditions or requirements that differ from general requirements.
[1587] This invention is a system for efficiently carrying out moving and delivery procedures. This system is composed of users, terminals, and a server, and is intended to centrally manage procedures carried out by users.
[1588] User Registration
[1589] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1590] Entering moving and delivery information
[1591] Next, the user enters details about the move and delivery (e.g., address, date, etc.) into the device. The device collects this information and sends it to the server, which stores it in a database. As part of the service, the server then analyzes this information and automatically generates a list of necessary procedures and delivery instructions.
[1592] Generate guides
[1593] After the procedure list or delivery guide is generated, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1594] Procedure progress tracking and reminders
[1595] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[1596] Protection of Personal Information
[1597] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1598] Hardware and software used
[1599] Server: Any cloud-based server (e.g. AWS, Google Cloud)
[1600] Client: Smartphone
[1601] Framework: Flask (Python web framework)
[1602] Security: werkzeug.security (password hashing)
[1603] Email service: smtplib (simple email sending; in practice, we recommend using an email API such as SendGrid)
[1604] Specific examples
[1605] For example, if a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023," the server will use this information to generate a list including procedures for changing residence certificates and create a guide. The guide will contain detailed information about the documents and methods required for each procedure and will be sent to the user.
[1606] Prompt Sentence Examples
[1607] "A user has placed a new food delivery order. Please use the details below to generate a delivery guide.
[1608] Delivery address: 1-1-1 Shibuya, Shibuya-ku, Tokyo
[1609] Desired delivery date and time: December 20, 2023, 6:00 PM
[1610] In this way, the system reduces the burden on users and helps them carry out procedures related to moving and delivery efficiently and reliably.
[1611] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1612] Step 1:
[1613] A user uses a terminal to register a new account. The user enters their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the information and registers the new user in the user database. The password is hashed to ensure security. The server then sends a confirmation email to the user and returns a message to the terminal indicating that the registration was successful.
[1614] Input: User's name, email address, and password
[1615] Output: New account creation confirmation email
[1616] Step 2:
[1617] The user enters details about the move or delivery into the device, such as the old address, new address, move date, delivery address, and desired delivery date and time. The device collects this information and sends it to the server, which stores it in a database.
[1618] Input: Moving or delivery details (old address, new address, moving date, delivery address, desired delivery date and time, etc.)
[1619] Output: Save detailed information to a database
[1620] Step 3:
[1621] The server analyzes the moving or delivery information stored in the database and automatically generates a list of necessary procedures or a delivery guide. The list of procedures includes changes to residence registration and changes to electricity, gas, and water contracts, while the delivery guide includes delivery address instructions and important points. This list of procedures or guide details all the actions required for the user.
[1622] Input: Details stored in the database
[1623] Output: Procedure list or delivery guide
[1624] Step 4:
[1625] The server generates a guide based on the generated procedure list or delivery guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The server then sends this to the user.
[1626] Input: Generated procedure list or delivery guide
[1627] Output: Detailed procedure guide
[1628] Step 5:
[1629] The server periodically checks the progress of the process and delivery status and updates the status based on the information stored in the database. If the process is not completed, the server sends reminders to the user about the incomplete process or delivery, allowing the user to avoid missing a process or delaying delivery.
[1630] Input: Procedure progress information stored in the database
[1631] Output: Reminder email or notification
[1632] Step 6:
[1633] To strictly protect users' personal information, the server encrypts the transmission and reception of information and sets access restrictions to the database, thereby minimizing the risk of user data being leaked to third parties.
[1634] Input: User's personal information
[1635] Output: Encrypted personal information, access restriction settings
[1636] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1637] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[1638] User Registration
[1639] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1640] Enter moving information
[1641] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1642] Generate guides
[1643] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1644] Procedure progress tracking and reminders
[1645] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1646] Protection of Personal Information
[1647] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1648] Introducing the Emotion Engine
[1649] The system also incorporates an emotion engine to recognize the user's emotions. For example, when a user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to a server in real time, and the emotion engine on the server analyzes the user's stress level, satisfaction, confusion, etc.
[1650] Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows high stress levels, the system can re-explain how to proceed or refer them to support staff. If the user is satisfied, the system can send a message praising the smoothness of the process.
[1651] Specific examples
[1652] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1653] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[1654] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[1655] The processing flow will be explained below.
[1656] User Registration
[1657] Step 1:
[1658] The user enters basic information such as name, email address, and password on the device.
[1659] Step 2:
[1660] The device checks the format of the information entered, checking the format of email addresses and the strength of passwords.
[1661] Step 3:
[1662] The terminal checks the format and sends the information to the server.
[1663] Step 4:
[1664] The server receives the input and hashes the password.
[1665] Step 5:
[1666] The server registers the new user in its user database, storing their name, email address, and hashed password.
[1667] Step 6:
[1668] The server sends a confirmation email to the user.
[1669] Step 7:
[1670] The server returns a registration completion message to the user terminal.
[1671] Enter moving information
[1672] Step 1:
[1673] The user enters detailed information about the move (such as addresses before and after the move, the moving date, etc.) on the terminal.
[1674] Step 2:
[1675] The terminal checks the input information and sends it to the server.
[1676] Step 3:
[1677] The server receives the input information and stores it in a database.
[1678] Step 4:
[1679] The server analyzes the moving information and automatically generates a list of necessary procedures.
[1680] Step 5:
[1681] The server stores the generated procedure list in a database.
[1682] Generate guides
[1683] Step 1:
[1684] Based on the procedure list, the server generates a guide that clearly states the necessary documents, deadlines, and procedures for each procedure.
[1685] Step 2:
[1686] The server sends the generated guide to the user.
[1687] Step 3:
[1688] The user receives the guide and proceeds with the procedure.
[1689] Procedure progress tracking and reminders
[1690] Step 1:
[1691] The server periodically checks the database to see how the procedure is progressing.
[1692] Step 2:
[1693] The server detects an incomplete procedure.
[1694] Step 3:
[1695] The server generates reminders for outstanding transactions.
[1696] Step 4:
[1697] The server sends the reminder to the user.
[1698] Step 5:
[1699] Users receive reminders to complete any outstanding tasks.
[1700] Protection of Personal Information
[1701] Step 1:
[1702] When the device sends input information to the server, the communication is encrypted.
[1703] Step 2:
[1704] The server stores the received information in an encrypted form in a database.
[1705] Step 3:
[1706] The server sets access restrictions to prevent unauthorized access to user information.
[1707] Introducing the Emotion Engine
[1708] Step 1:
[1709] While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice.
[1710] Step 2:
[1711] The device transmits this data to the server in real time.
[1712] Step 3:
[1713] The server's emotion engine analyzes the user's facial expression and voice data to evaluate their stress level, satisfaction, and confusion.
[1714] Step 4:
[1715] Based on the analysis results, the emotion engine suggests guidance and support that corresponds to the user's emotions.
[1716] Step 5:
[1717] If the user exhibits high stress levels, the server may provide detailed re-explaining of how to proceed or refer the user to support staff.
[1718] Step 6:
[1719] If the user is satisfied, the server sends a message praising the smoothness of the process.
[1720] Specific examples
[1721] For example, suppose a user creates a new account and enters "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1722] If a user shows a confused expression through the camera while entering moving information, the device detects this and sends it to the server. If the server's emotion engine detects confusion, it provides the user with additional explanations or support messages.
[1723] In this way, this system reduces the burden on users and supports them in carrying out procedures related to moving efficiently and reliably. In addition, the emotion engine enables flexible support according to the user's emotions.
[1724] Example 2
[1725] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1726] Conventional moving procedures involve a wide range of complicated steps, making it difficult for users to manage the process efficiently. Furthermore, they lacked a reminder function to track the progress of the process and ensure that any incomplete steps are completed. Furthermore, they did not provide support that took into account the user's emotional state, which could lead to stressful situations for the user. It is necessary to provide a system that solves these issues and makes the moving process efficient and user-friendly.
[1727] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1728] In this invention, the server includes means for receiving detailed moving-related information entered by a user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to help the user perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for analyzing the user's emotions and providing support based on the analysis, and means for strictly protecting the user's personal information. This makes it possible to efficiently manage the moving procedures and provide flexible support according to the user's emotional state.
[1729] "User" means an individual or corporation that uses the system.
[1730] A "terminal" is a device such as a computer or smartphone that a user uses to access the system.
[1731] A "server" is a central system that receives and processes information from users.
[1732] "Detailed information about moving" refers to information related to moving, such as old address, new address, moving date, etc., entered by the user.
[1733] The "procedure list" is a list of the procedures required when moving.
[1734] A "guide" is a document or display that allows a user to perform necessary procedures in an orderly manner based on a procedure list.
[1735] "Progress" refers to information indicating how much of the procedures that the user is to perform has been completed.
[1736] "Reminder" is a function that notifies the user of incomplete procedures.
[1737] "Emotions" refers to the user's state of mind, such as stress level, satisfaction, and confusion.
[1738] "Means for analyzing emotions" refers to technology that analyzes a user's facial expressions and voice to determine their emotional state.
[1739] "Personal information" refers to information about an individual, such as a user's name, address, and contact details.
[1740] "Strict protection measures" refer to security measures, such as data encryption and access restrictions, to prevent users' personal information from being leaked to the outside.
[1741] This invention relates to a system for efficiently carrying out moving procedures, allowing users to centrally manage moving-related procedures. This system is primarily composed of a user, a terminal, a server, and an emotion engine.
[1742] First, a user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the user as a new user in the user database. At this time, the password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1743] Next, the user enters detailed information about the move (e.g., addresses before and after the move, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database. Furthermore, as part of the service, the server analyzes this information and automatically generates a list of necessary procedures. This list includes things like changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1744] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1745] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1746] In addition, users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1747] The system also incorporates an emotion engine to recognize the user's emotions. For example, while the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides guidance and support according to the user's emotions. For example, if the user shows a high stress level, the system can explain how to proceed with the procedure again or introduce a support staff member. Also, if the user is satisfied, it can send a message praising the smoothness of the procedure.
[1748] For example, suppose a user creates a new account and enters moving information such as "old address: Minato-ku, Tokyo," "new address: Shibuya-ku, Tokyo," and "moving date: October 15, 2023." Based on this information, the server detects the need for procedures to change residence registration and change electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user.
[1749] Furthermore, if the user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it will provide the user with additional explanations or support messages.
[1750] This system uses prompts based on a generative AI model to efficiently manage moving procedures, reducing the burden on users and supporting them in carrying out moving-related procedures efficiently and reliably. In addition, an emotion engine enables flexible support based on the user's emotions.
[1751] Example prompt sentence:
[1752] Please explain the program's processing for the migration system in natural language. The subject should be either the server, the terminal, or the user. Please use plain sentence endings.
[1753] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1754] Step 1: User Registration
[1755] 1.1. The user accesses the system using a terminal and opens the registration page for a new account.
[1756] 1.2. The user enters basic information such as name, email address, and password (Input: Name, Email Address, Password).
[1757] 1.3. The terminal checks the format of the entered information (Process: Format Check).
[1758] 1.4. The terminal encrypts the information that has passed the format check and sends it to the server (output: encrypted user information).
[1759] Step 2: Register user data on the server
[1760] 2.1. The server receives the encrypted user information (Input: Encrypted user information).
[1761] 2.2. The server hashes the password (process: hash).
[1762] 2.3. The server saves the user information in the user database (Output: User information saved in the database).
[1763] 2.4. The server sends a confirmation email to the user's email address and returns a registration completion message to the terminal (output: confirmation email, registration completion message).
[1764] Step 3: Enter your moving information
[1765] 3.1. The user uses the device to open the moving information input page.
[1766] 3.2. The user enters details such as the old address, new address, and moving date (input: address, moving date).
[1767] 3.3. The terminal checks the format of the entered information (Process: Format Check).
[1768] 3.4. The device encrypts the information that has passed the format check and sends it to the server (output: encrypted moving information).
[1769] Step 4: Registering the moving data on the server
[1770] 4.1. The server receives the encrypted moving information (Input: Encrypted moving information).
[1771] 4.2. The server saves the moving information in the database (Output: Moving information saved in the database).
[1772] 4.3. The server analyzes the moving information and automatically generates a list of necessary procedures (Processing: Data Analysis, Procedure List Generation).
[1773] 4.4. The server saves the generated procedure list in the database (Output: Procedure list saved in the database).
[1774] Step 5: Generate guides
[1775] 5.1. The server generates a guide based on the procedure list to help the user perform the procedures in an orderly manner (process: guide generation).
[1776] 5.2. The guide will clearly state the required documents, deadlines and procedures for each procedure (Process: Entering required information).
[1777] 5.3. The server encrypts the generated guide and sends it to the user's device (Output: Encrypted guide).
[1778] Step 6: Track progress and send reminders
[1779] 6.1. The server periodically checks the progress of the procedure stored in the database (Input: Progress information in database, Action: Periodic check).
[1780] 6.2. Update the status based on any new information (Action: Update Status).
[1781] 6.3. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure (Output: Reminder notification).
[1782] Step 7: Collect emotion data
[1783] 7.1. While the user is entering moving information, the device will use the camera and microphone to collect the user's facial expressions and voice (input: facial expression data, voice data).
[1784] 7.2. The collected data is encrypted in real time and sent to the server (output: encrypted emotion data).
[1785] Step 8: Sentiment analysis and appropriate support
[1786] 8.1. The server analyzes the received emotion data (input: encrypted emotion data, processing: emotion analysis).
[1787] 8.2. The server determines the user's emotional state based on the analysis results (Process: Determine Emotional State).
[1788] 8.3. Provide guidance and support according to the user's emotions (Output: Guidance and support message).
[1789] For example, if a user shows a confused expression through the camera while entering moving information, the device will detect this and send it to the server. If the server's emotion engine detects confusion, it can provide additional explanations or support messages to the user, allowing them to proceed more smoothly.
[1790] In this way, the entire system efficiently supports users' relocation procedures.
[1791] (Application example 2)
[1792] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1793] Conventional moving procedure systems lack a means for users to centrally manage the procedures, and it takes a great deal of time and effort for users to remember to complete the various procedures associated with moving. Furthermore, they lack the functionality to track the progress of procedures or to provide flexible guidance that responds to the user's emotions, placing a heavy burden on users. Furthermore, the lack of a navigation guide to help users navigate efficiently through stores is also an issue for everyday shopping.
[1794] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1795] In this invention, the server includes means for receiving detailed moving information entered by the user, means for automatically generating a list of necessary procedures based on the detailed moving information, means for generating a guide based on the list of procedures to enable the user to perform the necessary procedures in an orderly manner, means for tracking the progress of the procedures and sending reminders for incomplete procedures, means for strictly protecting the user's personal information, means for analyzing the user's facial expressions and voice and providing adaptive guidance according to their emotions, and means for receiving a shopping list and store information and generating a navigation guide to enable efficient shopping. This enables the user to efficiently complete moving procedures and daily shopping and provides emotional support, thereby reducing the burden on the user.
[1796] "Detailed information" refers to specific information related to the move that is input by the user, such as the old address, new address, and moving date.
[1797] The "procedure list" is a list of the individual procedures that users must carry out when they move, including changing their residence registration and changing their electricity, gas, and water contracts.
[1798] The "guide" is a document that guides the user to carry out the procedures in an orderly manner based on the procedure list.
[1799] A "reminder" is a message that notifies the user of incomplete procedures and reminds them to complete the necessary steps.
[1800] "Personal information" refers to information about a user that can identify a specific individual, such as the user's name, address, telephone number, and email address.
[1801] "Facial expression" refers to the facial expression of the user, and refers to facial movements that express emotions.
[1802] "Voice" refers to information collected as sound, such as the content of a user's speech and tone of voice.
[1803] "Adaptive guidance" refers to support messages and explanations that are customized based on the user's emotions and situation.
[1804] A "shopping list" is a list of items a user plans to purchase, including groceries, clothing, electronics, and other items.
[1805] "Store information" is information about the store that the user visits, including the location, business hours, sale information, and the like.
[1806] "Navigation Guide" is route guidance that enables users to shop efficiently based on their shopping list and store information.
[1807] This invention is a system for enabling users to efficiently carry out procedures related to moving and daily shopping, and a specific embodiment thereof will be described. This system is mainly composed of a user, a terminal, a server, and an emotion engine.
[1808] User Registration
[1809] A user accesses the system using a terminal and registers a new account. They enter basic information such as their name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the received information and registers the new user in the user database. The password is also hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1810] Enter moving information
[1811] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1812] Generate guides
[1813] After generating the procedure list, the server generates a guide to help the user perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1814] Procedure progress tracking and reminders
[1815] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1816] Introducing the Emotion Engine
[1817] The emotion engine is used to recognize the user's emotions. While the user is entering moving information, the device uses a camera and microphone to collect the user's facial expressions and voice. This data is sent to the server in real time, and the emotion engine installed on the server analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine can provide guidance and support according to the user's emotions.
[1818] Generate navigation guides
[1819] Shopping lists and store information are also entered in the same way. Users input a list of products they plan to purchase and information about stores they plan to visit into their terminal. Based on this information, the server generates a navigation guide to help users shop efficiently. This guide includes information on efficient routes and special sales at each store.
[1820] Protection of Personal Information
[1821] Users' personal information is strictly protected, and measures are taken to prevent data leaks. Information transmission and reception is encrypted, and access to the database is restricted. This ensures users' privacy.
[1822] Specific examples
[1823] For example, suppose a user creates a new account and enters moving information such as "Old address: Tokyo wards," "New address: Tokyo wards," and "Moving date: October 15, 2023." Based on this information, the server detects the need for procedures such as changing residence registration and changing electricity, gas, and water contracts, and generates a list including these procedures. It then generates a guide detailing the documents and methods required for each procedure and sends it to the user. Furthermore, if the user shows a confused expression, the server can provide additional explanations or support messages based on the facial expression data sent to the server in real time.
[1824] Hardware and software used
[1825] The hardware used includes the devices used by users (smartphones, tablets, etc.). The server has powerful information processing capabilities and runs a database management system, emotion analysis system, etc. The emotion engine also uses facial expression analysis software and voice analysis software.
[1826] Prompt Sentence Examples
[1827] As an example of input to a generative AI model, use the following prompt:
[1828] "Recognize emotions while users are using a shopping guide app and generate code to provide supportive messages when stress levels are high. Key functionality requires a complete application flow including user registration, shopping list input, and generation of navigation guides based on emotions."
[1829] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1830] Step 1:
[1831] A user accesses the system using a terminal and registers a new account. The user enters basic information such as name, email address, and password. The terminal receives this information, checks the format, and then sends it to the server. The server analyzes the entered information and registers the user as a new user in the user database. The password is hashed to ensure security. Once registration is complete, the server sends a confirmation email to the user and returns a message to the terminal stating that registration was successful.
[1832] Input: Name, Email Address, Password
[1833] Output: Confirmation email, registration success message, database entry in hashed password
[1834] Step 2:
[1835] The user enters details about their move (e.g., old address, new address, moving date, etc.) into the device. The device collects this information and sends it to the server. The server stores the received moving information in a database and automatically generates a list of necessary procedures. This list includes changing residence registration, changing electricity, gas, and water contracts, mail forwarding, and changing internet and cable TV settings.
[1836] Input: Old address, New address, Moving date
[1837] Output: Procedure list, saved moving information
[1838] Step 3:
[1839] Based on the procedure list, the server generates a guide to help users perform the necessary procedures in an orderly manner. This guide clearly describes the necessary documents, deadlines, and procedures for each procedure. The generated guide is sent to the user, who can then follow the instructions to proceed with the procedures.
[1840] Input: Procedure list
[1841] Output: Procedural guide, messages sent to the user
[1842] Step 4:
[1843] The server periodically checks the progress of the procedure and updates it based on the information stored in the database. If the procedure is not completed, the server sends a reminder to the user about the incomplete procedure, helping the user to avoid missing any steps.
[1844] Input: Procedure progress, incomplete procedures
[1845] Output: Reminder message, progress update
[1846] Step 5:
[1847] The device analyzes the user's facial expressions and voice to provide adaptive guidance based on their emotions. As the user enters their moving information, the device uses a camera and microphone to collect facial and voice data. This data is sent to the server in real time, and the emotion engine analyzes the user's stress level, satisfaction, confusion, etc. Based on the analysis results, the emotion engine provides the user with optimal guidance and support messages.
[1848] Input: facial expression data, voice data
[1849] Output: Sentiment analysis results, adaptive guidance messages
[1850] Step 6:
[1851] The user inputs a shopping list and store information into the device. The device then sends this information to the server, which then generates a navigation guide based on the received information to help the user shop efficiently. This guide includes information on efficient routes and special sales at each store.
[1852] Input: Shopping list, store information
[1853] Output: Navigation guide, special offers
[1854] Step 7:
[1855] To strictly protect users' personal information, the transmission of information is encrypted. The server limits access to personal information stored in the database to prevent data leakage.
[1856] Input: Personal Information
[1857] Output: Encrypted data, access restriction log
[1858] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1859] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1860] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1861] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1862] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1863] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1864] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1865] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1866] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1867] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1868] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1869] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1870] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1871] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1872] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1873] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1874] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1875] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1876] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1877] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1878] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1879] The following is further disclosed regarding the above embodiment.
[1880] (Claim 1)
[1881] a means for receiving the user-entered details about the move;
[1882] means for automatically generating a list of required procedures based on the detailed information;
[1883] means for generating a guide based on the procedure list so that the user can perform the necessary procedures in an orderly manner;
[1884] means for tracking the progress of said procedures and sending reminders for incomplete procedures;
[1885] Measures to strictly protect users' personal information;
[1886] A system including:
[1887] (Claim 2)
[1888] 10. The system of claim 1, wherein the generation of the procedure list is customized according to a user's lifestyle and specific needs.
[1889] (Claim 3)
[1890] 2. The system of claim 1, wherein the sending of the reminder comprises periodically checking the progress of the procedure and sending a reminder for any uncompleted procedure.
[1891] "Example 1"
[1892] (Claim 1)
[1893] A means for receiving basic information entered by a user, checking its format, and sending it to a server;
[1894] A means for analyzing the basic information, registering the user as a new user in a user database, and hashing the password to ensure security;
[1895] means for receiving and transmitting to a server the moving details entered by the user;
[1896] means for storing the detailed information in a database and automatically generating a list of required procedures;
[1897] means for generating a guide based on the procedure list so that the user can perform the necessary procedures in an orderly manner;
[1898] means for tracking the progress of said procedures and sending reminders for incomplete procedures;
[1899] A method for encrypting and transmitting user personal information and protecting it by restricting access to the database.
[1900] A system including:
[1901] (Claim 2)
[1902] 10. The system of claim 1, wherein the generation of the procedure list is customized according to a user's lifestyle and specific needs.
[1903] (Claim 3)
[1904] 2. The system of claim 1, wherein the sending of the reminder comprises periodically checking the progress of the procedure and sending a reminder for any uncompleted procedure.
[1905] "Application Example 1"
[1906] (Claim 1)
[1907] a means of receiving the moving or delivery details entered by the user;
[1908] means for automatically generating a list of required procedures or a delivery guide based on the detailed information;
[1909] A means for generating a guide based on the procedure list or delivery guide so that the user can perform the necessary procedures in an orderly manner;
[1910] means for tracking the progress of said transaction and sending reminders about outstanding transactions or delivery status;
[1911] Measures to strictly protect users' personal information...
Claims
1. a means for receiving the user-entered details about the move; means for automatically generating a list of required procedures based on the detailed information; means for generating a guide based on the procedure list so that the user can perform the necessary procedures in an orderly manner; means for tracking the progress of said procedures and sending reminders for incomplete procedures; Measures to strictly protect users' personal information; A system including:
2. 10. The system of claim 1, wherein the generation of the procedure list is customized according to a user's lifestyle and particular needs.
3. 2. The system according to claim 1, wherein the sending of the reminder comprises periodically checking the progress of the procedure and sending a reminder for any uncompleted procedure.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A