system

Abstract

We provide the system. [Solution] A means for generating individual timelines based on user input information, A means of displaying a task list based on the generated timeline on the user's terminal, An artificial intelligence algorithm for recommending products and services based on user preferences and budget, A means of automating communication and coordination with stakeholders, A means of using augmented reality technology to conduct virtual try-on, A reminder mechanism for managing and notifying users of their progress, A system that includes this.

Description

Technical Field

[0005] ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0006] "User input information" refers to data about the individual needs and preferences that users provide to the system.

[0007] A "timeline" is a schedule set up to systematically carry out a series of tasks related to wedding preparations.

[0008] A "task list" is a list of the various tasks that a user needs to complete in preparation for their wedding.

[0009] A "user terminal" refers to a device or computer used by a user, which provides a means of displaying system information.

[0010] An "artificial intelligence algorithm" is a computational method used to recommend products and services based on user preferences and budget.

[0011] "Stakeholders" refer to all parties involved in wedding preparations, such as venues, vendors, and service providers.

[0012] "Automated communication and coordination" refers to a function in which the system automates the process of communicating with stakeholders.

[0013] "Virtual try-on" is a technology that allows users to virtually try on clothing they have selected.

[0014] Augmented reality technology refers to a technique that overlays virtual information onto real-world images, providing users with visual information.

[0015] "Progress status" refers to the current state of the user's wedding preparations, including completed and incomplete tasks.

[0016] A "reminder" is a notification function that informs the user of the next action they should take. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be described.

[0020] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), APU (Accelerated Processing Unit), etc.

[0021] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] This invention aims to create a system that efficiently manages and supports wedding preparations by facilitating interaction between users, servers, and terminals. The system aims to reduce the burden on users by providing multiple functions in an integrated manner.

[0039] First, the user accesses the system using a terminal, creates an account, and enters basic information about their marriage. This information includes the wedding date, desired style, and budget. This information is sent to the server and securely stored in a database.

[0040] Based on the received user information, the server generates a timeline of tasks necessary for wedding preparations. This timeline combines a general wedding preparation schedule with the user's individual needs. The generated timeline, along with the recommended completion deadline for each task, is displayed on the device. The user can adjust this task schedule according to their preferences.

[0041] Next, the server utilizes AI algorithms to recommend the most suitable products and services to the user based on the input information. This includes furniture, home appliances, clothing, and wedding venue services. On the device, the user can review these recommendations, click on items of interest to view details, and proceed with the purchase.

[0042] Furthermore, the server includes communication functions to manage contact with stakeholders such as wedding venues and service providers. The system provides automatically generated email templates and messages to enable users to communicate smoothly with stakeholders and exchange necessary information.

[0043] Regarding costume selection, the server can utilize augmented reality technology to provide users with a virtual try-on experience. This feature allows users to visually check whether an outfit suits them before actually trying it on.

[0044] Furthermore, the server tracks the user's task progress in real time and notifies the device of the next steps to take or things that need to be checked. The reminder function allows users to keep track of incomplete tasks and important deadlines, enabling them to plan and prepare systematically.

[0045] For example, if a user desires a modern-style wedding but also wants to incorporate Japanese elements, the system will suggest venue options and designs that match their requests and incorporate the necessary tasks into a timeline. In this way, the system supports efficient wedding preparations that reflect the user's individual needs.

[0046] The following describes the processing flow.

[0047] Step 1:

[0048] The user creates an account using their device and logs in. After logging in, they enter basic information about their marriage (e.g., wedding date, desired style, budget, etc.) and submit it to the system.

[0049] Step 2:

[0050] The server receives information sent by the user and securely stores it in a database. Based on the stored information, it creates an individual wedding preparation timeline.

[0051] Step 3:

[0052] The server generates a timeline which is then displayed on the user's device, allowing them to view details and recommended completion deadlines for each task. Users can then use this information to prioritize their tasks.

[0053] Step 4:

[0054] The server uses an AI algorithm to generate a list of recommended products and services based on the user's input. This list is tailored to the user's preferences and budget.

[0055] Step 5:

[0056] On the device, users can view details of recommended products and services and, if necessary, proceed with the purchase.

[0057] Step 6:

[0058] The server manages communication and coordination with stakeholders such as wedding venues and service providers. When necessary, it automatically generates email templates and messages to facilitate communication.

[0059] Step 7:

[0060] The server uses augmented reality technology to provide users with a virtual try-on experience. Users can view a virtual fitting of the selected outfit on their device.

[0061] Step 8:

[0062] The server tracks progress and sends reminders and important notifications to the user's device. This makes it easier for users to manage incomplete tasks and next steps.

[0063] (Example 1)

[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0065] Traditional wedding planning systems had problems such as being unable to efficiently create plans and suggest products and services tailored to individual user needs, and coordinating with stakeholders, resulting in a significant burden on users. Furthermore, insufficient progress management led to missed deadlines, and inconveniences during fittings negatively impacted the user experience. There was a need for a system that could solve these problems and allow users to proceed with wedding preparations efficiently and systematically.

[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0067] In this invention, the server includes means for generating individual schedules based on user input information, intelligent algorithm means for recommending goods and services based on the user's preferences and financial plan, and means for automatically coordinating communication with relevant organizations. This reduces the burden on the user and enables efficient wedding preparations that meet diverse needs.

[0068] "User input information" refers to basic data and requests related to marriage that users enter when using the system.

[0069] A "planned timetable" is a schedule of tasks necessary for a user's wedding preparations, and is generated according to the user's individual needs.

[0070] A "task list" is a list that enumerates the specific tasks that the user should perform, based on the planned time schedule.

[0071] A "user information processing device" is a terminal device that allows users to access a system and input information or confirm presented data.

[0072] An "intelligent algorithm" is an artificial intelligence technology used in systems to recommend the most suitable products and services based on user preferences and budget.

[0073] "Related organizations" refers to businesses and service providers that offer services related to weddings, and who users need to contact during their wedding preparations.

[0074] "Automatic communication coordination" refers to a feature where the system automatically generates email templates and messages to facilitate smooth communication between users and relevant parties.

[0075] "Virtual try-on" is a feature that uses augmented reality technology to allow users to virtually try on the clothes they want to wear.

[0076] Augmented reality technology is a technique that overlays virtual information onto real-world images and videos, and is used in applications such as virtual try-ons.

[0077] A "recall mechanism" is a function that tracks the user's task progress and notifies the user of incomplete tasks and the next actions to take.

[0078] An "artificial intelligence model" refers to a trained algorithm or computer program used to generate optimal suggestions for a user in response to a specific prompt.

[0079] A "prompt statement" is a command or instruction statement entered into a system to indicate the user's request or intention.

[0080] This invention is a system for efficiently managing wedding preparations, and is designed around the interaction between users, servers, and terminals.

[0081] Users access the system using a terminal and enter basic information about their marriage (e.g., wedding date, style, budget, etc.). This data entry is performed through an intuitive interface designed to prevent errors with guidance.

[0082] The server receives information sent by the user and securely stores it in a database. Based on this information, the server utilizes AI algorithms to generate a personalized schedule tailored to the user's needs. Furthermore, the server has the ability to recommend optimal products and services based on the user's preferences and budget. This recommendation uses a generative AI model, and the following prompt is an example: "I would like a modern-style wedding incorporating Japanese elements. Please suggest the best venue options."

[0083] The terminal receives information transmitted from the server and displays it to the user. This includes generated schedules and lists of recommended products and services. Users can use this information to review and adjust detailed plans, and to make purchases or reservations. Furthermore, by using a terminal equipped with augmented reality technology, users can virtually try on clothes and visually experience the process of choosing outfits.

[0084] This system supports users in efficiently and systematically preparing for their wedding, simplifying progress management and communication with relevant organizations. The goal is to reduce the burden on users during wedding preparations.

[0085] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0086] Step 1:

[0087] Users access the system using a terminal, create an account, and enter basic information about their marriage. This information includes the wedding date, style, and budget. The entered information is sent from the terminal to the server. Based on the entered data, the terminal provides an interface, allowing users to easily enter the necessary information.

[0088] Step 2:

[0089] The server receives information sent by the user and securely stores it in a database. Based on the stored information, the server uses an AI algorithm to generate a personalized timetable for the user. This process involves data processing such as "prioritizing tasks" and "building work timelines," and setting recommended deadlines for individual tasks. The generated timetable is then sent to the terminal.

[0090] Step 3:

[0091] The terminal displays the scheduled timetable received from the server to the user. The user reviews the displayed scheduled timetable and adjusts the task schedule as needed. The user's adjustment operations are intuitive through a user-friendly UI, and the adjusted data is sent back to the server.

[0092] Step 4:

[0093] The server uses a generative AI model to recommend suitable products and services based on the user's preferences and budget. The server uses prompts to generate the AI ​​model's optimal output for the user's request (e.g., "a modern wedding with Japanese elements"). This recommendation information is then sent to the terminal.

[0094] Step 5:

[0095] The terminal displays a list of recommended products and services sent from the server, assisting users in viewing detailed information and making purchases or reservations. When a user selects a specific item, its details are displayed on the terminal, and the selection is sent to the server for progress tracking.

[0096] Step 6:

[0097] The server utilizes augmented reality technology to allow users to virtually try on clothes when selecting them. The server processes the user's selection data and sends 3D models for the virtual try-on to the device. The device then uses its camera function to overlay the 3D models onto the user's photograph.

[0098] Step 7:

[0099] The server tracks user progress in real time and notifies the device of task completion status and next steps. Notifications output through the reminder function help users not miss important deadlines, and continuous information updates and data transmission are performed.

[0100] (Application Example 1)

[0101] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0102] In wedding preparations, there is a need for systems that efficiently manage the process while meeting the individual needs of each user. However, many current systems specialize in a single function, making it difficult for users to manage the diverse preparation tasks. In particular, there is a lack of integrated systems that combine the experience of choosing attire in physical stores with efficient online preparation management. As a result, it is difficult for users to proceed with the entire preparation process smoothly and without burden.

[0103] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0104] This invention includes a server that generates individual time series based on user input information, a device that displays work instructions based on the generated time series on a user terminal, and a method for providing a virtual try-on experience using a visual device at a sales location. This allows users to efficiently proceed with wedding preparations while easily selecting outfits through virtual try-ons at physical stores.

[0105] "User input information" refers to basic information related to wedding preparations, and is data that the user provides to the system.

[0106] "Timeline" refers to the order and timing of tasks planned for wedding preparations.

[0107] A "work instruction" is a list of specific tasks and activities that the user should perform in preparation for their wedding.

[0108] A "user terminal" is an electronic device used by a user for wedding preparations, and its role is to receive and display information from the system.

[0109] A "sales outlet" is a physical location, such as a retail store or event space, where users can directly view and purchase products or services.

[0110] A "visual device" is a device used by users to have a virtual try-on experience, and it is equipped with technology to present information visually.

[0111] A "virtual try-on experience" is a feature that uses augmented reality technology to simulate trying on clothes, allowing users to visually check the options before actually trying them on.

[0112] To implement this invention, a system utilizing the cooperation between a server, a terminal, and a user is required. First, the user logs into the system using a terminal and enters the information necessary for wedding preparations. This information includes, for example, the wedding date, desired wedding style, and budget. This data is transmitted to the server and stored securely.

[0113] The server generates individual timelines (schedules) based on the user input information received. These timelines serve as a means of planning the tasks necessary for wedding preparations, and the generated work instructions are displayed on the user's terminal. This allows the user to check the schedule and priority of each task and proceed with preparations efficiently.

[0114] Furthermore, at sales locations, users can experience virtual try-on using visual devices. This feature utilizes augmented reality technology, allowing users to virtually try on selected clothing through devices such as smart glasses or head-mounted displays. This enables users to try on multiple outfits without visiting a physical store.

[0115] For example, if a user plans a "casual elegance" wedding and has a limited budget, the server will automatically select suitable clothing and accessories and present them as options for virtual try-on. This allows the user to easily select their outfit.

[0116] An example of a prompt using a generative AI model is: "The user is trying on a casual elegance dress while wearing smart glasses. Please describe in detail how it will look on them."

[0117] This system allows users to plan their preparations carefully while reducing the time and cost associated with actually trying on clothes.

[0118] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0119] Step 1:

[0120] Users log in to the system using their devices and enter the information necessary for wedding preparations. This information includes the wedding date, theme, and budget. This allows users to input personal data related to their wedding preparations and send it to the server.

[0121] Step 2:

[0122] The server receives information sent by the user and stores it in a database. Next, it generates a personalized timeline (schedule) tailored to the user's needs. Based on the input data, it customizes a general wedding preparation schedule and creates a user-specific task list.

[0123] Step 3:

[0124] The server sends the generated timeline to the terminal and displays work instructions on the user's screen. The user can review this schedule and reset priorities as needed. This allows the user to efficiently prepare while monitoring the progress of tasks.

[0125] Step 4:

[0126] Users virtually try on clothes at the sales location using a visual device. The terminal acquires data on the clothing selected by the user and transmits it to the visual device. The visual device uses augmented reality technology to virtually display the selected clothing in the user's field of view. This allows users to virtually try on different clothing and make visual confirmations without actually trying them on.

[0127] Step 5:

[0128] After the user tries on the product, feedback generated by the visual device is sent to the server. Based on this data, the server further analyzes the user's preferences and uses a generative AI model to recommend the most suitable products and services, improving the accuracy of future recommendations.

[0129] This processing flow allows users to comprehensively prepare for their wedding through the system and efficiently utilize the preparations for the evening reception and ceremony.

[0130] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0131] This invention incorporates an emotion engine that recognizes the user's emotions into a system that effectively supports wedding preparations, thereby providing flexible support tailored to the user's situation and emotional state. In this system, the user, terminal, and server work together to dynamically manage and provide information.

[0132] First, the user accesses the system via a terminal and enters basic information about their wedding preparations. This initial information includes the wedding date, desired style, and budget. This information is sent to the server and stored in the database.

[0133] The server generates a timeline and task list based on user information and displays them on the device. Users can set the priority of each task themselves. The system also uses AI algorithms to recommend products and services based on the user's preferences and budget.

[0134] The emotion engine analyzes user emotions from input data and behavior, and plays a role in adjusting the progress and suggestions of wedding preparations according to changes in emotions. For example, if the system determines that the user is feeling stressed, it will recommend more relaxing options.

[0135] Furthermore, the server automatically reprioritizes tasks and updates recommended product lists based on the user's emotional state. It also coordinates communication with stakeholders and automatically generates and sends messages as needed.

[0136] The device visually displays daily progress and provides users with appropriate advice and reminders based on feedback from the emotion engine. This allows users to proceed with wedding preparations at a pace that suits their emotions.

[0137] For example, if a user enters "I'm pressed for time" and the emotion engine detects the user's stress, the system will postpone lower-priority tasks and recommend a list of items that can help soothe the user. In this way, the system provides support that is as attentive as possible to the user's emotions and needs.

[0138] The following describes the processing flow.

[0139] Step 1:

[0140] Users log in to the system via their terminal, enter basic information about their wedding preparations (e.g., wedding date, style, budget, etc.), and submit it.

[0141] Step 2:

[0142] The server receives information sent by the user and stores it in a database. Based on this, it generates individual timelines and task lists.

[0143] Step 3:

[0144] On the device, the generated timeline and task list are displayed to the user, showing task details and completion deadlines. The user can set task priorities.

[0145] Step 4:

[0146] The server uses AI algorithms to analyze products and services based on the user's preferences and budget, and creates a recommendation list. The list is immediately displayed on the device.

[0147] Step 5:

[0148] Users operate their devices to view details of the recommendation list and make purchases or reservations. This information is sent to the server as feedback.

[0149] Step 6:

[0150] The emotion engine analyzes the user's input data and behavior to recognize the user's emotional state (e.g., stress, relief). The recognition results are sent to the server.

[0151] Step 7:

[0152] The server automatically adjusts the priority of wedding preparation tasks based on feedback from the emotion engine. For example, if the user is feeling stressed, it will reschedule tasks to reduce the burden.

[0153] Step 8:

[0154] The server updates its list of recommended products and services based on the user's mood, providing them with choices that suit them. The updated information is then displayed on the device again.

[0155] Step 9:

[0156] The server automatically coordinates communication with stakeholders, generating and sending messages to share updated schedules and requirements as needed.

[0157] Step 10:

[0158] The device notifies the user of their progress in real time and reminds them of the next necessary actions. This allows the user to proceed with wedding preparations while reducing stress.

[0159] (Example 2)

[0160] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0161] In today's diverse wedding preparation process, a lack of flexible support tailored to the individual needs and emotional states of users is a challenge. Traditional systems lack effective means of alleviating the stress and anxiety users experience during the preparation process, and the provision of customized experiences is limited. As a result, it is difficult for users to create efficient and stress-free plans that suit their own emotions and circumstances.

[0162] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0163] In this invention, the server includes input means for inputting initial information from the user, means for generating a dynamic schedule and task list based on the input information, and emotion measurement means for analyzing the user's state from their behavior and emotions. This enables the user to receive appropriate schedule management and recommendation information tailored to their emotions.

[0164] An "input means" is a device or mechanism that can receive initial information from a user and record that information in a digital format.

[0165] A "dynamic schedule" is a calendar or plan that can be updated in real time based on user input.

[0166] "A means of generating a task list" refers to a function that lists the necessary tasks and items according to the user's needs and provides them to the user.

[0167] "Means of displaying on a terminal" refers to a function that visualizes the generated information on a display device such as the user's computer or mobile device.

[0168] An "emotion measurement method" is a system that analyzes a user's psychological state from their behavior and input, and infers their emotions.

[0169] An "artificial intelligence model" is a system that uses advanced computational techniques to make optimal recommendations and decisions based on user data.

[0170] "Means of automatically coordinating communications" refers to a function in which the system automatically arranges communication with necessary stakeholders and transmits appropriate information.

[0171] "Monitoring and notification means" refers to a system that tracks the user's progress and notifies them of reminders and important information as needed.

[0172] This invention is a system that provides flexible planning and support that takes into account the user's emotions and needs in order to assist with wedding preparations. The user first accesses the system using a terminal and inputs basic information about the wedding, such as the date of the ceremony, desired style, and budget. The information obtained through the input means is transmitted to a server and recorded in a database.

[0173] The server automatically generates a dynamic schedule and task list based on this information. The generated information is visualized to the user via a terminal. The user can review the displayed task list and set the priority of each task themselves.

[0174] Furthermore, machine learning algorithms are used as a means of measuring emotions, and the user's emotional state is analyzed by analyzing user input data and behavioral logs. Based on this analysis, the artificial intelligence model automatically updates recommendation information and proposes the most suitable products and services according to the user's emotional state.

[0175] Furthermore, by using automated communication coordination methods, the system generates automated messages to ensure that stakeholders are contacted at the appropriate time, thereby supporting smooth communication. Monitoring and notification methods visualize daily progress on the device, providing reminders and advice to help users proceed with preparations efficiently.

[0176] For example, if a user inputs that they are "pressured for time," the emotion measurement system will identify this as stress, and the server will postpone lower-priority tasks and suggest a list of products with relaxing effects. An example of a prompt message would be, "What options should be recommended when a user is feeling stressed?" This input is processed by a generative AI model, which then provides specific suggestions.

[0177] The system provided by this invention enables users to make wedding preparations that are optimized for their own environment and emotions.

[0178] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0179] Step 1:

[0180] Users access the system using a terminal and enter basic information about their wedding preparations. Specifically, users enter the wedding date, desired style, budget, etc., into an input form and press the submit button. The entered information is sent to the server and stored in the database. The input is basic preparation information, and the output is recorded in the database in the correct format.

[0181] Step 2:

[0182] The server generates a dynamic schedule and task list based on user information stored in the database. The server utilizes programmed algorithms to analyze user information and automatically create a timeline and necessary task list. Stored user information is used as input, and the generated timeline and task list are obtained as output.

[0183] Step 3:

[0184] The terminal visualizes and displays the generated schedule and task list to the user. Specifically, a timeline is graphically displayed on the terminal screen, and an interface is provided that allows the user to change the priority of each task by dragging and dropping. The input in this step is the timeline and task list received from the server, and the output is the visual information displayed to the user.

[0185] Step 4:

[0186] The server analyzes the user's emotional state using emotion measurement techniques based on user input data and interaction logs. This analysis utilizes a generative AI model. Specifically, the server infers emotions from the user's operation logs and prompt messages and reports its assessment back to the server. The input is user behavior data, and the output is the analyzed emotional information.

[0187] Step 5:

[0188] The server generates and provides optimal recommendations to the user based on analyzed emotional data. An artificial intelligence model considers the user's emotional state and suggests relaxing products and services. The input is the analysis results, and the output includes recommendations in a visualized format for the user. Specifically, the server generates prompts based on emotional information and selects content to display.

[0189] Step 6:

[0190] To support users in managing their schedules, the device visualizes daily progress using monitoring and notification mechanisms, providing users with reminders and advice. Specifically, a progress bar is displayed on the device, and notifications are sent based on the set schedule. The input is the user's progress data, and the output is notifications that appear as reminders and advice.

[0191] (Application Example 2)

[0192] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0193] In wedding preparations, there is a need to automatically understand users' emotions and stress levels and provide appropriate suggestions and schedule adjustments accordingly. Similarly, in in-store shopping experiences, dynamic suggestions based on user emotions are crucial. While this would allow users to have a more comfortable and satisfying experience, currently, no system exists that effectively achieves this.

[0194] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0195] In this invention, the server includes means for using an emotion analysis engine to analyze the user's emotions and adjust suggestions and tasks based on the analysis results, and means for dynamically presenting product suggestions through a visual display device. This enables flexible and personalized support that responds to the user's emotions.

[0196] "User input information" refers to the basic data used to generate individual time-series plans that users provide to the system.

[0197] A "time-series plan" is a plan for progress management that is generated based on user input information.

[0198] A "task list" is a list of specific tasks and activities organized according to a chronological plan.

[0199] "User information devices" are devices or terminals used by users to input information and check results.

[0200] An "artificial judgment algorithm" is a computational method used to recommend products and services based on user preferences and budget.

[0201] "Related parties" refers to individuals or organizations involved in a user's wedding preparations or shopping activities.

[0202] A "virtual experience" is a technology that uses augmented reality to visualize information that does not actually exist.

[0203] "Memory means" refers to memory or recording devices used to manage and notify users of their progress.

[0204] An "emotion analysis engine" is a technology that analyzes a user's emotions and makes suggestions or adjusts tasks based on the analysis results.

[0205] A "visual display device" is a device that dynamically presents information through a screen or display.

[0206] In a system implementing this invention, the user, server, and user information device work together in coordination.

[0207] The server generates individual time-series plans based on user input information provided by the user. The generated time-series plans are converted into a work list by the server and visually displayed on the user's information device. User information devices include smart glasses and head-mounted displays, and are designed to improve user convenience.

[0208] Furthermore, the server uses artificial intelligence algorithms to recommend appropriate products and services based on the user's preferences and budget. It also automatically coordinates communication with relevant parties and provides visual feedback to the user using augmented reality technology for virtual experiences.

[0209] The server implements an emotion analysis engine that analyzes the user's emotions. Based on this analysis, it optimizes the user experience by making suggestions and adjusting tasks. For example, if the analysis indicates that the user is feeling stressed, the system will offer suggestions that promote relaxation, thereby enhancing the user's comfort.

[0210] For example, when a user is browsing products in a store, if their facial expression is judged to be "happy," the system will suggest similar style products. This prompt would be written as follows: "User's facial expression was judged to be 'happy.' Generate a prompt suggesting similar style products." In this way, the system provides a dynamic and personalized shopping experience.

[0211] Using a generative AI model, appropriate suggestions are automatically generated based on this prompt. To achieve this, software such as EmotionEngineAPI and OpenCV are used in combination with hardware to deliver high-quality support that responds to the user's emotions.

[0212] In this way, the system provides an integrated solution to improve the user's experience when preparing for or shopping for their wedding.

[0213] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0214] Step 1:

[0215] The server receives input information from the user and generates an individual time-series plan based on it. This input information includes basic information about wedding preparations and desired dates. The server optimizes the time-series plan by referring to past patterns and user history data stored in the database. As output, a plan is generated to efficiently carry out the user's activities.

[0216] Step 2:

[0217] The terminal displays a list of tasks sent from the server to the user. The user sets the priority of the displayed tasks via the terminal. This input allows the terminal to visually manage tasks using its interface. As output, the task list, reflecting the priorities, is updated in real time.

[0218] Step 3:

[0219] The server uses artificial intelligence algorithms to recommend products and services tailored to the user's preferences and budget. Inputs include the user's past purchase history and budget limits. Through data analysis, the server generates the most suitable recommendation list for the user and sends it to the terminal.

[0220] Step 4:

[0221] The server activates an emotion analysis engine to analyze the user's emotions and understand their emotional state in real time. Camera video and audio data are used as input. The EmotionEngine API is used to perform emotion analysis and evaluate the user's stress level, etc. As output, suggestions are adjusted according to the emotion.

[0222] Step 5:

[0223] The terminal dynamically presents product suggestions through a visual display. At this time, it feeds prompt text based on the user's emotional state to a generating AI model, which then suggests appropriate products and services. The input is the result of emotion analysis, and the output is visual information presented to the user. Specifically, if the user's emotion towards a particular product is determined to be "happy," additional recommendations related to that product will be displayed.

[0224] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0225] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0226] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0227] [Second Embodiment]

[0228] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0229] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0230] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0231] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0232] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0233] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0234] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0235] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0236] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0237] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0238] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0239] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0240] This invention aims to create a system that efficiently manages and supports wedding preparations by facilitating interaction between users, servers, and terminals. The system aims to reduce the burden on users by providing multiple functions in an integrated manner.

[0241] First, the user accesses the system using a terminal, creates an account, and enters basic information about their marriage. This information includes the wedding date, desired style, and budget. This information is sent to the server and securely stored in a database.

[0242] Based on the received user information, the server generates a timeline of tasks necessary for wedding preparations. This timeline combines a general wedding preparation schedule with the user's individual needs. The generated timeline, along with the recommended completion deadline for each task, is displayed on the device. The user can adjust this task schedule according to their preferences.

[0243] Next, the server utilizes AI algorithms to recommend the most suitable products and services to the user based on the input information. This includes furniture, home appliances, clothing, and wedding venue services. On the device, the user can review these recommendations, click on items of interest to view details, and proceed with the purchase.

[0244] Furthermore, the server includes communication functions to manage contact with stakeholders such as wedding venues and service providers. The system provides automatically generated email templates and messages to enable users to communicate smoothly with stakeholders and exchange necessary information.

[0245] Regarding costume selection, the server can utilize augmented reality technology to provide users with a virtual try-on experience. This feature allows users to visually check whether an outfit suits them before actually trying it on.

[0246] Furthermore, the server tracks the user's task progress in real time and notifies the device of the next steps to take or things that need to be checked. The reminder function allows users to keep track of incomplete tasks and important deadlines, enabling them to plan and prepare systematically.

[0247] For example, if a user desires a modern-style wedding but also wants to incorporate Japanese elements, the system will suggest venue options and designs that match their requests and incorporate the necessary tasks into a timeline. In this way, the system supports efficient wedding preparations that reflect the user's individual needs.

[0248] The following describes the processing flow.

[0249] Step 1:

[0250] The user creates an account using their device and logs in. After logging in, they enter basic information about their marriage (e.g., wedding date, desired style, budget, etc.) and submit it to the system.

[0251] Step 2:

[0252] The server receives information sent by the user and securely stores it in a database. Based on the stored information, it creates an individual wedding preparation timeline.

[0253] Step 3:

[0254] The server generates a timeline which is then displayed on the user's device, allowing them to view details and recommended completion deadlines for each task. Users can then use this information to prioritize their tasks.

[0255] Step 4:

[0256] The server uses an AI algorithm to generate a list of recommended products and services based on the user's input. This list is tailored to the user's preferences and budget.

[0257] Step 5:

[0258] On the device, users can view details of recommended products and services and, if necessary, proceed with the purchase.

[0259] Step 6:

[0260] The server manages communication and coordination with stakeholders such as wedding venues and service providers. When necessary, it automatically generates email templates and messages to facilitate communication.

[0261] Step 7:

[0262] The server uses augmented reality technology to provide users with a virtual try-on experience. Users can view a virtual fitting of the selected outfit on their device.

[0263] Step 8:

[0264] The server tracks progress and sends reminders and important notifications to the user's device. This makes it easier for users to manage incomplete tasks and next steps.

[0265] (Example 1)

[0266] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0267] Traditional wedding planning systems had problems such as being unable to efficiently create plans and suggest products and services tailored to individual user needs, and coordinating with stakeholders, resulting in a significant burden on users. Furthermore, insufficient progress management led to missed deadlines, and inconveniences during fittings negatively impacted the user experience. There was a need for a system that could solve these problems and allow users to proceed with wedding preparations efficiently and systematically.

[0268] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0269] In this invention, the server includes means for generating individual schedules based on user input information, intelligent algorithm means for recommending goods and services based on the user's preferences and financial plan, and means for automatically coordinating communication with relevant organizations. This reduces the burden on the user and enables efficient wedding preparations that meet diverse needs.

[0270] "User input information" refers to basic data and requests related to marriage that users enter when using the system.

[0271] A "planned timetable" is a schedule of tasks necessary for a user's wedding preparations, and is generated according to the user's individual needs.

[0272] A "task list" is a list that enumerates the specific tasks that the user should perform, based on the planned time schedule.

[0273] A "user information processing device" is a terminal device that allows users to access a system and input information or confirm presented data.

[0274] An "intelligent algorithm" is an artificial intelligence technology used in systems to recommend the most suitable products and services based on user preferences and budget.

[0275] "Related organizations" refers to businesses and service providers that offer services related to weddings, and who users need to contact during their wedding preparations.

[0276] "Automatic communication coordination" refers to a feature where the system automatically generates email templates and messages to facilitate smooth communication between users and relevant parties.

[0277] "Virtual try-on" is a feature that uses augmented reality technology to allow users to virtually try on the clothes they want to wear.

[0278] Augmented reality technology is a technique that overlays virtual information onto real-world images and videos, and is used in applications such as virtual try-ons.

[0279] A "recall mechanism" is a function that tracks the user's task progress and notifies the user of incomplete tasks and the next actions to take.

[0280] An "artificial intelligence model" refers to a trained algorithm or computer program used to generate optimal proposals for users in response to specific prompts.

[0281] A "prompt sentence" is an instruction sentence or directive sentence input in the system to indicate the user's requirements and intentions. !

[0282] This invention is a system for efficiently managing wedding preparations, designed around the interaction among users, servers, and terminals.

[0283] The user accesses the system using a terminal and enters basic information related to the wedding (e.g., wedding date, style, budget, etc.). This data entry is performed through an interface that the user can intuitively operate and is designed to prevent incorrect input with guidance.

[0284] The server receives the information sent by the user and securely stores it in the database. The server utilizes AI algorithms based on this information to generate an individual schedule tailored to the user's needs. Furthermore, the server has a function to recommend optimal products and services based on the user's preferences and budget. This recommendation uses a generated AI model, and the following prompt sentences are given as examples. "I hope to have a wedding with a modern style incorporating Japanese elements. Please propose the optimal venue options."

[0285] The terminal receives the information sent by the server and displays it to the user. The displayed content includes the generated schedule and a recommended list of products and services. The user uses this to check and adjust the detailed plan and execute purchases, reservations, etc. Also, by using a terminal equipped with augmented reality technology, the user can perform virtual try - on and visually experience clothing selection.

[0286] This system supports users in preparing for marriage efficiently and systematically, and simplifies progress management and communication and coordination with related organizations. The purpose is to reduce the burden on users in preparing for marriage.

[0287] The flow of the specific process in Example 1 will be described using FIG. 11.

[0288] Step 1:

[0289] The user uses the terminal to access the system, create an account, and enter basic information related to marriage. This information includes the schedule, style, budget, etc. of the wedding ceremony. The entered information is sent from the terminal to the server. Based on the data to be entered, the terminal provides an interface to enable the user to easily enter the necessary items.

[0290] Step 2:

[0291] The server receives the information sent from the user and securely stores it in the database. Based on the stored information, the server uses an AI algorithm to generate an individual schedule for the user. In this process, data processing such as "task prioritization" and "construction of work timeline" is performed to set the recommended deadlines for individual tasks. The generated schedule is sent to the terminal.

[0292] Step 3:

[0293] The terminal displays the schedule received from the server to the user. The user checks the displayed schedule and adjusts the task schedule as needed. The user's adjustment operation is intuitively performed through a user-friendly UI, and the adjusted data is sent to the server again.

[0294] Step 4:

[0295] The server uses a generative AI model to recommend suitable products and services based on the user's preferences and budget. The server uses prompts to generate the AI ​​model's optimal output for the user's request (e.g., "a modern wedding with Japanese elements"). This recommendation information is then sent to the terminal.

[0296] Step 5:

[0297] The terminal displays a list of recommended products and services sent from the server, assisting users in viewing detailed information and making purchases or reservations. When a user selects a specific item, its details are displayed on the terminal, and the selection is sent to the server for progress tracking.

[0298] Step 6:

[0299] The server utilizes augmented reality technology to allow users to virtually try on clothes when selecting them. The server processes the user's selection data and sends 3D models for the virtual try-on to the device. The device then uses its camera function to overlay the 3D models onto the user's photograph.

[0300] Step 7:

[0301] The server tracks user progress in real time and notifies the device of task completion status and next steps. Notifications output through the reminder function help users not miss important deadlines, and continuous information updates and data transmission are performed.

[0302] (Application Example 1)

[0303] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0304] In wedding preparations, there is a need for a system that can efficiently proceed with preparations while meeting the individual needs of users. However, many current systems are specialized for a single function, making it difficult for users to manage a wide range of preparatory tasks. In particular, there is a lack of an integrated system that combines the experience of selecting clothing in a physical store with efficient online preparation management. As a result, it has become difficult for users to smoothly proceed with the entire preparation process without burden.

[0305] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following respective means.

[0306] In this invention, the server includes a device that generates an individual time series based on user input information, a device that displays a work instruction based on the generated time series on a user terminal, and a method that provides a virtual fitting experience using a visual device at a sales base. Thereby, users can easily select clothing through virtual fitting in a physical store while efficiently proceeding with wedding preparations.

[0307] [[ID=1又]] "User input information" is basic information regarding wedding preparations and is data provided by the user to the system.

[0308] "Time series" indicates the order and period for executing tasks planned for wedding preparations.

[0309] "Work instruction" shows a list of specific tasks and activities that the user should perform in wedding preparations.

[0310] "User terminal" is an electronic device used by the user for wedding preparations and has the role of receiving and displaying information from the system.

[0311] "Sales base" is a physical location such as a physical store or event space where users can directly view and purchase goods and services.

[0312] Please note that in the translation of , I added "又" in the translation to make the Chinese sentence more fluent. If this addition is not allowed according to your strict requirements, you can adjust it back to the original form. A "visual device" is a device used by users to have a virtual try-on experience, and it is equipped with technology to present information visually.

[0313] A "virtual try-on experience" is a feature that uses augmented reality technology to simulate trying on clothes, allowing users to visually check the options before actually trying them on.

[0314] To implement this invention, a system utilizing the cooperation between a server, a terminal, and a user is required. First, the user logs into the system using a terminal and enters the information necessary for wedding preparations. This information includes, for example, the wedding date, desired wedding style, and budget. This data is transmitted to the server and stored securely.

[0315] The server generates individual timelines (schedules) based on the user input information received. These timelines serve as a means of planning the tasks necessary for wedding preparations, and the generated work instructions are displayed on the user's terminal. This allows the user to check the schedule and priority of each task and proceed with preparations efficiently.

[0316] Furthermore, at sales locations, users can experience virtual try-on using visual devices. This feature utilizes augmented reality technology, allowing users to virtually try on selected clothing through devices such as smart glasses or head-mounted displays. This enables users to try on multiple outfits without visiting a physical store.

[0317] For example, if a user plans a "casual elegance" wedding and has a limited budget, the server will automatically select suitable clothing and accessories and present them as options for virtual try-on. This allows the user to easily select their outfit.

[0318] An example of a prompt using a generative AI model is: "The user is trying on a casual elegance dress while wearing smart glasses. Please describe in detail how it will look on them."

[0319] This system allows users to plan their preparations carefully while reducing the time and cost associated with actually trying on clothes.

[0320] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0321] Step 1:

[0322] Users log in to the system using their devices and enter the information necessary for wedding preparations. This information includes the wedding date, theme, and budget. This allows users to input personal data related to their wedding preparations and send it to the server.

[0323] Step 2:

[0324] The server receives information sent by the user and stores it in a database. Next, it generates a personalized timeline (schedule) tailored to the user's needs. Based on the input data, it customizes a general wedding preparation schedule and creates a user-specific task list.

[0325] Step 3:

[0326] The server sends the generated timeline to the terminal and displays work instructions on the user's screen. The user can review this schedule and reset priorities as needed. This allows the user to efficiently prepare while monitoring the progress of tasks.

[0327] Step 4:

[0328] Users virtually try on clothes at the sales location using a visual device. The terminal acquires data on the clothing selected by the user and transmits it to the visual device. The visual device uses augmented reality technology to virtually display the selected clothing in the user's field of view. This allows users to virtually try on different clothing and make visual confirmations without actually trying them on.

[0329] Step 5:

[0330] After the user tries on the product, feedback generated by the visual device is sent to the server. Based on this data, the server further analyzes the user's preferences and uses a generative AI model to recommend the most suitable products and services, improving the accuracy of future recommendations.

[0331] This processing flow allows users to comprehensively prepare for their wedding through the system and efficiently utilize the preparations for the evening reception and ceremony.

[0332] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0333] This invention incorporates an emotion engine that recognizes the user's emotions into a system that effectively supports wedding preparations, thereby providing flexible support tailored to the user's situation and emotional state. In this system, the user, terminal, and server work together to dynamically manage and provide information.

[0334] First, the user accesses the system via a terminal and enters basic information about their wedding preparations. This initial information includes the wedding date, desired style, and budget. This information is sent to the server and stored in the database.

[0335] The server generates a timeline and task list based on user information and displays them on the device. Users can set the priority of each task themselves. The system also uses AI algorithms to recommend products and services based on the user's preferences and budget.

[0336] The emotion engine analyzes user emotions from input data and behavior, and plays a role in adjusting the progress and suggestions of wedding preparations according to changes in emotions. For example, if the system determines that the user is feeling stressed, it will recommend more relaxing options.

[0337] Furthermore, the server automatically reprioritizes tasks and updates recommended product lists based on the user's emotional state. It also coordinates communication with stakeholders and automatically generates and sends messages as needed.

[0338] The device visually displays daily progress and provides users with appropriate advice and reminders based on feedback from the emotion engine. This allows users to proceed with wedding preparations at a pace that suits their emotions.

[0339] For example, if a user enters "I'm pressed for time" and the emotion engine detects the user's stress, the system will postpone lower-priority tasks and recommend a list of items that can help soothe the user. In this way, the system provides support that is as attentive as possible to the user's emotions and needs.

[0340] The following describes the processing flow.

[0341] Step 1:

[0342] Users log in to the system via their terminal, enter basic information about their wedding preparations (e.g., wedding date, style, budget, etc.), and submit it.

[0343] Step 2:

[0344] The server receives information sent by the user and stores it in a database. Based on this, it generates individual timelines and task lists.

[0345] Step 3:

[0346] On the device, the generated timeline and task list are displayed to the user, showing task details and completion deadlines. The user can set task priorities.

[0347] Step 4:

[0348] The server uses AI algorithms to analyze products and services based on the user's preferences and budget, and creates a recommendation list. The list is immediately displayed on the device.

[0349] Step 5:

[0350] Users operate their devices to view details of the recommendation list and make purchases or reservations. This information is sent to the server as feedback.

[0351] Step 6:

[0352] The emotion engine analyzes the user's input data and behavior to recognize the user's emotional state (e.g., stress, relief). The recognition results are sent to the server.

[0353] Step 7:

[0354] The server automatically adjusts the priority of wedding preparation tasks based on feedback from the emotion engine. For example, if the user is feeling stressed, it will reschedule tasks to reduce the burden.

[0355] Step 8:

[0356] The server updates its list of recommended products and services based on the user's mood, providing them with choices that suit them. The updated information is then displayed on the device again.

[0357] Step 9:

[0358] The server automatically coordinates communication with stakeholders, generating and sending messages to share updated schedules and requirements as needed.

[0359] Step 10:

[0360] The device notifies the user of their progress in real time and reminds them of the next necessary actions. This allows the user to proceed with wedding preparations while reducing stress.

[0361] (Example 2)

[0362] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0363] In today's diverse wedding preparation process, a lack of flexible support tailored to the individual needs and emotional states of users is a challenge. Traditional systems lack effective means of alleviating the stress and anxiety users experience during the preparation process, and the provision of customized experiences is limited. As a result, it is difficult for users to create efficient and stress-free plans that suit their own emotions and circumstances.

[0364] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0365] In this invention, the server includes input means for inputting initial information from the user, means for generating a dynamic schedule and task list based on the input information, and emotion measurement means for analyzing the user's state from their behavior and emotions. This enables the user to receive appropriate schedule management and recommendation information tailored to their emotions.

[0366] An "input means" is a device or mechanism that can receive initial information from a user and record that information in a digital format.

[0367] A "dynamic schedule" is a calendar or plan that can be updated in real time based on user input.

[0368] "A means of generating a task list" refers to a function that lists the necessary tasks and items according to the user's needs and provides them to the user.

[0369] "Means of displaying on a terminal" refers to a function that visualizes the generated information on a display device such as the user's computer or mobile device.

[0370] An "emotion measurement method" is a system that analyzes a user's psychological state from their behavior and input, and infers their emotions.

[0371] An "artificial intelligence model" is a system that uses advanced computational techniques to make optimal recommendations and decisions based on user data.

[0372] "Means of automatically coordinating communications" refers to a function in which the system automatically arranges communication with necessary stakeholders and transmits appropriate information.

[0373] "Monitoring and notification means" refers to a system that tracks the user's progress and notifies them of reminders and important information as needed.

[0374] This invention is a system that provides flexible planning and support that takes into account the user's emotions and needs in order to assist with wedding preparations. The user first accesses the system using a terminal and inputs basic information about the wedding, such as the date of the ceremony, desired style, and budget. The information obtained through the input means is transmitted to a server and recorded in a database.

[0375] The server automatically generates a dynamic schedule and task list based on this information. The generated information is visualized to the user via a terminal. The user can review the displayed task list and set the priority of each task themselves.

[0376] Furthermore, machine learning algorithms are used as a means of measuring emotions, and the user's emotional state is analyzed by analyzing user input data and behavioral logs. Based on this analysis, the artificial intelligence model automatically updates recommendation information and proposes the most suitable products and services according to the user's emotional state.

[0377] Furthermore, by using automated communication coordination methods, the system generates automated messages to ensure that stakeholders are contacted at the appropriate time, thereby supporting smooth communication. Monitoring and notification methods visualize daily progress on the device, providing reminders and advice to help users proceed with preparations efficiently.

[0378] For example, if a user inputs that they are "pressured for time," the emotion measurement system will identify this as stress, and the server will postpone lower-priority tasks and suggest a list of products with relaxing effects. An example of a prompt message would be, "What options should be recommended when a user is feeling stressed?" This input is processed by a generative AI model, which then provides specific suggestions.

[0379] The system provided by this invention enables users to make wedding preparations that are optimized for their own environment and emotions.

[0380] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0381] Step 1:

[0382] Users access the system using a terminal and enter basic information about their wedding preparations. Specifically, users enter the wedding date, desired style, budget, etc., into an input form and press the submit button. The entered information is sent to the server and stored in the database. The input is basic preparation information, and the output is recorded in the database in the correct format.

[0383] Step 2:

[0384] The server generates a dynamic schedule and task list based on user information stored in the database. The server utilizes programmed algorithms to analyze user information and automatically create a timeline and necessary task list. Stored user information is used as input, and the generated timeline and task list are obtained as output.

[0385] Step 3:

[0386] The terminal visualizes and displays the generated schedule and task list to the user. Specifically, a timeline is graphically displayed on the terminal screen, and an interface is provided that allows the user to change the priority of each task by dragging and dropping. The input in this step is the timeline and task list received from the server, and the output is the visual information displayed to the user.

[0387] Step 4:

[0388] The server analyzes the user's emotional state using emotion measurement techniques based on user input data and interaction logs. This analysis utilizes a generative AI model. Specifically, the server infers emotions from the user's operation logs and prompt messages and reports its assessment back to the server. The input is user behavior data, and the output is the analyzed emotional information.

[0389] Step 5:

[0390] The server generates and provides optimal recommendations to the user based on analyzed emotional data. An artificial intelligence model considers the user's emotional state and suggests relaxing products and services. The input is the analysis results, and the output includes recommendations in a visualized format for the user. Specifically, the server generates prompts based on emotional information and selects content to display.

[0391] Step 6:

[0392] To support users in managing their schedules, the device visualizes daily progress using monitoring and notification mechanisms, providing users with reminders and advice. Specifically, a progress bar is displayed on the device, and notifications are sent based on the set schedule. The input is the user's progress data, and the output is notifications that appear as reminders and advice.

[0393] (Application Example 2)

[0394] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0395] In wedding preparations, there is a need to automatically understand users' emotions and stress levels and provide appropriate suggestions and schedule adjustments accordingly. Similarly, in in-store shopping experiences, dynamic suggestions based on user emotions are crucial. While this would allow users to have a more comfortable and satisfying experience, currently, no system exists that effectively achieves this.

[0396] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0397] In this invention, the server includes means for using an emotion analysis engine to analyze the user's emotions and adjust suggestions and tasks based on the analysis results, and means for dynamically presenting product suggestions through a visual display device. This enables flexible and personalized support that responds to the user's emotions.

[0398] "User input information" refers to the basic data used to generate individual time-series plans that users provide to the system.

[0399] A "time-series plan" is a plan for progress management that is generated based on user input information.

[0400] A "task list" is a list of specific tasks and activities organized according to a chronological plan.

[0401] "User information devices" are devices or terminals used by users to input information and check results.

[0402] An "artificial judgment algorithm" is a computational method used to recommend products and services based on user preferences and budget.

[0403] "Related parties" refers to individuals or organizations involved in a user's wedding preparations or shopping activities.

[0404] A "virtual experience" is a technology that uses augmented reality to visualize information that does not actually exist.

[0405] "Memory means" refers to memory or recording devices used to manage and notify users of their progress.

[0406] An "emotion analysis engine" is a technology that analyzes a user's emotions and makes suggestions or adjusts tasks based on the analysis results.

[0407] A "visual display device" is a device that dynamically presents information through a screen or display.

[0408] In a system implementing this invention, the user, server, and user information device work together in coordination.

[0409] The server generates individual time-series plans based on user input information provided by the user. The generated time-series plans are converted into a work list by the server and visually displayed on the user's information device. User information devices include smart glasses and head-mounted displays, and are designed to improve user convenience.

[0410] Furthermore, the server uses artificial intelligence algorithms to recommend appropriate products and services based on the user's preferences and budget. It also automatically coordinates communication with relevant parties and provides visual feedback to the user using augmented reality technology for virtual experiences.

[0411] The server implements an emotion analysis engine that analyzes the user's emotions. Based on this analysis, it optimizes the user experience by making suggestions and adjusting tasks. For example, if the analysis indicates that the user is feeling stressed, the system will offer suggestions that promote relaxation, thereby enhancing the user's comfort.

[0412] For example, when a user is browsing products in a store, if their facial expression is judged to be "happy," the system will suggest similar style products. This prompt would be written as follows: "User's facial expression was judged to be 'happy.' Generate a prompt suggesting similar style products." In this way, the system provides a dynamic and personalized shopping experience.

[0413] Using a generative AI model, appropriate suggestions are automatically generated based on this prompt. To achieve this, software such as EmotionEngineAPI and OpenCV are used in combination with hardware to deliver high-quality support that responds to the user's emotions.

[0414] In this way, the system provides an integrated solution to improve the user's experience when preparing for or shopping for their wedding.

[0415] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0416] Step 1:

[0417] The server receives input information from the user and generates an individual time-series plan based on it. This input information includes basic information about wedding preparations and desired dates. The server optimizes the time-series plan by referring to past patterns and user history data stored in the database. As output, a plan is generated to efficiently carry out the user's activities.

[0418] Step 2:

[0419] The terminal displays a list of tasks sent from the server to the user. The user sets the priority of the displayed tasks via the terminal. This input allows the terminal to visually manage tasks using its interface. As output, the task list, reflecting the priorities, is updated in real time.

[0420] Step 3:

[0421] The server uses artificial intelligence algorithms to recommend products and services tailored to the user's preferences and budget. Inputs include the user's past purchase history and budget limits. Through data analysis, the server generates the most suitable recommendation list for the user and sends it to the terminal.

[0422] Step 4:

[0423] The server activates an emotion analysis engine to analyze the user's emotions and understand their emotional state in real time. Camera video and audio data are used as input. The EmotionEngine API is used to perform emotion analysis and evaluate the user's stress level, etc. As output, suggestions are adjusted according to the emotion.

[0424] Step 5:

[0425] The terminal dynamically presents product suggestions through a visual display. At this time, it feeds prompt text based on the user's emotional state to a generating AI model, which then suggests appropriate products and services. The input is the result of emotion analysis, and the output is visual information presented to the user. Specifically, if the user's emotion towards a particular product is determined to be "happy," additional recommendations related to that product will be displayed.

[0426] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0427] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0428] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0429] [Third Embodiment]

[0430] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0431] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0432] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0433] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0434] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0435] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0436] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0437] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0438] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0439] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0440] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0441] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0442] This invention aims to create a system that efficiently manages and supports wedding preparations by facilitating interaction between users, servers, and terminals. The system aims to reduce the burden on users by providing multiple functions in an integrated manner.

[0443] First, the user accesses the system using a terminal, creates an account, and enters basic information about their marriage. This information includes the wedding date, desired style, and budget. This information is sent to the server and securely stored in a database.

[0444] Based on the received user information, the server generates a timeline of tasks necessary for wedding preparations. This timeline combines a general wedding preparation schedule with the user's individual needs. The generated timeline, along with the recommended completion deadline for each task, is displayed on the device. The user can adjust this task schedule according to their preferences.

[0445] Next, the server utilizes AI algorithms to recommend the most suitable products and services to the user based on the input information. This includes furniture, home appliances, clothing, and wedding venue services. On the device, the user can review these recommendations, click on items of interest to view details, and proceed with the purchase.

[0446] Furthermore, the server includes communication functions to manage contact with stakeholders such as wedding venues and service providers. The system provides automatically generated email templates and messages to enable users to communicate smoothly with stakeholders and exchange necessary information.

[0447] Regarding costume selection, the server can utilize augmented reality technology to provide users with a virtual try-on experience. This feature allows users to visually check whether an outfit suits them before actually trying it on.

[0448] Furthermore, the server tracks the user's task progress in real time and notifies the device of the next steps to take or things that need to be checked. The reminder function allows users to keep track of incomplete tasks and important deadlines, enabling them to plan and prepare systematically.

[0449] For example, if a user desires a modern-style wedding but also wants to incorporate Japanese elements, the system will suggest venue options and designs that match their requests and incorporate the necessary tasks into a timeline. In this way, the system supports efficient wedding preparations that reflect the user's individual needs.

[0450] The following describes the processing flow.

[0451] Step 1:

[0452] The user creates an account using their device and logs in. After logging in, they enter basic information about their marriage (e.g., wedding date, desired style, budget, etc.) and submit it to the system.

[0453] Step 2:

[0454] The server receives information sent by the user and securely stores it in a database. Based on the stored information, it creates an individual wedding preparation timeline.

[0455] Step 3:

[0456] The server generates a timeline which is then displayed on the user's device, allowing them to view details and recommended completion deadlines for each task. Users can then use this information to prioritize their tasks.

[0457] Step 4:

[0458] The server uses an AI algorithm to generate a list of recommended products and services based on the user's input. This list is tailored to the user's preferences and budget.

[0459] Step 5:

[0460] On the device, users can view details of recommended products and services and, if necessary, proceed with the purchase.

[0461] Step 6:

[0462] The server manages communication and coordination with stakeholders such as wedding venues and service providers. When necessary, it automatically generates email templates and messages to facilitate communication.

[0463] Step 7:

[0464] The server uses augmented reality technology to provide users with a virtual try-on experience. Users can view a virtual fitting of the selected outfit on their device.

[0465] Step 8:

[0466] The server tracks progress and sends reminders and important notifications to the user's device. This makes it easier for users to manage incomplete tasks and next steps.

[0467] (Example 1)

[0468] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0469] Traditional wedding planning systems had problems such as being unable to efficiently create plans and suggest products and services tailored to individual user needs, and coordinating with stakeholders, resulting in a significant burden on users. Furthermore, insufficient progress management led to missed deadlines, and inconveniences during fittings negatively impacted the user experience. There was a need for a system that could solve these problems and allow users to proceed with wedding preparations efficiently and systematically.

[0470] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0471] In this invention, the server includes means for generating individual schedules based on user input information, intelligent algorithm means for recommending goods and services based on the user's preferences and financial plan, and means for automatically coordinating communication with relevant organizations. This reduces the burden on the user and enables efficient wedding preparations that meet diverse needs.

[0472] "User input information" refers to basic data and requests related to marriage that users enter when using the system.

[0473] A "planned timetable" is a schedule of tasks necessary for a user's wedding preparations, and is generated according to the user's individual needs.

[0474] A "task list" is a list that enumerates the specific tasks that the user should perform, based on the planned time schedule.

[0475] A "user information processing device" is a terminal device that allows users to access a system and input information or confirm presented data.

[0476] An "intelligent algorithm" is an artificial intelligence technology used in systems to recommend the most suitable products and services based on user preferences and budget.

[0477] "Related organizations" refers to businesses and service providers that offer services related to weddings, and who users need to contact during their wedding preparations.

[0478] "Automatic communication coordination" refers to a feature where the system automatically generates email templates and messages to facilitate smooth communication between users and relevant parties.

[0479] "Virtual try-on" is a feature that uses augmented reality technology to allow users to virtually try on the clothes they want to wear.

[0480] Augmented reality technology is a technique that overlays virtual information onto real-world images and videos, and is used in applications such as virtual try-ons.

[0481] A "recall mechanism" is a function that tracks the user's task progress and notifies the user of incomplete tasks and the next actions to take.

[0482] An "artificial intelligence model" refers to a trained algorithm or computer program used to generate optimal suggestions for a user in response to a specific prompt.

[0483] A "prompt statement" is a command or instruction statement entered into a system to indicate the user's request or intention.

[0484] This invention is a system for efficiently managing wedding preparations, and is designed around the interaction between users, servers, and terminals.

[0485] Users access the system using a terminal and enter basic information about their marriage (e.g., wedding date, style, budget, etc.). This data entry is performed through an intuitive interface designed to prevent errors with guidance.

[0486] The server receives information sent by the user and securely stores it in a database. Based on this information, the server utilizes AI algorithms to generate a personalized schedule tailored to the user's needs. Furthermore, the server has the ability to recommend optimal products and services based on the user's preferences and budget. This recommendation uses a generative AI model, and the following prompt is an example: "I would like a modern-style wedding incorporating Japanese elements. Please suggest the best venue options."

[0487] The terminal receives information transmitted from the server and displays it to the user. This includes generated schedules and lists of recommended products and services. Users can use this information to review and adjust detailed plans, and to make purchases or reservations. Furthermore, by using a terminal equipped with augmented reality technology, users can virtually try on clothes and visually experience the process of choosing outfits.

[0488] This system supports users in efficiently and systematically preparing for their wedding, simplifying progress management and communication with relevant organizations. The goal is to reduce the burden on users during wedding preparations.

[0489] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0490] Step 1:

[0491] Users access the system using a terminal, create an account, and enter basic information about their marriage. This information includes the wedding date, style, and budget. The entered information is sent from the terminal to the server. Based on the entered data, the terminal provides an interface, allowing users to easily enter the necessary information.

[0492] Step 2:

[0493] The server receives information sent by the user and securely stores it in a database. Based on the stored information, the server uses an AI algorithm to generate a personalized timetable for the user. This process involves data processing such as "prioritizing tasks" and "building work timelines," and setting recommended deadlines for individual tasks. The generated timetable is then sent to the terminal.

[0494] Step 3:

[0495] The terminal displays the scheduled timetable received from the server to the user. The user reviews the displayed scheduled timetable and adjusts the task schedule as needed. The user's adjustment operations are intuitive through a user-friendly UI, and the adjusted data is sent back to the server.

[0496] Step 4:

[0497] The server uses a generative AI model to recommend suitable products and services based on the user's preferences and budget. The server uses prompts to generate the AI ​​model's optimal output for the user's request (e.g., "a modern wedding with Japanese elements"). This recommendation information is then sent to the terminal.

[0498] Step 5:

[0499] The terminal displays a list of recommended products and services sent from the server, assisting users in viewing detailed information and making purchases or reservations. When a user selects a specific item, its details are displayed on the terminal, and the selection is sent to the server for progress tracking.

[0500] Step 6:

[0501] The server utilizes augmented reality technology to allow users to virtually try on clothes when selecting them. The server processes the user's selection data and sends 3D models for the virtual try-on to the device. The device then uses its camera function to overlay the 3D models onto the user's photograph.

[0502] Step 7:

[0503] The server tracks user progress in real time and notifies the device of task completion status and next steps. Notifications output through the reminder function help users not miss important deadlines, and continuous information updates and data transmission are performed.

[0504] (Application Example 1)

[0505] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0506] In wedding preparations, there is a need for systems that efficiently manage the process while meeting the individual needs of each user. However, many current systems specialize in a single function, making it difficult for users to manage the diverse preparation tasks. In particular, there is a lack of integrated systems that combine the experience of choosing attire in physical stores with efficient online preparation management. As a result, it is difficult for users to proceed with the entire preparation process smoothly and without burden.

[0507] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0508] This invention includes a server that generates individual time series based on user input information, a device that displays work instructions based on the generated time series on a user terminal, and a method for providing a virtual try-on experience using a visual device at a sales location. This allows users to efficiently proceed with wedding preparations while easily selecting outfits through virtual try-ons at physical stores.

[0509] "User input information" refers to basic information related to wedding preparations, and is data that the user provides to the system.

[0510] "Timeline" refers to the order and timing of tasks planned for wedding preparations.

[0511] A "work instruction" is a list of specific tasks and activities that the user should perform in preparation for their wedding.

[0512] A "user terminal" is an electronic device used by a user for wedding preparations, and its role is to receive and display information from the system.

[0513] A "sales outlet" is a physical location, such as a retail store or event space, where users can directly view and purchase products or services.

[0514] A "visual device" is a device used by users to have a virtual try-on experience, and it is equipped with technology to present information visually.

[0515] A "virtual try-on experience" is a feature that uses augmented reality technology to simulate trying on clothes, allowing users to visually check the options before actually trying them on.

[0516] To implement this invention, a system utilizing the cooperation between a server, a terminal, and a user is required. First, the user logs into the system using a terminal and enters the information necessary for wedding preparations. This information includes, for example, the wedding date, desired wedding style, and budget. This data is transmitted to the server and stored securely.

[0517] The server generates individual timelines (schedules) based on the user input information received. These timelines serve as a means of planning the tasks necessary for wedding preparations, and the generated work instructions are displayed on the user's terminal. This allows the user to check the schedule and priority of each task and proceed with preparations efficiently.

[0518] Furthermore, at sales locations, users can experience virtual try-on using visual devices. This feature utilizes augmented reality technology, allowing users to virtually try on selected clothing through devices such as smart glasses or head-mounted displays. This enables users to try on multiple outfits without visiting a physical store.

[0519] For example, if a user plans a "casual elegance" wedding and has a limited budget, the server will automatically select suitable clothing and accessories and present them as options for virtual try-on. This allows the user to easily select their outfit.

[0520] An example of a prompt using a generative AI model is: "The user is trying on a casual elegance dress while wearing smart glasses. Please describe in detail how it will look on them."

[0521] This system allows users to plan their preparations carefully while reducing the time and cost associated with actually trying on clothes.

[0522] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0523] Step 1:

[0524] Users log in to the system using their devices and enter the information necessary for wedding preparations. This information includes the wedding date, theme, and budget. This allows users to input personal data related to their wedding preparations and send it to the server.

[0525] Step 2:

[0526] The server receives information sent by the user and stores it in a database. Next, it generates a personalized timeline (schedule) tailored to the user's needs. Based on the input data, it customizes a general wedding preparation schedule and creates a user-specific task list.

[0527] Step 3:

[0528] The server sends the generated timeline to the terminal and displays work instructions on the user's screen. The user can review this schedule and reset priorities as needed. This allows the user to efficiently prepare while monitoring the progress of tasks.

[0529] Step 4:

[0530] Users virtually try on clothes at the sales location using a visual device. The terminal acquires data on the clothing selected by the user and transmits it to the visual device. The visual device uses augmented reality technology to virtually display the selected clothing in the user's field of view. This allows users to virtually try on different clothing and make visual confirmations without actually trying them on.

[0531] Step 5:

[0532] After the user tries on the product, feedback generated by the visual device is sent to the server. Based on this data, the server further analyzes the user's preferences and uses a generative AI model to recommend the most suitable products and services, improving the accuracy of future recommendations.

[0533] This processing flow allows users to comprehensively prepare for their wedding through the system and efficiently utilize the preparations for the evening reception and ceremony.

[0534] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0535] This invention incorporates an emotion engine that recognizes the user's emotions into a system that effectively supports wedding preparations, thereby providing flexible support tailored to the user's situation and emotional state. In this system, the user, terminal, and server work together to dynamically manage and provide information.

[0536] First, the user accesses the system via a terminal and enters basic information about their wedding preparations. This initial information includes the wedding date, desired style, and budget. This information is sent to the server and stored in the database.

[0537] The server generates a timeline and task list based on user information and displays them on the device. Users can set the priority of each task themselves. The system also uses AI algorithms to recommend products and services based on the user's preferences and budget.

[0538] The emotion engine analyzes user emotions from input data and behavior, and plays a role in adjusting the progress and suggestions of wedding preparations according to changes in emotions. For example, if the system determines that the user is feeling stressed, it will recommend more relaxing options.

[0539] Furthermore, the server automatically reprioritizes tasks and updates recommended product lists based on the user's emotional state. It also coordinates communication with stakeholders and automatically generates and sends messages as needed.

[0540] The device visually displays daily progress and provides users with appropriate advice and reminders based on feedback from the emotion engine. This allows users to proceed with wedding preparations at a pace that suits their emotions.

[0541] For example, if a user enters "I'm pressed for time" and the emotion engine detects the user's stress, the system will postpone lower-priority tasks and recommend a list of items that can help soothe the user. In this way, the system provides support that is as attentive as possible to the user's emotions and needs.

[0542] The following describes the processing flow.

[0543] Step 1:

[0544] Users log in to the system via their terminal, enter basic information about their wedding preparations (e.g., wedding date, style, budget, etc.), and submit it.

[0545] Step 2:

[0546] The server receives information sent by the user and stores it in a database. Based on this, it generates individual timelines and task lists.

[0547] Step 3:

[0548] On the device, the generated timeline and task list are displayed to the user, showing task details and completion deadlines. The user can set task priorities.

[0549] Step 4:

[0550] The server uses AI algorithms to analyze products and services based on the user's preferences and budget, and creates a recommendation list. The list is immediately displayed on the device.

[0551] Step 5:

[0552] Users operate their devices to view details of the recommendation list and make purchases or reservations. This information is sent to the server as feedback.

[0553] Step 6:

[0554] The emotion engine analyzes the user's input data and behavior to recognize the user's emotional state (e.g., stress, relief). The recognition results are sent to the server.

[0555] Step 7:

[0556] The server automatically adjusts the priority of wedding preparation tasks based on feedback from the emotion engine. For example, if the user is feeling stressed, it will reschedule tasks to reduce the burden.

[0557] Step 8:

[0558] The server updates its list of recommended products and services based on the user's mood, providing them with choices that suit them. The updated information is then displayed on the device again.

[0559] Step 9:

[0560] The server automatically coordinates communication with stakeholders, generating and sending messages to share updated schedules and requirements as needed.

[0561] Step 10:

[0562] The device notifies the user of their progress in real time and reminds them of the next necessary actions. This allows the user to proceed with wedding preparations while reducing stress.

[0563] (Example 2)

[0564] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0565] In today's diverse wedding preparation process, a lack of flexible support tailored to the individual needs and emotional states of users is a challenge. Traditional systems lack effective means of alleviating the stress and anxiety users experience during the preparation process, and the provision of customized experiences is limited. As a result, it is difficult for users to create efficient and stress-free plans that suit their own emotions and circumstances.

[0566] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0567] In this invention, the server includes input means for inputting initial information from the user, means for generating a dynamic schedule and task list based on the input information, and emotion measurement means for analyzing the user's state from their behavior and emotions. This enables the user to receive appropriate schedule management and recommendation information tailored to their emotions.

[0568] An "input means" is a device or mechanism that can receive initial information from a user and record that information in a digital format.

[0569] A "dynamic schedule" is a calendar or plan that can be updated in real time based on user input.

[0570] "A means of generating a task list" refers to a function that lists the necessary tasks and items according to the user's needs and provides them to the user.

[0571] "Means of displaying on a terminal" refers to a function that visualizes the generated information on a display device such as the user's computer or mobile device.

[0572] An "emotion measurement method" is a system that analyzes a user's psychological state from their behavior and input, and infers their emotions.

[0573] An "artificial intelligence model" is a system that uses advanced computational techniques to make optimal recommendations and decisions based on user data.

[0574] "Means of automatically coordinating communications" refers to a function in which the system automatically arranges communication with necessary stakeholders and transmits appropriate information.

[0575] "Monitoring and notification means" refers to a system that tracks the user's progress and notifies them of reminders and important information as needed.

[0576] This invention is a system that provides flexible planning and support that takes into account the user's emotions and needs in order to assist with wedding preparations. The user first accesses the system using a terminal and inputs basic information about the wedding, such as the date of the ceremony, desired style, and budget. The information obtained through the input means is transmitted to a server and recorded in a database.

[0577] The server automatically generates a dynamic schedule and task list based on this information. The generated information is visualized to the user via a terminal. The user can review the displayed task list and set the priority of each task themselves.

[0578] Furthermore, machine learning algorithms are used as a means of measuring emotions, and the user's emotional state is analyzed by analyzing user input data and behavioral logs. Based on this analysis, the artificial intelligence model automatically updates recommendation information and proposes the most suitable products and services according to the user's emotional state.

[0579] Furthermore, by using automated communication coordination methods, the system generates automated messages to ensure that stakeholders are contacted at the appropriate time, thereby supporting smooth communication. Monitoring and notification methods visualize daily progress on the device, providing reminders and advice to help users proceed with preparations efficiently.

[0580] For example, if a user inputs that they are "pressured for time," the emotion measurement system will identify this as stress, and the server will postpone lower-priority tasks and suggest a list of products with relaxing effects. An example of a prompt message would be, "What options should be recommended when a user is feeling stressed?" This input is processed by a generative AI model, which then provides specific suggestions.

[0581] The system provided by this invention enables users to make wedding preparations that are optimized for their own environment and emotions.

[0582] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0583] Step 1:

[0584] Users access the system using a terminal and enter basic information about their wedding preparations. Specifically, users enter the wedding date, desired style, budget, etc., into an input form and press the submit button. The entered information is sent to the server and stored in the database. The input is basic preparation information, and the output is recorded in the database in the correct format.

[0585] Step 2:

[0586] The server generates a dynamic schedule and task list based on user information stored in the database. The server utilizes programmed algorithms to analyze user information and automatically create a timeline and necessary task list. Stored user information is used as input, and the generated timeline and task list are obtained as output.

[0587] Step 3:

[0588] The terminal visualizes and displays the generated schedule and task list to the user. Specifically, a timeline is graphically displayed on the terminal screen, and an interface is provided that allows the user to change the priority of each task by dragging and dropping. The input in this step is the timeline and task list received from the server, and the output is the visual information displayed to the user.

[0589] Step 4:

[0590] The server analyzes the user's emotional state using emotion measurement techniques based on user input data and interaction logs. This analysis utilizes a generative AI model. Specifically, the server infers emotions from the user's operation logs and prompt messages and reports its assessment back to the server. The input is user behavior data, and the output is the analyzed emotional information.

[0591] Step 5:

[0592] The server generates and provides optimal recommendations to the user based on analyzed emotional data. An artificial intelligence model considers the user's emotional state and suggests relaxing products and services. The input is the analysis results, and the output includes recommendations in a visualized format for the user. Specifically, the server generates prompts based on emotional information and selects content to display.

[0593] Step 6:

[0594] To support users in managing their schedules, the device visualizes daily progress using monitoring and notification mechanisms, providing users with reminders and advice. Specifically, a progress bar is displayed on the device, and notifications are sent based on the set schedule. The input is the user's progress data, and the output is notifications that appear as reminders and advice.

[0595] (Application Example 2)

[0596] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0597] In wedding preparations, there is a need to automatically understand users' emotions and stress levels and provide appropriate suggestions and schedule adjustments accordingly. Similarly, in in-store shopping experiences, dynamic suggestions based on user emotions are crucial. While this would allow users to have a more comfortable and satisfying experience, currently, no system exists that effectively achieves this.

[0598] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0599] In this invention, the server includes means for using an emotion analysis engine to analyze the user's emotions and adjust suggestions and tasks based on the analysis results, and means for dynamically presenting product suggestions through a visual display device. This enables flexible and personalized support that responds to the user's emotions.

[0600] "User input information" refers to the basic data used to generate individual time-series plans that users provide to the system.

[0601] A "time-series plan" is a plan for progress management that is generated based on user input information.

[0602] A "task list" is a list of specific tasks and activities organized according to a chronological plan.

[0603] "User information devices" are devices or terminals used by users to input information and check results.

[0604] An "artificial judgment algorithm" is a computational method used to recommend products and services based on user preferences and budget.

[0605] "Related parties" refers to individuals or organizations involved in a user's wedding preparations or shopping activities.

[0606] A "virtual experience" is a technology that uses augmented reality to visualize information that does not actually exist.

[0607] "Memory means" refers to memory or recording devices used to manage and notify users of their progress.

[0608] An "emotion analysis engine" is a technology that analyzes a user's emotions and makes suggestions or adjusts tasks based on the analysis results.

[0609] A "visual display device" is a device that dynamically presents information through a screen or display.

[0610] In a system implementing this invention, the user, server, and user information device work together in coordination.

[0611] The server generates individual time-series plans based on user input information provided by the user. The generated time-series plans are converted into a work list by the server and visually displayed on the user's information device. User information devices include smart glasses and head-mounted displays, and are designed to improve user convenience.

[0612] Furthermore, the server uses artificial intelligence algorithms to recommend appropriate products and services based on the user's preferences and budget. It also automatically coordinates communication with relevant parties and provides visual feedback to the user using augmented reality technology for virtual experiences.

[0613] The server implements an emotion analysis engine that analyzes the user's emotions. Based on this analysis, it optimizes the user experience by making suggestions and adjusting tasks. For example, if the analysis indicates that the user is feeling stressed, the system will offer suggestions that promote relaxation, thereby enhancing the user's comfort.

[0614] For example, when a user is browsing products in a store, if their facial expression is judged to be "happy," the system will suggest similar style products. This prompt would be written as follows: "User's facial expression was judged to be 'happy.' Generate a prompt suggesting similar style products." In this way, the system provides a dynamic and personalized shopping experience.

[0615] Using a generative AI model, appropriate suggestions are automatically generated based on this prompt. To achieve this, software such as EmotionEngineAPI and OpenCV are used in combination with hardware to deliver high-quality support that responds to the user's emotions.

[0616] In this way, the system provides an integrated solution to improve the user's experience when preparing for or shopping for their wedding.

[0617] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0618] Step 1:

[0619] The server receives input information from the user and generates an individual time-series plan based on it. This input information includes basic information about wedding preparations and desired dates. The server optimizes the time-series plan by referring to past patterns and user history data stored in the database. As output, a plan is generated to efficiently carry out the user's activities.

[0620] Step 2:

[0621] The terminal displays a list of tasks sent from the server to the user. The user sets the priority of the displayed tasks via the terminal. This input allows the terminal to visually manage tasks using its interface. As output, the task list, reflecting the priorities, is updated in real time.

[0622] Step 3:

[0623] The server uses artificial intelligence algorithms to recommend products and services tailored to the user's preferences and budget. Inputs include the user's past purchase history and budget limits. Through data analysis, the server generates the most suitable recommendation list for the user and sends it to the terminal.

[0624] Step 4:

[0625] The server activates an emotion analysis engine to analyze the user's emotions and understand their emotional state in real time. Camera video and audio data are used as input. The EmotionEngine API is used to perform emotion analysis and evaluate the user's stress level, etc. As output, suggestions are adjusted according to the emotion.

[0626] Step 5:

[0627] The terminal dynamically presents product suggestions through a visual display. At this time, it feeds prompt text based on the user's emotional state to a generating AI model, which then suggests appropriate products and services. The input is the result of emotion analysis, and the output is visual information presented to the user. Specifically, if the user's emotion towards a particular product is determined to be "happy," additional recommendations related to that product will be displayed.

[0628] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0629] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0630] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0631] [Fourth Embodiment]

[0632] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0633] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0634] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0635] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0636] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0637] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0638] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0639] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0640] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0641] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0642] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0643] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0644] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0645] This invention aims to create a system that efficiently manages and supports wedding preparations by facilitating interaction between users, servers, and terminals. The system aims to reduce the burden on users by providing multiple functions in an integrated manner.

[0646] First, the user accesses the system using a terminal, creates an account, and enters basic information about their marriage. This information includes the wedding date, desired style, and budget. This information is sent to the server and securely stored in a database.

[0647] Based on the received user information, the server generates a timeline of tasks necessary for wedding preparations. This timeline combines a general wedding preparation schedule with the user's individual needs. The generated timeline, along with the recommended completion deadline for each task, is displayed on the device. The user can adjust this task schedule according to their preferences.

[0648] Next, the server utilizes AI algorithms to recommend the most suitable products and services to the user based on the input information. This includes furniture, home appliances, clothing, and wedding venue services. On the device, the user can review these recommendations, click on items of interest to view details, and proceed with the purchase.

[0649] Furthermore, the server includes communication functions to manage contact with stakeholders such as wedding venues and service providers. The system provides automatically generated email templates and messages to enable users to communicate smoothly with stakeholders and exchange necessary information.

[0650] Regarding costume selection, the server can utilize augmented reality technology to provide users with a virtual try-on experience. This feature allows users to visually check whether an outfit suits them before actually trying it on.

[0651] Furthermore, the server tracks the user's task progress in real time and notifies the device of the next steps to take or things that need to be checked. The reminder function allows users to keep track of incomplete tasks and important deadlines, enabling them to plan and prepare systematically.

[0652] For example, if a user desires a modern-style wedding but also wants to incorporate Japanese elements, the system will suggest venue options and designs that match their requests and incorporate the necessary tasks into a timeline. In this way, the system supports efficient wedding preparations that reflect the user's individual needs.

[0653] The following describes the processing flow.

[0654] Step 1:

[0655] The user creates an account using their device and logs in. After logging in, they enter basic information about their marriage (e.g., wedding date, desired style, budget, etc.) and submit it to the system.

[0656] Step 2:

[0657] The server receives information sent by the user and securely stores it in a database. Based on the stored information, it creates an individual wedding preparation timeline.

[0658] Step 3:

[0659] The server generates a timeline which is then displayed on the user's device, allowing them to view details and recommended completion deadlines for each task. Users can then use this information to prioritize their tasks.

[0660] Step 4:

[0661] The server uses an AI algorithm to generate a list of recommended products and services based on the user's input. This list is tailored to the user's preferences and budget.

[0662] Step 5:

[0663] On the device, users can view details of recommended products and services and, if necessary, proceed with the purchase.

[0664] Step 6:

[0665] The server manages communication and coordination with stakeholders such as wedding venues and service providers. When necessary, it automatically generates email templates and messages to facilitate communication.

[0666] Step 7:

[0667] The server uses augmented reality technology to provide users with a virtual try-on experience. Users can view a virtual fitting of the selected outfit on their device.

[0668] Step 8:

[0669] The server tracks progress and sends reminders and important notifications to the user's device. This makes it easier for users to manage incomplete tasks and next steps.

[0670] (Example 1)

[0671] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0672] Traditional wedding planning systems had problems such as being unable to efficiently create plans and suggest products and services tailored to individual user needs, and coordinating with stakeholders, resulting in a significant burden on users. Furthermore, insufficient progress management led to missed deadlines, and inconveniences during fittings negatively impacted the user experience. There was a need for a system that could solve these problems and allow users to proceed with wedding preparations efficiently and systematically.

[0673] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0674] In this invention, the server includes means for generating individual schedules based on user input information, intelligent algorithm means for recommending goods and services based on the user's preferences and financial plan, and means for automatically coordinating communication with relevant organizations. This reduces the burden on the user and enables efficient wedding preparations that meet diverse needs.

[0675] "User input information" refers to basic data and requests related to marriage that users enter when using the system.

[0676] A "planned timetable" is a schedule of tasks necessary for a user's wedding preparations, and is generated according to the user's individual needs.

[0677] A "task list" is a list that enumerates the specific tasks that the user should perform, based on the planned time schedule.

[0678] A "user information processing device" is a terminal device that allows users to access a system and input information or confirm presented data.

[0679] An "intelligent algorithm" is an artificial intelligence technology used in systems to recommend the most suitable products and services based on user preferences and budget.

[0680] "Related organizations" refers to businesses and service providers that offer services related to weddings, and who users need to contact during their wedding preparations.

[0681] "Automatic communication coordination" refers to a feature where the system automatically generates email templates and messages to facilitate smooth communication between users and relevant parties.

[0682] "Virtual try-on" is a feature that uses augmented reality technology to allow users to virtually try on the clothes they want to wear.

[0683] Augmented reality technology is a technique that overlays virtual information onto real-world images and videos, and is used in applications such as virtual try-ons.

[0684] A "recall mechanism" is a function that tracks the user's task progress and notifies the user of incomplete tasks and the next actions to take.

[0685] An "artificial intelligence model" refers to a trained algorithm or computer program used to generate optimal suggestions for a user in response to a specific prompt.

[0686] A "prompt statement" is a command or instruction statement entered into a system to indicate the user's request or intention.

[0687] This invention is a system for efficiently managing wedding preparations, and is designed around the interaction between users, servers, and terminals.

[0688] Users access the system using a terminal and enter basic information about their marriage (e.g., wedding date, style, budget, etc.). This data entry is performed through an intuitive interface designed to prevent errors with guidance.

[0689] The server receives information sent by the user and securely stores it in a database. Based on this information, the server utilizes AI algorithms to generate a personalized schedule tailored to the user's needs. Furthermore, the server has the ability to recommend optimal products and services based on the user's preferences and budget. This recommendation uses a generative AI model, and the following prompt is an example: "I would like a modern-style wedding incorporating Japanese elements. Please suggest the best venue options."

[0690] The terminal receives information transmitted from the server and displays it to the user. This includes generated schedules and lists of recommended products and services. Users can use this information to review and adjust detailed plans, and to make purchases or reservations. Furthermore, by using a terminal equipped with augmented reality technology, users can virtually try on clothes and visually experience the process of choosing outfits.

[0691] This system supports users in efficiently and systematically preparing for their wedding, simplifying progress management and communication with relevant organizations. The goal is to reduce the burden on users during wedding preparations.

[0692] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0693] Step 1:

[0694] Users access the system using a terminal, create an account, and enter basic information about their marriage. This information includes the wedding date, style, and budget. The entered information is sent from the terminal to the server. Based on the entered data, the terminal provides an interface, allowing users to easily enter the necessary information.

[0695] Step 2:

[0696] The server receives information sent by the user and securely stores it in a database. Based on the stored information, the server uses an AI algorithm to generate a personalized timetable for the user. This process involves data processing such as "prioritizing tasks" and "building work timelines," and setting recommended deadlines for individual tasks. The generated timetable is then sent to the terminal.

[0697] Step 3:

[0698] The terminal displays the scheduled timetable received from the server to the user. The user reviews the displayed scheduled timetable and adjusts the task schedule as needed. The user's adjustment operations are intuitive through a user-friendly UI, and the adjusted data is sent back to the server.

[0699] Step 4:

[0700] The server uses a generative AI model to recommend suitable products and services based on the user's preferences and budget. The server uses prompts to generate the AI ​​model's optimal output for the user's request (e.g., "a modern wedding with Japanese elements"). This recommendation information is then sent to the terminal.

[0701] Step 5:

[0702] The terminal displays a list of recommended products and services sent from the server, assisting users in viewing detailed information and making purchases or reservations. When a user selects a specific item, its details are displayed on the terminal, and the selection is sent to the server for progress tracking.

[0703] Step 6:

[0704] The server utilizes augmented reality technology to allow users to virtually try on clothes when selecting them. The server processes the user's selection data and sends 3D models for the virtual try-on to the device. The device then uses its camera function to overlay the 3D models onto the user's photograph.

[0705] Step 7:

[0706] The server tracks user progress in real time and notifies the device of task completion status and next steps. Notifications output through the reminder function help users not miss important deadlines, and continuous information updates and data transmission are performed.

[0707] (Application Example 1)

[0708] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0709] In wedding preparations, there is a need for systems that efficiently manage the process while meeting the individual needs of each user. However, many current systems specialize in a single function, making it difficult for users to manage the diverse preparation tasks. In particular, there is a lack of integrated systems that combine the experience of choosing attire in physical stores with efficient online preparation management. As a result, it is difficult for users to proceed with the entire preparation process smoothly and without burden.

[0710] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0711] This invention includes a server that generates individual time series based on user input information, a device that displays work instructions based on the generated time series on a user terminal, and a method for providing a virtual try-on experience using a visual device at a sales location. This allows users to efficiently proceed with wedding preparations while easily selecting outfits through virtual try-ons at physical stores.

[0712] "User input information" refers to basic information related to wedding preparations, and is data that the user provides to the system.

[0713] "Timeline" refers to the order and timing of tasks planned for wedding preparations.

[0714] A "work instruction" is a list of specific tasks and activities that the user should perform in preparation for their wedding.

[0715] A "user terminal" is an electronic device used by a user for wedding preparations, and its role is to receive and display information from the system.

[0716] A "sales outlet" is a physical location, such as a retail store or event space, where users can directly view and purchase products or services.

[0717] A "visual device" is a device used by users to have a virtual try-on experience, and it is equipped with technology to present information visually.

[0718] A "virtual try-on experience" is a feature that uses augmented reality technology to simulate trying on clothes, allowing users to visually check the options before actually trying them on.

[0719] To implement this invention, a system utilizing the cooperation between a server, a terminal, and a user is required. First, the user logs into the system using a terminal and enters the information necessary for wedding preparations. This information includes, for example, the wedding date, desired wedding style, and budget. This data is transmitted to the server and stored securely.

[0720] The server generates individual timelines (schedules) based on the user input information received. These timelines serve as a means of planning the tasks necessary for wedding preparations, and the generated work instructions are displayed on the user's terminal. This allows the user to check the schedule and priority of each task and proceed with preparations efficiently.

[0721] Furthermore, at sales locations, users can experience virtual try-on using visual devices. This feature utilizes augmented reality technology, allowing users to virtually try on selected clothing through devices such as smart glasses or head-mounted displays. This enables users to try on multiple outfits without visiting a physical store.

[0722] For example, if a user plans a "casual elegance" wedding and has a limited budget, the server will automatically select suitable clothing and accessories and present them as options for virtual try-on. This allows the user to easily select their outfit.

[0723] An example of a prompt using a generative AI model is: "The user is trying on a casual elegance dress while wearing smart glasses. Please describe in detail how it will look on them."

[0724] This system allows users to plan their preparations carefully while reducing the time and cost associated with actually trying on clothes.

[0725] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0726] Step 1:

[0727] Users log in to the system using their devices and enter the information necessary for wedding preparations. This information includes the wedding date, theme, and budget. This allows users to input personal data related to their wedding preparations and send it to the server.

[0728] Step 2:

[0729] The server receives information sent by the user and stores it in a database. Next, it generates a personalized timeline (schedule) tailored to the user's needs. Based on the input data, it customizes a general wedding preparation schedule and creates a user-specific task list.

[0730] Step 3:

[0731] The server sends the generated timeline to the terminal and displays work instructions on the user's screen. The user can review this schedule and reset priorities as needed. This allows the user to efficiently prepare while monitoring the progress of tasks.

[0732] Step 4:

[0733] Users virtually try on clothes at the sales location using a visual device. The terminal acquires data on the clothing selected by the user and transmits it to the visual device. The visual device uses augmented reality technology to virtually display the selected clothing in the user's field of view. This allows users to virtually try on different clothing and make visual confirmations without actually trying them on.

[0734] Step 5:

[0735] After the user tries on the product, feedback generated by the visual device is sent to the server. Based on this data, the server further analyzes the user's preferences and uses a generative AI model to recommend the most suitable products and services, improving the accuracy of future recommendations.

[0736] This processing flow allows users to comprehensively prepare for their wedding through the system and efficiently utilize the preparations for the evening reception and ceremony.

[0737] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0738] This invention incorporates an emotion engine that recognizes the user's emotions into a system that effectively supports wedding preparations, thereby providing flexible support tailored to the user's situation and emotional state. In this system, the user, terminal, and server work together to dynamically manage and provide information.

[0739] First, the user accesses the system via a terminal and enters basic information about their wedding preparations. This initial information includes the wedding date, desired style, and budget. This information is sent to the server and stored in the database.

[0740] The server generates a timeline and task list based on user information and displays them on the device. Users can set the priority of each task themselves. The system also uses AI algorithms to recommend products and services based on the user's preferences and budget.

[0741] The emotion engine analyzes user emotions from input data and behavior, and plays a role in adjusting the progress and suggestions of wedding preparations according to changes in emotions. For example, if the system determines that the user is feeling stressed, it will recommend more relaxing options.

[0742] Furthermore, the server automatically reprioritizes tasks and updates recommended product lists based on the user's emotional state. It also coordinates communication with stakeholders and automatically generates and sends messages as needed.

[0743] The device visually displays daily progress and provides users with appropriate advice and reminders based on feedback from the emotion engine. This allows users to proceed with wedding preparations at a pace that suits their emotions.

[0744] For example, if a user enters "I'm pressed for time" and the emotion engine detects the user's stress, the system will postpone lower-priority tasks and recommend a list of items that can help soothe the user. In this way, the system provides support that is as attentive as possible to the user's emotions and needs.

[0745] The following describes the processing flow.

[0746] Step 1:

[0747] Users log in to the system via their terminal, enter basic information about their wedding preparations (e.g., wedding date, style, budget, etc.), and submit it.

[0748] Step 2:

[0749] The server receives information sent by the user and stores it in a database. Based on this, it generates individual timelines and task lists.

[0750] Step 3:

[0751] On the device, the generated timeline and task list are displayed to the user, showing task details and completion deadlines. The user can set task priorities.

[0752] Step 4:

[0753] The server uses AI algorithms to analyze products and services based on the user's preferences and budget, and creates a recommendation list. The list is immediately displayed on the device.

[0754] Step 5:

[0755] Users operate their devices to view details of the recommendation list and make purchases or reservations. This information is sent to the server as feedback.

[0756] Step 6:

[0757] The emotion engine analyzes the user's input data and behavior to recognize the user's emotional state (e.g., stress, relief). The recognition results are sent to the server.

[0758] Step 7:

[0759] The server automatically adjusts the priority of wedding preparation tasks based on feedback from the emotion engine. For example, if the user is feeling stressed, it will reschedule tasks to reduce the burden.

[0760] Step 8:

[0761] The server updates its list of recommended products and services based on the user's mood, providing them with choices that suit them. The updated information is then displayed on the device again.

[0762] Step 9:

[0763] The server automatically coordinates communication with stakeholders, generating and sending messages to share updated schedules and requirements as needed.

[0764] Step 10:

[0765] The device notifies the user of their progress in real time and reminds them of the next necessary actions. This allows the user to proceed with wedding preparations while reducing stress.

[0766] (Example 2)

[0767] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0768] In today's diverse wedding preparation process, a lack of flexible support tailored to the individual needs and emotional states of users is a challenge. Traditional systems lack effective means of alleviating the stress and anxiety users experience during the preparation process, and the provision of customized experiences is limited. As a result, it is difficult for users to create efficient and stress-free plans that suit their own emotions and circumstances.

[0769] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0770] In this invention, the server includes input means for inputting initial information from the user, means for generating a dynamic schedule and task list based on the input information, and emotion measurement means for analyzing the user's state from their behavior and emotions. This enables the user to receive appropriate schedule management and recommendation information tailored to their emotions.

[0771] An "input means" is a device or mechanism that can receive initial information from a user and record that information in a digital format.

[0772] A "dynamic schedule" is a calendar or plan that can be updated in real time based on user input.

[0773] "A means of generating a task list" refers to a function that lists the necessary tasks and items according to the user's needs and provides them to the user.

[0774] "Means of displaying on a terminal" refers to a function that visualizes the generated information on a display device such as the user's computer or mobile device.

[0775] An "emotion measurement method" is a system that analyzes a user's psychological state from their behavior and input, and infers their emotions.

[0776] An "artificial intelligence model" is a system that uses advanced computational techniques to make optimal recommendations and decisions based on user data.

[0777] "Means of automatically coordinating communications" refers to a function in which the system automatically arranges communication with necessary stakeholders and transmits appropriate information.

[0778] "Monitoring and notification means" refers to a system that tracks the user's progress and notifies them of reminders and important information as needed.

[0779] This invention is a system that provides flexible planning and support that takes into account the user's emotions and needs in order to assist with wedding preparations. The user first accesses the system using a terminal and inputs basic information about the wedding, such as the date of the ceremony, desired style, and budget. The information obtained through the input means is transmitted to a server and recorded in a database.

[0780] The server automatically generates a dynamic schedule and task list based on this information. The generated information is visualized to the user via a terminal. The user can review the displayed task list and set the priority of each task themselves.

[0781] Furthermore, machine learning algorithms are used as a means of measuring emotions, and the user's emotional state is analyzed by analyzing user input data and behavioral logs. Based on this analysis, the artificial intelligence model automatically updates recommendation information and proposes the most suitable products and services according to the user's emotional state.

[0782] Furthermore, by using automated communication coordination methods, the system generates automated messages to ensure that stakeholders are contacted at the appropriate time, thereby supporting smooth communication. Monitoring and notification methods visualize daily progress on the device, providing reminders and advice to help users proceed with preparations efficiently.

[0783] For example, if a user inputs that they are "pressured for time," the emotion measurement system will identify this as stress, and the server will postpone lower-priority tasks and suggest a list of products with relaxing effects. An example of a prompt message would be, "What options should be recommended when a user is feeling stressed?" This input is processed by a generative AI model, which then provides specific suggestions.

[0784] The system provided by this invention enables users to make wedding preparations that are optimized for their own environment and emotions.

[0785] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0786] Step 1:

[0787] Users access the system using a terminal and enter basic information about their wedding preparations. Specifically, users enter the wedding date, desired style, budget, etc., into an input form and press the submit button. The entered information is sent to the server and stored in the database. The input is basic preparation information, and the output is recorded in the database in the correct format.

[0788] Step 2:

[0789] The server generates a dynamic schedule and task list based on user information stored in the database. The server utilizes programmed algorithms to analyze user information and automatically create a timeline and necessary task list. Stored user information is used as input, and the generated timeline and task list are obtained as output.

[0790] Step 3:

[0791] The terminal visualizes and displays the generated schedule and task list to the user. Specifically, a timeline is graphically displayed on the terminal screen, and an interface is provided that allows the user to change the priority of each task by dragging and dropping. The input in this step is the timeline and task list received from the server, and the output is the visual information displayed to the user.

[0792] Step 4:

[0793] The server analyzes the user's emotional state using emotion measurement techniques based on user input data and interaction logs. This analysis utilizes a generative AI model. Specifically, the server infers emotions from the user's operation logs and prompt messages and reports its assessment back to the server. The input is user behavior data, and the output is the analyzed emotional information.

[0794] Step 5:

[0795] The server generates and provides optimal recommendations to the user based on analyzed emotional data. An artificial intelligence model considers the user's emotional state and suggests relaxing products and services. The input is the analysis results, and the output includes recommendations in a visualized format for the user. Specifically, the server generates prompts based on emotional information and selects content to display.

[0796] Step 6:

[0797] To support users in managing their schedules, the device visualizes daily progress using monitoring and notification mechanisms, providing users with reminders and advice. Specifically, a progress bar is displayed on the device, and notifications are sent based on the set schedule. The input is the user's progress data, and the output is notifications that appear as reminders and advice.

[0798] (Application Example 2)

[0799] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0800] In wedding preparations, there is a need to automatically understand users' emotions and stress levels and provide appropriate suggestions and schedule adjustments accordingly. Similarly, in in-store shopping experiences, dynamic suggestions based on user emotions are crucial. While this would allow users to have a more comfortable and satisfying experience, currently, no system exists that effectively achieves this.

[0801] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0802] In this invention, the server includes means for using an emotion analysis engine to analyze the user's emotions and adjust suggestions and tasks based on the analysis results, and means for dynamically presenting product suggestions through a visual display device. This enables flexible and personalized support that responds to the user's emotions.

[0803] "User input information" refers to the basic data used to generate individual time-series plans that users provide to the system.

[0804] A "time-series plan" is a plan for progress management that is generated based on user input information.

[0805] A "task list" is a list of specific tasks and activities organized according to a chronological plan.

[0806] "User information devices" are devices or terminals used by users to input information and check results.

[0807] An "artificial judgment algorithm" is a computational method used to recommend products and services based on user preferences and budget.

[0808] "Related parties" refers to individuals or organizations involved in a user's wedding preparations or shopping activities.

[0809] A "virtual experience" is a technology that uses augmented reality to visualize information that does not actually exist.

[0810] "Memory means" refers to memory or recording devices used to manage and notify users of their progress.

[0811] An "emotion analysis engine" is a technology that analyzes a user's emotions and makes suggestions or adjusts tasks based on the analysis results.

[0812] A "visual display device" is a device that dynamically presents information through a screen or display.

[0813] In a system implementing this invention, the user, server, and user information device work together in coordination.

[0814] The server generates individual time-series plans based on user input information provided by the user. The generated time-series plans are converted into a work list by the server and visually displayed on the user's information device. User information devices include smart glasses and head-mounted displays, and are designed to improve user convenience.

[0815] Furthermore, the server uses artificial intelligence algorithms to recommend appropriate products and services based on the user's preferences and budget. It also automatically coordinates communication with relevant parties and provides visual feedback to the user using augmented reality technology for virtual experiences.

[0816] The server implements an emotion analysis engine that analyzes the user's emotions. Based on this analysis, it optimizes the user experience by making suggestions and adjusting tasks. For example, if the analysis indicates that the user is feeling stressed, the system will offer suggestions that promote relaxation, thereby enhancing the user's comfort.

[0817] For example, when a user is browsing products in a store, if their facial expression is judged to be "happy," the system will suggest similar style products. This prompt would be written as follows: "User's facial expression was judged to be 'happy.' Generate a prompt suggesting similar style products." In this way, the system provides a dynamic and personalized shopping experience.

[0818] Using a generative AI model, appropriate suggestions are automatically generated based on this prompt. To achieve this, software such as EmotionEngineAPI and OpenCV are used in combination with hardware to deliver high-quality support that responds to the user's emotions.

[0819] In this way, the system provides an integrated solution to improve the user's experience when preparing for or shopping for their wedding.

[0820] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0821] Step 1:

[0822] The server receives input information from the user and generates an individual time-series plan based on it. This input information includes basic information about wedding preparations and desired dates. The server optimizes the time-series plan by referring to past patterns and user history data stored in the database. As output, a plan is generated to efficiently carry out the user's activities.

[0823] Step 2:

[0824] The terminal displays a list of tasks sent from the server to the user. The user sets the priority of the displayed tasks via the terminal. This input allows the terminal to visually manage tasks using its interface. As output, the task list, reflecting the priorities, is updated in real time.

[0825] Step 3:

[0826] The server uses artificial intelligence algorithms to recommend products and services tailored to the user's preferences and budget. Inputs include the user's past purchase history and budget limits. Through data analysis, the server generates the most suitable recommendation list for the user and sends it to the terminal.

[0827] Step 4:

[0828] The server activates an emotion analysis engine to analyze the user's emotions and understand their emotional state in real time. Camera video and audio data are used as input. The EmotionEngine API is used to perform emotion analysis and evaluate the user's stress level, etc. As output, suggestions are adjusted according to the emotion.

[0829] Step 5:

[0830] The terminal dynamically presents product suggestions through a visual display. At this time, it feeds prompt text based on the user's emotional state to a generating AI model, which then suggests appropriate products and services. The input is the result of emotion analysis, and the output is visual information presented to the user. Specifically, if the user's emotion towards a particular product is determined to be "happy," additional recommendations related to that product will be displayed.

[0831] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0832] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0833] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0834] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0835] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0836] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0837] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0838] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0839] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0840] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0841] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0842] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0843] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0844] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0845] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0846] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0847] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0848] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0849] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0850] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0851] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0852] The following is further disclosed regarding the embodiments described above.

[0853] (Claim 1)

[0854] A means for generating individual timelines based on user input information,

[0855] A means of displaying a task list based on the generated timeline on the user's terminal,

[0856] An artificial intelligence algorithm for recommending products and services based on user preferences and budget,

[0857] A means of automating communication and coordination with stakeholders,

[0858] A means of using augmented reality technology to conduct virtual try-on,

[0859] A reminder mechanism for managing and notifying users of their progress,

[0860] A system that includes this.

[0861] (Claim 2)

[0862] The system according to claim 1, characterized in that it includes a function that allows the user to set the priority of tasks on the user terminal.

[0863] (Claim 3)

[0864] The system according to claim 1, characterized by including means for providing information to support the customization of weddings according to specific cultures or religions.

[0865] "Example 1"

[0866] (Claim 1)

[0867] A means for generating individual timetables based on user input information,

[0868] A means for displaying a list of tasks based on the generated schedule on a user information processing device,

[0869] An intelligent algorithm for recommending goods and services based on user preferences and financial plans,

[0870] A means of automatically coordinating communication with related organizations,

[0871] A means of using augmented reality technology to conduct virtual try-on,

[0872] A reminder mechanism for managing and notifying users of their progress,

[0873] A means of generating optimal suggestions by utilizing an artificial intelligence model based on user requests,

[0874] A system that includes this.

[0875] (Claim 2)

[0876] The system according to claim 1, characterized in that the user information processing device includes a function that allows the user to adjust the importance level of the task themselves.

[0877] (Claim 3)

[0878] The system according to claim 1, characterized by including means for providing information to assist in the adjustment of rituals in accordance with specific social customs or beliefs.

[0879] "Application Example 1"

[0880] (Claim 1)

[0881] A device that generates individual time series based on user input information,

[0882] A device that displays work instructions based on the generated time series on the user terminal,

[0883] An artificial intelligence computing means for recommending products and services based on user preferences and budget,

[0884] A device that automatically coordinates communication with stakeholders,

[0885] A device that uses augmented reality technology to conduct virtual try-ons,

[0886] A storage device that manages and notifies users of their progress,

[0887] A method for providing a virtual try-on experience using visual devices at sales locations,

[0888] A system that includes this.

[0889] (Claim 2)

[0890] The system according to claim 1, which includes a function that allows the user to set the priority of tasks on the user terminal.

[0891] (Claim 3)

[0892] The system according to claim 1, including means for providing information to support the coordination of weddings, funerals, and other ceremonies according to a specific culture or religion.

[0893] "Example 2 of combining an emotion engine"

[0894] (Claim 1)

[0895] An input method for entering initial information from the user,

[0896] A means for generating a dynamic schedule and task list based on the input information,

[0897] A means for displaying the generated schedule and task list on a terminal,

[0898] A means of measuring emotions to analyze a user's state from their behavior and feelings,

[0899] An artificial intelligence model means for regenerating recommendation information based on analyzed sentiment data,

[0900] A means of automatically coordinating communication with stakeholders and generating messages,

[0901] A monitoring and notification system that visualizes daily progress and notifies users,

[0902] A system that includes this.

[0903] (Claim 2)

[0904] The system according to claim 1, characterized in that it includes a function that allows the user to manipulate the priority of tasks.

[0905] (Claim 3)

[0906] The system according to claim 1, characterized by including means for providing information to support the customization of events according to specific cultural backgrounds.

[0907] "Application example 2 when combining with an emotional engine"

[0908] (Claim 1)

[0909] A means for generating individual time-series plans based on user input information,

[0910] A means for displaying a list of tasks based on the generated time-series plan on a user information device,

[0911] An artificial judgment algorithm means for recommending products and services based on user preferences and budget,

[0912] A means of automatically coordinating communication with relevant parties,

[0913] Means of using augmented reality technology to conduct virtual experiences,

[0914] A storage means for managing and notifying the user's progress,

[0915] A means of using an emotion analysis engine to analyze user emotions and make suggestions and adjust tasks based on the analysis results,

[0916] A means of dynamically presenting product suggestions through a visual display device,

[0917] A system that includes this.

[0918] (Claim 2)

[0919] The system according to claim 1, characterized in that the user information device includes a function that allows the user to set the priority of tasks themselves.

[0920] (Claim 3)

[0921] The system according to claim 1, characterized in that it includes means for providing information to support the customization of rituals according to a specific culture or religion. [Explanation of symbols]

[0922] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for generating individual timelines based on user input information, A means of displaying a task list based on the generated timeline on the user's terminal, An artificial intelligence algorithm for recommending products and services based on user preferences and budget, A means of automating communication and coordination with stakeholders, A means of using augmented reality technology to conduct virtual try-on, A reminder mechanism for managing and notifying users of their progress, A system that includes this.

2. The system according to claim 1, characterized in that it includes a function that allows the user to set the priority of tasks on the user terminal.

3. The system according to claim 1, characterized in that it includes means for providing information to support the customization of weddings according to specific cultures or religions.

Images