system
The system addresses inefficiencies in event planning by using AI to generate optimal plans and VR simulations, improving success rates and participant satisfaction.
Patent Information
- Application Number
- JP2024138641
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-20
- Publication Date
- 2026-03-05
AI Technical Summary
Conventional event planning systems are inefficient, costly, and lack success indicators, often resulting in unsuccessful events due to geographical constraints, scheduling issues, and participant unavailability, with limited utilization of past data for effective planning.
A system that allows users to input basic event information, utilizes a server for analysis and AI to generate optimal event plans based on past data, provides a VR experience for feedback, and includes a detailed schedule and troubleshooting methods to enhance planning and execution.
The system streamlines event planning, increases success rates, and enhances participant satisfaction by generating personalized and effective event plans through AI and VR simulations, reducing costs and time consumption.
Smart Images

Figure 2026036126000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] The problem this invention aims to solve is to reduce the amount of wasted people, time, and costs involved when companies and organizations plan and implement events, as well as the uncertainty of whether the event will be successful. It is also necessary to resolve the issue of participants being unable to participate due to geographical constraints or scheduling issues. Conventional event planning has few success indicators that utilize past data, which often results in a decline in the effectiveness of the event and participant satisfaction. [Means for solving the problem]
[0005] To solve the above problems, the present invention provides the following means. First, a means is provided for the user to input basic event information. Next, a server is provided with means for receiving and analyzing the basic event information. Furthermore, an imitation AI means is provided for generating an optimal event plan based on past event data. By providing the generated event plan to the user and adding a means for collecting feedback and a means for providing an event experience in a VR environment, geographical constraints are eliminated and the experience for participants is improved. Furthermore, by providing a means for the server to generate a detailed schedule list and troubleshooting methods and provide them to the user, the success rate of the event is increased. In this way, a system is provided that enables efficient and effective event planning and implementation.
[0006] "User" refers to a person or organization that uses the system to plan and implement an event.
[0007] "Basic event information" refers to information about the event entered by the user, such as the title, purpose, number of participants, budget, and desired date of the event.
[0008] A "server" is a computer system that receives and analyzes data sent by users.
[0009] "Analysis" is the process of examining the received data in detail to extract necessary information and check for deficiencies.
[0010] "Past event data" refers to records and data of events that have been previously conducted, including successful and unsuccessful cases.
[0011] The "optimal event plan" is the plan that is most suitable for the current event based on past event data.
[0012] "Imitation AI" is an artificial intelligence that learns from past event data and generates optimal event plans based on that data.
[0013] "Feedback" refers to opinions and ratings collected from users that are used to improve event planning.
[0014] A "VR environment" is a virtual space that uses virtual reality technology, and refers to an environment in which users can experience events in virtual reality.
[0015] A "planning list" is a list of the steps required to carry out an event.
[0016] "Troubleshooting" is a list of solutions to problems that may arise during the event.
[0017] The "system" refers to a series of mechanisms that combine the aforementioned means to support efficient event planning and implementation. [Brief explanation of the drawings]
[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0020] First, the terms used in the following description will be explained.
[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0026] [First embodiment]
[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0039] This invention is an AI system for streamlining the process from event planning to execution. An embodiment of the system is described in detail below.
[0040] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[0041] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[0042] Next, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment and inputs feedback. The server receives the feedback and makes any necessary adjustments.
[0043] Once the final event plan is finalized, the server confirms with the user and provides all necessary materials (proposal, schedule list, troubleshooting methods, etc.). The user downloads these materials and begins preparations for the event. This allows for efficient and effective event planning and implementation.
[0044] Specific examples
[0045] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0046] Title: Team Building Event
[0047] Objective: To improve employee collaboration
[0048] Number of participants: 50
[0049] Budget: 500,000 yen
[0050] Preferred date: December 15, 2023
[0051] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[0052] When a user requests a VR experience, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The user provides feedback from the experience, and the server adjusts the plan accordingly.
[0053] Once the final plan is finalized, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. The user can download these materials and begin preparations for the actual event. In this way, this system increases the success rate of events and enables effective, cost-effective event implementation.
[0054] The processing flow will be explained below.
[0055] Step 1:
[0056] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[0057] Step 2:
[0058] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[0059] Step 3:
[0060] The user completes the input and clicks the "Submit" button.
[0061] Step 4:
[0062] The server receives basic information about the event sent by the user.
[0063] Step 5:
[0064] The server analyzes the received data and checks for any incomplete or inappropriate input information.
[0065] Step 6:
[0066] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[0067] Step 7:
[0068] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[0069] Step 8:
[0070] The server provides the generated event plan to the user, who then confirms it.
[0071] Step 9:
[0072] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[0073] Step 10:
[0074] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[0075] Step 11:
[0076] The user performs an event simulation in a VR environment and inputs feedback.
[0077] Step 12:
[0078] The server receives user feedback and makes necessary adjustments.
[0079] Step 13:
[0080] Once the final event plan is finalized, the server will check with the user and obtain final confirmation.
[0081] Step 14:
[0082] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[0083] Step 15:
[0084] The user downloads the provided materials and prepares for the event.
[0085] Example 1
[0086] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0087] The process from planning to implementing an event is often time-consuming and complicated. There is a need for a system that allows users to efficiently plan and implement events. Furthermore, to increase the success of an event, it is necessary to provide an optimal plan based on past success stories. Furthermore, it is expected that by using a simulation in a virtual reality environment to check the atmosphere and details of the event in advance and incorporating feedback, more accurate event planning can be achieved.
[0088] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0089] In this invention, the server includes a terminal means for a user to input basic event information, a means for receiving and analyzing the basic event information, a generation AI model means for generating an optimal event plan based on past event data, a means for providing the event plan to the user and receiving feedback, and a means for providing an experience in a virtual reality environment, thereby enabling the user to efficiently and effectively carry out events from planning to implementation.
[0090] "User" refers to an individual or organization that uses the system to plan and implement an event.
[0091] The "terminal means" refers to an electronic device such as a computer or smartphone that a user uses to input basic event information.
[0092] A "server" is a central computer system that receives, analyzes, and processes information entered by users.
[0093] "Basic event information" refers to basic information required for planning an event, such as the event title, purpose, target number of people, budget, and desired date.
[0094] The "analyzing means" is a processing means for checking the basic event information received from the user and determining whether there are any deficiencies or inappropriate values.
[0095] "Past event data" is a collection of data that records information about events that have taken place in the past, and is a database that the system uses as a reference.
[0096] "Generative AI model means" refers to artificial intelligence technology that automatically generates optimal event plans based on past event data.
[0097] An "event plan" is a detailed plan for an event that is generated based on basic information entered by the user and past data.
[0098] The "means for receiving feedback" refers to a processing means for receiving feedback (opinions and impressions) provided by the user and recognizing it in the system.
[0099] "Virtual reality environment" means a computer-generated environment in which a user simulates events in a virtual space.
[0100] "Virtual reality content" means a simulation of an event or other related content that can be experienced by a user within a virtual reality environment.
[0101] A "stage list" is a list that lists the specific work procedures and order required to carry out an event.
[0102] "Troubleshooting" refers to specific measures to deal with problems or issues that may arise during the event.
[0103] This invention is a system for streamlining the process from event planning to implementation. The system includes a terminal where users input basic event information, a server that receives and analyzes this information, a generative AI model that generates an optimal event plan based on past event data, and a VR system that provides a virtual reality environment.
[0104] First, the user accesses the system's website using their own device (computer or smartphone) and logs in or registers. The user then moves to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The server receives this information and analyzes the input data. Data cleansing techniques are used to check for any errors or inappropriate values. Python is used for data analysis, and Django is used as the web framework.
[0105] Once the analysis is complete, the server references a database of past events to search for events similar to the criteria entered by the user. This search uses PostgreSQL as the SQL database and ElasticSearch (registered trademark) as the search engine. Based on the past data, a generative AI model (for example, an imitation AI using TENSORFLOW (registered trademark)) generates an optimal event plan. This generated plan includes a basic project proposal, a detailed schedule list, and anticipated problems and how to deal with them.
[0106] Next, if the user wishes to experience an event in a VR environment, they input this into the system. The server generates VR content using tools such as Unity and provides a virtual reality environment that the user can use. After the link is generated, the user is provided with a download link for a VR headset or smartphone app. The user uses this to simulate an event in the VR environment and provides feedback from the experience. The server receives the feedback and makes any necessary adjustments.
[0107] Finally, the server presents the revised event plan to the user for confirmation. After confirmation is obtained, the server generates all the final materials (proposal, schedule list, troubleshooting methods, etc.) and provides them to the user. The user downloads these materials and begins preparations for the actual event.
[0108] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0109] Title: Team Building Event
[0110] Objective: To improve employee collaboration
[0111] Number of participants: 50
[0112] Budget: 500,000 yen
[0113] Preferred date: December 15, 2023
[0114] The server receives and analyzes this information and references a database of past team-building events. The generative AI model generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.) based on the most successful past events. If the user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the event atmosphere and activities in virtual reality. The user provides feedback from the experience, and the server adjusts the plan based on that feedback.
[0115] Example prompt for generative AI model:
[0116] Prompt: I'd like to organize a team building event for my employees. Please suggest the best plan for the event based on the following basic information:
[0117] Title: Team Building Event
[0118] Objective: To improve employee collaboration
[0119] Number of participants: 50
[0120] Budget: 500,000 yen
[0121] Preferred date: December 15, 2023
[0122] In this way, the system increases the success rate of events and enables efficient and effective event planning and execution.
[0123] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0124] Step 1:
[0125] A user accesses the system's website using their own device and logs in or registers. A username and password are required as input. The output is the dashboard screen after successful login. Specifically, the username and password are sent to the server for authentication.
[0126] Step 2:
[0127] The user enters basic information about the event. Input items include the title, purpose, number of participants, budget, desired date, etc. When the send button is clicked, this information is sent to the server. As an output, a message is displayed to confirm the input information. Specifically, the information entered from the terminal is sent to the server.
[0128] Step 3:
[0129] The server analyzes the basic information of the event received from the user. The input data is the basic information of the event provided by the user. Data cleansing techniques are used to check for errors and inappropriate values. The output is the analysis results, which are saved. Specifically, data cleansing is performed using Python and the analysis results are displayed within the Django framework.
[0130] Step 4:
[0131] The server references a database of past events and searches for events similar to the conditions entered by the user. The input is the basic information of the analyzed events. The search is performed using PostgreSQL and Elasticsearch. The output is a list of similar events. Specifically, an SQL query is issued and similar events are extracted in Elasticsearch.
[0132] Step 5:
[0133] The server uses a generative AI model to generate an optimal event plan. The input is similar event data. Using an AI model (e.g., TensorFlow), an event plan is generated that includes optimal activities, a schedule list, and troubleshooting methods. The output is an event plan to provide to the user. Specifically, data is input into the generative AI model, and a plan is generated.
[0134] Step 6:
[0135] If a user wishes to experience an event in a VR environment, they input this into the system. The input is the user's choice of VR experience. The server generates the VR content using Unity or similar software. The output is a download link for a VR headset or smartphone app. Specifically, the VR content is generated and the link is sent to the user.
[0136] Step 7:
[0137] The user performs an event simulation in a VR environment. The input is access to VR content. The user experiences the simulation and submits feedback. The output is feedback data sent to the server. The specific operation is for the user to experience VR, enter their opinions in a feedback form, and submit it.
[0138] Step 8:
[0139] The server receives feedback from users and adjusts the event plan as needed. The input is the feedback data. The adjusted plan is regenerated. The output is an adjusted event plan. Specifically, the server re-analyzes the data based on the feedback and adjusts the plan using the generative AI model.
[0140] Step 9:
[0141] The server provides the final event plan to the user. The input is the adjusted event plan. The user reviews it and agrees. The output is the final event plan. Specific operations include generating the plan in a format such as PDF and providing the user with a download link.
[0142] Step 10:
[0143] The user receives the final plan and prepares to carry out the event. The input is the provided planning materials. The user then proceeds with specific preparations based on these. The output is that the event is ready to be carried out. Specific operations include the user downloading the materials and making the necessary arrangements and contacts.
[0144] (Application example 1)
[0145] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0146] Conventional event planning systems not only analyze user input information and reference past data to generate plans, but also lack the means to support execution in real-world environments and simulations. This makes it difficult to address problems and optimize the plan during the actual event, making it difficult to improve the success rate. Furthermore, the lack of functionality to support specific preparation work through real-time advice and simulations makes it difficult to streamline the cost and time required for event implementation.
[0147] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0148] In this invention, the server includes a means for users to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, a means for providing the event plan to users and receiving feedback, a means for providing an experience in a virtual reality environment, and a means for staff to prepare and simulate an event in a physical store while receiving advice in real time. This streamlines the process from event planning to implementation, enabling problem solving and optimization during actual event implementation. Furthermore, real-time advice and simulations enable cost and time efficiency in event implementation.
[0149] "User" refers to a person who inputs basic event information and uses the system to support the planning and implementation of an event.
[0150] "Basic event information" refers to basic information required for holding an event, such as the event title, purpose, target number of people, budget, desired date, etc.
[0151] The "server" is a computer system that analyzes information received from users and uses past data to generate optimal event plans.
[0152] "Imitation AI means" refers to artificial intelligence that learns from past event data and generates optimal event plans based on user input information.
[0153] "Feedback" refers to opinions and correction requests provided by users regarding the proposed event plan.
[0154] A "virtual reality environment" is an environment in which users can experience a virtual event space using a VR headset or smart glasses.
[0155] A "brick and mortar store" is a physical store where actual business activities are conducted.
[0156] "Simulation" is the process of virtually executing an event plan in a virtual reality environment to verify its effectiveness and any problems with its execution.
[0157] A "detailed procedure list" refers to the specific procedures and time schedule required to carry out an event.
[0158] "Problem-solving strategies" are solutions to problems that may arise during the event.
[0159] The system of this invention allows users to input basic event information, and the server analyzes and processes it to provide an optimal event plan. Furthermore, it aims to increase the success rate of events through real-time advice and simulations in a virtual reality environment.
[0160] Hardware and Software Configuration
[0161] 1. User device: A device (PC, smartphone, etc.) used to enter basic event information.
[0162] 2. Server: A computer system that receives and analyzes the basic information entered and generates the optimal event plan.
[0163] 3. Imitation AI method: Artificial intelligence (using GPT, etc.) that generates optimal event plans based on past event data.
[0164] 4. Cloud server: Infrastructure for analyzing input data and generating plans.
[0165] 5. Smart glasses: A device that helps with event preparation by providing real-time advice in physical stores.
[0166] 6. VR headset: A device to support event simulation in a virtual reality environment.
[0167] Program processing explanation
[0168] User terminal
[0169] The user uses the terminal to enter basic information about the event, such as the title, purpose, number of participants, budget, and desired date, into a form and sends it to the server.
[0170] server
[0171] The server analyzes the received basic event information and checks for inappropriate values or missing information. Once the analysis is complete, it references a database of past events and generates an event plan that best suits the input conditions.
[0172] Imitation AI methods
[0173] Imitation AI generates optimal event plans based on past event data and user input. The generated plans include a basic plan, a detailed procedure list, and solutions to problems. GPT-based models are often used as generative AI models.
[0174] Cloud Server
[0175] The cloud server is responsible for analyzing input data and generating plans, and also serves as the infrastructure for providing the generated event plans and feedback to users.
[0176] Smart Glasses
[0177] Staff can use smart glasses to prepare for events in physical stores with real-time advice, with a virtual assistant appearing on the screen to provide advice and direction.
[0178] VR headset
[0179] It is a device that allows users to simulate events in a virtual reality environment, allowing them to confirm and optimize their plans through a realistic experience.
[0180] Specific examples
[0181] For example, to organize a new product launch event for employees, a user logs into the system and enters the following basic information:
[0182] Title: New product launch event
[0183] Objective: New product launch
[0184] Number of participants: 100
[0185] Budget: 1 million yen
[0186] Preferred date: November 30, 2023
[0187] The server receives and analyzes this information and uses mimicry AI to generate an optimal event plan, including new product presentations, demonstrations, Q&A sessions, etc. Furthermore, by using simulations in a virtual reality environment and receiving feedback from users, the plan can be optimized, resulting in cost and time savings during preparation and execution.
[0188] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0189] Step 1:
[0190] The user enters the basic event information
[0191] Users access the system's website from their devices (PCs or smartphones) and are taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.). This information is sent to the server as user input.
[0192] Input: Basic information about the event
[0193] Output: Send information to the server
[0194] Step 2:
[0195] The server receives and analyzes basic event information
[0196] The server receives the basic event information sent by the user and checks for incomplete information or inappropriate values, specifically validating data types and checking for blank fields.
[0197] Input: Basic information about the event
[0198] Output: Parsed event information
[0199] Step 3:
[0200] Reference past data and generate optimal plans
[0201] The server then searches for similar events by referencing a database of past events based on the analyzed event information, and uses mimicry AI (e.g., a GPT model) to generate an optimal event plan based on the search results.
[0202] Input: Parsed event information
[0203] Output: Optimal event plan
[0204] Step 4:
[0205] Providing event plans and receiving feedback
[0206] The server provides the generated event plan to the user, who then reviews the plan and inputs feedback such as corrections and changes. The server receives and stores this feedback.
[0207] Input: Optimal event plan, user feedback
[0208] Output: User suggested fixes
[0209] Step 5:
[0210] Simulation in a virtual reality environment
[0211] When a user wants to simulate a virtual reality environment, the server generates VR content (such as 3D modeling and scene setting) and sends it to the user's VR headset or smartphone. The user then performs the simulation and provides feedback on the experience.
[0212] Input: Optimal event plan, virtual reality environment requirements
[0213] Output: VR content, feedback
[0214] Step 6:
[0215] Optimize your plan based on feedback
[0216] The server uses mimicry AI to fine-tune the plan based on user feedback, analyzing the feedback, identifying necessary modifications, and updating the plan.
[0217] Input: User feedback
[0218] Output: Updated event plan
[0219] Step 7:
[0220] Providing a detailed list of steps and solutions to problems
[0221] After the event plan is finalized, the server creates a detailed procedure list and troubleshooting methods and provides them to the user, who can then download these materials and begin preparations for the event.
[0222] Input: Final Event Plan
[0223] Output: Steps list, troubleshooting
[0224] Through these steps, users are effectively supported in the process from event planning to implementation.
[0225] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0226] This invention is an AI system for streamlining the process from event planning to execution. In particular, it is characterized by providing a more personalized event experience by combining it with an emotion engine that recognizes user emotions. An embodiment of the system is described in detail below.
[0227] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[0228] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[0229] The emotion engine then analyzes text and voice data from user input and feedback to recognize the user's emotions. For example, if the user expresses dissatisfaction with an activity, the engine can adjust the event plan based on that data. The engine also collects the user's preferences and interests and optimizes the plan accordingly.
[0230] Furthermore, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment, and the emotion engine monitors the user's emotions in real time. Based on the user's emotion data, the server adjusts the experience within the VR content in real time.
[0231] Once the final event plan is finalized, the server confirms with the user and receives final approval. The server then generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The user can download these materials and begin preparations for the event. In this way, combining the emotion engine improves user satisfaction and enables more effective and personalized event planning and implementation.
[0232] Specific examples
[0233] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0234] Title: Team Building Event
[0235] Objective: To improve employee collaboration
[0236] Number of participants: 50
[0237] Budget: 500,000 yen
[0238] Preferred date: December 15, 2023
[0239] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[0240] The emotion engine reads the user's expectations and anxieties from the data they input, adjusts the selection and distribution of activities, and collects feedback from the user and re-optimizes the plan based on that data.
[0241] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The emotion engine analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, it can switch to a different activity.
[0242] Finally, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. Users can download these materials and begin preparations for the actual event. This system increases the success rate of events and improves user satisfaction.
[0243] The processing flow will be explained below.
[0244] Step 1:
[0245] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[0246] Step 2:
[0247] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[0248] Step 3:
[0249] The user completes the input and clicks the "Submit" button.
[0250] Step 4:
[0251] The server receives basic information about the event sent by the user.
[0252] Step 5:
[0253] The server analyzes the data it receives and checks for incomplete input information or inappropriate values.
[0254] Step 6:
[0255] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[0256] Step 7:
[0257] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[0258] Step 8:
[0259] The server provides the generated event plan to the user and has the user confirm it.
[0260] Step 9:
[0261] The user enters feedback, which is then analyzed by the emotion engine.
[0262] Step 10:
[0263] The emotion engine identifies emotions based on user feedback and adjusts the event plan accordingly.
[0264] Step 11:
[0265] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[0266] Step 12:
[0267] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[0268] Step 13:
[0269] The user performs an event simulation in a VR environment, and the emotion engine monitors the user's emotions in real time.
[0270] Step 14:
[0271] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user expresses negative emotions in a particular scene, the scene will be changed.
[0272] Step 15:
[0273] The server presents the final event plan to the user for confirmation.
[0274] Step 16:
[0275] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[0276] Step 17:
[0277] The user downloads the provided materials and prepares for the event.
[0278] Example 2
[0279] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0280] Conventional event planning systems have the problem that once a plan is generated based on the event information entered by the user, it is fixed and difficult to adjust afterwards. Furthermore, they lack the functionality to reflect the user's preferences and emotions, which can result in insufficient personalization for each user and reduced user satisfaction. Furthermore, it is difficult to reflect user feedback in real time in VR experiences, making it difficult to provide an experience that is in line with the user's emotions.
[0281] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0282] In this invention, the server includes a means for a user to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past statistical data, an emotion analysis means for recognizing the user's emotions and adjusting the event plan, a means for providing the event plan to the user and receiving feedback, a means for providing an experience in a VR environment, and a means for monitoring the user's emotions in real time during the VR experience and instantly adjusting the content. This allows the user's emotions to be reflected in the event plan, providing a personalized, optimized event experience. Furthermore, adjusting the VR content based on real-time emotion feedback can achieve higher user satisfaction and a sense of realism.
[0283] "User" means any person or entity that accesses the system and enters basic information about an event.
[0284] "Basic event information" refers to basic information required for event planning, such as the title, purpose, target number of people, budget, and desired date.
[0285] "Server" means a computer system that receives and analyzes information sent by users and generates and provides event plans.
[0286] "Receiving" refers to the server taking in data sent by the user.
[0287] "Analysis" is the process of verifying received data to check for any errors or inappropriate values.
[0288] "Statistical data" is a collection of data about events that have taken place in the past, and is information that forms the basis of analysis.
[0289] "Mimetic AI means" is an artificial intelligence technology that generates optimal event plans based on past statistical data.
[0290] "Emotion analysis means" is a technical means for analyzing a user's emotions and adjusting the event plan based on the analysis.
[0291] "Providing" refers to the act of presenting the generated event plan to the user.
[0292] "Feedback" refers to evaluations and opinions obtained from users.
[0293] A "VR environment" is a simulation space constructed using virtual reality technology.
[0294] "Emotion monitoring" is a technology that monitors and records the emotions felt by users during a VR experience in real time.
[0295] "Real-time monitoring" is a technology that instantly observes and responds to users' emotions and behavior.
[0296] "Instant adjustment" means instantly changing the content of the VR content based on the results of emotion monitoring.
[0297] This invention is an AI system that streamlines the process from event planning to execution. Its unique feature is that it provides a more personalized event experience by incorporating an emotion engine that recognizes user emotions. The system allows users to input basic event information, and the server receives and analyzes that information to generate an optimal event plan. It also provides an experience in a VR environment, adjusting the plan based on feedback.
[0298] First, the user accesses the system's website from a device such as a PC or smartphone and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The device then sends an HTTP request to the server, which transmits the information entered by the user.
[0299] The server receives the basic information of the event sent by the user and parses the input data to check for errors or invalid values, using a data validation library (e.g., JSON Schema Validator).
[0300] Once the analysis is complete, the server uses past statistical data to search for events similar to the criteria entered by the user. This search process involves executing a database query to retrieve data that matches the criteria. The server then uses mimicry AI to generate an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them. The generative AI model is invoked as an API call or library to generate a plan based on the input data.
[0301] Furthermore, the sentiment analysis means analyzes text and voice data from user input and feedback to recognize the user's emotions. This analysis is performed using sentiment analysis libraries (e.g., IBM Watson®, Microsoft® Azure® Cognitive Services). If the user expresses dissatisfaction with the activity, the event plan is adjusted based on that data. The system also collects the user's preferences and interests and optimizes the plan accordingly.
[0302] Next, if the user wishes to experience the event in a VR environment, they input this into the system. The server generates the VR content and provides a link that the user can access from a VR headset or smartphone app. For this purpose, a VR content generation engine (e.g., Unity, Unreal Engine) is used. The user puts on the VR headset and accesses the VR content from the link provided by the system.
[0303] During the VR experience, the emotion engine monitors the user's emotions in real time and instantly adjusts the VR content as needed. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[0304] Finally, once the final event plan has been finalized, the server confirms it with the user. After final confirmation, the server generates all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The server generates the materials using a document generation tool (e.g., LaTeX, MICROSOFT OFFICE® API) and provides them to the user. The user can download the provided materials and proceed with event preparations.
[0305] Specific examples
[0306] For example, to organize a team building event for employees, a user logs into the system and enters the following basic information:
[0307] Title: Team Building Event
[0308] Objective: To improve employee collaboration
[0309] Number of participants: 50
[0310] Budget: 500,000 yen
[0311] Preferred date: December 15, 2023
[0312] The server receives and analyzes this information and references a statistical database of past team building events. Based on the most successful past events, the Mimic AI generates a plan that combines the optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[0313] The system uses emotion analysis to read user input data to understand their expectations and anxieties, adjusts the selection and distribution of activities, and collects user feedback to re-optimize the plan based on that data.
[0314] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere of the event or activity in virtual reality. An emotion analysis means analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, the server can switch to another activity.
[0315] An example prompt is:
[0316] I'd like to organize a team building event for my employees. Please generate the best event plan based on the following information:
[0317] Title: Team Building Event
[0318] Objective: To improve employee collaboration
[0319] Number of participants: 50
[0320] Budget: 500,000 yen
[0321] Preferred date: December 15, 2023
[0322] Use past success stories to suggest a plan with optimal activities and steps, and be prepared to adjust the plan based on user sentiment.
[0323] This system will improve user satisfaction and enable more effective event planning and implementation.
[0324] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0325] Step 1:
[0326] A user accesses the system and logs in
[0327] Users use a device such as a PC or smartphone to access the system's website using a web browser and log in or register.
[0328] Specific actions: Open a browser, enter the URL to access the system website, enter the username and password on the login page, and click the login button.
[0329] Input: URL, username, password
[0330] Output: Login success / failure response
[0331] Step 2:
[0332] The user fills in the form with basic event information
[0333] The user is taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[0334] Specific actions: Move cursor to form fields, enter information, and click submit.
[0335] Input: Basic information about the event (title, purpose, number of people, budget, desired date, etc.)
[0336] Output: HTTP request containing basic event information
[0337] Step 3:
[0338] The server receives and analyzes basic event information.
[0339] The server receives the basic information of the event sent by the user and parses the input data, using a data validation library (e.g., JSON Schema Validator) to check for errors or invalid values.
[0340] Specific behavior: Receives an HTTP request and verifies the validity of the data.
[0341] Input: Event basic information (HTTP request)
[0342] Output: Verification result (valid / invalid)
[0343] Step 4:
[0344] The server references past statistical data and generates an event plan
[0345] The server references a historical statistical database to search for events similar to the user's criteria, executes a database query, retrieves event data that matches the criteria, and then uses mimicry AI to generate an optimal event plan.
[0346] What it does: Executes SQL queries to retrieve information from a database and invokes a generative AI model to generate a plan.
[0347] Input: Verified event basic information
[0348] Output: Optimal event plan (basic plan, detailed schedule, anticipated problems and how to deal with them)
[0349] Step 5:
[0350] The server recognizes the user's emotions using emotion analysis means.
[0351] The server uses emotion analysis to analyze text and voice data at the time of user input and feedback, and recognizes the user's emotions. An emotion analysis library (e.g., IBM Watson, Microsoft Azure Cognitive Services) is used.
[0352] Specific operation: User text and voice data are input into the emotion analysis tool, and emotion data is output.
[0353] Input: text and voice data during user input and feedback
[0354] Output: User's emotional data (expectation, anxiety, satisfaction, dissatisfaction, etc.)
[0355] Step 6:
[0356] The server adjusts the event plan based on the emotional data.
[0357] Based on the emotional data recognized by the emotion analysis means, the event plan generated using the mimicry AI is adjusted. The emotional data is fed back to the mimicry AI model to regenerate the plan.
[0358] Specific operation: Emotional data is input into the AI model, and an optimized event plan is output.
[0359] Input: User emotion data, the initially generated event plan
[0360] Output: Adjusted event plan
[0361] Step 7:
[0362] If a user wishes to experience an event in a VR environment, the server generates the VR content.
[0363] The server generates VR content based on the user's request. It creates simulation data using a VR content generation engine (e.g., Unity, Unreal Engine).
[0364] Specific operation: Inputs the necessary data into the VR content generation engine and outputs a link to the generated VR content.
[0365] Enter: Event Plan
[0366] Output: VR content link
[0367] Step 8:
[0368] The user experiences VR
[0369] Users experience the generated VR content using a VR headset or smartphone app. They wear the headset and access the content via a link provided by the system.
[0370] Specific Actions: Put on the VR headset and click the provided link to connect to the VR content.
[0371] Input: VR content link
[0372] Output: VR experience
[0373] Step 9:
[0374] Emotion analysis means monitors the user's emotions in real time during the VR experience, and the server instantly adjusts the content.
[0375] The emotion analysis means analyzes the user's emotions in real time during the VR experience, and the server instantly adjusts the VR content based on that data. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[0376] Specific operation: Data collected from sensors is input into an emotion analysis tool to generate adjusted VR content.
[0377] Input: User's real-time emotional data, current VR content
[0378] Output: Adjusted VR content
[0379] Step 10:
[0380] The server confirms the event plan with the user, and after final confirmation, generates and provides the materials.
[0381] Once the event plan is finalized, the server confirms with the user. After final confirmation, all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) are generated and sent to the user. The materials are generated using a document generation tool (e.g., LaTeX, Microsoft Office API).
[0382] Specific operations: The final plan contents are sent to the user via email or notification, and materials are created using a document generation tool based on feedback and provided to the user via email or download link.
[0383] Input: Final event plan, feedback
[0384] Output: All materials for the event
[0385] (Application example 2)
[0386] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0387] Current virtual store systems offer uniform product recommendations to users, resulting in a lack of personalized recommendations that address individual users' emotions and needs. Furthermore, they are unable to grasp users' emotional changes in real time during the shopping experience and adjust the experience accordingly. This results in lower user satisfaction and a decrease in purchasing motivation. Furthermore, even systems that offer event experiences have difficulty providing optimal experiences based on users' emotions.
[0388] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0389] In this invention, the server includes means for a user to input basic event information, means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, an emotion recognition engine means for analyzing and monitoring user emotion data in real time, and means for personalizing the shopping experience based on the user emotion data. This enables personalized suggestions and experiences according to the user's emotions, improving user satisfaction and increasing purchasing motivation.
[0390] The "means for users to input basic event information" is an interface that allows users to input basic information about an event, such as the title, purpose, target number of people, budget, and desired date, into the system.
[0391] The "means for the server to receive and analyze the basic event information" is a function that receives the basic event information entered by the user, analyzes it, and checks for any errors or inappropriate values.
[0392] "An imitation AI method that generates optimal event plans based on past event data" is an artificial intelligence technology that references a past event database, searches for events similar to the user's input conditions, and generates optimal event plans.
[0393] The "means for providing the event plan to the user and receiving feedback" is a function for presenting the generated event plan to the user and collecting opinions and impressions from the user.
[0394] "Means for providing an experience in a VR environment" refers to a function that provides VR content and links necessary for users to simulate an event in a virtual reality environment.
[0395] The "emotion recognition engine means for analyzing and monitoring user emotion data in real time" is a technology for analyzing a user's text and voice data and grasping and monitoring the user's emotional state in real time.
[0396] "Means for personalizing the shopping experience based on the user's emotional data" refers to a function that optimizes products and experience content based on the user's emotional data and makes personalized suggestions tailored to each individual user.
[0397] "Means for the server to generate a detailed schedule list and troubleshooting methods based on the event plan and provide them to the user" refers to a function that creates detailed procedures and troubleshooting methods for anticipated problems based on the generated event plan and provides them to the user.
[0398] The "natural language analysis means for analyzing text data entered by a user and obtaining an emotion score and the intensity of the emotion" is a technology for mechanically analyzing text data entered by a user and calculating the user's emotion score and the intensity of that emotion.
[0399] The present invention relates to a system and method for personalizing a user's shopping experience in a virtual store. DETAILED DESCRIPTION OF THE INVENTION The following describes an embodiment of the present invention.
[0400] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event or shopping (title, purpose, budget, etc.), enter the required information, and submit it.
[0401] The server receives the basic information sent by the user and analyzes the input data. This analysis uses natural language processing technology using the Google® Cloud Natural Language API. This checks for any errors or inappropriate values in the input data.
[0402] The server then searches a database of past events to find events similar to the user's input. The mimicry AI then generates an optimal event plan, which includes a basic plan, a detailed schedule, and potential problems and how to deal with them.
[0403] The emotion recognition engine analyzes text and voice data during user input and feedback to identify the user's emotions. Again, it uses the Google Cloud Natural Language API to obtain an emotion score and emotion intensity. For example, if a user has a positive reaction to a particular product, that emotion data can be used to optimize product suggestions.
[0404] Furthermore, if a user wishes to experience a VR environment, they input this into the system. The server generates the VR content and provides links to a VR headset and smartphone app. The user simulates an event in the VR environment, and an emotion recognition engine monitors the user's emotions in real time. For example, if the user has a negative reaction to a particular activity, the system can switch to another activity.
[0405] Once the final event plan is finalized, the server will contact the user for confirmation. The server will then generate all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and send them to the user. The user can then download these materials and begin preparing for the event and shopping.
[0406] This allows for personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction and increasing purchasing motivation.
[0407] Specific examples
[0408] The user puts on a head-mounted display and accesses a virtual shop. The AI assistant in the shop asks, "Are you looking for something?" If the user says, "I've been feeling stressed lately and want to relax," the emotion engine analyzes the text and suggests products that have a relaxing effect.
[0409] Example prompts to input to the generative AI model
[0410] Example of input prompt:
[0411] If a user says, "I've been feeling stressed lately and want to relax," analyze this using an emotion recognition engine and generate Python code that suggests products that have a relaxing effect.
[0412] This method allows the shopping experience in the virtual store to be personalized based on the user's emotions, providing a more satisfying experience.
[0413] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0414] Step 1:
[0415] A user accesses the system's website from their device (PC or smartphone) and logs in or registers. In this step, the user's authentication information is entered, which is received by the server and authenticates the user. The input data is the user ID and password, and the output is the authentication result.
[0416] Step 2:
[0417] The user enters basic information about the event or shopping (title, purpose, budget, etc.) into an input form and submits it. The server receives the submitted basic information, analyzes the input data, and checks for errors or inappropriate values. The input data is the basic information about the event or shopping, and the output is the analysis results.
[0418] Step 3:
[0419] The server refers to a database of past events and searches for event data similar to the conditions entered by the user. The mimicking AI generates an optimal event plan. In this step, the input data is the user's input information and past event data, and the output is the generated event plan.
[0420] Step 4:
[0421] The emotion recognition engine analyzes text and voice data during user input and feedback to recognize the user's emotions. Specifically, it uses the Google Cloud Natural Language API to obtain emotion scores and emotion intensity. The input data is the user's text and voice data, and the output is emotion scores and emotion intensity.
[0422] Step 5:
[0423] The server provides the event plan to the user and receives feedback. The server adjusts the generated event plan based on the user's feedback. The input data are the event plan and the user's feedback, and the output is the adjusted event plan.
[0424] Step 6:
[0425] When a user requests an experience in a VR environment, the server generates VR content and a link to a VR headset or smartphone app. The user simulates an event in the VR environment, and the emotion recognition engine monitors the user's emotions in real time. The input data is the user's desired information and past VR content, and the output is the generated VR content and a link.
[0426] Step 7:
[0427] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user has a negative reaction to a particular activity, it switches to another activity. In this step, the input data is the user's emotional data, and the output is the adjusted VR content.
[0428] Step 8:
[0429] The server confirms the final event plan with the user and receives final approval. The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The input data is the final event plan, and the output is all generated materials.
[0430] This series of steps enables personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction.
[0431] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0432] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0433] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0434] [Second embodiment]
[0435] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0436] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0437] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0438] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0439] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0440] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0441] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0442] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0443] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0444] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0445] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0446] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0447] This invention is an AI system for streamlining the process from event planning to execution. An embodiment of the system is described in detail below.
[0448] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[0449] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[0450] Next, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment and inputs feedback. The server receives the feedback and makes any necessary adjustments.
[0451] Once the final event plan is finalized, the server confirms with the user and provides all necessary materials (proposal, schedule list, troubleshooting methods, etc.). The user downloads these materials and begins preparations for the event. This allows for efficient and effective event planning and implementation.
[0452] Specific examples
[0453] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0454] Title: Team Building Event
[0455] Objective: To improve employee collaboration
[0456] Number of participants: 50
[0457] Budget: 500,000 yen
[0458] Preferred date: December 15, 2023
[0459] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[0460] When a user requests a VR experience, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The user provides feedback from the experience, and the server adjusts the plan accordingly.
[0461] Once the final plan is finalized, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. The user can download these materials and begin preparations for the actual event. In this way, this system increases the success rate of events and enables effective, cost-effective event implementation.
[0462] The processing flow will be explained below.
[0463] Step 1:
[0464] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[0465] Step 2:
[0466] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[0467] Step 3:
[0468] The user completes the input and clicks the "Submit" button.
[0469] Step 4:
[0470] The server receives basic information about the event sent by the user.
[0471] Step 5:
[0472] The server analyzes the received data and checks for any incomplete or inappropriate input information.
[0473] Step 6:
[0474] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[0475] Step 7:
[0476] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[0477] Step 8:
[0478] The server provides the generated event plan to the user, who then confirms it.
[0479] Step 9:
[0480] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[0481] Step 10:
[0482] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[0483] Step 11:
[0484] The user performs an event simulation in a VR environment and inputs feedback.
[0485] Step 12:
[0486] The server receives user feedback and makes necessary adjustments.
[0487] Step 13:
[0488] Once the final event plan is finalized, the server will check with the user and obtain final confirmation.
[0489] Step 14:
[0490] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[0491] Step 15:
[0492] The user downloads the provided materials and prepares for the event.
[0493] Example 1
[0494] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0495] The process from planning to implementing an event is often time-consuming and complicated. There is a need for a system that allows users to efficiently plan and implement events. Furthermore, to increase the success of an event, it is necessary to provide an optimal plan based on past success stories. Furthermore, it is expected that by using a simulation in a virtual reality environment to check the atmosphere and details of the event in advance and incorporating feedback, more accurate event planning can be achieved.
[0496] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0497] In this invention, the server includes a terminal means for a user to input basic event information, a means for receiving and analyzing the basic event information, a generation AI model means for generating an optimal event plan based on past event data, a means for providing the event plan to the user and receiving feedback, and a means for providing an experience in a virtual reality environment, thereby enabling the user to efficiently and effectively carry out events from planning to implementation.
[0498] "User" refers to an individual or organization that uses the system to plan and implement an event.
[0499] The "terminal means" refers to an electronic device such as a computer or smartphone that a user uses to input basic event information.
[0500] A "server" is a central computer system that receives, analyzes, and processes information entered by users.
[0501] "Basic event information" refers to basic information required for planning an event, such as the event title, purpose, target number of people, budget, and desired date.
[0502] The "analyzing means" is a processing means for checking the basic event information received from the user and determining whether there are any deficiencies or inappropriate values.
[0503] "Past event data" is a collection of data that records information about events that have taken place in the past, and is a database that the system uses as a reference.
[0504] "Generative AI model means" refers to artificial intelligence technology that automatically generates optimal event plans based on past event data.
[0505] An "event plan" is a detailed plan for an event that is generated based on basic information entered by the user and past data.
[0506] The "means for receiving feedback" refers to a processing means for receiving feedback (opinions and impressions) provided by the user and recognizing it in the system.
[0507] "Virtual reality environment" means a computer-generated environment in which a user simulates events in a virtual space.
[0508] "Virtual reality content" means a simulation of an event or other related content that can be experienced by a user within a virtual reality environment.
[0509] A "stage list" is a list that lists the specific work procedures and order required to carry out an event.
[0510] "Troubleshooting" refers to specific measures to deal with problems or issues that may arise during the event.
[0511] This invention is a system for streamlining the process from event planning to implementation. The system includes a terminal where users input basic event information, a server that receives and analyzes this information, a generative AI model that generates an optimal event plan based on past event data, and a VR system that provides a virtual reality environment.
[0512] First, the user accesses the system's website using their own device (computer or smartphone) and logs in or registers. The user then moves to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The server receives this information and analyzes the input data. Data cleansing techniques are used to check for any errors or inappropriate values. Python is used for data analysis, and Django is used as the web framework.
[0513] Once the analysis is complete, the server references a database of past events to search for events similar to the criteria entered by the user. This search uses PostgreSQL as the SQL database and Elasticsearch as the search engine. Based on the past data, a generative AI model (such as an imitation AI using TensorFlow) generates an optimal event plan. This generated plan includes a basic plan, a detailed procedure list, and anticipated problems and how to deal with them.
[0514] Next, if the user wishes to experience an event in a VR environment, they input this into the system. The server generates VR content using tools such as Unity and provides a virtual reality environment that the user can use. After the link is generated, the user is provided with a download link for a VR headset or smartphone app. The user uses this to simulate an event in the VR environment and provides feedback from the experience. The server receives the feedback and makes any necessary adjustments.
[0515] Finally, the server presents the revised event plan to the user for confirmation. After confirmation is obtained, the server generates all the final materials (proposal, schedule list, troubleshooting methods, etc.) and provides them to the user. The user downloads these materials and begins preparations for the actual event.
[0516] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0517] Title: Team Building Event
[0518] Objective: To improve employee collaboration
[0519] Number of participants: 50
[0520] Budget: 500,000 yen
[0521] Preferred date: December 15, 2023
[0522] The server receives and analyzes this information and references a database of past team-building events. The generative AI model generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.) based on the most successful past events. If the user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the event atmosphere and activities in virtual reality. The user provides feedback from the experience, and the server adjusts the plan based on that feedback.
[0523] Example prompt for generative AI model:
[0524] Prompt: I'd like to organize a team building event for my employees. Please suggest the best plan for the event based on the following basic information:
[0525] Title: Team Building Event
[0526] Objective: To improve employee collaboration
[0527] Number of participants: 50
[0528] Budget: 500,000 yen
[0529] Preferred date: December 15, 2023
[0530] In this way, the system increases the success rate of events and enables efficient and effective event planning and execution.
[0531] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0532] Step 1:
[0533] A user accesses the system's website using their own device and logs in or registers. A username and password are required as input. The output is the dashboard screen after successful login. Specifically, the username and password are sent to the server for authentication.
[0534] Step 2:
[0535] The user enters basic information about the event. Input items include the title, purpose, number of participants, budget, desired date, etc. When the send button is clicked, this information is sent to the server. As an output, a message is displayed to confirm the input information. Specifically, the information entered from the terminal is sent to the server.
[0536] Step 3:
[0537] The server analyzes the basic information of the event received from the user. The input data is the basic information of the event provided by the user. Data cleansing techniques are used to check for errors and inappropriate values. The output is the analysis results, which are saved. Specifically, data cleansing is performed using Python and the analysis results are displayed within the Django framework.
[0538] Step 4:
[0539] The server references a database of past events and searches for events similar to the conditions entered by the user. The input is the basic information of the analyzed events. The search is performed using PostgreSQL and Elasticsearch. The output is a list of similar events. Specifically, an SQL query is issued and similar events are extracted in Elasticsearch.
[0540] Step 5:
[0541] The server uses a generative AI model to generate an optimal event plan. The input is similar event data. Using an AI model (e.g., TensorFlow), an event plan is generated that includes optimal activities, a schedule list, and troubleshooting methods. The output is an event plan to provide to the user. Specifically, data is input into the generative AI model, and a plan is generated.
[0542] Step 6:
[0543] If a user wishes to experience an event in a VR environment, they input this into the system. The input is the user's choice of VR experience. The server generates the VR content using Unity or similar software. The output is a download link for a VR headset or smartphone app. Specifically, the VR content is generated and the link is sent to the user.
[0544] Step 7:
[0545] The user performs an event simulation in a VR environment. The input is access to VR content. The user experiences the simulation and submits feedback. The output is feedback data sent to the server. The specific operation is for the user to experience VR, enter their opinions in a feedback form, and submit it.
[0546] Step 8:
[0547] The server receives feedback from users and adjusts the event plan as needed. The input is the feedback data. The adjusted plan is regenerated. The output is an adjusted event plan. Specifically, the server re-analyzes the data based on the feedback and adjusts the plan using the generative AI model.
[0548] Step 9:
[0549] The server provides the final event plan to the user. The input is the adjusted event plan. The user reviews it and agrees. The output is the final event plan. Specific operations include generating the plan in a format such as PDF and providing the user with a download link.
[0550] Step 10:
[0551] The user receives the final plan and prepares to carry out the event. The input is the provided planning materials. The user then proceeds with specific preparations based on these. The output is that the event is ready to be carried out. Specific operations include the user downloading the materials and making the necessary arrangements and contacts.
[0552] (Application example 1)
[0553] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0554] Conventional event planning systems not only analyze user input information and reference past data to generate plans, but also lack the means to support execution in real-world environments and simulations. This makes it difficult to address problems and optimize the plan during the actual event, making it difficult to improve the success rate. Furthermore, the lack of functionality to support specific preparation work through real-time advice and simulations makes it difficult to streamline the cost and time required for event implementation.
[0555] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0556] In this invention, the server includes a means for users to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, a means for providing the event plan to users and receiving feedback, a means for providing an experience in a virtual reality environment, and a means for staff to prepare and simulate an event in a physical store while receiving advice in real time. This streamlines the process from event planning to implementation, enabling problem solving and optimization during actual event implementation. Furthermore, real-time advice and simulations enable cost and time efficiency in event implementation.
[0557] "User" refers to a person who inputs basic event information and uses the system to support the planning and implementation of an event.
[0558] "Basic event information" refers to basic information required for holding an event, such as the event title, purpose, target number of people, budget, desired date, etc.
[0559] The "server" is a computer system that analyzes information received from users and uses past data to generate optimal event plans.
[0560] "Imitation AI means" refers to artificial intelligence that learns from past event data and generates optimal event plans based on user input information.
[0561] "Feedback" refers to opinions and correction requests provided by users regarding the proposed event plan.
[0562] A "virtual reality environment" is an environment in which users can experience a virtual event space using a VR headset or smart glasses.
[0563] A "brick and mortar store" is a physical store where actual business activities are conducted.
[0564] "Simulation" is the process of virtually executing an event plan in a virtual reality environment to verify its effectiveness and any problems with its execution.
[0565] A "detailed procedure list" refers to the specific procedures and time schedule required to carry out an event.
[0566] "Problem-solving strategies" are solutions to problems that may arise during the event.
[0567] The system of this invention allows users to input basic event information, and the server analyzes and processes it to provide an optimal event plan. Furthermore, it aims to increase the success rate of events through real-time advice and simulations in a virtual reality environment.
[0568] Hardware and Software Configuration
[0569] 1. User device: A device (PC, smartphone, etc.) used to enter basic event information.
[0570] 2. Server: A computer system that receives and analyzes the basic information entered and generates the optimal event plan.
[0571] 3. Imitation AI method: Artificial intelligence (using GPT, etc.) that generates optimal event plans based on past event data.
[0572] 4. Cloud server: Infrastructure for analyzing input data and generating plans.
[0573] 5. Smart glasses: A device that helps with event preparation by providing real-time advice in physical stores.
[0574] 6. VR headset: A device to support event simulation in a virtual reality environment.
[0575] Program processing explanation
[0576] User terminal
[0577] The user uses the terminal to enter basic information about the event, such as the title, purpose, number of participants, budget, and desired date, into a form and sends it to the server.
[0578] server
[0579] The server analyzes the received basic event information and checks for inappropriate values or missing information. Once the analysis is complete, it references a database of past events and generates an event plan that best suits the input conditions.
[0580] Imitation AI methods
[0581] Imitation AI generates optimal event plans based on past event data and user input. The generated plans include a basic plan, a detailed procedure list, and solutions to problems. GPT-based models are often used as generative AI models.
[0582] Cloud Server
[0583] The cloud server is responsible for analyzing input data and generating plans, and also serves as the infrastructure for providing the generated event plans and feedback to users.
[0584] Smart Glasses
[0585] Staff can use smart glasses to prepare for events in physical stores with real-time advice, with a virtual assistant appearing on the screen to provide advice and direction.
[0586] VR headset
[0587] It is a device that allows users to simulate events in a virtual reality environment, allowing them to confirm and optimize their plans through a realistic experience.
[0588] Specific examples
[0589] For example, to organize a new product launch event for employees, a user logs into the system and enters the following basic information:
[0590] Title: New product launch event
[0591] Objective: New product launch
[0592] Number of participants: 100
[0593] Budget: 1 million yen
[0594] Preferred date: November 30, 2023
[0595] The server receives and analyzes this information and uses mimicry AI to generate an optimal event plan, including new product presentations, demonstrations, Q&A sessions, etc. Furthermore, by using simulations in a virtual reality environment and receiving feedback from users, the plan can be optimized, resulting in cost and time savings during preparation and execution.
[0596] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0597] Step 1:
[0598] The user enters the basic event information
[0599] Users access the system's website from their devices (PCs or smartphones) and are taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.). This information is sent to the server as user input.
[0600] Input: Basic information about the event
[0601] Output: Send information to the server
[0602] Step 2:
[0603] The server receives and analyzes basic event information
[0604] The server receives the basic event information sent by the user and checks for incomplete information or inappropriate values, specifically validating data types and checking for blank fields.
[0605] Input: Basic information about the event
[0606] Output: Parsed event information
[0607] Step 3:
[0608] Reference past data and generate optimal plans
[0609] The server then searches for similar events by referencing a database of past events based on the analyzed event information, and uses mimicry AI (e.g., a GPT model) to generate an optimal event plan based on the search results.
[0610] Input: Parsed event information
[0611] Output: Optimal event plan
[0612] Step 4:
[0613] Providing event plans and receiving feedback
[0614] The server provides the generated event plan to the user, who then reviews the plan and inputs feedback such as corrections and changes. The server receives and stores this feedback.
[0615] Input: Optimal event plan, user feedback
[0616] Output: User suggested fixes
[0617] Step 5:
[0618] Simulation in a virtual reality environment
[0619] When a user wants to simulate a virtual reality environment, the server generates VR content (such as 3D modeling and scene setting) and sends it to the user's VR headset or smartphone. The user then performs the simulation and provides feedback on the experience.
[0620] Input: Optimal event plan, virtual reality environment requirements
[0621] Output: VR content, feedback
[0622] Step 6:
[0623] Optimize your plan based on feedback
[0624] The server uses mimicry AI to fine-tune the plan based on user feedback, analyzing the feedback, identifying necessary modifications, and updating the plan.
[0625] Input: User feedback
[0626] Output: Updated event plan
[0627] Step 7:
[0628] Providing a detailed list of steps and solutions to problems
[0629] After the event plan is finalized, the server creates a detailed procedure list and troubleshooting methods and provides them to the user, who can then download these materials and begin preparations for the event.
[0630] Input: Final Event Plan
[0631] Output: Steps list, troubleshooting
[0632] Through these steps, users are effectively supported in the process from event planning to implementation.
[0633] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0634] This invention is an AI system for streamlining the process from event planning to execution. In particular, it is characterized by providing a more personalized event experience by combining it with an emotion engine that recognizes user emotions. An embodiment of the system is described in detail below.
[0635] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[0636] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[0637] The emotion engine then analyzes text and voice data from user input and feedback to recognize the user's emotions. For example, if the user expresses dissatisfaction with an activity, the engine can adjust the event plan based on that data. The engine also collects the user's preferences and interests and optimizes the plan accordingly.
[0638] Furthermore, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment, and the emotion engine monitors the user's emotions in real time. Based on the user's emotion data, the server adjusts the experience within the VR content in real time.
[0639] Once the final event plan is finalized, the server confirms with the user and receives final approval. The server then generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The user can download these materials and begin preparations for the event. In this way, combining the emotion engine improves user satisfaction and enables more effective and personalized event planning and implementation.
[0640] Specific examples
[0641] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0642] Title: Team Building Event
[0643] Objective: To improve employee collaboration
[0644] Number of participants: 50
[0645] Budget: 500,000 yen
[0646] Preferred date: December 15, 2023
[0647] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[0648] The emotion engine reads the user's expectations and anxieties from the data they input, adjusts the selection and distribution of activities, and collects feedback from the user and re-optimizes the plan based on that data.
[0649] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The emotion engine analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, it can switch to a different activity.
[0650] Finally, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. Users can download these materials and begin preparations for the actual event. This system increases the success rate of events and improves user satisfaction.
[0651] The processing flow will be explained below.
[0652] Step 1:
[0653] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[0654] Step 2:
[0655] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[0656] Step 3:
[0657] The user completes the input and clicks the "Submit" button.
[0658] Step 4:
[0659] The server receives basic information about the event sent by the user.
[0660] Step 5:
[0661] The server analyzes the data it receives and checks for incomplete input information or inappropriate values.
[0662] Step 6:
[0663] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[0664] Step 7:
[0665] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[0666] Step 8:
[0667] The server provides the generated event plan to the user and has the user confirm it.
[0668] Step 9:
[0669] The user enters feedback, which is then analyzed by the emotion engine.
[0670] Step 10:
[0671] The emotion engine identifies emotions based on user feedback and adjusts the event plan accordingly.
[0672] Step 11:
[0673] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[0674] Step 12:
[0675] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[0676] Step 13:
[0677] The user performs an event simulation in a VR environment, and the emotion engine monitors the user's emotions in real time.
[0678] Step 14:
[0679] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user expresses negative emotions in a particular scene, the scene will be changed.
[0680] Step 15:
[0681] The server presents the final event plan to the user for confirmation.
[0682] Step 16:
[0683] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[0684] Step 17:
[0685] The user downloads the provided materials and prepares for the event.
[0686] Example 2
[0687] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0688] Conventional event planning systems have the problem that once a plan is generated based on the event information entered by the user, it is fixed and difficult to adjust afterwards. Furthermore, they lack the functionality to reflect the user's preferences and emotions, which can result in insufficient personalization for each user and reduced user satisfaction. Furthermore, it is difficult to reflect user feedback in real time in VR experiences, making it difficult to provide an experience that is in line with the user's emotions.
[0689] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0690] In this invention, the server includes a means for a user to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past statistical data, an emotion analysis means for recognizing the user's emotions and adjusting the event plan, a means for providing the event plan to the user and receiving feedback, a means for providing an experience in a VR environment, and a means for monitoring the user's emotions in real time during the VR experience and instantly adjusting the content. This allows the user's emotions to be reflected in the event plan, providing a personalized, optimized event experience. Furthermore, adjusting the VR content based on real-time emotion feedback can achieve higher user satisfaction and a sense of realism.
[0691] "User" means any person or entity that accesses the system and enters basic information about an event.
[0692] "Basic event information" refers to basic information required for event planning, such as the title, purpose, target number of people, budget, and desired date.
[0693] "Server" means a computer system that receives and analyzes information sent by users and generates and provides event plans.
[0694] "Receiving" refers to the server taking in data sent by the user.
[0695] "Analysis" is the process of verifying received data to check for any errors or inappropriate values.
[0696] "Statistical data" is a collection of data about events that have taken place in the past, and is information that forms the basis of analysis.
[0697] "Mimetic AI means" is an artificial intelligence technology that generates optimal event plans based on past statistical data.
[0698] "Emotion analysis means" is a technical means for analyzing a user's emotions and adjusting the event plan based on the analysis.
[0699] "Providing" refers to the act of presenting the generated event plan to the user.
[0700] "Feedback" refers to evaluations and opinions obtained from users.
[0701] A "VR environment" is a simulation space constructed using virtual reality technology.
[0702] "Emotion monitoring" is a technology that monitors and records the emotions felt by users during a VR experience in real time.
[0703] "Real-time monitoring" is a technology that instantly observes and responds to users' emotions and behavior.
[0704] "Instant adjustment" means instantly changing the content of the VR content based on the results of emotion monitoring.
[0705] This invention is an AI system that streamlines the process from event planning to execution. Its unique feature is that it provides a more personalized event experience by incorporating an emotion engine that recognizes user emotions. The system allows users to input basic event information, and the server receives and analyzes that information to generate an optimal event plan. It also provides an experience in a VR environment, adjusting the plan based on feedback.
[0706] First, the user accesses the system's website from a device such as a PC or smartphone and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The device then sends an HTTP request to the server, which transmits the information entered by the user.
[0707] The server receives the basic information of the event sent by the user and parses the input data to check for errors or invalid values, using a data validation library (e.g., JSON Schema Validator).
[0708] Once the analysis is complete, the server uses past statistical data to search for events similar to the criteria entered by the user. This search process involves executing a database query to retrieve data that matches the criteria. The server then uses mimicry AI to generate an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them. The generative AI model is invoked as an API call or library to generate a plan based on the input data.
[0709] Furthermore, the sentiment analysis method analyzes text and voice data during user input and feedback to recognize the user's emotions. This analysis is performed using sentiment analysis libraries (e.g., IBM Watson, Microsoft Azure Cognitive Services). If the user expresses dissatisfaction with the activity, the event plan is adjusted based on this data. The system also collects the user's preferences and interests and optimizes the plan accordingly.
[0710] Next, if the user wishes to experience the event in a VR environment, they input this into the system. The server generates the VR content and provides a link that the user can access from a VR headset or smartphone app. For this purpose, a VR content generation engine (e.g., Unity, Unreal Engine) is used. The user puts on the VR headset and accesses the VR content from the link provided by the system.
[0711] During the VR experience, the emotion engine monitors the user's emotions in real time and instantly adjusts the VR content as needed. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[0712] Finally, once the final event plan has been finalized, the server confirms it with the user. After final confirmation, the server generates all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The server generates the materials using a document generation tool (e.g., LaTeX, Microsoft Office API) and provides them to the user. The user can then download the provided materials and proceed with event preparations.
[0713] Specific examples
[0714] For example, to organize a team building event for employees, a user logs into the system and enters the following basic information:
[0715] Title: Team Building Event
[0716] Objective: To improve employee collaboration
[0717] Number of participants: 50
[0718] Budget: 500,000 yen
[0719] Preferred date: December 15, 2023
[0720] The server receives and analyzes this information and references a statistical database of past team building events. Based on the most successful past events, the Mimic AI generates a plan that combines the optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[0721] The system uses emotion analysis to read user input data to understand their expectations and anxieties, adjusts the selection and distribution of activities, and collects user feedback to re-optimize the plan based on that data.
[0722] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere of the event or activity in virtual reality. An emotion analysis means analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, the server can switch to another activity.
[0723] An example prompt is:
[0724] I'd like to organize a team building event for my employees. Please generate the best event plan based on the following information:
[0725] Title: Team Building Event
[0726] Objective: To improve employee collaboration
[0727] Number of participants: 50
[0728] Budget: 500,000 yen
[0729] Preferred date: December 15, 2023
[0730] Use past success stories to suggest a plan with optimal activities and steps, and be prepared to adjust the plan based on user sentiment.
[0731] This system will improve user satisfaction and enable more effective event planning and implementation.
[0732] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0733] Step 1:
[0734] A user accesses the system and logs in
[0735] Users use a device such as a PC or smartphone to access the system's website using a web browser and log in or register.
[0736] Specific actions: Open a browser, enter the URL to access the system website, enter the username and password on the login page, and click the login button.
[0737] Input: URL, username, password
[0738] Output: Login success / failure response
[0739] Step 2:
[0740] The user fills in the form with basic event information
[0741] The user is taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[0742] Specific actions: Move cursor to form fields, enter information, and click submit.
[0743] Input: Basic information about the event (title, purpose, number of people, budget, desired date, etc.)
[0744] Output: HTTP request containing basic event information
[0745] Step 3:
[0746] The server receives and analyzes basic event information.
[0747] The server receives the basic information of the event sent by the user and parses the input data, using a data validation library (e.g., JSON Schema Validator) to check for errors or invalid values.
[0748] Specific behavior: Receives an HTTP request and verifies the validity of the data.
[0749] Input: Event basic information (HTTP request)
[0750] Output: Verification result (valid / invalid)
[0751] Step 4:
[0752] The server references past statistical data and generates an event plan
[0753] The server references a historical statistical database to search for events similar to the user's criteria, executes a database query, retrieves event data that matches the criteria, and then uses mimicry AI to generate an optimal event plan.
[0754] What it does: Executes SQL queries to retrieve information from a database and invokes a generative AI model to generate a plan.
[0755] Input: Verified event basic information
[0756] Output: Optimal event plan (basic plan, detailed schedule, anticipated problems and how to deal with them)
[0757] Step 5:
[0758] The server recognizes the user's emotions using emotion analysis means.
[0759] The server uses emotion analysis to analyze text and voice data at the time of user input and feedback, and recognizes the user's emotions. An emotion analysis library (e.g., IBM Watson, Microsoft Azure Cognitive Services) is used.
[0760] Specific operation: User text and voice data are input into the emotion analysis tool, and emotion data is output.
[0761] Input: text and voice data during user input and feedback
[0762] Output: User's emotional data (expectation, anxiety, satisfaction, dissatisfaction, etc.)
[0763] Step 6:
[0764] The server adjusts the event plan based on the emotional data.
[0765] Based on the emotional data recognized by the emotion analysis means, the event plan generated using the mimicry AI is adjusted. The emotional data is fed back to the mimicry AI model to regenerate the plan.
[0766] Specific operation: Emotional data is input into the AI model, and an optimized event plan is output.
[0767] Input: User emotion data, the initially generated event plan
[0768] Output: Adjusted event plan
[0769] Step 7:
[0770] If a user wishes to experience an event in a VR environment, the server generates the VR content.
[0771] The server generates VR content based on the user's request. It creates simulation data using a VR content generation engine (e.g., Unity, Unreal Engine).
[0772] Specific operation: Inputs the necessary data into the VR content generation engine and outputs a link to the generated VR content.
[0773] Enter: Event Plan
[0774] Output: VR content link
[0775] Step 8:
[0776] The user experiences VR
[0777] Users experience the generated VR content using a VR headset or smartphone app. They wear the headset and access the content via a link provided by the system.
[0778] Specific Actions: Put on the VR headset and click the provided link to connect to the VR content.
[0779] Input: VR content link
[0780] Output: VR experience
[0781] Step 9:
[0782] Emotion analysis means monitors the user's emotions in real time during the VR experience, and the server instantly adjusts the content.
[0783] The emotion analysis means analyzes the user's emotions in real time during the VR experience, and the server instantly adjusts the VR content based on that data. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[0784] Specific operation: Data collected from sensors is input into an emotion analysis tool to generate adjusted VR content.
[0785] Input: User's real-time emotional data, current VR content
[0786] Output: Adjusted VR content
[0787] Step 10:
[0788] The server confirms the event plan with the user, and after final confirmation, generates and provides the materials.
[0789] Once the event plan is finalized, the server confirms with the user. After final confirmation, all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) are generated and sent to the user. The materials are generated using a document generation tool (e.g., LaTeX, Microsoft Office API).
[0790] Specific operations: The final plan contents are sent to the user via email or notification, and materials are created using a document generation tool based on feedback and provided to the user via email or download link.
[0791] Input: Final event plan, feedback
[0792] Output: All materials for the event
[0793] (Application example 2)
[0794] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0795] Current virtual store systems offer uniform product recommendations to users, resulting in a lack of personalized recommendations that address individual users' emotions and needs. Furthermore, they are unable to grasp users' emotional changes in real time during the shopping experience and adjust the experience accordingly. This results in lower user satisfaction and a decrease in purchasing motivation. Furthermore, even systems that offer event experiences have difficulty providing optimal experiences based on users' emotions.
[0796] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0797] In this invention, the server includes means for a user to input basic event information, means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, an emotion recognition engine means for analyzing and monitoring user emotion data in real time, and means for personalizing the shopping experience based on the user emotion data. This enables personalized suggestions and experiences according to the user's emotions, improving user satisfaction and increasing purchasing motivation.
[0798] The "means for users to input basic event information" is an interface that allows users to input basic information about an event, such as the title, purpose, target number of people, budget, and desired date, into the system.
[0799] The "means for the server to receive and analyze the basic event information" is a function that receives the basic event information entered by the user, analyzes it, and checks for any errors or inappropriate values.
[0800] "An imitation AI method that generates optimal event plans based on past event data" is an artificial intelligence technology that references a past event database, searches for events similar to the user's input conditions, and generates optimal event plans.
[0801] The "means for providing the event plan to the user and receiving feedback" is a function for presenting the generated event plan to the user and collecting opinions and impressions from the user.
[0802] "Means for providing an experience in a VR environment" refers to a function that provides VR content and links necessary for users to simulate an event in a virtual reality environment.
[0803] The "emotion recognition engine means for analyzing and monitoring user emotion data in real time" is a technology for analyzing a user's text and voice data and grasping and monitoring the user's emotional state in real time.
[0804] "Means for personalizing the shopping experience based on the user's emotional data" refers to a function that optimizes products and experience content based on the user's emotional data and makes personalized suggestions tailored to each individual user.
[0805] "Means for the server to generate a detailed schedule list and troubleshooting methods based on the event plan and provide them to the user" refers to a function that creates detailed procedures and troubleshooting methods for anticipated problems based on the generated event plan and provides them to the user.
[0806] The "natural language analysis means for analyzing text data entered by a user and obtaining an emotion score and the intensity of the emotion" is a technology for mechanically analyzing text data entered by a user and calculating the user's emotion score and the intensity of that emotion.
[0807] The present invention relates to a system and method for personalizing a user's shopping experience in a virtual store. DETAILED DESCRIPTION OF THE INVENTION The following describes an embodiment of the present invention.
[0808] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event or shopping (title, purpose, budget, etc.), enter the required information, and submit it.
[0809] The server receives the basic information sent by the user and analyzes the input data using natural language processing technology using the Google Cloud Natural Language API, which checks for any errors or inappropriate values in the input data.
[0810] The server then searches a database of past events to find events similar to the user's input. The mimicry AI then generates an optimal event plan, which includes a basic plan, a detailed schedule, and potential problems and how to deal with them.
[0811] The emotion recognition engine analyzes text and voice data during user input and feedback to identify the user's emotions. Again, it uses the Google Cloud Natural Language API to obtain an emotion score and emotion intensity. For example, if a user has a positive reaction to a particular product, that emotion data can be used to optimize product suggestions.
[0812] Furthermore, if a user wishes to experience a VR environment, they input this into the system. The server generates the VR content and provides links to a VR headset and smartphone app. The user simulates an event in the VR environment, and an emotion recognition engine monitors the user's emotions in real time. For example, if the user has a negative reaction to a particular activity, the system can switch to another activity.
[0813] Once the final event plan is finalized, the server will contact the user for confirmation. The server will then generate all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and send them to the user. The user can then download these materials and begin preparing for the event and shopping.
[0814] This allows for personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction and increasing purchasing motivation.
[0815] Specific examples
[0816] The user puts on a head-mounted display and accesses a virtual shop. The AI assistant in the shop asks, "Are you looking for something?" If the user says, "I've been feeling stressed lately and want to relax," the emotion engine analyzes the text and suggests products that have a relaxing effect.
[0817] Example prompts to input to the generative AI model
[0818] Example of input prompt:
[0819] If a user says, "I've been feeling stressed lately and want to relax," analyze this using an emotion recognition engine and generate Python code that suggests products that have a relaxing effect.
[0820] This method allows the shopping experience in the virtual store to be personalized based on the user's emotions, providing a more satisfying experience.
[0821] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0822] Step 1:
[0823] A user accesses the system's website from their device (PC or smartphone) and logs in or registers. In this step, the user's authentication information is entered, which is received by the server and authenticates the user. The input data is the user ID and password, and the output is the authentication result.
[0824] Step 2:
[0825] The user enters basic information about the event or shopping (title, purpose, budget, etc.) into an input form and submits it. The server receives the submitted basic information, analyzes the input data, and checks for errors or inappropriate values. The input data is the basic information about the event or shopping, and the output is the analysis results.
[0826] Step 3:
[0827] The server refers to a database of past events and searches for event data similar to the conditions entered by the user. The mimicking AI generates an optimal event plan. In this step, the input data is the user's input information and past event data, and the output is the generated event plan.
[0828] Step 4:
[0829] The emotion recognition engine analyzes text and voice data during user input and feedback to recognize the user's emotions. Specifically, it uses the Google Cloud Natural Language API to obtain emotion scores and emotion intensity. The input data is the user's text and voice data, and the output is emotion scores and emotion intensity.
[0830] Step 5:
[0831] The server provides the event plan to the user and receives feedback. The server adjusts the generated event plan based on the user's feedback. The input data are the event plan and the user's feedback, and the output is the adjusted event plan.
[0832] Step 6:
[0833] When a user requests an experience in a VR environment, the server generates VR content and a link to a VR headset or smartphone app. The user simulates an event in the VR environment, and the emotion recognition engine monitors the user's emotions in real time. The input data is the user's desired information and past VR content, and the output is the generated VR content and a link.
[0834] Step 7:
[0835] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user has a negative reaction to a particular activity, it switches to another activity. In this step, the input data is the user's emotional data, and the output is the adjusted VR content.
[0836] Step 8:
[0837] The server confirms the final event plan with the user and receives final approval. The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The input data is the final event plan, and the output is all generated materials.
[0838] This series of steps enables personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction.
[0839] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0840] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0841] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0842] [Third embodiment]
[0843] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0844] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0845] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0846] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0847] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0848] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0849] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0850] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0851] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0852] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0853] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0854] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0855] This invention is an AI system for streamlining the process from event planning to execution. An embodiment of the system is described in detail below.
[0856] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[0857] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[0858] Next, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment and inputs feedback. The server receives the feedback and makes any necessary adjustments.
[0859] Once the final event plan is finalized, the server confirms with the user and provides all necessary materials (proposal, schedule list, troubleshooting methods, etc.). The user downloads these materials and begins preparations for the event. This allows for efficient and effective event planning and implementation.
[0860] Specific examples
[0861] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0862] Title: Team Building Event
[0863] Objective: To improve employee collaboration
[0864] Number of participants: 50
[0865] Budget: 500,000 yen
[0866] Preferred date: December 15, 2023
[0867] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[0868] When a user requests a VR experience, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The user provides feedback from the experience, and the server adjusts the plan accordingly.
[0869] Once the final plan is finalized, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. The user can download these materials and begin preparations for the actual event. In this way, this system increases the success rate of events and enables effective, cost-effective event implementation.
[0870] The processing flow will be explained below.
[0871] Step 1:
[0872] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[0873] Step 2:
[0874] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[0875] Step 3:
[0876] The user completes the input and clicks the "Submit" button.
[0877] Step 4:
[0878] The server receives basic information about the event sent by the user.
[0879] Step 5:
[0880] The server analyzes the received data and checks for any incomplete or inappropriate input information.
[0881] Step 6:
[0882] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[0883] Step 7:
[0884] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[0885] Step 8:
[0886] The server provides the generated event plan to the user, who then confirms it.
[0887] Step 9:
[0888] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[0889] Step 10:
[0890] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[0891] Step 11:
[0892] The user performs an event simulation in a VR environment and inputs feedback.
[0893] Step 12:
[0894] The server receives user feedback and makes necessary adjustments.
[0895] Step 13:
[0896] Once the final event plan is finalized, the server will check with the user and obtain final confirmation.
[0897] Step 14:
[0898] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[0899] Step 15:
[0900] The user downloads the provided materials and prepares for the event.
[0901] Example 1
[0902] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0903] The process from planning to implementing an event is often time-consuming and complicated. There is a need for a system that allows users to efficiently plan and implement events. Furthermore, to increase the success of an event, it is necessary to provide an optimal plan based on past success stories. Furthermore, it is expected that by using a simulation in a virtual reality environment to check the atmosphere and details of the event in advance and incorporating feedback, more accurate event planning can be achieved.
[0904] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0905] In this invention, the server includes a terminal means for a user to input basic event information, a means for receiving and analyzing the basic event information, a generation AI model means for generating an optimal event plan based on past event data, a means for providing the event plan to the user and receiving feedback, and a means for providing an experience in a virtual reality environment, thereby enabling the user to efficiently and effectively carry out events from planning to implementation.
[0906] "User" refers to an individual or organization that uses the system to plan and implement an event.
[0907] The "terminal means" refers to an electronic device such as a computer or smartphone that a user uses to input basic event information.
[0908] A "server" is a central computer system that receives, analyzes, and processes information entered by users.
[0909] "Basic event information" refers to basic information required for planning an event, such as the event title, purpose, target number of people, budget, and desired date.
[0910] The "analyzing means" is a processing means for checking the basic event information received from the user and determining whether there are any deficiencies or inappropriate values.
[0911] "Past event data" is a collection of data that records information about events that have taken place in the past, and is a database that the system uses as a reference.
[0912] "Generative AI model means" refers to artificial intelligence technology that automatically generates optimal event plans based on past event data.
[0913] An "event plan" is a detailed plan for an event that is generated based on basic information entered by the user and past data.
[0914] The "means for receiving feedback" refers to a processing means for receiving feedback (opinions and impressions) provided by the user and recognizing it in the system.
[0915] "Virtual reality environment" means a computer-generated environment in which a user simulates events in a virtual space.
[0916] "Virtual reality content" means a simulation of an event or other related content that can be experienced by a user within a virtual reality environment.
[0917] A "stage list" is a list that lists the specific work procedures and order required to carry out an event.
[0918] "Troubleshooting" refers to specific measures to deal with problems or issues that may arise during the event.
[0919] This invention is a system for streamlining the process from event planning to implementation. The system includes a terminal where users input basic event information, a server that receives and analyzes this information, a generative AI model that generates an optimal event plan based on past event data, and a VR system that provides a virtual reality environment.
[0920] First, the user accesses the system's website using their own device (computer or smartphone) and logs in or registers. The user then moves to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The server receives this information and analyzes the input data. Data cleansing techniques are used to check for any errors or inappropriate values. Python is used for data analysis, and Django is used as the web framework.
[0921] Once the analysis is complete, the server references a database of past events to search for events similar to the criteria entered by the user. This search uses PostgreSQL as the SQL database and Elasticsearch as the search engine. Based on the past data, a generative AI model (such as an imitation AI using TensorFlow) generates an optimal event plan. This generated plan includes a basic plan, a detailed procedure list, and anticipated problems and how to deal with them.
[0922] Next, if the user wishes to experience an event in a VR environment, they input this into the system. The server generates VR content using tools such as Unity and provides a virtual reality environment that the user can use. After the link is generated, the user is provided with a download link for a VR headset or smartphone app. The user uses this to simulate an event in the VR environment and provides feedback from the experience. The server receives the feedback and makes any necessary adjustments.
[0923] Finally, the server presents the revised event plan to the user for confirmation. After confirmation is obtained, the server generates all the final materials (proposal, schedule list, troubleshooting methods, etc.) and provides them to the user. The user downloads these materials and begins preparations for the actual event.
[0924] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[0925] Title: Team Building Event
[0926] Objective: To improve employee collaboration
[0927] Number of participants: 50
[0928] Budget: 500,000 yen
[0929] Preferred date: December 15, 2023
[0930] The server receives and analyzes this information and references a database of past team-building events. The generative AI model generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.) based on the most successful past events. If the user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the event atmosphere and activities in virtual reality. The user provides feedback from the experience, and the server adjusts the plan based on that feedback.
[0931] Example prompt for generative AI model:
[0932] Prompt: I'd like to organize a team building event for my employees. Please suggest the best plan for the event based on the following basic information:
[0933] Title: Team Building Event
[0934] Objective: To improve employee collaboration
[0935] Number of participants: 50
[0936] Budget: 500,000 yen
[0937] Preferred date: December 15, 2023
[0938] In this way, the system increases the success rate of events and enables efficient and effective event planning and execution.
[0939] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0940] Step 1:
[0941] A user accesses the system's website using their own device and logs in or registers. A username and password are required as input. The output is the dashboard screen after successful login. Specifically, the username and password are sent to the server for authentication.
[0942] Step 2:
[0943] The user enters basic information about the event. Input items include the title, purpose, number of participants, budget, desired date, etc. When the send button is clicked, this information is sent to the server. As an output, a message is displayed to confirm the input information. Specifically, the information entered from the terminal is sent to the server.
[0944] Step 3:
[0945] The server analyzes the basic information of the event received from the user. The input data is the basic information of the event provided by the user. Data cleansing techniques are used to check for errors and inappropriate values. The output is the analysis results, which are saved. Specifically, data cleansing is performed using Python and the analysis results are displayed within the Django framework.
[0946] Step 4:
[0947] The server references a database of past events and searches for events similar to the conditions entered by the user. The input is the basic information of the analyzed events. The search is performed using PostgreSQL and Elasticsearch. The output is a list of similar events. Specifically, an SQL query is issued and similar events are extracted in Elasticsearch.
[0948] Step 5:
[0949] The server uses a generative AI model to generate an optimal event plan. The input is similar event data. Using an AI model (e.g., TensorFlow), an event plan is generated that includes optimal activities, a schedule list, and troubleshooting methods. The output is an event plan to provide to the user. Specifically, data is input into the generative AI model, and a plan is generated.
[0950] Step 6:
[0951] If a user wishes to experience an event in a VR environment, they input this into the system. The input is the user's choice of VR experience. The server generates the VR content using Unity or similar software. The output is a download link for a VR headset or smartphone app. Specifically, the VR content is generated and the link is sent to the user.
[0952] Step 7:
[0953] The user performs an event simulation in a VR environment. The input is access to VR content. The user experiences the simulation and submits feedback. The output is feedback data sent to the server. The specific operation is for the user to experience VR, enter their opinions in a feedback form, and submit it.
[0954] Step 8:
[0955] The server receives feedback from users and adjusts the event plan as needed. The input is the feedback data. The adjusted plan is regenerated. The output is an adjusted event plan. Specifically, the server re-analyzes the data based on the feedback and adjusts the plan using the generative AI model.
[0956] Step 9:
[0957] The server provides the final event plan to the user. The input is the adjusted event plan. The user reviews it and agrees. The output is the final event plan. Specific operations include generating the plan in a format such as PDF and providing the user with a download link.
[0958] Step 10:
[0959] The user receives the final plan and prepares to carry out the event. The input is the provided planning materials. The user then proceeds with specific preparations based on these. The output is that the event is ready to be carried out. Specific operations include the user downloading the materials and making the necessary arrangements and contacts.
[0960] (Application example 1)
[0961] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0962] Conventional event planning systems not only analyze user input information and reference past data to generate plans, but also lack the means to support execution in real-world environments and simulations. This makes it difficult to address problems and optimize the plan during the actual event, making it difficult to improve the success rate. Furthermore, the lack of functionality to support specific preparation work through real-time advice and simulations makes it difficult to streamline the cost and time required for event implementation.
[0963] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0964] In this invention, the server includes a means for users to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, a means for providing the event plan to users and receiving feedback, a means for providing an experience in a virtual reality environment, and a means for staff to prepare and simulate an event in a physical store while receiving advice in real time. This streamlines the process from event planning to implementation, enabling problem solving and optimization during actual event implementation. Furthermore, real-time advice and simulations enable cost and time efficiency in event implementation.
[0965] "User" refers to a person who inputs basic event information and uses the system to support the planning and implementation of an event.
[0966] "Basic event information" refers to basic information required for holding an event, such as the event title, purpose, target number of people, budget, desired date, etc.
[0967] The "server" is a computer system that analyzes information received from users and uses past data to generate optimal event plans.
[0968] "Imitation AI means" refers to artificial intelligence that learns from past event data and generates optimal event plans based on user input information.
[0969] "Feedback" refers to opinions and correction requests provided by users regarding the proposed event plan.
[0970] A "virtual reality environment" is an environment in which users can experience a virtual event space using a VR headset or smart glasses.
[0971] A "brick and mortar store" is a physical store where actual business activities are conducted.
[0972] "Simulation" is the process of virtually executing an event plan in a virtual reality environment to verify its effectiveness and any problems with its execution.
[0973] A "detailed procedure list" refers to the specific procedures and time schedule required to carry out an event.
[0974] "Problem-solving strategies" are solutions to problems that may arise during the event.
[0975] The system of this invention allows users to input basic event information, and the server analyzes and processes it to provide an optimal event plan. Furthermore, it aims to increase the success rate of events through real-time advice and simulations in a virtual reality environment.
[0976] Hardware and Software Configuration
[0977] 1. User device: A device (PC, smartphone, etc.) used to enter basic event information.
[0978] 2. Server: A computer system that receives and analyzes the basic information entered and generates the optimal event plan.
[0979] 3. Imitation AI method: Artificial intelligence (using GPT, etc.) that generates optimal event plans based on past event data.
[0980] 4. Cloud server: Infrastructure for analyzing input data and generating plans.
[0981] 5. Smart glasses: A device that helps with event preparation by providing real-time advice in physical stores.
[0982] 6. VR headset: A device to support event simulation in a virtual reality environment.
[0983] Program processing explanation
[0984] User terminal
[0985] The user uses the terminal to enter basic information about the event, such as the title, purpose, number of participants, budget, and desired date, into a form and sends it to the server.
[0986] server
[0987] The server analyzes the received basic event information and checks for inappropriate values or missing information. Once the analysis is complete, it references a database of past events and generates an event plan that best suits the input conditions.
[0988] Imitation AI methods
[0989] Imitation AI generates optimal event plans based on past event data and user input. The generated plans include a basic plan, a detailed procedure list, and solutions to problems. GPT-based models are often used as generative AI models.
[0990] Cloud Server
[0991] The cloud server is responsible for analyzing input data and generating plans, and also serves as the infrastructure for providing the generated event plans and feedback to users.
[0992] Smart Glasses
[0993] Staff can use smart glasses to prepare for events in physical stores with real-time advice, with a virtual assistant appearing on the screen to provide advice and direction.
[0994] VR headset
[0995] It is a device that allows users to simulate events in a virtual reality environment, allowing them to confirm and optimize their plans through a realistic experience.
[0996] Specific examples
[0997] For example, to organize a new product launch event for employees, a user logs into the system and enters the following basic information:
[0998] Title: New product launch event
[0999] Objective: New product launch
[1000] Number of participants: 100
[1001] Budget: 1 million yen
[1002] Preferred date: November 30, 2023
[1003] The server receives and analyzes this information and uses mimicry AI to generate an optimal event plan, including new product presentations, demonstrations, Q&A sessions, etc. Furthermore, by using simulations in a virtual reality environment and receiving feedback from users, the plan can be optimized, resulting in cost and time savings during preparation and execution.
[1004] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1005] Step 1:
[1006] The user enters the basic event information
[1007] Users access the system's website from their devices (PCs or smartphones) and are taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.). This information is sent to the server as user input.
[1008] Input: Basic information about the event
[1009] Output: Send information to the server
[1010] Step 2:
[1011] The server receives and analyzes basic event information
[1012] The server receives the basic event information sent by the user and checks for incomplete information or inappropriate values, specifically validating data types and checking for blank fields.
[1013] Input: Basic information about the event
[1014] Output: Parsed event information
[1015] Step 3:
[1016] Reference past data and generate optimal plans
[1017] The server then searches for similar events by referencing a database of past events based on the analyzed event information, and uses mimicry AI (e.g., a GPT model) to generate an optimal event plan based on the search results.
[1018] Input: Parsed event information
[1019] Output: Optimal event plan
[1020] Step 4:
[1021] Providing event plans and receiving feedback
[1022] The server provides the generated event plan to the user, who then reviews the plan and inputs feedback such as corrections and changes. The server receives and stores this feedback.
[1023] Input: Optimal event plan, user feedback
[1024] Output: User suggested fixes
[1025] Step 5:
[1026] Simulation in a virtual reality environment
[1027] When a user wants to simulate a virtual reality environment, the server generates VR content (such as 3D modeling and scene setting) and sends it to the user's VR headset or smartphone. The user then performs the simulation and provides feedback on the experience.
[1028] Input: Optimal event plan, virtual reality environment requirements
[1029] Output: VR content, feedback
[1030] Step 6:
[1031] Optimize your plan based on feedback
[1032] The server uses mimicry AI to fine-tune the plan based on user feedback, analyzing the feedback, identifying necessary modifications, and updating the plan.
[1033] Input: User feedback
[1034] Output: Updated event plan
[1035] Step 7:
[1036] Providing a detailed list of steps and solutions to problems
[1037] After the event plan is finalized, the server creates a detailed procedure list and troubleshooting methods and provides them to the user, who can then download these materials and begin preparations for the event.
[1038] Input: Final Event Plan
[1039] Output: Steps list, troubleshooting
[1040] Through these steps, users are effectively supported in the process from event planning to implementation.
[1041] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1042] This invention is an AI system for streamlining the process from event planning to execution. In particular, it is characterized by providing a more personalized event experience by combining it with an emotion engine that recognizes user emotions. An embodiment of the system is described in detail below.
[1043] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[1044] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[1045] The emotion engine then analyzes text and voice data from user input and feedback to recognize the user's emotions. For example, if the user expresses dissatisfaction with an activity, the engine can adjust the event plan based on that data. The engine also collects the user's preferences and interests and optimizes the plan accordingly.
[1046] Furthermore, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment, and the emotion engine monitors the user's emotions in real time. Based on the user's emotion data, the server adjusts the experience within the VR content in real time.
[1047] Once the final event plan is finalized, the server confirms with the user and receives final approval. The server then generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The user can download these materials and begin preparations for the event. In this way, combining the emotion engine improves user satisfaction and enables more effective and personalized event planning and implementation.
[1048] Specific examples
[1049] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[1050] Title: Team Building Event
[1051] Objective: To improve employee collaboration
[1052] Number of participants: 50
[1053] Budget: 500,000 yen
[1054] Preferred date: December 15, 2023
[1055] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[1056] The emotion engine reads the user's expectations and anxieties from the data they input, adjusts the selection and distribution of activities, and collects feedback from the user and re-optimizes the plan based on that data.
[1057] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The emotion engine analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, it can switch to a different activity.
[1058] Finally, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. Users can download these materials and begin preparations for the actual event. This system increases the success rate of events and improves user satisfaction.
[1059] The processing flow will be explained below.
[1060] Step 1:
[1061] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[1062] Step 2:
[1063] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[1064] Step 3:
[1065] The user completes the input and clicks the "Submit" button.
[1066] Step 4:
[1067] The server receives basic information about the event sent by the user.
[1068] Step 5:
[1069] The server analyzes the data it receives and checks for incomplete input information or inappropriate values.
[1070] Step 6:
[1071] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[1072] Step 7:
[1073] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[1074] Step 8:
[1075] The server provides the generated event plan to the user and has the user confirm it.
[1076] Step 9:
[1077] The user enters feedback, which is then analyzed by the emotion engine.
[1078] Step 10:
[1079] The emotion engine identifies emotions based on user feedback and adjusts the event plan accordingly.
[1080] Step 11:
[1081] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[1082] Step 12:
[1083] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[1084] Step 13:
[1085] The user performs an event simulation in a VR environment, and the emotion engine monitors the user's emotions in real time.
[1086] Step 14:
[1087] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user expresses negative emotions in a particular scene, the scene will be changed.
[1088] Step 15:
[1089] The server presents the final event plan to the user for confirmation.
[1090] Step 16:
[1091] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[1092] Step 17:
[1093] The user downloads the provided materials and prepares for the event.
[1094] Example 2
[1095] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1096] Conventional event planning systems have the problem that once a plan is generated based on the event information entered by the user, it is fixed and difficult to adjust afterwards. Furthermore, they lack the functionality to reflect the user's preferences and emotions, which can result in insufficient personalization for each user and reduced user satisfaction. Furthermore, it is difficult to reflect user feedback in real time in VR experiences, making it difficult to provide an experience that is in line with the user's emotions.
[1097] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1098] In this invention, the server includes a means for a user to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past statistical data, an emotion analysis means for recognizing the user's emotions and adjusting the event plan, a means for providing the event plan to the user and receiving feedback, a means for providing an experience in a VR environment, and a means for monitoring the user's emotions in real time during the VR experience and instantly adjusting the content. This allows the user's emotions to be reflected in the event plan, providing a personalized, optimized event experience. Furthermore, adjusting the VR content based on real-time emotion feedback can achieve higher user satisfaction and a sense of realism.
[1099] "User" means any person or entity that accesses the system and enters basic information about an event.
[1100] "Basic event information" refers to basic information required for event planning, such as the title, purpose, target number of people, budget, and desired date.
[1101] "Server" means a computer system that receives and analyzes information sent by users and generates and provides event plans.
[1102] "Receiving" refers to the server taking in data sent by the user.
[1103] "Analysis" is the process of verifying received data to check for any errors or inappropriate values.
[1104] "Statistical data" is a collection of data about events that have taken place in the past, and is information that forms the basis of analysis.
[1105] "Mimetic AI means" is an artificial intelligence technology that generates optimal event plans based on past statistical data.
[1106] "Emotion analysis means" is a technical means for analyzing a user's emotions and adjusting the event plan based on the analysis.
[1107] "Providing" refers to the act of presenting the generated event plan to the user.
[1108] "Feedback" refers to evaluations and opinions obtained from users.
[1109] A "VR environment" is a simulation space constructed using virtual reality technology.
[1110] "Emotion monitoring" is a technology that monitors and records the emotions felt by users during a VR experience in real time.
[1111] "Real-time monitoring" is a technology that instantly observes and responds to users' emotions and behavior.
[1112] "Instant adjustment" means instantly changing the content of the VR content based on the results of emotion monitoring.
[1113] This invention is an AI system that streamlines the process from event planning to execution. Its unique feature is that it provides a more personalized event experience by incorporating an emotion engine that recognizes user emotions. The system allows users to input basic event information, and the server receives and analyzes that information to generate an optimal event plan. It also provides an experience in a VR environment, adjusting the plan based on feedback.
[1114] First, the user accesses the system's website from a device such as a PC or smartphone and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The device then sends an HTTP request to the server, which transmits the information entered by the user.
[1115] The server receives the basic information of the event sent by the user and parses the input data to check for errors or invalid values, using a data validation library (e.g., JSON Schema Validator).
[1116] Once the analysis is complete, the server uses past statistical data to search for events similar to the criteria entered by the user. This search process involves executing a database query to retrieve data that matches the criteria. The server then uses mimicry AI to generate an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them. The generative AI model is invoked as an API call or library to generate a plan based on the input data.
[1117] Furthermore, the sentiment analysis method analyzes text and voice data during user input and feedback to recognize the user's emotions. This analysis is performed using sentiment analysis libraries (e.g., IBM Watson, Microsoft Azure Cognitive Services). If the user expresses dissatisfaction with the activity, the event plan is adjusted based on this data. The system also collects the user's preferences and interests and optimizes the plan accordingly.
[1118] Next, if the user wishes to experience the event in a VR environment, they input this into the system. The server generates the VR content and provides a link that the user can access from a VR headset or smartphone app. For this purpose, a VR content generation engine (e.g., Unity, Unreal Engine) is used. The user puts on the VR headset and accesses the VR content from the link provided by the system.
[1119] During the VR experience, the emotion engine monitors the user's emotions in real time and instantly adjusts the VR content as needed. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[1120] Finally, once the final event plan has been finalized, the server confirms it with the user. After final confirmation, the server generates all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The server generates the materials using a document generation tool (e.g., LaTeX, Microsoft Office API) and provides them to the user. The user can then download the provided materials and proceed with event preparations.
[1121] Specific examples
[1122] For example, to organize a team building event for employees, a user logs into the system and enters the following basic information:
[1123] Title: Team Building Event
[1124] Objective: To improve employee collaboration
[1125] Number of participants: 50
[1126] Budget: 500,000 yen
[1127] Preferred date: December 15, 2023
[1128] The server receives and analyzes this information and references a statistical database of past team building events. Based on the most successful past events, the Mimic AI generates a plan that combines the optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[1129] The system uses emotion analysis to read user input data to understand their expectations and anxieties, adjusts the selection and distribution of activities, and collects user feedback to re-optimize the plan based on that data.
[1130] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere of the event or activity in virtual reality. An emotion analysis means analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, the server can switch to another activity.
[1131] An example prompt is:
[1132] I'd like to organize a team building event for my employees. Please generate the best event plan based on the following information:
[1133] Title: Team Building Event
[1134] Objective: To improve employee collaboration
[1135] Number of participants: 50
[1136] Budget: 500,000 yen
[1137] Preferred date: December 15, 2023
[1138] Use past success stories to suggest a plan with optimal activities and steps, and be prepared to adjust the plan based on user sentiment.
[1139] This system will improve user satisfaction and enable more effective event planning and implementation.
[1140] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1141] Step 1:
[1142] A user accesses the system and logs in
[1143] Users use a device such as a PC or smartphone to access the system's website using a web browser and log in or register.
[1144] Specific actions: Open a browser, enter the URL to access the system website, enter the username and password on the login page, and click the login button.
[1145] Input: URL, username, password
[1146] Output: Login success / failure response
[1147] Step 2:
[1148] The user fills in the form with basic event information
[1149] The user is taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[1150] Specific actions: Move cursor to form fields, enter information, and click submit.
[1151] Input: Basic information about the event (title, purpose, number of people, budget, desired date, etc.)
[1152] Output: HTTP request containing basic event information
[1153] Step 3:
[1154] The server receives and analyzes basic event information.
[1155] The server receives the basic information of the event sent by the user and parses the input data, using a data validation library (e.g., JSON Schema Validator) to check for errors or invalid values.
[1156] Specific behavior: Receives an HTTP request and verifies the validity of the data.
[1157] Input: Event basic information (HTTP request)
[1158] Output: Verification result (valid / invalid)
[1159] Step 4:
[1160] The server references past statistical data and generates an event plan
[1161] The server references a historical statistical database to search for events similar to the user's criteria, executes a database query, retrieves event data that matches the criteria, and then uses mimicry AI to generate an optimal event plan.
[1162] What it does: Executes SQL queries to retrieve information from a database and invokes a generative AI model to generate a plan.
[1163] Input: Verified event basic information
[1164] Output: Optimal event plan (basic plan, detailed schedule, anticipated problems and how to deal with them)
[1165] Step 5:
[1166] The server recognizes the user's emotions using emotion analysis means.
[1167] The server uses emotion analysis to analyze text and voice data at the time of user input and feedback, and recognizes the user's emotions. An emotion analysis library (e.g., IBM Watson, Microsoft Azure Cognitive Services) is used.
[1168] Specific operation: User text and voice data are input into the emotion analysis tool, and emotion data is output.
[1169] Input: text and voice data during user input and feedback
[1170] Output: User's emotional data (expectation, anxiety, satisfaction, dissatisfaction, etc.)
[1171] Step 6:
[1172] The server adjusts the event plan based on the emotional data.
[1173] Based on the emotional data recognized by the emotion analysis means, the event plan generated using the mimicry AI is adjusted. The emotional data is fed back to the mimicry AI model to regenerate the plan.
[1174] Specific operation: Emotional data is input into the AI model, and an optimized event plan is output.
[1175] Input: User emotion data, the initially generated event plan
[1176] Output: Adjusted event plan
[1177] Step 7:
[1178] If a user wishes to experience an event in a VR environment, the server generates the VR content.
[1179] The server generates VR content based on the user's request. It creates simulation data using a VR content generation engine (e.g., Unity, Unreal Engine).
[1180] Specific operation: Inputs the necessary data into the VR content generation engine and outputs a link to the generated VR content.
[1181] Enter: Event Plan
[1182] Output: VR content link
[1183] Step 8:
[1184] The user experiences VR
[1185] Users experience the generated VR content using a VR headset or smartphone app. They wear the headset and access the content via a link provided by the system.
[1186] Specific Actions: Put on the VR headset and click the provided link to connect to the VR content.
[1187] Input: VR content link
[1188] Output: VR experience
[1189] Step 9:
[1190] Emotion analysis means monitors the user's emotions in real time during the VR experience, and the server instantly adjusts the content.
[1191] The emotion analysis means analyzes the user's emotions in real time during the VR experience, and the server instantly adjusts the VR content based on that data. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[1192] Specific operation: Data collected from sensors is input into an emotion analysis tool to generate adjusted VR content.
[1193] Input: User's real-time emotional data, current VR content
[1194] Output: Adjusted VR content
[1195] Step 10:
[1196] The server confirms the event plan with the user, and after final confirmation, generates and provides the materials.
[1197] Once the event plan is finalized, the server confirms with the user. After final confirmation, all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) are generated and sent to the user. The materials are generated using a document generation tool (e.g., LaTeX, Microsoft Office API).
[1198] Specific operations: The final plan contents are sent to the user via email or notification, and materials are created using a document generation tool based on feedback and provided to the user via email or download link.
[1199] Input: Final event plan, feedback
[1200] Output: All materials for the event
[1201] (Application example 2)
[1202] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1203] Current virtual store systems offer uniform product recommendations to users, resulting in a lack of personalized recommendations that address individual users' emotions and needs. Furthermore, they are unable to grasp users' emotional changes in real time during the shopping experience and adjust the experience accordingly. This results in lower user satisfaction and a decrease in purchasing motivation. Furthermore, even systems that offer event experiences have difficulty providing optimal experiences based on users' emotions.
[1204] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1205] In this invention, the server includes means for a user to input basic event information, means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, an emotion recognition engine means for analyzing and monitoring user emotion data in real time, and means for personalizing the shopping experience based on the user emotion data. This enables personalized suggestions and experiences according to the user's emotions, improving user satisfaction and increasing purchasing motivation.
[1206] The "means for users to input basic event information" is an interface that allows users to input basic information about an event, such as the title, purpose, target number of people, budget, and desired date, into the system.
[1207] The "means for the server to receive and analyze the basic event information" is a function that receives the basic event information entered by the user, analyzes it, and checks for any errors or inappropriate values.
[1208] "An imitation AI method that generates optimal event plans based on past event data" is an artificial intelligence technology that references a past event database, searches for events similar to the user's input conditions, and generates optimal event plans.
[1209] The "means for providing the event plan to the user and receiving feedback" is a function for presenting the generated event plan to the user and collecting opinions and impressions from the user.
[1210] "Means for providing an experience in a VR environment" refers to a function that provides VR content and links necessary for users to simulate an event in a virtual reality environment.
[1211] The "emotion recognition engine means for analyzing and monitoring user emotion data in real time" is a technology for analyzing a user's text and voice data and grasping and monitoring the user's emotional state in real time.
[1212] "Means for personalizing the shopping experience based on the user's emotional data" refers to a function that optimizes products and experience content based on the user's emotional data and makes personalized suggestions tailored to each individual user.
[1213] "Means for the server to generate a detailed schedule list and troubleshooting methods based on the event plan and provide them to the user" refers to a function that creates detailed procedures and troubleshooting methods for anticipated problems based on the generated event plan and provides them to the user.
[1214] The "natural language analysis means for analyzing text data entered by a user and obtaining an emotion score and the intensity of the emotion" is a technology for mechanically analyzing text data entered by a user and calculating the user's emotion score and the intensity of that emotion.
[1215] The present invention relates to a system and method for personalizing a user's shopping experience in a virtual store. DETAILED DESCRIPTION OF THE INVENTION The following describes an embodiment of the present invention.
[1216] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event or shopping (title, purpose, budget, etc.), enter the required information, and submit it.
[1217] The server receives the basic information sent by the user and analyzes the input data using natural language processing technology using the Google Cloud Natural Language API, which checks for any errors or inappropriate values in the input data.
[1218] The server then searches a database of past events to find events similar to the user's input. The mimicry AI then generates an optimal event plan, which includes a basic plan, a detailed schedule, and potential problems and how to deal with them.
[1219] The emotion recognition engine analyzes text and voice data during user input and feedback to identify the user's emotions. Again, it uses the Google Cloud Natural Language API to obtain an emotion score and emotion intensity. For example, if a user has a positive reaction to a particular product, that emotion data can be used to optimize product suggestions.
[1220] Furthermore, if a user wishes to experience a VR environment, they input this into the system. The server generates the VR content and provides links to a VR headset and smartphone app. The user simulates an event in the VR environment, and an emotion recognition engine monitors the user's emotions in real time. For example, if the user has a negative reaction to a particular activity, the system can switch to another activity.
[1221] Once the final event plan is finalized, the server will contact the user for confirmation. The server will then generate all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and send them to the user. The user can then download these materials and begin preparing for the event and shopping.
[1222] This allows for personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction and increasing purchasing motivation.
[1223] Specific examples
[1224] The user puts on a head-mounted display and accesses a virtual shop. The AI assistant in the shop asks, "Are you looking for something?" If the user says, "I've been feeling stressed lately and want to relax," the emotion engine analyzes the text and suggests products that have a relaxing effect.
[1225] Example prompts to input to the generative AI model
[1226] Example of input prompt:
[1227] If a user says, "I've been feeling stressed lately and want to relax," analyze this using an emotion recognition engine and generate Python code that suggests products that have a relaxing effect.
[1228] This method allows the shopping experience in the virtual store to be personalized based on the user's emotions, providing a more satisfying experience.
[1229] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1230] Step 1:
[1231] A user accesses the system's website from their device (PC or smartphone) and logs in or registers. In this step, the user's authentication information is entered, which is received by the server and authenticates the user. The input data is the user ID and password, and the output is the authentication result.
[1232] Step 2:
[1233] The user enters basic information about the event or shopping (title, purpose, budget, etc.) into an input form and submits it. The server receives the submitted basic information, analyzes the input data, and checks for errors or inappropriate values. The input data is the basic information about the event or shopping, and the output is the analysis results.
[1234] Step 3:
[1235] The server refers to a database of past events and searches for event data similar to the conditions entered by the user. The mimicking AI generates an optimal event plan. In this step, the input data is the user's input information and past event data, and the output is the generated event plan.
[1236] Step 4:
[1237] The emotion recognition engine analyzes text and voice data during user input and feedback to recognize the user's emotions. Specifically, it uses the Google Cloud Natural Language API to obtain emotion scores and emotion intensity. The input data is the user's text and voice data, and the output is emotion scores and emotion intensity.
[1238] Step 5:
[1239] The server provides the event plan to the user and receives feedback. The server adjusts the generated event plan based on the user's feedback. The input data are the event plan and the user's feedback, and the output is the adjusted event plan.
[1240] Step 6:
[1241] When a user requests an experience in a VR environment, the server generates VR content and a link to a VR headset or smartphone app. The user simulates an event in the VR environment, and the emotion recognition engine monitors the user's emotions in real time. The input data is the user's desired information and past VR content, and the output is the generated VR content and a link.
[1242] Step 7:
[1243] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user has a negative reaction to a particular activity, it switches to another activity. In this step, the input data is the user's emotional data, and the output is the adjusted VR content.
[1244] Step 8:
[1245] The server confirms the final event plan with the user and receives final approval. The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The input data is the final event plan, and the output is all generated materials.
[1246] This series of steps enables personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction.
[1247] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1248] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1249] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1250] [Fourth embodiment]
[1251] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1252] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1253] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1254] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1255] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1256] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1257] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1258] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1259] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1260] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1261] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1262] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1263] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1264] This invention is an AI system for streamlining the process from event planning to execution. An embodiment of the system is described in detail below.
[1265] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[1266] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[1267] Next, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment and inputs feedback. The server receives the feedback and makes any necessary adjustments.
[1268] Once the final event plan is finalized, the server confirms with the user and provides all necessary materials (proposal, schedule list, troubleshooting methods, etc.). The user downloads these materials and begins preparations for the event. This allows for efficient and effective event planning and implementation.
[1269] Specific examples
[1270] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[1271] Title: Team Building Event
[1272] Objective: To improve employee collaboration
[1273] Number of participants: 50
[1274] Budget: 500,000 yen
[1275] Preferred date: December 15, 2023
[1276] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[1277] When a user requests a VR experience, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The user provides feedback from the experience, and the server adjusts the plan accordingly.
[1278] Once the final plan is finalized, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. The user can download these materials and begin preparations for the actual event. In this way, this system increases the success rate of events and enables effective, cost-effective event implementation.
[1279] The processing flow will be explained below.
[1280] Step 1:
[1281] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[1282] Step 2:
[1283] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[1284] Step 3:
[1285] The user completes the input and clicks the "Submit" button.
[1286] Step 4:
[1287] The server receives basic information about the event sent by the user.
[1288] Step 5:
[1289] The server analyzes the received data and checks for any incomplete or inappropriate input information.
[1290] Step 6:
[1291] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[1292] Step 7:
[1293] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[1294] Step 8:
[1295] The server provides the generated event plan to the user, who then confirms it.
[1296] Step 9:
[1297] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[1298] Step 10:
[1299] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[1300] Step 11:
[1301] The user performs an event simulation in a VR environment and inputs feedback.
[1302] Step 12:
[1303] The server receives user feedback and makes necessary adjustments.
[1304] Step 13:
[1305] Once the final event plan is finalized, the server will check with the user and obtain final confirmation.
[1306] Step 14:
[1307] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[1308] Step 15:
[1309] The user downloads the provided materials and prepares for the event.
[1310] Example 1
[1311] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1312] The process from planning to implementing an event is often time-consuming and complicated. There is a need for a system that allows users to efficiently plan and implement events. Furthermore, to increase the success of an event, it is necessary to provide an optimal plan based on past success stories. Furthermore, it is expected that by using a simulation in a virtual reality environment to check the atmosphere and details of the event in advance and incorporating feedback, more accurate event planning can be achieved.
[1313] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1314] In this invention, the server includes a terminal means for a user to input basic event information, a means for receiving and analyzing the basic event information, a generation AI model means for generating an optimal event plan based on past event data, a means for providing the event plan to the user and receiving feedback, and a means for providing an experience in a virtual reality environment, thereby enabling the user to efficiently and effectively carry out events from planning to implementation.
[1315] "User" refers to an individual or organization that uses the system to plan and implement an event.
[1316] The "terminal means" refers to an electronic device such as a computer or smartphone that a user uses to input basic event information.
[1317] A "server" is a central computer system that receives, analyzes, and processes information entered by users.
[1318] "Basic event information" refers to basic information required for planning an event, such as the event title, purpose, target number of people, budget, and desired date.
[1319] The "analyzing means" is a processing means for checking the basic event information received from the user and determining whether there are any deficiencies or inappropriate values.
[1320] "Past event data" is a collection of data that records information about events that have taken place in the past, and is a database that the system uses as a reference.
[1321] "Generative AI model means" refers to artificial intelligence technology that automatically generates optimal event plans based on past event data.
[1322] An "event plan" is a detailed plan for an event that is generated based on basic information entered by the user and past data.
[1323] The "means for receiving feedback" refers to a processing means for receiving feedback (opinions and impressions) provided by the user and recognizing it in the system.
[1324] "Virtual reality environment" means a computer-generated environment in which a user simulates events in a virtual space.
[1325] "Virtual reality content" means a simulation of an event or other related content that can be experienced by a user within a virtual reality environment.
[1326] A "stage list" is a list that lists the specific work procedures and order required to carry out an event.
[1327] "Troubleshooting" refers to specific measures to deal with problems or issues that may arise during the event.
[1328] This invention is a system for streamlining the process from event planning to implementation. The system includes a terminal where users input basic event information, a server that receives and analyzes this information, a generative AI model that generates an optimal event plan based on past event data, and a VR system that provides a virtual reality environment.
[1329] First, the user accesses the system's website using their own device (computer or smartphone) and logs in or registers. The user then moves to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The server receives this information and analyzes the input data. Data cleansing techniques are used to check for any errors or inappropriate values. Python is used for data analysis, and Django is used as the web framework.
[1330] Once the analysis is complete, the server references a database of past events to search for events similar to the criteria entered by the user. This search uses PostgreSQL as the SQL database and Elasticsearch as the search engine. Based on the past data, a generative AI model (such as an imitation AI using TensorFlow) generates an optimal event plan. This generated plan includes a basic plan, a detailed procedure list, and anticipated problems and how to deal with them.
[1331] Next, if the user wishes to experience an event in a VR environment, they input this into the system. The server generates VR content using tools such as Unity and provides a virtual reality environment that the user can use. After the link is generated, the user is provided with a download link for a VR headset or smartphone app. The user uses this to simulate an event in the VR environment and provides feedback from the experience. The server receives the feedback and makes any necessary adjustments.
[1332] Finally, the server presents the revised event plan to the user for confirmation. After confirmation is obtained, the server generates all the final materials (proposal, schedule list, troubleshooting methods, etc.) and provides them to the user. The user downloads these materials and begins preparations for the actual event.
[1333] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[1334] Title: Team Building Event
[1335] Objective: To improve employee collaboration
[1336] Number of participants: 50
[1337] Budget: 500,000 yen
[1338] Preferred date: December 15, 2023
[1339] The server receives and analyzes this information and references a database of past team-building events. The generative AI model generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.) based on the most successful past events. If the user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the event atmosphere and activities in virtual reality. The user provides feedback from the experience, and the server adjusts the plan based on that feedback.
[1340] Example prompt for generative AI model:
[1341] Prompt: I'd like to organize a team building event for my employees. Please suggest the best plan for the event based on the following basic information:
[1342] Title: Team Building Event
[1343] Objective: To improve employee collaboration
[1344] Number of participants: 50
[1345] Budget: 500,000 yen
[1346] Preferred date: December 15, 2023
[1347] In this way, the system increases the success rate of events and enables efficient and effective event planning and execution.
[1348] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1349] Step 1:
[1350] A user accesses the system's website using their own device and logs in or registers. A username and password are required as input. The output is the dashboard screen after successful login. Specifically, the username and password are sent to the server for authentication.
[1351] Step 2:
[1352] The user enters basic information about the event. Input items include the title, purpose, number of participants, budget, desired date, etc. When the send button is clicked, this information is sent to the server. As an output, a message is displayed to confirm the input information. Specifically, the information entered from the terminal is sent to the server.
[1353] Step 3:
[1354] The server analyzes the basic information of the event received from the user. The input data is the basic information of the event provided by the user. Data cleansing techniques are used to check for errors and inappropriate values. The output is the analysis results, which are saved. Specifically, data cleansing is performed using Python and the analysis results are displayed within the Django framework.
[1355] Step 4:
[1356] The server references a database of past events and searches for events similar to the conditions entered by the user. The input is the basic information of the analyzed events. The search is performed using PostgreSQL and Elasticsearch. The output is a list of similar events. Specifically, an SQL query is issued and similar events are extracted in Elasticsearch.
[1357] Step 5:
[1358] The server uses a generative AI model to generate an optimal event plan. The input is similar event data. Using an AI model (e.g., TensorFlow), an event plan is generated that includes optimal activities, a schedule list, and troubleshooting methods. The output is an event plan to provide to the user. Specifically, data is input into the generative AI model, and a plan is generated.
[1359] Step 6:
[1360] If a user wishes to experience an event in a VR environment, they input this into the system. The input is the user's choice of VR experience. The server generates the VR content using Unity or similar software. The output is a download link for a VR headset or smartphone app. Specifically, the VR content is generated and the link is sent to the user.
[1361] Step 7:
[1362] The user performs an event simulation in a VR environment. The input is access to VR content. The user experiences the simulation and submits feedback. The output is feedback data sent to the server. The specific operation is for the user to experience VR, enter their opinions in a feedback form, and submit it.
[1363] Step 8:
[1364] The server receives feedback from users and adjusts the event plan as needed. The input is the feedback data. The adjusted plan is regenerated. The output is an adjusted event plan. Specifically, the server re-analyzes the data based on the feedback and adjusts the plan using the generative AI model.
[1365] Step 9:
[1366] The server provides the final event plan to the user. The input is the adjusted event plan. The user reviews it and agrees. The output is the final event plan. Specific operations include generating the plan in a format such as PDF and providing the user with a download link.
[1367] Step 10:
[1368] The user receives the final plan and prepares to carry out the event. The input is the provided planning materials. The user then proceeds with specific preparations based on these. The output is that the event is ready to be carried out. Specific operations include the user downloading the materials and making the necessary arrangements and contacts.
[1369] (Application example 1)
[1370] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1371] Conventional event planning systems not only analyze user input information and reference past data to generate plans, but also lack the means to support execution in real-world environments and simulations. This makes it difficult to address problems and optimize the plan during the actual event, making it difficult to improve the success rate. Furthermore, the lack of functionality to support specific preparation work through real-time advice and simulations makes it difficult to streamline the cost and time required for event implementation.
[1372] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1373] In this invention, the server includes a means for users to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, a means for providing the event plan to users and receiving feedback, a means for providing an experience in a virtual reality environment, and a means for staff to prepare and simulate an event in a physical store while receiving advice in real time. This streamlines the process from event planning to implementation, enabling problem solving and optimization during actual event implementation. Furthermore, real-time advice and simulations enable cost and time efficiency in event implementation.
[1374] "User" refers to a person who inputs basic event information and uses the system to support the planning and implementation of an event.
[1375] "Basic event information" refers to basic information required for holding an event, such as the event title, purpose, target number of people, budget, desired date, etc.
[1376] The "server" is a computer system that analyzes information received from users and uses past data to generate optimal event plans.
[1377] "Imitation AI means" refers to artificial intelligence that learns from past event data and generates optimal event plans based on user input information.
[1378] "Feedback" refers to opinions and correction requests provided by users regarding the proposed event plan.
[1379] A "virtual reality environment" is an environment in which users can experience a virtual event space using a VR headset or smart glasses.
[1380] A "brick and mortar store" is a physical store where actual business activities are conducted.
[1381] "Simulation" is the process of virtually executing an event plan in a virtual reality environment to verify its effectiveness and any problems with its execution.
[1382] A "detailed procedure list" refers to the specific procedures and time schedule required to carry out an event.
[1383] "Problem-solving strategies" are solutions to problems that may arise during the event.
[1384] The system of this invention allows users to input basic event information, and the server analyzes and processes it to provide an optimal event plan. Furthermore, it aims to increase the success rate of events through real-time advice and simulations in a virtual reality environment.
[1385] Hardware and Software Configuration
[1386] 1. User device: A device (PC, smartphone, etc.) used to enter basic event information.
[1387] 2. Server: A computer system that receives and analyzes the basic information entered and generates the optimal event plan.
[1388] 3. Imitation AI method: Artificial intelligence (using GPT, etc.) that generates optimal event plans based on past event data.
[1389] 4. Cloud server: Infrastructure for analyzing input data and generating plans.
[1390] 5. Smart glasses: A device that helps with event preparation by providing real-time advice in physical stores.
[1391] 6. VR headset: A device to support event simulation in a virtual reality environment.
[1392] Program processing explanation
[1393] User terminal
[1394] The user uses the terminal to enter basic information about the event, such as the title, purpose, number of participants, budget, and desired date, into a form and sends it to the server.
[1395] server
[1396] The server analyzes the received basic event information and checks for inappropriate values or missing information. Once the analysis is complete, it references a database of past events and generates an event plan that best suits the input conditions.
[1397] Imitation AI methods
[1398] Imitation AI generates optimal event plans based on past event data and user input. The generated plans include a basic plan, a detailed procedure list, and solutions to problems. GPT-based models are often used as generative AI models.
[1399] Cloud Server
[1400] The cloud server is responsible for analyzing input data and generating plans, and also serves as the infrastructure for providing the generated event plans and feedback to users.
[1401] Smart Glasses
[1402] Staff can use smart glasses to prepare for events in physical stores with real-time advice, with a virtual assistant appearing on the screen to provide advice and direction.
[1403] VR headset
[1404] It is a device that allows users to simulate events in a virtual reality environment, allowing them to confirm and optimize their plans through a realistic experience.
[1405] Specific examples
[1406] For example, to organize a new product launch event for employees, a user logs into the system and enters the following basic information:
[1407] Title: New product launch event
[1408] Objective: New product launch
[1409] Number of participants: 100
[1410] Budget: 1 million yen
[1411] Preferred date: November 30, 2023
[1412] The server receives and analyzes this information and uses mimicry AI to generate an optimal event plan, including new product presentations, demonstrations, Q&A sessions, etc. Furthermore, by using simulations in a virtual reality environment and receiving feedback from users, the plan can be optimized, resulting in cost and time savings during preparation and execution.
[1413] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1414] Step 1:
[1415] The user enters the basic event information
[1416] Users access the system's website from their devices (PCs or smartphones) and are taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.). This information is sent to the server as user input.
[1417] Input: Basic information about the event
[1418] Output: Send information to the server
[1419] Step 2:
[1420] The server receives and analyzes basic event information
[1421] The server receives the basic event information sent by the user and checks for incomplete information or inappropriate values, specifically validating data types and checking for blank fields.
[1422] Input: Basic information about the event
[1423] Output: Parsed event information
[1424] Step 3:
[1425] Reference past data and generate optimal plans
[1426] The server then searches for similar events by referencing a database of past events based on the analyzed event information, and uses mimicry AI (e.g., a GPT model) to generate an optimal event plan based on the search results.
[1427] Input: Parsed event information
[1428] Output: Optimal event plan
[1429] Step 4:
[1430] Providing event plans and receiving feedback
[1431] The server provides the generated event plan to the user, who then reviews the plan and inputs feedback such as corrections and changes. The server receives and stores this feedback.
[1432] Input: Optimal event plan, user feedback
[1433] Output: User suggested fixes
[1434] Step 5:
[1435] Simulation in a virtual reality environment
[1436] When a user wants to simulate a virtual reality environment, the server generates VR content (such as 3D modeling and scene setting) and sends it to the user's VR headset or smartphone. The user then performs the simulation and provides feedback on the experience.
[1437] Input: Optimal event plan, virtual reality environment requirements
[1438] Output: VR content, feedback
[1439] Step 6:
[1440] Optimize your plan based on feedback
[1441] The server uses mimicry AI to fine-tune the plan based on user feedback, analyzing the feedback, identifying necessary modifications, and updating the plan.
[1442] Input: User feedback
[1443] Output: Updated event plan
[1444] Step 7:
[1445] Providing a detailed list of steps and solutions to problems
[1446] After the event plan is finalized, the server creates a detailed procedure list and troubleshooting methods and provides them to the user, who can then download these materials and begin preparations for the event.
[1447] Input: Final Event Plan
[1448] Output: Steps list, troubleshooting
[1449] Through these steps, users are effectively supported in the process from event planning to implementation.
[1450] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1451] This invention is an AI system for streamlining the process from event planning to execution. In particular, it is characterized by providing a more personalized event experience by combining it with an emotion engine that recognizes user emotions. An embodiment of the system is described in detail below.
[1452] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[1453] The server receives the basic event information sent by the user and analyzes the input data to check for any errors or inappropriate values. Once the analysis is complete, the server references a database of past events to search for events similar to the conditions entered by the user. Based on these search results, the mimicry AI generates an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them.
[1454] The emotion engine then analyzes text and voice data from user input and feedback to recognize the user's emotions. For example, if the user expresses dissatisfaction with an activity, the engine can adjust the event plan based on that data. The engine also collects the user's preferences and interests and optimizes the plan accordingly.
[1455] Furthermore, if the user wishes to participate in an event in a VR environment, they input this into the system. The server generates the VR content and provides links to the VR headset and smartphone app. The user simulates the event in the VR environment, and the emotion engine monitors the user's emotions in real time. Based on the user's emotion data, the server adjusts the experience within the VR content in real time.
[1456] Once the final event plan is finalized, the server confirms with the user and receives final approval. The server then generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The user can download these materials and begin preparations for the event. In this way, combining the emotion engine improves user satisfaction and enables more effective and personalized event planning and implementation.
[1457] Specific examples
[1458] For example, say you're planning a team-building event for your employees. A user logs into the system and enters the following basic information:
[1459] Title: Team Building Event
[1460] Objective: To improve employee collaboration
[1461] Number of participants: 50
[1462] Budget: 500,000 yen
[1463] Preferred date: December 15, 2023
[1464] The server receives and analyzes this information and references a database of past team-building events. Based on the most successful past events, the Mimicry AI generates a plan that combines optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[1465] The emotion engine reads the user's expectations and anxieties from the data they input, adjusts the selection and distribution of activities, and collects feedback from the user and re-optimizes the plan based on that data.
[1466] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere and activities of the event in virtual reality. The emotion engine analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, it can switch to a different activity.
[1467] Finally, the server generates a proposal, a schedule list, troubleshooting methods, and other information, and provides them to the user. Users can download these materials and begin preparations for the actual event. This system increases the success rate of events and improves user satisfaction.
[1468] The processing flow will be explained below.
[1469] Step 1:
[1470] The user accesses the system's website from their own device (PC or smartphone) and logs in or registers.
[1471] Step 2:
[1472] The user is redirected to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.) and enter the required information.
[1473] Step 3:
[1474] The user completes the input and clicks the "Submit" button.
[1475] Step 4:
[1476] The server receives basic information about the event sent by the user.
[1477] Step 5:
[1478] The server analyzes the data it receives and checks for incomplete input information or inappropriate values.
[1479] Step 6:
[1480] The server refers to a database of past events and searches for events similar to the conditions entered by the user.
[1481] Step 7:
[1482] The server's mimicry AI generates the optimal event plan based on the search results. Specifically, it takes into account successful and unsuccessful examples and combines the optimal project plan, schedule list, anticipated problems, and how to deal with them.
[1483] Step 8:
[1484] The server provides the generated event plan to the user and has the user confirm it.
[1485] Step 9:
[1486] The user enters feedback, which is then analyzed by the emotion engine.
[1487] Step 10:
[1488] The emotion engine identifies emotions based on user feedback and adjusts the event plan accordingly.
[1489] Step 11:
[1490] If a user wishes to participate in an event in a VR environment, they input this information into the system.
[1491] Step 12:
[1492] The server generates the VR content and sends links and data to the user's device, allowing it to be experienced through a VR headset or smartphone app.
[1493] Step 13:
[1494] The user performs an event simulation in a VR environment, and the emotion engine monitors the user's emotions in real time.
[1495] Step 14:
[1496] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user expresses negative emotions in a particular scene, the scene will be changed.
[1497] Step 15:
[1498] The server presents the final event plan to the user for confirmation.
[1499] Step 16:
[1500] The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user.
[1501] Step 17:
[1502] The user downloads the provided materials and prepares for the event.
[1503] Example 2
[1504] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1505] Conventional event planning systems have the problem that once a plan is generated based on the event information entered by the user, it is fixed and difficult to adjust afterwards. Furthermore, they lack the functionality to reflect the user's preferences and emotions, which can result in insufficient personalization for each user and reduced user satisfaction. Furthermore, it is difficult to reflect user feedback in real time in VR experiences, making it difficult to provide an experience that is in line with the user's emotions.
[1506] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1507] In this invention, the server includes a means for a user to input basic event information, a means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past statistical data, an emotion analysis means for recognizing the user's emotions and adjusting the event plan, a means for providing the event plan to the user and receiving feedback, a means for providing an experience in a VR environment, and a means for monitoring the user's emotions in real time during the VR experience and instantly adjusting the content. This allows the user's emotions to be reflected in the event plan, providing a personalized, optimized event experience. Furthermore, adjusting the VR content based on real-time emotion feedback can achieve higher user satisfaction and a sense of realism.
[1508] "User" means any person or entity that accesses the system and enters basic information about an event.
[1509] "Basic event information" refers to basic information required for event planning, such as the title, purpose, target number of people, budget, and desired date.
[1510] "Server" means a computer system that receives and analyzes information sent by users and generates and provides event plans.
[1511] "Receiving" refers to the server taking in data sent by the user.
[1512] "Analysis" is the process of verifying received data to check for any errors or inappropriate values.
[1513] "Statistical data" is a collection of data about events that have taken place in the past, and is information that forms the basis of analysis.
[1514] "Mimetic AI means" is an artificial intelligence technology that generates optimal event plans based on past statistical data.
[1515] "Emotion analysis means" is a technical means for analyzing a user's emotions and adjusting the event plan based on the analysis.
[1516] "Providing" refers to the act of presenting the generated event plan to the user.
[1517] "Feedback" refers to evaluations and opinions obtained from users.
[1518] A "VR environment" is a simulation space constructed using virtual reality technology.
[1519] "Emotion monitoring" is a technology that monitors and records the emotions felt by users during a VR experience in real time.
[1520] "Real-time monitoring" is a technology that instantly observes and responds to users' emotions and behavior.
[1521] "Instant adjustment" means instantly changing the content of the VR content based on the results of emotion monitoring.
[1522] This invention is an AI system that streamlines the process from event planning to execution. Its unique feature is that it provides a more personalized event experience by incorporating an emotion engine that recognizes user emotions. The system allows users to input basic event information, and the server receives and analyzes that information to generate an optimal event plan. It also provides an experience in a VR environment, adjusting the plan based on feedback.
[1523] First, the user accesses the system's website from a device such as a PC or smartphone and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit it. The device then sends an HTTP request to the server, which transmits the information entered by the user.
[1524] The server receives the basic information of the event sent by the user and parses the input data to check for errors or invalid values, using a data validation library (e.g., JSON Schema Validator).
[1525] Once the analysis is complete, the server uses past statistical data to search for events similar to the criteria entered by the user. This search process involves executing a database query to retrieve data that matches the criteria. The server then uses mimicry AI to generate an optimal event plan. The generated plan includes a basic plan, a detailed schedule list, and anticipated problems and how to deal with them. The generative AI model is invoked as an API call or library to generate a plan based on the input data.
[1526] Furthermore, the sentiment analysis method analyzes text and voice data during user input and feedback to recognize the user's emotions. This analysis is performed using sentiment analysis libraries (e.g., IBM Watson, Microsoft Azure Cognitive Services). If the user expresses dissatisfaction with the activity, the event plan is adjusted based on this data. The system also collects the user's preferences and interests and optimizes the plan accordingly.
[1527] Next, if the user wishes to experience the event in a VR environment, they input this into the system. The server generates the VR content and provides a link that the user can access from a VR headset or smartphone app. For this purpose, a VR content generation engine (e.g., Unity, Unreal Engine) is used. The user puts on the VR headset and accesses the VR content from the link provided by the system.
[1528] During the VR experience, the emotion engine monitors the user's emotions in real time and instantly adjusts the VR content as needed. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[1529] Finally, once the final event plan has been finalized, the server confirms it with the user. After final confirmation, the server generates all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The server generates the materials using a document generation tool (e.g., LaTeX, Microsoft Office API) and provides them to the user. The user can then download the provided materials and proceed with event preparations.
[1530] Specific examples
[1531] For example, to organize a team building event for employees, a user logs into the system and enters the following basic information:
[1532] Title: Team Building Event
[1533] Objective: To improve employee collaboration
[1534] Number of participants: 50
[1535] Budget: 500,000 yen
[1536] Preferred date: December 15, 2023
[1537] The server receives and analyzes this information and references a statistical database of past team building events. Based on the most successful past events, the Mimic AI generates a plan that combines the optimal activities (e.g., outdoor challenges, dinner parties, short workshops, etc.).
[1538] The system uses emotion analysis to read user input data to understand their expectations and anxieties, adjusts the selection and distribution of activities, and collects user feedback to re-optimize the plan based on that data.
[1539] When a user requests an experience in a VR environment, the server generates VR content, allowing the user to experience the atmosphere of the event or activity in virtual reality. An emotion analysis means analyzes the user's emotions in real time during the VR experience and instantly adjusts the content as needed. For example, if the user has a negative reaction to a particular activity, the server can switch to another activity.
[1540] An example prompt is:
[1541] I'd like to organize a team building event for my employees. Please generate the best event plan based on the following information:
[1542] Title: Team Building Event
[1543] Objective: To improve employee collaboration
[1544] Number of participants: 50
[1545] Budget: 500,000 yen
[1546] Preferred date: December 15, 2023
[1547] Use past success stories to suggest a plan with optimal activities and steps, and be prepared to adjust the plan based on user sentiment.
[1548] This system will improve user satisfaction and enable more effective event planning and implementation.
[1549] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1550] Step 1:
[1551] A user accesses the system and logs in
[1552] Users use a device such as a PC or smartphone to access the system's website using a web browser and log in or register.
[1553] Specific actions: Open a browser, enter the URL to access the system website, enter the username and password on the login page, and click the login button.
[1554] Input: URL, username, password
[1555] Output: Login success / failure response
[1556] Step 2:
[1557] The user fills in the form with basic event information
[1558] The user is taken to a form screen where they can enter basic information about the event (title, purpose, number of participants, budget, desired date, etc.), enter the necessary information, and submit.
[1559] Specific actions: Move cursor to form fields, enter information, and click submit.
[1560] Input: Basic information about the event (title, purpose, number of people, budget, desired date, etc.)
[1561] Output: HTTP request containing basic event information
[1562] Step 3:
[1563] The server receives and analyzes basic event information.
[1564] The server receives the basic information of the event sent by the user and parses the input data, using a data validation library (e.g., JSON Schema Validator) to check for errors or invalid values.
[1565] Specific behavior: Receives an HTTP request and verifies the validity of the data.
[1566] Input: Event basic information (HTTP request)
[1567] Output: Verification result (valid / invalid)
[1568] Step 4:
[1569] The server references past statistical data and generates an event plan
[1570] The server references a historical statistical database to search for events similar to the user's criteria, executes a database query, retrieves event data that matches the criteria, and then uses mimicry AI to generate an optimal event plan.
[1571] What it does: Executes SQL queries to retrieve information from a database and invokes a generative AI model to generate a plan.
[1572] Input: Verified event basic information
[1573] Output: Optimal event plan (basic plan, detailed schedule, anticipated problems and how to deal with them)
[1574] Step 5:
[1575] The server recognizes the user's emotions using emotion analysis means.
[1576] The server uses emotion analysis to analyze text and voice data at the time of user input and feedback, and recognizes the user's emotions. An emotion analysis library (e.g., IBM Watson, Microsoft Azure Cognitive Services) is used.
[1577] Specific operation: User text and voice data are input into the emotion analysis tool, and emotion data is output.
[1578] Input: text and voice data during user input and feedback
[1579] Output: User's emotional data (expectation, anxiety, satisfaction, dissatisfaction, etc.)
[1580] Step 6:
[1581] The server adjusts the event plan based on the emotional data.
[1582] Based on the emotional data recognized by the emotion analysis means, the event plan generated using the mimicry AI is adjusted. The emotional data is fed back to the mimicry AI model to regenerate the plan.
[1583] Specific operation: Emotional data is input into the AI model, and an optimized event plan is output.
[1584] Input: User emotion data, the initially generated event plan
[1585] Output: Adjusted event plan
[1586] Step 7:
[1587] If a user wishes to experience an event in a VR environment, the server generates the VR content.
[1588] The server generates VR content based on the user's request. It creates simulation data using a VR content generation engine (e.g., Unity, Unreal Engine).
[1589] Specific operation: Inputs the necessary data into the VR content generation engine and outputs a link to the generated VR content.
[1590] Enter: Event Plan
[1591] Output: VR content link
[1592] Step 8:
[1593] The user experiences VR
[1594] Users experience the generated VR content using a VR headset or smartphone app. They wear the headset and access the content via a link provided by the system.
[1595] Specific Actions: Put on the VR headset and click the provided link to connect to the VR content.
[1596] Input: VR content link
[1597] Output: VR experience
[1598] Step 9:
[1599] Emotion analysis means monitors the user's emotions in real time during the VR experience, and the server instantly adjusts the content.
[1600] The emotion analysis means analyzes the user's emotions in real time during the VR experience, and the server instantly adjusts the VR content based on that data. The emotion monitoring tool collects data from sensors built into the headset and dynamically changes the content based on the analysis results.
[1601] Specific operation: Data collected from sensors is input into an emotion analysis tool to generate adjusted VR content.
[1602] Input: User's real-time emotional data, current VR content
[1603] Output: Adjusted VR content
[1604] Step 10:
[1605] The server confirms the event plan with the user, and after final confirmation, generates and provides the materials.
[1606] Once the event plan is finalized, the server confirms with the user. After final confirmation, all materials based on the plan (proposal, schedule list, troubleshooting methods, etc.) are generated and sent to the user. The materials are generated using a document generation tool (e.g., LaTeX, Microsoft Office API).
[1607] Specific operations: The final plan contents are sent to the user via email or notification, and materials are created using a document generation tool based on feedback and provided to the user via email or download link.
[1608] Input: Final event plan, feedback
[1609] Output: All materials for the event
[1610] (Application example 2)
[1611] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1612] Current virtual store systems offer uniform product recommendations to users, resulting in a lack of personalized recommendations that address individual users' emotions and needs. Furthermore, they are unable to grasp users' emotional changes in real time during the shopping experience and adjust the experience accordingly. This results in lower user satisfaction and a decrease in purchasing motivation. Furthermore, even systems that offer event experiences have difficulty providing optimal experiences based on users' emotions.
[1613] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1614] In this invention, the server includes means for a user to input basic event information, means for the server to receive and analyze the basic event information, an imitation AI means for generating an optimal event plan based on past event data, an emotion recognition engine means for analyzing and monitoring user emotion data in real time, and means for personalizing the shopping experience based on the user emotion data. This enables personalized suggestions and experiences according to the user's emotions, improving user satisfaction and increasing purchasing motivation.
[1615] The "means for users to input basic event information" is an interface that allows users to input basic information about an event, such as the title, purpose, target number of people, budget, and desired date, into the system.
[1616] The "means for the server to receive and analyze the basic event information" is a function that receives the basic event information entered by the user, analyzes it, and checks for any errors or inappropriate values.
[1617] "An imitation AI method that generates optimal event plans based on past event data" is an artificial intelligence technology that references a past event database, searches for events similar to the user's input conditions, and generates optimal event plans.
[1618] The "means for providing the event plan to the user and receiving feedback" is a function for presenting the generated event plan to the user and collecting opinions and impressions from the user.
[1619] "Means for providing an experience in a VR environment" refers to a function that provides VR content and links necessary for users to simulate an event in a virtual reality environment.
[1620] The "emotion recognition engine means for analyzing and monitoring user emotion data in real time" is a technology for analyzing a user's text and voice data and grasping and monitoring the user's emotional state in real time.
[1621] "Means for personalizing the shopping experience based on the user's emotional data" refers to a function that optimizes products and experience content based on the user's emotional data and makes personalized suggestions tailored to each individual user.
[1622] "Means for the server to generate a detailed schedule list and troubleshooting methods based on the event plan and provide them to the user" refers to a function that creates detailed procedures and troubleshooting methods for anticipated problems based on the generated event plan and provides them to the user.
[1623] The "natural language analysis means for analyzing text data entered by a user and obtaining an emotion score and the intensity of the emotion" is a technology for mechanically analyzing text data entered by a user and calculating the user's emotion score and the intensity of that emotion.
[1624] The present invention relates to a system and method for personalizing a user's shopping experience in a virtual store. DETAILED DESCRIPTION OF THE INVENTION The following describes an embodiment of the present invention.
[1625] First, the user accesses the system's website from their device (PC or smartphone) and logs in or registers. The user is then taken to a form screen where they can enter basic information about the event or shopping (title, purpose, budget, etc.), enter the required information, and submit it.
[1626] The server receives the basic information sent by the user and analyzes the input data using natural language processing technology using the Google Cloud Natural Language API, which checks for any errors or inappropriate values in the input data.
[1627] The server then searches a database of past events to find events similar to the user's input. The mimicry AI then generates an optimal event plan, which includes a basic plan, a detailed schedule, and potential problems and how to deal with them.
[1628] The emotion recognition engine analyzes text and voice data during user input and feedback to identify the user's emotions. Again, it uses the Google Cloud Natural Language API to obtain an emotion score and emotion intensity. For example, if a user has a positive reaction to a particular product, that emotion data can be used to optimize product suggestions.
[1629] Furthermore, if a user wishes to experience a VR environment, they input this into the system. The server generates the VR content and provides links to a VR headset and smartphone app. The user simulates an event in the VR environment, and an emotion recognition engine monitors the user's emotions in real time. For example, if the user has a negative reaction to a particular activity, the system can switch to another activity.
[1630] Once the final event plan is finalized, the server will contact the user for confirmation. The server will then generate all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and send them to the user. The user can then download these materials and begin preparing for the event and shopping.
[1631] This allows for personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction and increasing purchasing motivation.
[1632] Specific examples
[1633] The user puts on a head-mounted display and accesses a virtual shop. The AI assistant in the shop asks, "Are you looking for something?" If the user says, "I've been feeling stressed lately and want to relax," the emotion engine analyzes the text and suggests products that have a relaxing effect.
[1634] Example prompts to input to the generative AI model
[1635] Example of input prompt:
[1636] If a user says, "I've been feeling stressed lately and want to relax," analyze this using an emotion recognition engine and generate Python code that suggests products that have a relaxing effect.
[1637] This method allows the shopping experience in the virtual store to be personalized based on the user's emotions, providing a more satisfying experience.
[1638] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1639] Step 1:
[1640] A user accesses the system's website from their device (PC or smartphone) and logs in or registers. In this step, the user's authentication information is entered, which is received by the server and authenticates the user. The input data is the user ID and password, and the output is the authentication result.
[1641] Step 2:
[1642] The user enters basic information about the event or shopping (title, purpose, budget, etc.) into an input form and submits it. The server receives the submitted basic information, analyzes the input data, and checks for errors or inappropriate values. The input data is the basic information about the event or shopping, and the output is the analysis results.
[1643] Step 3:
[1644] The server refers to a database of past events and searches for event data similar to the conditions entered by the user. The mimicking AI generates an optimal event plan. In this step, the input data is the user's input information and past event data, and the output is the generated event plan.
[1645] Step 4:
[1646] The emotion recognition engine analyzes text and voice data during user input and feedback to recognize the user's emotions. Specifically, it uses the Google Cloud Natural Language API to obtain emotion scores and emotion intensity. The input data is the user's text and voice data, and the output is emotion scores and emotion intensity.
[1647] Step 5:
[1648] The server provides the event plan to the user and receives feedback. The server adjusts the generated event plan based on the user's feedback. The input data are the event plan and the user's feedback, and the output is the adjusted event plan.
[1649] Step 6:
[1650] When a user requests an experience in a VR environment, the server generates VR content and a link to a VR headset or smartphone app. The user simulates an event in the VR environment, and the emotion recognition engine monitors the user's emotions in real time. The input data is the user's desired information and past VR content, and the output is the generated VR content and a link.
[1651] Step 7:
[1652] Based on the user's emotional data, the server adjusts the experience in the VR content in real time. For example, if the user has a negative reaction to a particular activity, it switches to another activity. In this step, the input data is the user's emotional data, and the output is the adjusted VR content.
[1653] Step 8:
[1654] The server confirms the final event plan with the user and receives final approval. The server generates all materials based on the final plan (proposal, schedule list, troubleshooting methods, etc.) and sends them to the user. The input data is the final event plan, and the output is all generated materials.
[1655] This series of steps enables personalized suggestions and experiences that reflect the user's emotions, improving user satisfaction.
[1656] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1657] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1658] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1659] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1660] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1661] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1662] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1663] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1664] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1665] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1666] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1667] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1668] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1669] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1670] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1671] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1672] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1673] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1674] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1675] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1676] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1677] The following is further disclosed regarding the above embodiment.
[1678] (Claim 1)
[1679] A means for a user to input basic event information;
[1680] A server receives and analyzes the basic event information;
[1681] An imitation AI method to generate optimal event plans based on past event data, and
[1682] means for providing the event plan to a user and receiving feedback;
[1683] A means of providing experiences in a VR environment,
[1684] A system including:
[1685] (Claim 2)
[1686] 2. The system according to claim 1, further comprising means for generating a detailed schedule and troubleshooting based on said event plan and providing the schedule and troubleshooting to a user.
[1687] (Claim 3)
[1688] 10. The system of claim 1, further comprising means for simulating an event in the VR environment and adjusting the VR content based on feedback from the user.
[1689] "Example 1"
[1690] (Claim 1)
[1691] a terminal means for a user to input basic event information;
[1692] A server receives and analyzes the basic event information;
[1693] A generative AI model means for generating an optimal event plan based on past event data;
[1694] means for providing the event plan to a user and receiving feedback;
[1695] a means for providing an experience in a virtual reality environment;
[1696] A system including:
[1697] (Claim 2)
[1698] 2. The system of claim 1, further comprising means for generating a detailed schedule and troubleshooting based on said event plan and providing the schedule and troubleshooting to a user.
[1699] (Claim 3)
[1700] 10. The system of claim 1, further comprising means for simulating an event in the virtual reality environment and adjusting the virtual reality content based on feedback from the user.
[1701] "Application Example 1"
[1702] (Claim 1)
[1703] A means for a user to input basic event information;
[1704] A server receives and analyzes the basic event information;
[1705] An imitation AI method to generate optimal event plans based on past event data, and
[1706] means for providing the event plan to a user and receiving feedback;
[1707] a means for providing an experience in a virtual reality environment;
[1708] A way for staff to prepare and simulate in-store events with real-time advice,
[1709] A system including:
[1710] (Claim 2)
[1711] 2. The system of claim 1, further comprising means for generating a detailed procedure list and problem resolution methods based on the event plan and providing the list to the user.
[1712] (Claim 3)
[1713] 10. The system of claim 1, further comprising means for simulating an event in the virtual reality environment and adjusting the virtual reality content based on feedback from the user.
[1714] "Example 2: Combining Emotion Engines"
[1715] (Claim 1)
[1716] A means for a user to input basic event information;
[1717] A server receives and analyzes the basic event information;
[1718] An imitation AI method that generates optimal event plans based on past statistical data, and
[1719] emotion analysis means for recognizing the emotion of a user and adjusting the event plan;
[1720] means for providing the event plan to a user and receiving feedback;
[1721] A means of providing experiences in a VR environment,
[1722] A means to monitor user emotions in real time during a VR experience and adjust content instantly;
[1723] A system including:
[1724] (Claim 2)
[1725] 2. The system according to claim 1, further comprising means for generating a detailed schedule and troubleshooting based on said event plan and providing the schedule and troubleshooting to a user.
[1726] (Claim 3)
[1727] 10. The system of claim 1, further comprising means for simulating an event in the VR environment and adjusting the VR content based on feedback from the user.
[1728] "Application example 2 when combining emotion engines"
[1729] (Claim 1)
[1730] A means for a user to input basic event information;
[1731] A server receives and analyzes the basic event information;
[1732] An imitation AI method to generate optimal event plans based on past event data, and
[1733] means for providing the event plan to a user and receiving feedback;
[1734] A means of providing experiences in a VR environment,
[1735] an emotion recognition engine means for analyzing and monitoring user emotion data in real time;
[1736] a means for personalizing the shopping experience based on the user's emotional data;
[1737] A system including:
[1738] (Claim 2)
[1739] 2. The system according to claim 1, further comprising means for generating a detailed schedule and troubleshooting based on said event plan and providing the schedule and troubleshooting to a user.
[1740] (Claim 3)
[1741] 10. The system of claim 1, further comprising means for simulating an event in the VR environment and adjusting the VR content based on feedback from the user.
[1742] (Claim 4)
[1743] 10. The system of claim 1, further comprising natural language analysis means for analyzing text data entered by a user and obtaining an emotion score and an emotion intensity. [Explanation of symbols]
[1744] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. A means for a user to input basic event information; A server receives and analyzes the basic event information; An imitation AI method to generate optimal event plans based on past event data, and means for providing the event plan to a user and receiving feedback; A means of providing experiences in a VR environment, A system including:
2. 2. The system of claim 1, further comprising means for generating a detailed schedule and troubleshooting based on said event plan and providing the schedule and troubleshooting to a user.
3. 10. The system of claim 1, further comprising means for simulating an event in the VR environment and adjusting the VR content based on feedback from the user.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A