system

Abstract

We provide the system. [Solution] An input means for the user to input presentation setting information; a prompt generation means for generating prompts based on the input setting information; an avatar generation means for generating an avatar based on the generated prompts; a material generation means for automatically generating presentation materials; a material checking means for checking the automatically generated presentation materials; a practice recording means for the user to practice the presentation and record what they say; and a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback. A system that includes follow-up measures to support users during the actual presentation.

Description

Technical Field

[0008] , , ,

[0009] , , ,

[0007]

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

[0010] The present invention provides a system that includes a prompt generation means for a user to input presentation setting information and generate prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for a user to practice their presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, and a follow-up means for supporting the user during the actual presentation.

[0011] This allows users to receive support at each stage of their presentation, reducing the effort required to create materials, gaining psychological confidence through practice, and ultimately delivering high-quality presentations. Furthermore, real-time support during the actual presentation helps alleviate anxiety and allows for proper time management and responses to questions.

[0012] "Input means" refers to the interface and devices that users use to input presentation settings information.

[0013] "Prompt generation means" refers to a function that creates an appropriate prompt based on the input configuration information.

[0014] "Avatar generation means" refers to a function that creates an avatar tailored to the user's presentation audience based on the generated prompt.

[0015] "The 'document generation means' refers to the function of automatically creating a presentation document based on the outline and basic information provided by the user."

[0016] "The 'document checking means' refers to the function of automatically checking the consistency of the design, the appropriateness of the expression, and copyright infringement of the automatically generated presentation document."

[0017] "The 'practice recording means' refers to the function of recording and documenting the user's speech content during the presentation practice."

[0018] "The 'feedback means' refers to the function of evaluating the recorded speech content and providing suggestions for improvement, pointing out inconsistent parts with the document, and highlighting difficult-to-understand areas."

[0019] "The 'assistance means' refers to the function of supporting the user during the actual presentation, helping to relieve tension, check time allocation, and respond to questions."

[0020] "The'system' refers to an integrated combination of software and hardware in which multiple means cooperate to comprehensively support the user's presentation."

Brief Description of the Drawings

[0021] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment." [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment." [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment." [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment." [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment." [Figure 6]It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0022] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings. ​​​​​​In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0025] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0026] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0027] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0029] [First Embodiment]

[0030] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0031] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0034] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0037] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0041] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0042] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[0043] The "AI Presentation Master" system of the present invention is designed to allow users to receive support at each step of their presentation. The system primarily operates through the cooperation of three parties: the server, the terminal, and the user.

[0044] Entering presentation settings information

[0045] User:

[0046] The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[0047] Prompt generation and avatar generation

[0048] server:

[0049] The server receives configuration information sent by the user and generates an appropriate prompt. This prompt will be professional and effective, tailored to the content of the presentation and the audience. The generated prompt is then sent to the terminal.

[0050] Terminal:

[0051] The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to executives, an avatar resembling an executive is generated. This avatar is displayed on the user's screen for the user to confirm.

[0052] Automatic generation and checking of documents

[0053] User:

[0054] The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they might input an outline such as "Advantages of Cloud Services."

[0055] server:

[0056] The server uses AI to automatically generate presentation materials based on information received from the user. These materials undergo checks for design consistency, appropriateness of expression, and copyright infringement. The generated materials are then sent to the user's device and provided to them.

[0057] Presentation practice and feedback

[0058] User:

[0059] The user starts presentation practice mode on the device's interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[0060] Terminal:

[0061] The device converts the recorded speech into text data and sends it to the server.

[0062] server:

[0063] The server analyzes the received text data and evaluates its consistency with the document. It then identifies unclear sections, suggests improvements, generates a list of anticipated questions (FAQs), and sends them to the terminal.

[0064] Follow-up during the actual presentation

[0065] Terminal:

[0066] During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[0067] User:

[0068] When a question comes in, the content is entered into the terminal and sent to the server.

[0069] server:

[0070] The server analyzes the received question and processes it to understand its intent. It then generates hints for an appropriate answer and sends them to the terminal.

[0071] This system provides users with comprehensive support from presentation preparation to the actual presentation. Specifically, it reduces the effort required to create materials and provides a sense of security through prior practice, thereby increasing the success rate of the actual presentation. Furthermore, real-time support during the presentation allows for smooth handling of questions and other inquiries.

[0072] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows them to quickly create high-quality presentation materials and deliver their presentation with confidence through practice. Furthermore, it enables them to respond accurately to questions, maximizing the effectiveness of their presentation.

[0073] The following describes the processing flow.

[0074] Step 1:

[0075] The user accesses the terminal and enters presentation settings (audience, purpose, presentation time, audience knowledge level, industry, etc.). Clicking the submit button sends the entered data from the terminal to the server.

[0076] Step 2:

[0077] The server receives configuration information sent by the user and stores it in its internal database. Next, it parses the received data and processes it to generate an appropriate prompt. The generated prompt is then sent to the terminal.

[0078] Step 3:

[0079] The terminal generates an avatar tailored to the presentation audience based on prompts received from the server. This includes avatars that resemble executives or superiors. The generated avatar is displayed on the user's screen for the user to confirm.

[0080] Step 4:

[0081] The user inputs basic information and the main points of the presentation materials into the terminal. For example, they might enter "Advantages of the cloud service" or "Features of the new product" and then click the submit button.

[0082] Step 5:

[0083] The server receives basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. The checked materials are then sent to the terminal.

[0084] Step 6:

[0085] The terminal displays the completed document received from the server to the user. The user reviews the document and, if necessary, enters and submits feedback on the terminal.

[0086] Step 7:

[0087] The user starts presentation practice mode on their device and practices using the generated materials. The device records what the user says during practice.

[0088] Step 8:

[0089] The device converts the recorded speech into text data and sends it to the server.

[0090] Step 9:

[0091] The server analyzes the received text data and evaluates its consistency with the document, the clarity of the statements, and whether any important points are missing. It then generates the evaluation results, points out unclear sections, suggested corrections, and anticipated questions (FAQs), and sends them to the terminal.

[0092] Step 10:

[0093] The terminal displays feedback received from the server and FAQs to the user. The user then makes corrections and improvements accordingly.

[0094] Step 11:

[0095] The user prepares for their presentation. During the presentation, they receive real-time support from their device. For example, a timer function displays the time allocation, and reminders appear to help alleviate nervousness.

[0096] Step 12:

[0097] When a user receives a question, they input the content into their device and send it.

[0098] Step 13:

[0099] The server analyzes the received question and processes it to understand its intent. It then generates appropriate response guidelines and hints and sends them to the terminal.

[0100] Step 14:

[0101] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0102] Through the above process, users will receive comprehensive support and be able to deliver high-quality presentations.

[0103] (Example 1)

[0104] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0105] Conventional presentation support systems lacked sufficient functionality to automatically generate appropriate prompts and materials based on manual input of presentation settings by the user. Furthermore, they lacked features to provide real-time feedback during presentation practice, monitor the progress of the presentation, and offer appropriate advice and responses. As a result, it was difficult for users to deliver presentations smoothly during preparation and the actual presentation itself.

[0106] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0107] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a question analysis and answer generation means for generating appropriate answers to questions the user receives during the presentation, and a progress monitoring means for monitoring the user's progress during the presentation and displaying alerts and advice. This enables the user to receive comprehensive support from the preparation to the actual presentation.

[0108] "Input method" refers to the interface or device that allows the user to input presentation settings information.

[0109] "Prompt generation means" refers to a function that generates appropriate prompts based on the input configuration information, tailored to the presentation content and the audience.

[0110] "Avatar generation means" refers to a function that generates an avatar suitable for the presentation audience based on the generated prompt.

[0111] "Document generation means" refers to a function that automatically creates presentation materials based on basic information and outlines provided by the user.

[0112] "Document checking method" refers to a function for checking automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[0113] "Practice recording means" refers to a function that allows users to record and save what they say while practicing a presentation.

[0114] "Feedback mechanisms" refer to functions that evaluate the consistency between recorded statements and documents, and provide users with suggestions for improvement.

[0115] "Question analysis and answer generation means" refers to a function that analyzes questions received by users during a presentation, understands their intent, and generates appropriate answers.

[0116] "Progress monitoring means" refers to a function that monitors the user's progress in real time during a presentation and displays time allocation alerts and appropriate advice.

[0117] This invention is a support system for users to deliver presentations efficiently and effectively. This system primarily operates through the cooperation of a server, a terminal, and the user. The system is implemented using the following hardware and software.

[0118] Specific examples of hardware and software

[0119] A terminal refers to a computer or smart device that accepts user input and operations. It also includes input devices such as microphones and cameras. A server refers to a high-performance computer that performs processing using generative AI models. Natural language processing (NLP) technology is expected to be used for generating shapes and text, while the Google Vision API is expected to be used for image processing and the Google Speech-to-Text API for speech recognition.

[0120] Specific actions

[0121] First, the user accesses the terminal's interface and enters presentation settings information. Specifically, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it. Based on the received information, the server uses a generative AI model to generate appropriate prompts and sends them to the terminal. The terminal then generates an avatar appropriate for the audience based on the received prompts. For example, an avatar resembling an executive might be generated.

[0122] Next, the user inputs the outline and basic information of the presentation materials into the terminal and sends it. The server uses AI to automatically generate the presentation materials based on the received information. These materials are checked for design consistency, appropriateness of expression, and copyright infringement, and the generated materials are sent to the terminal and provided to the user.

[0123] The user starts a presentation practice mode on the device's interface and practices using the generated materials. The device records the user's speech, converts it into text data using speech recognition software, and sends it to the server. The server analyzes the received text data, evaluates its consistency with the materials, identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them back to the device.

[0124] During the presentation, the device monitors the user's progress in real time and displays reminders such as "5 minutes remaining." It also inputs any questions the user receives during the presentation into the device and sends them to the server. The server analyzes the received questions, processes them to understand their intent, generates hints for appropriate answers, and sends them back to the device.

[0125] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system will generate the following prompt:

[0126] "Please create an outline and materials for a presentation on the benefits of cloud services. The audience consists of executives with limited technical knowledge, and the goal of the presentation is to persuade them of the advantages of migrating to the cloud. The content should be clear and easy to understand, and include specific benefits and examples."

[0127] This allows users to receive comprehensive support from presentation preparation to the actual presentation. Through specific actions and technologies, all-encompassing support is provided from preparation to the actual presentation.

[0128] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0129] Step 1:

[0130] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation duration, audience knowledge level, and industry. The entered settings information is stored as data on the terminal for subsequent processing steps. The terminal then sends this settings information to the server.

[0131] Input: Presentation audience, purpose, presentation time, audience knowledge level, industry

[0132] Output: Configuration information is sent to the server.

[0133] Step 2:

[0134] The server receives configuration information sent by the user. Based on the received configuration information, it uses a generative AI model to generate appropriate prompts. The generated prompts are optimized for the user's presentation content and the audience. For example, it can generate a prompt explaining the benefits of cloud services to executives with limited technical knowledge. The generated prompts are then sent to the terminal.

[0135] Input: Settings information

[0136] Output: The generated prompt is sent to the terminal.

[0137] Step 3:

[0138] The terminal generates an avatar based on prompts received from the server. For example, it might generate an avatar resembling an executive using 3D modeling software. This avatar has an appearance tailored to the audience being presented to. The generated avatar is displayed on the user's screen for confirmation.

[0139] Input: Generated prompt

[0140] Output: The generated avatar is displayed on the screen.

[0141] Step 4:

[0142] Users input the main points and basic information of their presentation materials into their terminal and send it. For example, they might input "advantages of cloud services," "cost reduction," and "operational flexibility." This information is stored on the terminal and sent to the server.

[0143] Input: Outline and basic information of the presentation materials

[0144] Output: The outline of the generated document is sent to the server.

[0145] Step 5:

[0146] The server uses AI to automatically generate presentation materials based on the outline and basic information received from the user. The generated materials include checks for design consistency, appropriateness of expression, and copyright infringement. For example, the Google Vision API is used to check image copyrights. The generated materials are sent to the device and provided to the user.

[0147] Input: Outline and basic information of the presentation materials

[0148] Output: Automatically generated presentation materials

[0149] Step 6:

[0150] The user starts presentation practice mode on the device interface and practices using the generated materials. The device records the user's speech and converts it into text data using the Google Speech-to-Text API. The converted text data is sent to the server.

[0151] Input: User's statement

[0152] Output: Converted text data

[0153] Step 7:

[0154] The server analyzes the received text data and evaluates its consistency with the document. Specifically, it uses NLP (Neuro-Linguistic Programming) technology to compare the user's statements with the document content and points out unclear areas or areas for improvement. It also generates a list of frequently asked questions (FAQs) and sends them to the terminal.

[0155] Input: Converted text data

[0156] Output: Feedback and FAQ

[0157] Step 8:

[0158] During the presentation, the device monitors the user's progress in real time and displays time-out alerts (e.g., "5 minutes remaining"). It also displays messages and advice to help ease the user's anxiety.

[0159] Input: User's presentation progress

[0160] Output: Alerts and advice

[0161] Step 9:

[0162] When a question comes in during the presentation, the user enters the content into their device and sends it to the server. For example, they might enter "a question about cloud security."

[0163] Input: Question content

[0164] Output: The question content is sent to the server.

[0165] Step 10:

[0166] The server uses a generative AI model to analyze the received question and understand its intent. It then generates hints for appropriate answers and sends them to the terminal. Based on these hints, the user can respond to the question accurately.

[0167] Input: Question content

[0168] Output: Hints for the generated answer

[0169] (Application Example 1)

[0170] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0171] In today's industrial environment, efficient and effective presentations are crucial for project success and the successful adoption of new technologies. However, creating, practicing, and delivering presentations is often cumbersome, and there is a lack of efficient systems, particularly in manufacturing. Therefore, there is a need for a support system that can quickly gather detailed information on manufacturing processes and efficiency proposals, and then use that information to propose the introduction of new technologies.

[0172] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0173] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a follow-up means for supporting the user during the actual presentation, and a data processing means for collecting detailed information on manufacturing processes and efficiency improvements when giving a presentation in a factory, and for proposing the introduction of new robots based on that information. This makes it possible to efficiently create presentation materials, practice, and handle the actual presentation.

[0174] A "user" refers to one or more individuals who use this system to create, practice, and deliver presentations.

[0175] An "input method" refers to a device or interface for a user to input presentation settings information.

[0176] A "prompt generation means" is a device or program that generates prompts to guide the presentation content based on the input configuration information.

[0177] An "avatar generation means" is a device or program that generates an avatar suitable for the presentation recipient based on the generated prompt.

[0178] "Document generation means" refers to devices or programs that automatically generate presentation materials.

[0179] "Document checking tools" refer to devices or programs that check automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement.

[0180] A "practice recording device" is a device or program that allows a user to practice a presentation and record what they say.

[0181] A "feedback mechanism" is a device or program that evaluates the consistency between recorded statements and documents and provides feedback on areas for improvement.

[0182] A "follow-up tool" is a device or program that provides real-time advice and reminders to support the user during the actual presentation.

[0183] "Data processing means" refers to devices and programs used to collect detailed information about manufacturing processes and efficiency improvements when giving presentations within a factory, and to use that information to propose the introduction of new robots.

[0184] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[0185] The system of this invention primarily operates through the cooperation of three parties: a server, a terminal, and a user.

[0186] Entering presentation settings information

[0187] User: The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[0188] Prompt generation and avatar generation

[0189] Server: The server receives configuration information sent by the user and generates an appropriate prompt. This prompt is professional and effective, tailored to the content of the presentation and the audience. The generated prompt is sent to the terminal.

[0190] Terminal: The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to management, it generates an avatar that looks like a management representative. This avatar is displayed on the user's screen for the user to confirm.

[0191] Automatic generation and checking of documents

[0192] User: The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they input the outline of "Plan for Introducing a New Robot Arm".

[0193] Server: The server automatically generates presentation materials using generative AI based on information received from the user. These materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal and provided to the user.

[0194] Presentation practice and feedback

[0195] User: The user starts presentation practice mode on the device interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[0196] Terminal: The terminal converts the recorded speech into text data and sends it to the server.

[0197] Server: The server analyzes the received text data and evaluates its consistency with the document. Based on the evaluation results, it identifies unclear sections, suggests areas for improvement, and generates a list of anticipated questions (FAQs), which are then sent to the terminal.

[0198] Follow-up during the actual presentation

[0199] Device: During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[0200] User: When a question comes in, enter the content into the terminal and send it to the server.

[0201] Server: The server analyzes the received question and processes it to understand its intent. It generates hints for an appropriate answer and sends them to the terminal.

[0202] The hardware used includes smartphones, tablets, personal computers, and industrial robots. The software used utilizes generative AI models (PromptGenerator, AvatarGenerator, PresentationGenerator, FeedbackAnalyzer).

[0203] Specific example:

[0204] For example, if a user is giving a presentation proposing the introduction of a new robotic arm, the configuration information might include the following:

[0205] Opponent: Management

[0206] Objective: Proposal for the introduction of a new robotic arm.

[0207] Presentation time: 10 minutes

[0208] Opponent's knowledge level: High

[0209] Industry: Automobile manufacturing

[0210] Example of a prompt:

[0211] "Please generate a presentation document to propose a plan to introduce a new robotic arm to management, focusing on efficiency and cost reduction."

[0212] This makes it possible to efficiently create, practice, and perform presentations.

[0213] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0214] Step 1:

[0215] Entering presentation settings information

[0216] User: Enters and submits setting information such as the presentation's purpose, audience, presentation time, audience knowledge level, and industry into the terminal's interface. This provides the system with basic presentation information. The entered information is sent from the terminal to the server and used for the next step.

[0217] Step 2:

[0218] Prompt generation

[0219] Server: Based on the received configuration information, the server uses an AI model (PromptGenerator) to generate prompts tailored to the presentation content and audience. These prompts serve as a guide for the user to conduct the presentation effectively. The generated prompts are sent to the terminal.

[0220] Step 3:

[0221] Avatar generation

[0222] Terminal: Based on prompts received from the server, an AI model (AvatarGenerator) is used to generate an avatar appropriate for the presentation audience. The generated avatar is displayed on the user's screen. For example, in a presentation to management, an avatar resembling a management representative will be displayed.

[0223] Step 4:

[0224] Automatic generation of documents

[0225] User: Enters the outline and basic information of the presentation materials (e.g., "Plan for Introducing a New Robotic Arm") into the terminal and sends it. This provides the server with the information necessary for creating the specific materials.

[0226] Server: Based on the received information, it automatically generates presentation materials using an AI model (PresentationGenerator). The materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal.

[0227] Step 5:

[0228] Presentation practice and feedback

[0229] User: Using the generated materials, start presentation practice mode on your device. Your speech will be recorded during practice. This allows you to simulate an actual presentation.

[0230] Terminal: Converts recorded speech into text data and sends it to the server. This converts the speech into a format that can be analyzed.

[0231] Server: Analyzes received text data and evaluates its consistency with the document. Using an AI model (FeedbackAnalyzer), it identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them to the user's device. The user reviews the feedback and uses it to improve their presentation.

[0232] Step 6:

[0233] Follow-up during the actual presentation

[0234] Terminal: During the presentation, it monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to alleviate the user's anxiety.

[0235] User: When a question comes in, enter the content into the terminal and send it to the server. This ensures that the question is sent to the server in a parseable format.

[0236] Server: Analyzes received questions and processes them to understand their intent. Generates appropriate answer hints using an AI model and sends them to the terminal. Users can answer questions quickly and accurately based on the provided hints.

[0237] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0238] This invention is a support system for users to give presentations efficiently and effectively, and by using an emotion engine that recognizes the user's emotions, it provides detailed support tailored to individual needs. The specific operation of the system for implementing this invention will be described below.

[0239] The "AI Presentation Master" system of the present invention primarily operates through the cooperation of three parties: a server, a terminal, and a user. This system has the function of recognizing the user's emotions in real time and dynamically adjusting the support provided at each step.

[0240] Entering presentation settings information

[0241] User:

[0242] First, the user accesses the terminal's interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. After entering the information, the user clicks the submit button to send the data from the terminal to the server.

[0243] Prompt generation and avatar generation

[0244] server:

[0245] The server receives configuration information sent by the user and analyzes the user's emotions in real time using an emotion engine. The prompt generation means generates the optimal prompt based on the user's emotions recognized by the emotion engine. For example, if the user is tense, a prompt to help them relax will be selected. The generated prompt is sent to the terminal.

[0246] Terminal:

[0247] The device generates an avatar that responds to the user's emotions based on prompts received from the server. The avatar's facial expressions and movements are also adjusted by the emotion engine, allowing the user to relax. The generated avatar is then displayed on the user's screen.

[0248] Automatic generation and checking of documents

[0249] User:

[0250] Next, the user enters the basic information and outline of the presentation materials into the terminal and clicks the send button. This information is sent to the server.

[0251] server:

[0252] The server receives basic information sent by the user and automatically generates materials using an AI model. The automatically generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. The emotion engine considers the impact of the check results on the user's emotions and generates appropriate feedback. This material and feedback are sent to the terminal.

[0253] Presentation practice and feedback

[0254] User:

[0255] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[0256] Terminal:

[0257] The device converts the recorded speech into text data and sends it to the server.

[0258] server:

[0259] The server analyzes the received text data and evaluates its consistency with the document. This evaluation also reflects the user's emotions. For example, if the user is feeling anxious, positive feedback is prioritized. The evaluation results, along with points of confusion, improvement suggestions, and anticipated questions (FAQs), are generated and sent to the terminal.

[0260] Follow-up during the actual presentation

[0261] Terminal:

[0262] During the presentation, the device monitors the user's progress in real time and checks the time allocation. The emotion engine recognizes the user's emotions and displays reminders and advice accordingly. For example, if the user is nervous, a message to help them relax will be displayed.

[0263] User:

[0264] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[0265] server:

[0266] The server analyzes the received question and uses an emotion engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[0267] Terminal:

[0268] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0269] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows the emotion engine to recognize the user's tension and provide prompts and avatars to help them relax. Furthermore, appropriate support tailored to the user's emotions is provided during both practice and the actual presentation, improving the quality of the presentation and increasing its success rate.

[0270] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotions, and effectively assists throughout the entire process from presentation preparation to the actual presentation.

[0271] The following describes the processing flow.

[0272] Step 1:

[0273] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. Once the information is entered, the user clicks the submit button to send the settings information to the server.

[0274] Step 2:

[0275] The server receives presentation settings information sent by the user and stores it in an internal database. Next, it activates the emotion engine and analyzes the user's emotional state. Using this analysis, the prompt generation system generates the most appropriate prompts according to the presentation content. If the user is nervous, it generates prompts to help them relax. The prompts are then sent to the terminal.

[0276] Step 3:

[0277] The terminal analyzes prompts received from the server and generates an avatar designed to help the user relax. For example, it might generate an avatar with a gentle expression or one performing relaxed movements. The generated avatar is displayed on the user's screen for the user to see.

[0278] Step 4:

[0279] The user inputs the basic information and outlines necessary for preparing the presentation materials into the terminal. For example, input "Advantages of cloud services" and "Features of new products", etc., and click the send button. The input data is sent to the server.

[0280] Step 5:

[0281] The server receives the basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. The sentiment engine evaluates the impact of the check results on the user's sentiment and generates appropriate feedback. These materials and feedback are sent to the terminal.

[0282] Step 6:

[0283] The terminal displays the materials and feedback received from the server to the user. The user checks the materials and makes corrections based on the feedback if necessary. If corrections are needed, send them to the server again.

[0284] Step 7:

[0285] The user starts the presentation practice mode on the interface of the terminal and practices using the generated materials. The speech content during practice is recorded and recorded by the terminal.

[0286] Step 8:

[0287] The terminal converts the recorded speech into text data and sends the text data to the server.

[0288] Step 9:

[0289] The server analyzes the received text data and evaluates its consistency with the document. It also assesses the user's emotional state and generates feedback on the clarity of the speech and any omissions or missing important points. The evaluation results, feedback, and anticipated questions (FAQs) are sent to the terminal.

[0290] Step 10:

[0291] The terminal displays feedback received from the server and FAQs to the user. The user can then revise the materials accordingly and practice again.

[0292] Step 11:

[0293] The user prepares for their presentation. During the presentation, the device monitors the progress and time allocation of the presentation in real time. The emotion engine analyzes the user's emotional state in real time and displays reminders and advice. For example, a message such as "Please take a deep breath" might be displayed.

[0294] Step 12:

[0295] If a user receives a question during live operation, the user enters the question into their terminal and sends it to the server.

[0296] Step 13:

[0297] The server analyzes the received question and processes it to understand its intent. The emotion engine generates response guidelines and hints appropriate to the user's emotional state. These generated hints are then sent to the terminal.

[0298] Step 14:

[0299] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0300] Through the above process, users receive comprehensive support and can deliver high-quality presentations. This system allows users to approach presentations with confidence and receive appropriate answers to questions through real-time support.

[0301] (Example 2)

[0302] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0303] Traditional presentation support systems often provided simplistic advice without considering the user's emotions. As a result, they failed to adequately alleviate the tension and anxiety users felt during presentations, making it difficult to improve the quality and success rate of presentations. Furthermore, even in presentation practice and automated material generation, there was a lack of feedback and advice tailored to the individual user's emotional state.

[0304] The specific processing by the specific processing unit 290 of the data processing apparatus 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for a user to input presentation setting information, an emotion analysis means for analyzing the user's emotion in real time based on the input setting information, a prompt generation means for generating a prompt based on the analyzed emotion information, an avatar generation means for generating an avatar based on the generated prompt, a material generation means for automatically generating presentation materials, a material check means for checking the automatically generated presentation materials from the viewpoints of design consistency, appropriateness of expression, and copyright infringement, a practice recording means for the user to practice the presentation and record the content of their speech, a feedback means for evaluating the consistency between the recorded speech content and the materials and providing feedback, and a follow-up means for monitoring and supporting the user's progress and emotion in real time during the actual presentation. Thereby, it becomes possible to consistently support the user from the creation of high-quality presentation materials to the actual presentation support while alleviating the user's tension and anxiety.

[0305] The "input means" is an interface for a user to input presentation setting information.

[0306] The "emotion analysis means" is an engine or system for analyzing the user's emotion in real time based on the input setting information.

[0307] The "prompt generation means" is a function for generating an appropriate prompt based on the emotion information obtained by the emotion analysis means.

[0308] The "avatar generation means" is a system for generating the expression and movement of an avatar based on the generated prompt.

[0309] The "material generation means" is a function for automatically generating presentation materials based on the basic information of the presentation materials input by the user.

[0310] A "document checking method" refers to a system or function that checks generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[0311] The "practice recording function" is a feature that allows users to record and save their speech when practicing a presentation.

[0312] A "feedback mechanism" is a system or function for evaluating the consistency between recorded statements and materials and providing appropriate feedback.

[0313] "Follow-up features" are functions that monitor the user's progress and emotions in real time during the presentation and provide support as needed.

[0314] This invention is a support system for users to give presentations efficiently and effectively, and it provides detailed support tailored to individual needs by using an emotion engine that analyzes the user's emotions in real time. This system mainly operates through the cooperation of three parties: a server, a terminal, and the user.

[0315] Entering presentation settings information

[0316] User:

[0317] The user enters presentation settings information using the device's interface (e.g., a web browser or dedicated application). This information includes the audience's name, company, purpose, presentation time, audience's knowledge level, and industry. After entering the information, the user clicks a submit button to send the information from the device to the server.

[0318] Hardware and software used:

[0319] Devices: PC, tablet, smartphone

[0320] Software: Web browser, dedicated application, HTML form, JavaScript

[0321] Sentiment analysis and prompt generation

[0322] server:

[0323] The server receives configuration information sent by the user and uses this information to analyze the user's emotions in real time using an emotion engine (e.g., Python's Emotion API or an open-source emotion analysis library). Based on the analysis results, the prompt generation means generates the optimal prompt using a generative AI model (e.g., OpenAI's GPT-4). For example, if the user is feeling anxious, a prompt to help them relax will be generated. This prompt is then sent to the terminal.

[0324] Hardware and software used:

[0325] Servers: Cloud servers, physical servers

[0326] Software: Python, Emotion API, open-source analysis library, GPT-4

[0327] Examples of prompt statements:

[0328] "Please speak calmly without being nervous. Take a slow, deep breath."

[0329] "On the next slide, highlight the points that will capture the audience's interest."

[0330] Avatar generation

[0331] Terminal:

[0332] The device generates an avatar based on prompts received from the server. The avatar's facial expressions and movements are adjusted based on the output of the emotion engine. For example, if the user is tense, an avatar with a relaxed expression will be generated. The generated avatar is then displayed in 3D on the user's screen.

[0333] Hardware and software used:

[0334] Devices: PC, tablet, smartphone

[0335] Software: JavaScript libraries (e.g., Three.js), WebGL

[0336] Automatic document generation and checking

[0337] User:

[0338] The user enters basic information and outlines of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[0339] server:

[0340] The server receives and analyzes basic information sent by the user and automatically generates materials using an AI model (e.g., OpenAI's DALLE 2 or GPT-4). The generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. Based on the check results, the sentiment engine generates appropriate feedback, and this material and feedback are sent to the terminal.

[0341] Hardware and software used:

[0342] Servers: Cloud servers, physical servers

[0343] Software: Python, DALLE 2, GPT-4, Google Cloud Vision API

[0344] Presentation practice and feedback

[0345] User:

[0346] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[0347] Terminal:

[0348] The device converts the recorded audio into text data and sends it to the server.

[0349] server:

[0350] The server analyzes the received text data and evaluates its consistency with the presentation materials. The evaluation results also reflect the user's emotions, with positive feedback given priority. Along with the evaluation results, points of confusion, improvement suggestions, and FAQs (expected questions) are generated and sent to the terminal.

[0351] Hardware and software used:

[0352] Devices: PC, tablet, smartphone

[0353] Software: Speech recognition APIs (e.g., Google Speech-to-Text API, Amazon Transcribe)

[0354] Follow-up during the actual presentation

[0355] Terminal:

[0356] During the presentation, the device monitors the user's progress in real time, and the emotion engine recognizes the user's emotions. Reminders and advice are displayed according to the user's state. For example, messages to help the user relax are provided.

[0357] User:

[0358] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[0359] server:

[0360] The server analyzes the received question and uses an emotion engine to generate answer hints and guidelines appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[0361] Terminal:

[0362] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0363] Hardware and software used:

[0364] Devices: PC, tablet, smartphone

[0365] Software: JavaScript time tracking function, real-time WebSocket communication

[0366] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotional state, and effectively assists the user from presentation preparation to the actual presentation.

[0367] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0368] Step 1: Enter presentation settings information

[0369] User:

[0370] The user enters presentation settings information using the terminal interface. For example, they might enter the audience's name, organization, presentation purpose, presentation time, audience knowledge level, and industry. To do this, the user fills in the information in a form and clicks the submit button. The entered information is sent to the server using the JavaScript fetch API.

[0371] Inputs and outputs:

[0372] Input: Presentation setup information (audience, purpose, presentation time, audience knowledge level, industry, etc.)

[0373] Output: Configuration information is sent to the server.

[0374] Specific actions:

[0375] The user enters information using an HTML form and clicks the submit button.

[0376] The configuration information is sent to the server as a POST request using the JavaScript fetch API.

[0377] Step 2: Emotion Analysis

[0378] server:

[0379] The server receives configuration information sent by the user and performs sentiment analysis. This sentiment analysis utilizes Python's Emotion API or open-source sentiment analysis libraries. This process analyzes the user's emotional state (e.g., tension or relaxation) in real time.

[0380] Inputs and outputs:

[0381] Input: Presentation settings information

[0382] Output: Emotion analysis results

[0383] Specific actions:

[0384] The server processes the received configuration information using a Python-based API.

[0385] The sentiment analysis library is called to analyze the user's emotions.

[0386] The analysis results are stored in JSON format.

[0387] Step 3: Generate prompt

[0388] server:

[0389] Based on the emotion analysis results, the prompt generation means generates an appropriate prompt. Using a generation AI model (e.g., OpenAI's GPT-4), prompts are generated that correspond to the user's emotional state. For example, if the user is tense, a prompt to help them relax is generated. The generated prompt is sent to the terminal.

[0390] Inputs and outputs:

[0391] Input: Sentiment analysis results

[0392] Output: Generated prompt

[0393] Specific actions:

[0394] The emotion analysis results are input into the generating AI model.

[0395] The model is used to generate prompts.

[0396] The generated prompt is sent to the terminal in JSON format.

[0397] Step 4: Avatar Creation

[0398] Terminal:

[0399] The terminal generates an avatar based on prompts received from the server. The avatar's facial expressions and movements are adjusted based on the emotion analysis results. For example, an avatar with a relaxed expression is generated. The generated avatar is displayed in 3D.

[0400] Inputs and outputs:

[0401] Input: Generated prompt

[0402] Output: The displayed avatar

[0403] Specific actions:

[0404] Analyze the prompt received from the server.

[0405] This project uses a JavaScript library (e.g., Three.js) to render a 3D avatar via WebGL.

[0406] Set the avatar's facial expressions based on prompts.

[0407] Step 5: Automatic document generation and checking

[0408] User:

[0409] The user enters basic information and outlines of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[0410] Inputs and outputs:

[0411] Input: Basic information and outline of the presentation materials

[0412] Output: Data information sent to the server

[0413] Specific actions:

[0414] The user enters information about the document into the form and submits it.

[0415] Use the JavaScript fetch API to send information to the server as a POST request.

[0416] server:

[0417] The server analyzes the received document information and automatically generates documents using an AI model (e.g., OpenAI's DALLE 2 or GPT-4). The generated documents are checked for design consistency, appropriateness of expression, and copyright infringement. Appropriate feedback is also added using sentiment analysis. These documents and feedback are sent to the terminal.

[0418] Inputs and outputs:

[0419] Input: Basic information and outline of the presentation materials

[0420] Output: Generated presentation materials and feedback

[0421] Specific actions:

[0422] The server analyzes the received data information.

[0423] Use an AI model to generate documents.

[0424] Check the design, consistency, and copyright of the materials.

[0425] Feedback is generated based on the emotion analysis results.

[0426] Send the documents and feedback back to the device.

[0427] Step 6: Presentation practice and feedback

[0428] User:

[0429] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[0430] Inputs and outputs:

[0431] Input: Presentation materials

[0432] Output: Recorded speech

[0433] Specific actions:

[0434] The user displays the presentation materials and begins practicing.

[0435] The device uses its recording function to record what is said.

[0436] Terminal:

[0437] The device converts the recorded audio into text data and sends it to the server.

[0438] Inputs and outputs:

[0439] Input: Recorded speech

[0440] Output: Text data sent to the server

[0441] Specific actions:

[0442] The recorded data is converted to text using a speech recognition API (e.g., Google Speech-to-Text API).

[0443] Send the converted text data to the server.

[0444] server:

[0445] The server analyzes the received text data and evaluates its consistency with the document. Sentiment analysis is also incorporated into this evaluation. Positive feedback is prioritized, and along with the evaluation results, points out unclear areas, suggestions for improvement, and FAQs are generated and sent to the terminal.

[0446] Inputs and outputs:

[0447] Input: Text data

[0448] Output: Feedback and FAQ

[0449] Specific actions:

[0450] Analyze the received text data.

[0451] Evaluate the consistency with the presentation materials.

[0452] Based on the results of the emotion analysis, feedback, improvement suggestions, and FAQs are generated.

[0453] Send feedback and FAQs to your device.

[0454] Step 7: Follow-up during the actual presentation

[0455] Terminal:

[0456] During the presentation, the device monitors the user's progress in real time, and the emotion engine recognizes the user's emotions. If the user is nervous, messages to help them relax and reminders about time management are displayed.

[0457] Inputs and outputs:

[0458] Input: User's progress, emotional state

[0459] Output: Reminders and advice

[0460] Specific actions:

[0461] Use JavaScript's time tracking feature to monitor progress.

[0462] It performs real-time sentiment analysis and displays appropriate reminders and advice.

[0463] User:

[0464] If a question comes in during the presentation, the question is entered into the terminal and sent to the server.

[0465] Inputs and outputs:

[0466] Input: Question content

[0467] Output: Question content sent to the server

[0468] Specific actions:

[0469] The questions received by the user are entered into the terminal.

[0470] Send the question to the server.

[0471] server:

[0472] The server analyzes the received question and uses an emotion engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. These hints are then sent to the terminal.

[0473] Inputs and outputs:

[0474] Input: Question content

[0475] Output: Hints and guidelines for answering the question.

[0476] Specific actions:

[0477] Analyze the content of the question.

[0478] Based on the results of the emotion analysis, hints and guidelines for the response are generated.

[0479] The generated hints and guidelines are sent to the device.

[0480] Terminal:

[0481] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0482] Inputs and outputs:

[0483] Input: Hints and guidelines for the answer

[0484] Output: Hints and guidance displayed on the screen.

[0485] Specific actions:

[0486] The received hints and instructions are displayed on the screen.

[0487] This system helps users answer questions while referring to hints.

[0488] (Application Example 2)

[0489] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0490] Traditional presentation support systems lacked the flexibility to adapt to users' emotions and transaction situations. This meant that appropriate support could not be provided when users felt nervous or anxious, potentially leading to a decline in the quality of presentations and transactions. Furthermore, in electronic payment services, ignoring users' emotional states during transactions resulted in insufficient support for anxious or nervous users, impacting transaction security and smooth progress.

[0491] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes an input means for the user to input presentation and transaction setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, an emotion recognition means for recognizing the user's emotions in real time, and an emotion response means for providing support messages based on the recognized emotions. This enables timely and appropriate support according to the user's emotional state.

[0492] "Input means" refers to a device or interface for a user to input presentation or transaction setting information into the system.

[0493] A "prompt generation means" is a device or program for generating instructions or advice presented to the user based on the input configuration information.

[0494] An "avatar generation means" is a device or program for generating characters or images that correspond to the user's emotions and presentation situation based on the generated prompts.

[0495] "Document generation means" refers to a device or system that automatically creates presentation materials based on basic information entered by the user.

[0496] A "document checking tool" is a device or program that verifies the consistency of the design, the appropriateness of the expression, and whether or not there are any copyright infringements in the generated presentation materials.

[0497] A "practice recording device" is a device or system that records the content of a user's speech during a presentation practice session.

[0498] A "feedback mechanism" is a device or program that evaluates the consistency between recorded statements and generated materials, and provides the user with suggestions for improvement and advice based on the evaluation results.

[0499] A "follow-up device" is a device or program that provides real-time advice and reminders to support the user during the actual presentation.

[0500] An "emotion recognition means" is a device or program for recognizing a user's emotional state in real time from the user's facial expressions, voice, gestures, etc.

[0501] An "emotional response device" is a device or program that provides appropriate support messages or advice based on the recognized emotional state of the user.

[0502] This invention is a support system for users to conduct presentations and electronic transactions efficiently and effectively, recognizing the user's emotions in real time and providing support tailored to individual needs. The specific operation of the system for implementing this invention will be described below.

[0503] Hardware and software configuration

[0504] hardware

[0505] Device: A computer, smartphone, tablet, etc., used by the user for presentations or transactions.

[0506] Webcam: Used to capture the user's facial expressions and recognize emotions.

[0507] Server: This server centralizes processes such as prompt generation, avatar generation, data generation, and emotion recognition.

[0508] software

[0509] Face detection engine: Face detection libraries such as dlib.

[0510] Emotion recognition engine: An emotion recognition model using Keras.

[0511] Prompt generation engine: A prompt generation algorithm equipped with a generative AI model.

[0512] Avatar generation engine: Software that generates avatars based on specified prompts.

[0513] Document generation engine and checking engine: Software for automatically generating and checking presentation materials.

[0514] System operation

[0515] Entering presentation settings information

[0516] User: First, the user accesses the terminal interface and enters presentation and transaction settings information. This information includes the other party, purpose, time, the other party's knowledge level, and industry. After entering the information, the user clicks the submit button to send the data from the terminal to the server.

[0517] Prompt generation and avatar generation

[0518] Server: The server receives configuration information sent by the user and generates the optimal prompt using a generative AI model. For example, if the user is stressed, a prompt to help them relax will be generated. The generated prompt is then sent to the terminal.

[0519] Terminal: Based on the received prompts, the terminal generates an avatar that responds to the user's emotions. The avatar's facial expressions and movements are also adjusted by the emotion recognition engine, allowing the user to relax. The generated avatar is displayed on the user's screen.

[0520] Automatic generation and checking of documents

[0521] User: Next, the user enters the basic information and outline of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[0522] Server: The server automatically generates presentation materials based on the received basic information. The materials are checked for design consistency, appropriateness of expression, and copyright infringement. The emotion recognition engine considers the impact of the check results on the user's emotions and generates appropriate feedback. This material and feedback are sent to the terminal.

[0523] Presentation practice and feedback

[0524] User: The user starts presentation practice mode on the device interface and practices using the generated materials. The device records what the user says during practice.

[0525] Terminal: The terminal converts the recorded speech into text data and sends it to the server.

[0526] Server: The server analyzes the received text data and evaluates its consistency with the material. This evaluation also reflects the user's emotions. For example, if the user is feeling anxious, positive feedback is prioritized. The evaluation results, along with points of confusion, improvement suggestions, and anticipated questions (FAQs), are generated and sent to the terminal.

[0527] Follow-up during the actual presentation

[0528] Terminal: During the presentation, the terminal monitors the user's progress in real time and checks the time allocation. The emotion recognition engine recognizes the user's emotions and displays reminders and advice according to their state. For example, if the user is nervous, a message to help them relax will be displayed.

[0529] User: If a question comes in during the presentation, enter the question into the terminal and send it to the server.

[0530] Server: The server analyzes the received question and uses an emotion recognition engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. The generated hints are sent to the terminal.

[0531] Terminal: The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0532] Examples of prompt statements

[0533] Example of a prompt:

[0534] "Relax and take a deep breath. This transaction is safe."

[0535] "That's fantastic! Keep it up."

[0536] "Please proceed as is."

[0537] In this way, by using this system, users can effectively conduct presentations and electronic transactions while receiving appropriate support through emotion recognition.

[0538] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0539] Step 1:

[0540] User: Access the terminal interface and enter presentation and transaction settings.

[0541] (Input): Information such as the other party, purpose, time, the other party's knowledge level, and industry.

[0542] (Data processing): The input data is formatted on the terminal and converted into a format that can be sent to the server.

[0543] (Output): Sends formatted configuration data to the server.

[0544] Step 2:

[0545] Server: Analyzes the received configuration information and generates prompts using a generation AI model.

[0546] (Input): Configuration data submitted by the user.

[0547] (Data processing): Use a generative AI model to generate prompts based on the configuration information.

[0548] (Output): Sends the generated prompt data to the terminal.

[0549] Step 3:

[0550] Terminal: Based on the received prompt, it generates an avatar using the avatar generation engine.

[0551] (Input): Prompt data sent from the server.

[0552] (Data Processing): An avatar generation engine is used to create avatars that respond to prompts. Facial expressions and movements are adjusted according to the user's emotions and presentation situation.

[0553] (Output): The generated avatar is displayed on the user's screen.

[0554] Step 4:

[0555] User: Enter the basic information and outline of the presentation materials into the terminal and click the send button.

[0556] (Input): Basic information and outline of the presentation materials.

[0557] (Data processing): The input information is formatted on the terminal and converted into a format that can be sent to the server.

[0558] (Output): Sends formatted data information to the server.

[0559] Step 5:

[0560] Server: Automatically generates presentation materials based on received basic information, and uses a material checking engine to verify design consistency, appropriateness of expression, and copyright infringement.

[0561] (Input): Basic information data submitted by the user.

[0562] (Data processing: Automatically generate presentation materials and evaluate them using a material checking engine.)

[0563] (Output): Sends the generated presentation materials and check results to the terminal.

[0564] Step 6:

[0565] User: Use the generated materials to practice your presentation on your device and record what you say.

[0566] (Input): Presentation materials and user comments.

[0567] (Data processing: The terminal records the spoken content, converts it to text, and sends it to the server.)

[0568] (Output): Sends the text data of the recorded speech to the server.

[0569] Step 7:

[0570] Server: Analyzes received text data, evaluates its consistency with the document, and generates feedback.

[0571] (Input: Text data and generated materials.)

[0572] (Data processing): Evaluate consistency with the document and generate areas for improvement and positive feedback.

[0573] (Output): Sends evaluation results and feedback data to the terminal.

[0574] Step 8:

[0575] Terminal: Monitors the progress of the presentation in real time and recognizes the user's emotions.

[0576] (Input): Real-time progress data and camera footage.

[0577] (Data Processing): Use an emotion recognition engine to recognize the user's emotions and monitor their progress. Generate reminders and advice.

[0578] (Output): Displays the generated reminders and advice to the user.

[0579] Step 9:

[0580] User: If a question comes in during the presentation, enter the content into the terminal and send it to the server.

[0581] (Input): Question content.

[0582] (Data processing): Format the question content and send it to the server.

[0583] (Output): Sends formatted question data to the server.

[0584] Step 10:

[0585] Server: Analyzes received questions and uses an emotion recognition engine to generate hints and guidelines for answers that are appropriate to the user's emotional state.

[0586] (Input): Question content data and user sentiment data.

[0587] (Data processing): Analyze the question content and generate hints and guidelines for responses that are appropriate to the user's emotional state.

[0588] (Output): Sends the generated answer hint data to the terminal.

[0589] Step 11:

[0590] Terminal: Displays answer hints from the server to the user, supporting the user in appropriately responding to questions.

[0591] (Input): Answer hint data sent from the server.

[0592] (Data processing): Convert the answer hint data into a displayable format and notify the user.

[0593] (Output): Displays answer hints on the user's screen.

[0594] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0595] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0596] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0597] [Second Embodiment]

[0598] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0599] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0600] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0601] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0602] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0603] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0604] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0605] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0606] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0607] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0608] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0609] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0610] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[0611] The "AI Presentation Master" system of the present invention is designed to allow users to receive support at each step of their presentation. The system primarily operates through the cooperation of three parties: the server, the terminal, and the user.

[0612] Entering presentation settings information

[0613] User:

[0614] The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[0615] Prompt generation and avatar generation

[0616] server:

[0617] The server receives configuration information sent by the user and generates an appropriate prompt. This prompt will be professional and effective, tailored to the content of the presentation and the audience. The generated prompt is then sent to the terminal.

[0618] Terminal:

[0619] The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to executives, an avatar resembling an executive is generated. This avatar is displayed on the user's screen for the user to confirm.

[0620] Automatic generation and checking of documents

[0621] User:

[0622] The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they might input an outline such as "Advantages of Cloud Services."

[0623] server:

[0624] The server uses AI to automatically generate presentation materials based on information received from the user. These materials undergo checks for design consistency, appropriateness of expression, and copyright infringement. The generated materials are then sent to the user's device and provided to them.

[0625] Presentation practice and feedback

[0626] User:

[0627] The user starts presentation practice mode on the device's interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[0628] Terminal:

[0629] The device converts the recorded speech into text data and sends it to the server.

[0630] server:

[0631] The server analyzes the received text data and evaluates its consistency with the document. It then identifies unclear sections, suggests improvements, generates a list of anticipated questions (FAQs), and sends them to the terminal.

[0632] Follow-up during the actual presentation

[0633] Terminal:

[0634] During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[0635] User:

[0636] When a question comes in, the content is entered into the terminal and sent to the server.

[0637] server:

[0638] The server analyzes the received question and processes it to understand its intent. It then generates hints for an appropriate answer and sends them to the terminal.

[0639] This system provides users with comprehensive support from presentation preparation to the actual presentation. Specifically, it reduces the effort required to create materials and provides a sense of security through prior practice, thereby increasing the success rate of the actual presentation. Furthermore, real-time support during the presentation allows for smooth handling of questions and other inquiries.

[0640] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows them to quickly create high-quality presentation materials and deliver their presentation with confidence through practice. Furthermore, it enables them to respond accurately to questions, maximizing the effectiveness of their presentation.

[0641] The following describes the processing flow.

[0642] Step 1:

[0643] The user accesses the terminal and enters presentation settings (audience, purpose, presentation time, audience knowledge level, industry, etc.). Clicking the submit button sends the entered data from the terminal to the server.

[0644] Step 2:

[0645] The server receives configuration information sent by the user and stores it in its internal database. Next, it parses the received data and processes it to generate an appropriate prompt. The generated prompt is then sent to the terminal.

[0646] Step 3:

[0647] The terminal generates an avatar tailored to the presentation audience based on prompts received from the server. This includes avatars that resemble executives or superiors. The generated avatar is displayed on the user's screen for the user to confirm.

[0648] Step 4:

[0649] The user inputs basic information and the main points of the presentation materials into the terminal. For example, they might enter "Advantages of the cloud service" or "Features of the new product" and then click the submit button.

[0650] Step 5:

[0651] The server receives basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. The checked materials are then sent to the terminal.

[0652] Step 6:

[0653] The terminal displays the completed document received from the server to the user. The user reviews the document and, if necessary, enters and submits feedback on the terminal.

[0654] Step 7:

[0655] The user starts presentation practice mode on their device and practices using the generated materials. The device records what the user says during practice.

[0656] Step 8:

[0657] The device converts the recorded speech into text data and sends it to the server.

[0658] Step 9:

[0659] The server analyzes the received text data and evaluates its consistency with the document, the clarity of the statements, and whether any important points are missing. It then generates the evaluation results, points out unclear sections, suggested corrections, and anticipated questions (FAQs), and sends them to the terminal.

[0660] Step 10:

[0661] The terminal displays feedback received from the server and FAQs to the user. The user then makes corrections and improvements accordingly.

[0662] Step 11:

[0663] The user prepares for their presentation. During the presentation, they receive real-time support from their device. For example, a timer function displays the time allocation, and reminders appear to help alleviate nervousness.

[0664] Step 12:

[0665] When a user receives a question, they input the content into their device and send it.

[0666] Step 13:

[0667] The server analyzes the received question and processes it to understand its intent. It then generates appropriate response guidelines and hints and sends them to the terminal.

[0668] Step 14:

[0669] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0670] Through the above process, users will receive comprehensive support and be able to deliver high-quality presentations.

[0671] (Example 1)

[0672] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0673] Conventional presentation support systems lacked sufficient functionality to automatically generate appropriate prompts and materials based on manual input of presentation settings by the user. Furthermore, they lacked features to provide real-time feedback during presentation practice, monitor the progress of the presentation, and offer appropriate advice and responses. As a result, it was difficult for users to deliver presentations smoothly during preparation and the actual presentation itself.

[0674] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0675] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a question analysis and answer generation means for generating appropriate answers to questions the user receives during the presentation, and a progress monitoring means for monitoring the user's progress during the presentation and displaying alerts and advice. This enables the user to receive comprehensive support from the preparation to the actual presentation.

[0676] "Input method" refers to the interface or device that allows the user to input presentation settings information.

[0677] "Prompt generation means" refers to a function that generates appropriate prompts based on the input configuration information, tailored to the presentation content and the audience.

[0678] "Avatar generation means" refers to a function that generates an avatar suitable for the presentation audience based on the generated prompt.

[0679] "Document generation means" refers to a function that automatically creates presentation materials based on basic information and outlines provided by the user.

[0680] "Document checking method" refers to a function for checking automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[0681] "Practice recording means" refers to a function that allows users to record and save what they say while practicing a presentation.

[0682] "Feedback mechanisms" refer to functions that evaluate the consistency between recorded statements and documents, and provide users with suggestions for improvement.

[0683] "Question analysis and answer generation means" refers to a function that analyzes questions received by users during a presentation, understands their intent, and generates appropriate answers.

[0684] "Progress monitoring means" refers to a function that monitors the user's progress in real time during a presentation and displays time allocation alerts and appropriate advice.

[0685] This invention is a support system for users to deliver presentations efficiently and effectively. This system primarily operates through the cooperation of a server, a terminal, and the user. The system is implemented using the following hardware and software.

[0686] Specific examples of hardware and software

[0687] A terminal refers to a computer or smart device that accepts user input and operations. It also includes input devices such as microphones and cameras. A server refers to a high-performance computer that performs processing using generative AI models. Natural language processing (NLP) technology is expected to be used for generating shapes and text, while the Google Vision API is expected to be used for image processing and the Google Speech-to-Text API for speech recognition.

[0688] Specific actions

[0689] First, the user accesses the terminal's interface and enters presentation settings information. Specifically, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it. Based on the received information, the server uses a generative AI model to generate appropriate prompts and sends them to the terminal. The terminal then generates an avatar appropriate for the audience based on the received prompts. For example, an avatar resembling an executive might be generated.

[0690] Next, the user inputs the outline and basic information of the presentation materials into the terminal and sends it. The server uses AI to automatically generate the presentation materials based on the received information. These materials are checked for design consistency, appropriateness of expression, and copyright infringement, and the generated materials are sent to the terminal and provided to the user.

[0691] The user starts a presentation practice mode on the device's interface and practices using the generated materials. The device records the user's speech, converts it into text data using speech recognition software, and sends it to the server. The server analyzes the received text data, evaluates its consistency with the materials, identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them back to the device.

[0692] During the presentation, the device monitors the user's progress in real time and displays reminders such as "5 minutes remaining." It also inputs any questions the user receives during the presentation into the device and sends them to the server. The server analyzes the received questions, processes them to understand their intent, generates hints for appropriate answers, and sends them back to the device.

[0693] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system will generate the following prompt:

[0694] "Please create an outline and materials for a presentation on the benefits of cloud services. The audience consists of executives with limited technical knowledge, and the goal of the presentation is to persuade them of the advantages of migrating to the cloud. The content should be clear and easy to understand, and include specific benefits and examples."

[0695] This allows users to receive comprehensive support from presentation preparation to the actual presentation. Through specific actions and technologies, all-encompassing support is provided from preparation to the actual presentation.

[0696] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0697] Step 1:

[0698] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation duration, audience knowledge level, and industry. The entered settings information is stored as data on the terminal for subsequent processing steps. The terminal then sends this settings information to the server.

[0699] Input: Presentation audience, purpose, presentation time, audience knowledge level, industry

[0700] Output: Configuration information is sent to the server.

[0701] Step 2:

[0702] The server receives configuration information sent by the user. Based on the received configuration information, it uses a generative AI model to generate appropriate prompts. The generated prompts are optimized for the user's presentation content and the audience. For example, it can generate a prompt explaining the benefits of cloud services to executives with limited technical knowledge. The generated prompts are then sent to the terminal.

[0703] Input: Settings information

[0704] Output: The generated prompt is sent to the terminal.

[0705] Step 3:

[0706] The terminal generates an avatar based on prompts received from the server. For example, it might generate an avatar resembling an executive using 3D modeling software. This avatar has an appearance tailored to the audience being presented to. The generated avatar is displayed on the user's screen for confirmation.

[0707] Input: Generated prompt

[0708] Output: The generated avatar is displayed on the screen.

[0709] Step 4:

[0710] Users input the main points and basic information of their presentation materials into their terminal and send it. For example, they might input "advantages of cloud services," "cost reduction," and "operational flexibility." This information is stored on the terminal and sent to the server.

[0711] Input: Outline and basic information of the presentation materials

[0712] Output: The outline of the generated document is sent to the server.

[0713] Step 5:

[0714] The server uses AI to automatically generate presentation materials based on the outline and basic information received from the user. The generated materials include checks for design consistency, appropriateness of expression, and copyright infringement. For example, the Google Vision API is used to check image copyrights. The generated materials are sent to the device and provided to the user.

[0715] Input: Outline and basic information of the presentation materials

[0716] Output: Automatically generated presentation materials

[0717] Step 6:

[0718] The user starts presentation practice mode on the device interface and practices using the generated materials. The device records the user's speech and converts it into text data using the Google Speech-to-Text API. The converted text data is sent to the server.

[0719] Input: User's statement

[0720] Output: Converted text data

[0721] Step 7:

[0722] The server analyzes the received text data and evaluates its consistency with the document. Specifically, it uses NLP (Neuro-Linguistic Programming) technology to compare the user's statements with the document content and points out unclear areas or areas for improvement. It also generates a list of frequently asked questions (FAQs) and sends them to the terminal.

[0723] Input: Converted text data

[0724] Output: Feedback and FAQ

[0725] Step 8:

[0726] During the presentation, the device monitors the user's progress in real time and displays time-out alerts (e.g., "5 minutes remaining"). It also displays messages and advice to help ease the user's anxiety.

[0727] Input: User's presentation progress

[0728] Output: Alerts and advice

[0729] Step 9:

[0730] When a question comes in during the presentation, the user enters the content into their device and sends it to the server. For example, they might enter "a question about cloud security."

[0731] Input: Question content

[0732] Output: The question content is sent to the server.

[0733] Step 10:

[0734] The server uses a generative AI model to analyze the received question and understand its intent. It then generates hints for appropriate answers and sends them to the terminal. Based on these hints, the user can respond to the question accurately.

[0735] Input: Question content

[0736] Output: Hints for the generated answer

[0737] (Application Example 1)

[0738] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0739] In today's industrial environment, efficient and effective presentations are crucial for project success and the successful adoption of new technologies. However, creating, practicing, and delivering presentations is often cumbersome, and there is a lack of efficient systems, particularly in manufacturing. Therefore, there is a need for a support system that can quickly gather detailed information on manufacturing processes and efficiency proposals, and then use that information to propose the introduction of new technologies.

[0740] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0741] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a follow-up means for supporting the user during the actual presentation, and a data processing means for collecting detailed information on manufacturing processes and efficiency improvements when giving a presentation in a factory, and for proposing the introduction of new robots based on that information. This makes it possible to efficiently create presentation materials, practice, and handle the actual presentation.

[0742] A "user" refers to one or more individuals who use this system to create, practice, and deliver presentations.

[0743] An "input method" refers to a device or interface for a user to input presentation settings information.

[0744] A "prompt generation means" is a device or program that generates prompts to guide the presentation content based on the input configuration information.

[0745] An "avatar generation means" is a device or program that generates an avatar suitable for the presentation recipient based on the generated prompt.

[0746] "Document generation means" refers to devices or programs that automatically generate presentation materials.

[0747] "Document checking tools" refer to devices or programs that check automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement.

[0748] A "practice recording device" is a device or program that allows a user to practice a presentation and record what they say.

[0749] A "feedback mechanism" is a device or program that evaluates the consistency between recorded statements and documents and provides feedback on areas for improvement.

[0750] A "follow-up tool" is a device or program that provides real-time advice and reminders to support the user during the actual presentation.

[0751] "Data processing means" refers to devices and programs used to collect detailed information about manufacturing processes and efficiency improvements when giving presentations within a factory, and to use that information to propose the introduction of new robots.

[0752] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[0753] The system of this invention primarily operates through the cooperation of three parties: a server, a terminal, and a user.

[0754] Entering presentation settings information

[0755] User: The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[0756] Prompt generation and avatar generation

[0757] Server: The server receives configuration information sent by the user and generates an appropriate prompt. This prompt is professional and effective, tailored to the content of the presentation and the audience. The generated prompt is sent to the terminal.

[0758] Terminal: The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to management, it generates an avatar that looks like a management representative. This avatar is displayed on the user's screen for the user to confirm.

[0759] Automatic generation and checking of documents

[0760] User: The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they input the outline of "Plan for Introducing a New Robot Arm".

[0761] Server: The server automatically generates presentation materials using generative AI based on information received from the user. These materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal and provided to the user.

[0762] Presentation practice and feedback

[0763] User: The user starts presentation practice mode on the device interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[0764] Terminal: The terminal converts the recorded speech into text data and sends it to the server.

[0765] Server: The server analyzes the received text data and evaluates its consistency with the document. Based on the evaluation results, it identifies unclear sections, suggests areas for improvement, and generates a list of anticipated questions (FAQs), which are then sent to the terminal.

[0766] Follow-up during the actual presentation

[0767] Device: During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[0768] User: When a question comes in, enter the content into the terminal and send it to the server.

[0769] Server: The server analyzes the received question and processes it to understand its intent. It generates hints for an appropriate answer and sends them to the terminal.

[0770] The hardware used includes smartphones, tablets, personal computers, and industrial robots. The software used utilizes generative AI models (PromptGenerator, AvatarGenerator, PresentationGenerator, FeedbackAnalyzer).

[0771] Specific example:

[0772] For example, if a user is giving a presentation proposing the introduction of a new robotic arm, the configuration information might include the following:

[0773] Opponent: Management

[0774] Objective: Proposal for the introduction of a new robotic arm.

[0775] Presentation time: 10 minutes

[0776] Opponent's knowledge level: High

[0777] Industry: Automobile manufacturing

[0778] Example of a prompt:

[0779] "Please generate a presentation document to propose a plan to introduce a new robotic arm to management, focusing on efficiency and cost reduction."

[0780] This makes it possible to efficiently create, practice, and perform presentations.

[0781] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0782] Step 1:

[0783] Entering presentation settings information

[0784] User: Enters and submits setting information such as the presentation's purpose, audience, presentation time, audience knowledge level, and industry into the terminal's interface. This provides the system with basic presentation information. The entered information is sent from the terminal to the server and used for the next step.

[0785] Step 2:

[0786] Prompt generation

[0787] Server: Based on the received configuration information, the server uses an AI model (PromptGenerator) to generate prompts tailored to the presentation content and audience. These prompts serve as a guide for the user to conduct the presentation effectively. The generated prompts are sent to the terminal.

[0788] Step 3:

[0789] Avatar generation

[0790] Terminal: Based on prompts received from the server, an AI model (AvatarGenerator) is used to generate an avatar appropriate for the presentation audience. The generated avatar is displayed on the user's screen. For example, in a presentation to management, an avatar resembling a management representative will be displayed.

[0791] Step 4:

[0792] Automatic generation of documents

[0793] User: Enters the outline and basic information of the presentation materials (e.g., "Plan for Introducing a New Robotic Arm") into the terminal and sends it. This provides the server with the information necessary for creating the specific materials.

[0794] Server: Based on the received information, it automatically generates presentation materials using an AI model (PresentationGenerator). The materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal.

[0795] Step 5:

[0796] Presentation practice and feedback

[0797] User: Using the generated materials, start presentation practice mode on your device. Your speech will be recorded during practice. This allows you to simulate an actual presentation.

[0798] Terminal: Converts recorded speech into text data and sends it to the server. This converts the speech into a format that can be analyzed.

[0799] Server: Analyzes received text data and evaluates its consistency with the document. Using an AI model (FeedbackAnalyzer), it identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them to the user's device. The user reviews the feedback and uses it to improve their presentation.

[0800] Step 6:

[0801] Follow-up during the actual presentation

[0802] Terminal: During the presentation, it monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to alleviate the user's anxiety.

[0803] User: When a question comes in, enter the content into the terminal and send it to the server. This ensures that the question is sent to the server in a parseable format.

[0804] Server: Analyzes received questions and processes them to understand their intent. Generates appropriate answer hints using an AI model and sends them to the terminal. Users can answer questions quickly and accurately based on the provided hints.

[0805] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0806] This invention is a support system for users to give presentations efficiently and effectively, and by using an emotion engine that recognizes the user's emotions, it provides detailed support tailored to individual needs. The specific operation of the system for implementing this invention will be described below.

[0807] The "AI Presentation Master" system of the present invention primarily operates through the cooperation of three parties: a server, a terminal, and a user. This system has the function of recognizing the user's emotions in real time and dynamically adjusting the support provided at each step.

[0808] Entering presentation settings information

[0809] User:

[0810] First, the user accesses the terminal's interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. After entering the information, the user clicks the submit button to send the data from the terminal to the server.

[0811] Prompt generation and avatar generation

[0812] server:

[0813] The server receives configuration information sent by the user and analyzes the user's emotions in real time using an emotion engine. The prompt generation means generates the optimal prompt based on the user's emotions recognized by the emotion engine. For example, if the user is tense, a prompt to help them relax will be selected. The generated prompt is sent to the terminal.

[0814] Terminal:

[0815] The device generates an avatar that responds to the user's emotions based on prompts received from the server. The avatar's facial expressions and movements are also adjusted by the emotion engine, allowing the user to relax. The generated avatar is then displayed on the user's screen.

[0816] Automatic generation and checking of documents

[0817] User:

[0818] Next, the user enters the basic information and outline of the presentation materials into the terminal and clicks the send button. This information is sent to the server.

[0819] server:

[0820] The server receives basic information sent by the user and automatically generates materials using an AI model. The automatically generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. The emotion engine considers the impact of the check results on the user's emotions and generates appropriate feedback. This material and feedback are sent to the terminal.

[0821] Presentation practice and feedback

[0822] User:

[0823] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[0824] Terminal:

[0825] The device converts the recorded speech into text data and sends it to the server.

[0826] server:

[0827] The server analyzes the received text data and evaluates its consistency with the document. This evaluation also reflects the user's emotions. For example, if the user is feeling anxious, positive feedback is prioritized. The evaluation results, along with points of confusion, improvement suggestions, and anticipated questions (FAQs), are generated and sent to the terminal.

[0828] Follow-up during the actual presentation

[0829] Terminal:

[0830] During the presentation, the device monitors the user's progress in real time and checks the time allocation. The emotion engine recognizes the user's emotions and displays reminders and advice accordingly. For example, if the user is nervous, a message to help them relax will be displayed.

[0831] User:

[0832] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[0833] server:

[0834] The server analyzes the received question and uses an emotion engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[0835] Terminal:

[0836] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0837] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows the emotion engine to recognize the user's tension and provide prompts and avatars to help them relax. Furthermore, appropriate support tailored to the user's emotions is provided during both practice and the actual presentation, improving the quality of the presentation and increasing its success rate.

[0838] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotions, and effectively assists throughout the entire process from presentation preparation to the actual presentation.

[0839] The following describes the processing flow.

[0840] Step 1:

[0841] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. Once the information is entered, the user clicks the submit button to send the settings information to the server.

[0842] Step 2:

[0843] The server receives presentation settings information sent by the user and stores it in an internal database. Next, it activates the emotion engine and analyzes the user's emotional state. Using this analysis, the prompt generation system generates the most appropriate prompts according to the presentation content. If the user is nervous, it generates prompts to help them relax. The prompts are then sent to the terminal.

[0844] Step 3:

[0845] The terminal analyzes prompts received from the server and generates an avatar designed to help the user relax. For example, it might generate an avatar with a gentle expression or one performing relaxed movements. The generated avatar is displayed on the user's screen for the user to see.

[0846] Step 4:

[0847] The user inputs the basic information and outline necessary for creating the presentation materials into the terminal. For example, they might input "Advantages of Cloud Services" or "Features of the New Product" and click the submit button. The input data is then sent to the server.

[0848] Step 5:

[0849] The server receives basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. An emotion engine evaluates the impact of the check results on the user's emotions and generates appropriate feedback. These materials and feedback are sent to the device.

[0850] Step 6:

[0851] The terminal displays the materials and feedback received from the server to the user. The user reviews the materials and makes corrections based on the feedback as needed. If corrections are required, the user resends them to the server.

[0852] Step 7:

[0853] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[0854] Step 8:

[0855] The device converts the recorded speech into text data and sends that text data to the server.

[0856] Step 9:

[0857] The server analyzes the received text data and evaluates its consistency with the document. It also assesses the user's emotional state and generates feedback on the clarity of the speech and any omissions or missing important points. The evaluation results, feedback, and anticipated questions (FAQs) are sent to the terminal.

[0858] Step 10:

[0859] The terminal displays feedback received from the server and FAQs to the user. The user can then revise the materials accordingly and practice again.

[0860] Step 11:

[0861] The user prepares for their presentation. During the presentation, the device monitors the progress and time allocation of the presentation in real time. The emotion engine analyzes the user's emotional state in real time and displays reminders and advice. For example, a message such as "Please take a deep breath" might be displayed.

[0862] Step 12:

[0863] If a user receives a question during live operation, the user enters the question into their terminal and sends it to the server.

[0864] Step 13:

[0865] The server analyzes the received question and processes it to understand its intent. The emotion engine generates response guidelines and hints appropriate to the user's emotional state. These generated hints are then sent to the terminal.

[0866] Step 14:

[0867] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0868] Through the above process, users receive comprehensive support and can deliver high-quality presentations. This system allows users to approach presentations with confidence and receive appropriate answers to questions through real-time support.

[0869] (Example 2)

[0870] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0871] Traditional presentation support systems often provided simplistic advice without considering the user's emotions. As a result, they failed to adequately alleviate the tension and anxiety users felt during presentations, making it difficult to improve the quality and success rate of presentations. Furthermore, even in presentation practice and automated material generation, there was a lack of feedback and advice tailored to the individual user's emotional state.

[0872] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for the user to input presentation setting information, an emotion analysis means for analyzing the user's emotions in real time based on the input setting information, a prompt generation means for generating prompts based on the analyzed emotion information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials from the viewpoints of design consistency, appropriateness of expression, and copyright infringement, a practice recording means for the user to practice the presentation and record the content of their remarks, a feedback means for evaluating the consistency between the recorded remarks and the materials and providing feedback, and a follow-up means for monitoring the user's progress and emotions in real time during the actual presentation and providing support. This makes it possible to alleviate the user's tension and anxiety while providing consistent support from the creation of high-quality presentation materials to support during the actual presentation.

[0873] An "input method" is an interface for users to input presentation settings information.

[0874] "Emotion analysis means" refers to an engine or system for analyzing a user's emotions in real time based on input configuration information.

[0875] The "prompt generation means" is a function for generating appropriate prompts based on emotional information obtained by the emotion analysis means.

[0876] An "avatar generation method" is a system for generating the facial expressions and movements of an avatar based on the generated prompts.

[0877] The "material generation method" is a function that automatically generates presentation materials based on the basic information of the presentation materials entered by the user.

[0878] A "document checking method" refers to a system or function that checks generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[0879] The "practice recording function" is a feature that allows users to record and save their speech when practicing a presentation.

[0880] A "feedback mechanism" is a system or function for evaluating the consistency between recorded statements and materials and providing appropriate feedback.

[0881] "Follow-up features" are functions that monitor the user's progress and emotions in real time during the presentation and provide support as needed.

[0882] This invention is a support system for users to give presentations efficiently and effectively, and it provides detailed support tailored to individual needs by using an emotion engine that analyzes the user's emotions in real time. This system mainly operates through the cooperation of three parties: a server, a terminal, and the user.

[0883] Entering presentation settings information

[0884] User:

[0885] The user enters presentation settings information using the device's interface (e.g., a web browser or dedicated application). This information includes the audience's name, company, purpose, presentation time, audience's knowledge level, and industry. After entering the information, the user clicks a submit button to send the information from the device to the server.

[0886] Hardware and software used:

[0887] Devices: PC, tablet, smartphone

[0888] Software: Web browser, dedicated application, HTML form, JavaScript

[0889] Sentiment analysis and prompt generation

[0890] server:

[0891] The server receives configuration information sent by the user and uses this information to analyze the user's emotions in real time using an emotion engine (e.g., Python's Emotion API or an open-source emotion analysis library). Based on the analysis results, the prompt generation means generates the optimal prompt using a generative AI model (e.g., OpenAI's GPT-4). For example, if the user is feeling anxious, a prompt to help them relax will be generated. This prompt is then sent to the terminal.

[0892] Hardware and software used:

[0893] Servers: Cloud servers, physical servers

[0894] Software: Python, Emotion API, open-source analysis library, GPT-4

[0895] Examples of prompt statements:

[0896] "Please speak calmly without being nervous. Take a slow, deep breath."

[0897] "On the next slide, highlight the points that will capture the audience's interest."

[0898] Avatar generation

[0899] Terminal:

[0900] The device generates an avatar based on prompts received from the server. The avatar's facial expressions and movements are adjusted based on the output of the emotion engine. For example, if the user is tense, an avatar with a relaxed expression will be generated. The generated avatar is then displayed in 3D on the user's screen.

[0901] Hardware and software used:

[0902] Devices: PC, tablet, smartphone

[0903] Software: JavaScript libraries (e.g., Three.js), WebGL

[0904] Automatic document generation and checking

[0905] User:

[0906] The user enters basic information and outlines of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[0907] server:

[0908] The server receives and analyzes basic information sent by the user and automatically generates materials using an AI model (e.g., OpenAI's DALLE 2 or GPT-4). The generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. Based on the check results, the sentiment engine generates appropriate feedback, and this material and feedback are sent to the terminal.

[0909] Hardware and software used:

[0910] Servers: Cloud servers, physical servers

[0911] Software: Python, DALLE 2, GPT-4, Google Cloud Vision API

[0912] Presentation practice and feedback

[0913] User:

[0914] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[0915] Terminal:

[0916] The device converts the recorded audio into text data and sends it to the server.

[0917] server:

[0918] The server analyzes the received text data and evaluates its consistency with the presentation materials. The evaluation results also reflect the user's emotions, with positive feedback given priority. Along with the evaluation results, points of confusion, improvement suggestions, and FAQs (expected questions) are generated and sent to the terminal.

[0919] Hardware and software used:

[0920] Devices: PC, tablet, smartphone

[0921] Software: Speech recognition APIs (e.g., Google Speech-to-Text API, Amazon Transcribe)

[0922] Follow-up during the actual presentation

[0923] Terminal:

[0924] During the presentation, the device monitors the user's progress in real time, and the emotion engine recognizes the user's emotions. Reminders and advice are displayed according to the user's state. For example, messages to help the user relax are provided.

[0925] User:

[0926] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[0927] server:

[0928] The server analyzes the received question and uses an emotion engine to generate answer hints and guidelines appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[0929] Terminal:

[0930] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[0931] Hardware and software used:

[0932] Devices: PC, tablet, smartphone

[0933] Software: JavaScript time tracking function, real-time WebSocket communication

[0934] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotional state, and effectively assists the user from presentation preparation to the actual presentation.

[0935] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0936] Step 1: Enter presentation settings information

[0937] User:

[0938] The user enters presentation settings information using the terminal interface. For example, they might enter the audience's name, organization, presentation purpose, presentation time, audience knowledge level, and industry. To do this, the user fills in the information in a form and clicks the submit button. The entered information is sent to the server using the JavaScript fetch API.

[0939] Inputs and outputs:

[0940] Input: Presentation setup information (audience, purpose, presentation time, audience knowledge level, industry, etc.)

[0941] Output: Configuration information is sent to the server.

[0942] Specific actions:

[0943] The user enters information using an HTML form and clicks the submit button.

[0944] The configuration information is sent to the server as a POST request using the JavaScript fetch API.

[0945] Step 2: Emotion Analysis

[0946] server:

[0947] The server receives configuration information sent by the user and performs sentiment analysis. This sentiment analysis utilizes Python's Emotion API or open-source sentiment analysis libraries. This process analyzes the user's emotional state (e.g., tension or relaxation) in real time.

[0948] Inputs and outputs:

[0949] Input: Presentation settings information

[0950] Output: Emotion analysis results

[0951] Specific actions:

[0952] The server processes the received configuration information using a Python-based API.

[0953] The sentiment analysis library is called to analyze the user's emotions.

[0954] The analysis results are stored in JSON format.

[0955] Step 3: Generate prompt

[0956] server:

[0957] Based on the emotion analysis results, the prompt generation means generates an appropriate prompt. Using a generation AI model (e.g., OpenAI's GPT-4), prompts are generated that correspond to the user's emotional state. For example, if the user is tense, a prompt to help them relax is generated. The generated prompt is sent to the terminal.

[0958] Inputs and outputs:

[0959] Input: Sentiment analysis results

[0960] Output: Generated prompt

[0961] Specific actions:

[0962] The emotion analysis results are input into the generating AI model.

[0963] The model is used to generate prompts.

[0964] The generated prompt is sent to the terminal in JSON format.

[0965] Step 4: Avatar Creation

[0966] Terminal:

[0967] The terminal generates an avatar based on prompts received from the server. The avatar's facial expressions and movements are adjusted based on the emotion analysis results. For example, an avatar with a relaxed expression is generated. The generated avatar is displayed in 3D.

[0968] Inputs and outputs:

[0969] Input: Generated prompt

[0970] Output: The displayed avatar

[0971] Specific actions:

[0972] Analyze the prompt received from the server.

[0973] This project uses a JavaScript library (e.g., Three.js) to render a 3D avatar via WebGL.

[0974] Set the avatar's facial expressions based on prompts.

[0975] Step 5: Automatic document generation and checking

[0976] User:

[0977] The user enters basic information and outlines of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[0978] Inputs and outputs:

[0979] Input: Basic information and outline of the presentation materials

[0980] Output: Data information sent to the server

[0981] Specific actions:

[0982] The user enters information about the document into the form and submits it.

[0983] Use the JavaScript fetch API to send information to the server as a POST request.

[0984] server:

[0985] The server analyzes the received document information and automatically generates documents using an AI model (e.g., OpenAI's DALLE 2 or GPT-4). The generated documents are checked for design consistency, appropriateness of expression, and copyright infringement. Appropriate feedback is also added using sentiment analysis. These documents and feedback are sent to the terminal.

[0986] Inputs and outputs:

[0987] Input: Basic information and outline of the presentation materials

[0988] Output: Generated presentation materials and feedback

[0989] Specific actions:

[0990] The server analyzes the received data information.

[0991] Use an AI model to generate documents.

[0992] Check the design, consistency, and copyright of the materials.

[0993] Feedback is generated based on the emotion analysis results.

[0994] Send the documents and feedback back to the device.

[0995] Step 6: Presentation practice and feedback

[0996] User:

[0997] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[0998] Inputs and outputs:

[0999] Input: Presentation materials

[1000] Output: Recorded speech

[1001] Specific actions:

[1002] The user displays the presentation materials and begins practicing.

[1003] The device uses its recording function to record what is said.

[1004] Terminal:

[1005] The device converts the recorded audio into text data and sends it to the server.

[1006] Inputs and outputs:

[1007] Input: Recorded speech

[1008] Output: Text data sent to the server

[1009] Specific actions:

[1010] The recorded data is converted to text using a speech recognition API (e.g., Google Speech-to-Text API).

[1011] Send the converted text data to the server.

[1012] server:

[1013] The server analyzes the received text data and evaluates its consistency with the document. Sentiment analysis is also incorporated into this evaluation. Positive feedback is prioritized, and along with the evaluation results, points out unclear areas, suggestions for improvement, and FAQs are generated and sent to the terminal.

[1014] Inputs and outputs:

[1015] Input: Text data

[1016] Output: Feedback and FAQ

[1017] Specific actions:

[1018] Analyze the received text data.

[1019] Evaluate the consistency with the presentation materials.

[1020] Based on the results of the emotion analysis, feedback, improvement suggestions, and FAQs are generated.

[1021] Send feedback and FAQs to your device.

[1022] Step 7: Follow-up during the actual presentation

[1023] Terminal:

[1024] During the presentation, the device monitors the user's progress in real time, and the emotion engine recognizes the user's emotions. If the user is nervous, messages to help them relax and reminders about time management are displayed.

[1025] Inputs and outputs:

[1026] Input: User's progress, emotional state

[1027] Output: Reminders and advice

[1028] Specific actions:

[1029] Use JavaScript's time tracking feature to monitor progress.

[1030] It performs real-time sentiment analysis and displays appropriate reminders and advice.

[1031] User:

[1032] If a question comes in during the presentation, the question is entered into the terminal and sent to the server.

[1033] Inputs and outputs:

[1034] Input: Question content

[1035] Output: Question content sent to the server

[1036] Specific actions:

[1037] The questions received by the user are entered into the terminal.

[1038] Send the question to the server.

[1039] server:

[1040] The server analyzes the received question and uses an emotion engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. These hints are then sent to the terminal.

[1041] Inputs and outputs:

[1042] Input: Question content

[1043] Output: Hints and guidelines for answering the question.

[1044] Specific actions:

[1045] Analyze the content of the question.

[1046] Based on the results of the emotion analysis, hints and guidelines for the response are generated.

[1047] The generated hints and guidelines are sent to the device.

[1048] Terminal:

[1049] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1050] Inputs and outputs:

[1051] Input: Hints and guidelines for the answer

[1052] Output: Hints and guidance displayed on the screen.

[1053] Specific actions:

[1054] The received hints and instructions are displayed on the screen.

[1055] This system helps users answer questions while referring to hints.

[1056] (Application Example 2)

[1057] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1058] Traditional presentation support systems lacked the flexibility to adapt to users' emotions and transaction situations. This meant that appropriate support could not be provided when users felt nervous or anxious, potentially leading to a decline in the quality of presentations and transactions. Furthermore, in electronic payment services, ignoring users' emotional states during transactions resulted in insufficient support for anxious or nervous users, impacting transaction security and smooth progress.

[1059] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes an input means for the user to input presentation and transaction setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, an emotion recognition means for recognizing the user's emotions in real time, and an emotion response means for providing support messages based on the recognized emotions. This enables timely and appropriate support according to the user's emotional state.

[1060] "Input means" refers to a device or interface for a user to input presentation or transaction setting information into the system.

[1061] A "prompt generation means" is a device or program for generating instructions or advice presented to the user based on the input configuration information.

[1062] An "avatar generation means" is a device or program for generating characters or images that correspond to the user's emotions and presentation situation based on the generated prompts.

[1063] "Document generation means" refers to a device or system that automatically creates presentation materials based on basic information entered by the user.

[1064] A "document checking tool" is a device or program that verifies the consistency of the design, the appropriateness of the expression, and whether or not there are any copyright infringements in the generated presentation materials.

[1065] A "practice recording device" is a device or system that records the content of a user's speech during a presentation practice session.

[1066] A "feedback mechanism" is a device or program that evaluates the consistency between recorded statements and generated materials, and provides the user with suggestions for improvement and advice based on the evaluation results.

[1067] A "follow-up device" is a device or program that provides real-time advice and reminders to support the user during the actual presentation.

[1068] An "emotion recognition means" is a device or program for recognizing a user's emotional state in real time from the user's facial expressions, voice, gestures, etc.

[1069] An "emotional response device" is a device or program that provides appropriate support messages or advice based on the recognized emotional state of the user.

[1070] This invention is a support system for users to conduct presentations and electronic transactions efficiently and effectively, recognizing the user's emotions in real time and providing support tailored to individual needs. The specific operation of the system for implementing this invention will be described below.

[1071] Hardware and software configuration

[1072] hardware

[1073] Device: A computer, smartphone, tablet, etc., used by the user for presentations or transactions.

[1074] Webcam: Used to capture the user's facial expressions and recognize emotions.

[1075] Server: This server centralizes processes such as prompt generation, avatar generation, data generation, and emotion recognition.

[1076] software

[1077] Face detection engine: Face detection libraries such as dlib.

[1078] Emotion recognition engine: An emotion recognition model using Keras.

[1079] Prompt generation engine: A prompt generation algorithm equipped with a generative AI model.

[1080] Avatar generation engine: Software that generates avatars based on specified prompts.

[1081] Document generation engine and checking engine: Software for automatically generating and checking presentation materials.

[1082] System operation

[1083] Entering presentation settings information

[1084] User: First, the user accesses the terminal interface and enters presentation and transaction settings information. This information includes the other party, purpose, time, the other party's knowledge level, and industry. After entering the information, the user clicks the submit button to send the data from the terminal to the server.

[1085] Prompt generation and avatar generation

[1086] Server: The server receives configuration information sent by the user and generates the optimal prompt using a generative AI model. For example, if the user is stressed, a prompt to help them relax will be generated. The generated prompt is then sent to the terminal.

[1087] Terminal: Based on the received prompts, the terminal generates an avatar that responds to the user's emotions. The avatar's facial expressions and movements are also adjusted by the emotion recognition engine, allowing the user to relax. The generated avatar is displayed on the user's screen.

[1088] Automatic generation and checking of documents

[1089] User: Next, the user enters the basic information and outline of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[1090] Server: The server automatically generates presentation materials based on the received basic information. The materials are checked for design consistency, appropriateness of expression, and copyright infringement. The emotion recognition engine considers the impact of the check results on the user's emotions and generates appropriate feedback. This material and feedback are sent to the terminal.

[1091] Presentation practice and feedback

[1092] User: The user starts presentation practice mode on the device interface and practices using the generated materials. The device records what the user says during practice.

[1093] Terminal: The terminal converts the recorded speech into text data and sends it to the server.

[1094] Server: The server analyzes the received text data and evaluates its consistency with the material. This evaluation also reflects the user's emotions. For example, if the user is feeling anxious, positive feedback is prioritized. The evaluation results, along with points of confusion, improvement suggestions, and anticipated questions (FAQs), are generated and sent to the terminal.

[1095] Follow-up during the actual presentation

[1096] Terminal: During the presentation, the terminal monitors the user's progress in real time and checks the time allocation. The emotion recognition engine recognizes the user's emotions and displays reminders and advice according to their state. For example, if the user is nervous, a message to help them relax will be displayed.

[1097] User: If a question comes in during the presentation, enter the question into the terminal and send it to the server.

[1098] Server: The server analyzes the received question and uses an emotion recognition engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. The generated hints are sent to the terminal.

[1099] Terminal: The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1100] Examples of prompt statements

[1101] Example of a prompt:

[1102] "Relax and take a deep breath. This transaction is safe."

[1103] "That's fantastic! Keep it up."

[1104] "Please proceed as is."

[1105] In this way, by using this system, users can effectively conduct presentations and electronic transactions while receiving appropriate support through emotion recognition.

[1106] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1107] Step 1:

[1108] User: Access the terminal interface and enter presentation and transaction settings.

[1109] (Input): Information such as the other party, purpose, time, the other party's knowledge level, and industry.

[1110] (Data processing): The input data is formatted on the terminal and converted into a format that can be sent to the server.

[1111] (Output): Sends formatted configuration data to the server.

[1112] Step 2:

[1113] Server: Analyzes the received configuration information and generates prompts using a generation AI model.

[1114] (Input): Configuration data submitted by the user.

[1115] (Data processing): Use a generative AI model to generate prompts based on the configuration information.

[1116] (Output): Sends the generated prompt data to the terminal.

[1117] Step 3:

[1118] Terminal: Based on the received prompt, it generates an avatar using the avatar generation engine.

[1119] (Input): Prompt data sent from the server.

[1120] (Data Processing): An avatar generation engine is used to create avatars that respond to prompts. Facial expressions and movements are adjusted according to the user's emotions and presentation situation.

[1121] (Output): The generated avatar is displayed on the user's screen.

[1122] Step 4:

[1123] User: Enter the basic information and outline of the presentation materials into the terminal and click the send button.

[1124] (Input): Basic information and outline of the presentation materials.

[1125] (Data processing): The input information is formatted on the terminal and converted into a format that can be sent to the server.

[1126] (Output): Sends formatted data information to the server.

[1127] Step 5:

[1128] Server: Automatically generates presentation materials based on received basic information, and uses a material checking engine to verify design consistency, appropriateness of expression, and copyright infringement.

[1129] (Input): Basic information data submitted by the user.

[1130] (Data processing: Automatically generate presentation materials and evaluate them using a material checking engine.)

[1131] (Output): Sends the generated presentation materials and check results to the terminal.

[1132] Step 6:

[1133] User: Use the generated materials to practice your presentation on your device and record what you say.

[1134] (Input): Presentation materials and user comments.

[1135] (Data processing: The terminal records the spoken content, converts it to text, and sends it to the server.)

[1136] (Output): Sends the text data of the recorded speech to the server.

[1137] Step 7:

[1138] Server: Analyzes received text data, evaluates its consistency with the document, and generates feedback.

[1139] (Input: Text data and generated materials.)

[1140] (Data processing): Evaluate consistency with the document and generate areas for improvement and positive feedback.

[1141] (Output): Sends evaluation results and feedback data to the terminal.

[1142] Step 8:

[1143] Terminal: Monitors the progress of the presentation in real time and recognizes the user's emotions.

[1144] (Input): Real-time progress data and camera footage.

[1145] (Data Processing): Use an emotion recognition engine to recognize the user's emotions and monitor their progress. Generate reminders and advice.

[1146] (Output): Displays the generated reminders and advice to the user.

[1147] Step 9:

[1148] User: If a question comes in during the presentation, enter the content into the terminal and send it to the server.

[1149] (Input): Question content.

[1150] (Data processing): Format the question content and send it to the server.

[1151] (Output): Sends formatted question data to the server.

[1152] Step 10:

[1153] Server: Analyzes received questions and uses an emotion recognition engine to generate hints and guidelines for answers that are appropriate to the user's emotional state.

[1154] (Input): Question content data and user sentiment data.

[1155] (Data processing): Analyze the question content and generate hints and guidelines for responses that are appropriate to the user's emotional state.

[1156] (Output): Sends the generated answer hint data to the terminal.

[1157] Step 11:

[1158] Terminal: Displays answer hints from the server to the user, supporting the user in appropriately responding to questions.

[1159] (Input): Answer hint data sent from the server.

[1160] (Data processing): Convert the answer hint data into a displayable format and notify the user.

[1161] (Output): Displays answer hints on the user's screen.

[1162] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1163] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1164] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1165] [Third Embodiment]

[1166] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1167] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1168] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1169] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1170] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1171] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1172] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1173] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1174] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1175] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1176] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1177] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1178] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[1179] The "AI Presentation Master" system of the present invention is designed to allow users to receive support at each step of their presentation. The system primarily operates through the cooperation of three parties: the server, the terminal, and the user.

[1180] Entering presentation settings information

[1181] User:

[1182] The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[1183] Prompt generation and avatar generation

[1184] server:

[1185] The server receives configuration information sent by the user and generates an appropriate prompt. This prompt will be professional and effective, tailored to the content of the presentation and the audience. The generated prompt is then sent to the terminal.

[1186] Terminal:

[1187] The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to executives, an avatar resembling an executive is generated. This avatar is displayed on the user's screen for the user to confirm.

[1188] Automatic generation and checking of documents

[1189] User:

[1190] The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they might input an outline such as "Advantages of Cloud Services."

[1191] server:

[1192] The server uses AI to automatically generate presentation materials based on information received from the user. These materials undergo checks for design consistency, appropriateness of expression, and copyright infringement. The generated materials are then sent to the user's device and provided to them.

[1193] Presentation practice and feedback

[1194] User:

[1195] The user starts presentation practice mode on the device's interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[1196] Terminal:

[1197] The device converts the recorded speech into text data and sends it to the server.

[1198] server:

[1199] The server analyzes the received text data and evaluates its consistency with the document. It then identifies unclear sections, suggests improvements, generates a list of anticipated questions (FAQs), and sends them to the terminal.

[1200] Follow-up during the actual presentation

[1201] Terminal:

[1202] During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[1203] User:

[1204] When a question comes in, the content is entered into the terminal and sent to the server.

[1205] server:

[1206] The server analyzes the received question and processes it to understand its intent. It then generates hints for an appropriate answer and sends them to the terminal.

[1207] This system provides users with comprehensive support from presentation preparation to the actual presentation. Specifically, it reduces the effort required to create materials and provides a sense of security through prior practice, thereby increasing the success rate of the actual presentation. Furthermore, real-time support during the presentation allows for smooth handling of questions and other inquiries.

[1208] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows them to quickly create high-quality presentation materials and deliver their presentation with confidence through practice. Furthermore, it enables them to respond accurately to questions, maximizing the effectiveness of their presentation.

[1209] The following describes the processing flow.

[1210] Step 1:

[1211] The user accesses the terminal and enters presentation settings (audience, purpose, presentation time, audience knowledge level, industry, etc.). Clicking the submit button sends the entered data from the terminal to the server.

[1212] Step 2:

[1213] The server receives configuration information sent by the user and stores it in its internal database. Next, it parses the received data and processes it to generate an appropriate prompt. The generated prompt is then sent to the terminal.

[1214] Step 3:

[1215] The terminal generates an avatar tailored to the presentation audience based on prompts received from the server. This includes avatars that resemble executives or superiors. The generated avatar is displayed on the user's screen for the user to confirm.

[1216] Step 4:

[1217] The user inputs basic information and the main points of the presentation materials into the terminal. For example, they might enter "Advantages of the cloud service" or "Features of the new product" and then click the submit button.

[1218] Step 5:

[1219] The server receives basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. The checked materials are then sent to the terminal.

[1220] Step 6:

[1221] The terminal displays the completed document received from the server to the user. The user reviews the document and, if necessary, enters and submits feedback on the terminal.

[1222] Step 7:

[1223] The user starts presentation practice mode on their device and practices using the generated materials. The device records what the user says during practice.

[1224] Step 8:

[1225] The device converts the recorded speech into text data and sends it to the server.

[1226] Step 9:

[1227] The server analyzes the received text data and evaluates its consistency with the document, the clarity of the statements, and whether any important points are missing. It then generates the evaluation results, points out unclear sections, suggested corrections, and anticipated questions (FAQs), and sends them to the terminal.

[1228] Step 10:

[1229] The terminal displays feedback received from the server and FAQs to the user. The user then makes corrections and improvements accordingly.

[1230] Step 11:

[1231] The user prepares for their presentation. During the presentation, they receive real-time support from their device. For example, a timer function displays the time allocation, and reminders appear to help alleviate nervousness.

[1232] Step 12:

[1233] When a user receives a question, they input the content into their device and send it.

[1234] Step 13:

[1235] The server analyzes the received question and processes it to understand its intent. It then generates appropriate response guidelines and hints and sends them to the terminal.

[1236] Step 14:

[1237] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1238] Through the above process, users will receive comprehensive support and be able to deliver high-quality presentations.

[1239] (Example 1)

[1240] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1241] Conventional presentation support systems lacked sufficient functionality to automatically generate appropriate prompts and materials based on manual input of presentation settings by the user. Furthermore, they lacked features to provide real-time feedback during presentation practice, monitor the progress of the presentation, and offer appropriate advice and responses. As a result, it was difficult for users to deliver presentations smoothly during preparation and the actual presentation itself.

[1242] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1243] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a question analysis and answer generation means for generating appropriate answers to questions the user receives during the presentation, and a progress monitoring means for monitoring the user's progress during the presentation and displaying alerts and advice. This enables the user to receive comprehensive support from the preparation to the actual presentation.

[1244] "Input method" refers to the interface or device that allows the user to input presentation settings information.

[1245] "Prompt generation means" refers to a function that generates appropriate prompts based on the input configuration information, tailored to the presentation content and the audience.

[1246] "Avatar generation means" refers to a function that generates an avatar suitable for the presentation audience based on the generated prompt.

[1247] "Document generation means" refers to a function that automatically creates presentation materials based on basic information and outlines provided by the user.

[1248] "Document checking method" refers to a function for checking automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[1249] "Practice recording means" refers to a function that allows users to record and save what they say while practicing a presentation.

[1250] "Feedback mechanisms" refer to functions that evaluate the consistency between recorded statements and documents, and provide users with suggestions for improvement.

[1251] "Question analysis and answer generation means" refers to a function that analyzes questions received by users during a presentation, understands their intent, and generates appropriate answers.

[1252] "Progress monitoring means" refers to a function that monitors the user's progress in real time during a presentation and displays time allocation alerts and appropriate advice.

[1253] This invention is a support system for users to deliver presentations efficiently and effectively. This system primarily operates through the cooperation of a server, a terminal, and the user. The system is implemented using the following hardware and software.

[1254] Specific examples of hardware and software

[1255] A terminal refers to a computer or smart device that accepts user input and operations. It also includes input devices such as microphones and cameras. A server refers to a high-performance computer that performs processing using generative AI models. Natural language processing (NLP) technology is expected to be used for generating shapes and text, while the Google Vision API is expected to be used for image processing and the Google Speech-to-Text API for speech recognition.

[1256] Specific actions

[1257] First, the user accesses the terminal's interface and enters presentation settings information. Specifically, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it. Based on the received information, the server uses a generative AI model to generate appropriate prompts and sends them to the terminal. The terminal then generates an avatar appropriate for the audience based on the received prompts. For example, an avatar resembling an executive might be generated.

[1258] Next, the user inputs the outline and basic information of the presentation materials into the terminal and sends it. The server uses AI to automatically generate the presentation materials based on the received information. These materials are checked for design consistency, appropriateness of expression, and copyright infringement, and the generated materials are sent to the terminal and provided to the user.

[1259] The user starts a presentation practice mode on the device's interface and practices using the generated materials. The device records the user's speech, converts it into text data using speech recognition software, and sends it to the server. The server analyzes the received text data, evaluates its consistency with the materials, identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them back to the device.

[1260] During the presentation, the device monitors the user's progress in real time and displays reminders such as "5 minutes remaining." It also inputs any questions the user receives during the presentation into the device and sends them to the server. The server analyzes the received questions, processes them to understand their intent, generates hints for appropriate answers, and sends them back to the device.

[1261] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system will generate the following prompt:

[1262] "Please create an outline and materials for a presentation on the benefits of cloud services. The audience consists of executives with limited technical knowledge, and the goal of the presentation is to persuade them of the advantages of migrating to the cloud. The content should be clear and easy to understand, and include specific benefits and examples."

[1263] This allows users to receive comprehensive support from presentation preparation to the actual presentation. Through specific actions and technologies, all-encompassing support is provided from preparation to the actual presentation.

[1264] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1265] Step 1:

[1266] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation duration, audience knowledge level, and industry. The entered settings information is stored as data on the terminal for subsequent processing steps. The terminal then sends this settings information to the server.

[1267] Input: Presentation audience, purpose, presentation time, audience knowledge level, industry

[1268] Output: Configuration information is sent to the server.

[1269] Step 2:

[1270] The server receives configuration information sent by the user. Based on the received configuration information, it uses a generative AI model to generate appropriate prompts. The generated prompts are optimized for the user's presentation content and the audience. For example, it can generate a prompt explaining the benefits of cloud services to executives with limited technical knowledge. The generated prompts are then sent to the terminal.

[1271] Input: Settings information

[1272] Output: The generated prompt is sent to the terminal.

[1273] Step 3:

[1274] The terminal generates an avatar based on prompts received from the server. For example, it might generate an avatar resembling an executive using 3D modeling software. This avatar has an appearance tailored to the audience being presented to. The generated avatar is displayed on the user's screen for confirmation.

[1275] Input: Generated prompt

[1276] Output: The generated avatar is displayed on the screen.

[1277] Step 4:

[1278] Users input the main points and basic information of their presentation materials into their terminal and send it. For example, they might input "advantages of cloud services," "cost reduction," and "operational flexibility." This information is stored on the terminal and sent to the server.

[1279] Input: Outline and basic information of the presentation materials

[1280] Output: The outline of the generated document is sent to the server.

[1281] Step 5:

[1282] The server uses AI to automatically generate presentation materials based on the outline and basic information received from the user. The generated materials include checks for design consistency, appropriateness of expression, and copyright infringement. For example, the Google Vision API is used to check image copyrights. The generated materials are sent to the device and provided to the user.

[1283] Input: Outline and basic information of the presentation materials

[1284] Output: Automatically generated presentation materials

[1285] Step 6:

[1286] The user starts presentation practice mode on the device interface and practices using the generated materials. The device records the user's speech and converts it into text data using the Google Speech-to-Text API. The converted text data is sent to the server.

[1287] Input: User's statement

[1288] Output: Converted text data

[1289] Step 7:

[1290] The server analyzes the received text data and evaluates its consistency with the document. Specifically, it uses NLP (Neuro-Linguistic Programming) technology to compare the user's statements with the document content and points out unclear areas or areas for improvement. It also generates a list of frequently asked questions (FAQs) and sends them to the terminal.

[1291] Input: Converted text data

[1292] Output: Feedback and FAQ

[1293] Step 8:

[1294] During the presentation, the device monitors the user's progress in real time and displays time-out alerts (e.g., "5 minutes remaining"). It also displays messages and advice to help ease the user's anxiety.

[1295] Input: User's presentation progress

[1296] Output: Alerts and advice

[1297] Step 9:

[1298] When a question comes in during the presentation, the user enters the content into their device and sends it to the server. For example, they might enter "a question about cloud security."

[1299] Input: Question content

[1300] Output: The question content is sent to the server.

[1301] Step 10:

[1302] The server uses a generative AI model to analyze the received question and understand its intent. It then generates hints for appropriate answers and sends them to the terminal. Based on these hints, the user can respond to the question accurately.

[1303] Input: Question content

[1304] Output: Hints for the generated answer

[1305] (Application Example 1)

[1306] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1307] In today's industrial environment, efficient and effective presentations are crucial for project success and the successful adoption of new technologies. However, creating, practicing, and delivering presentations is often cumbersome, and there is a lack of efficient systems, particularly in manufacturing. Therefore, there is a need for a support system that can quickly gather detailed information on manufacturing processes and efficiency proposals, and then use that information to propose the introduction of new technologies.

[1308] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1309] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a follow-up means for supporting the user during the actual presentation, and a data processing means for collecting detailed information on manufacturing processes and efficiency improvements when giving a presentation in a factory, and for proposing the introduction of new robots based on that information. This makes it possible to efficiently create presentation materials, practice, and handle the actual presentation.

[1310] A "user" refers to one or more individuals who use this system to create, practice, and deliver presentations.

[1311] An "input method" refers to a device or interface for a user to input presentation settings information.

[1312] A "prompt generation means" is a device or program that generates prompts to guide the presentation content based on the input configuration information.

[1313] An "avatar generation means" is a device or program that generates an avatar suitable for the presentation recipient based on the generated prompt.

[1314] "Document generation means" refers to devices or programs that automatically generate presentation materials.

[1315] "Document checking tools" refer to devices or programs that check automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement.

[1316] A "practice recording device" is a device or program that allows a user to practice a presentation and record what they say.

[1317] A "feedback mechanism" is a device or program that evaluates the consistency between recorded statements and documents and provides feedback on areas for improvement.

[1318] A "follow-up tool" is a device or program that provides real-time advice and reminders to support the user during the actual presentation.

[1319] "Data processing means" refers to devices and programs used to collect detailed information about manufacturing processes and efficiency improvements when giving presentations within a factory, and to use that information to propose the introduction of new robots.

[1320] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[1321] The system of this invention primarily operates through the cooperation of three parties: a server, a terminal, and a user.

[1322] Entering presentation settings information

[1323] User: The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[1324] Prompt generation and avatar generation

[1325] Server: The server receives configuration information sent by the user and generates an appropriate prompt. This prompt is professional and effective, tailored to the content of the presentation and the audience. The generated prompt is sent to the terminal.

[1326] Terminal: The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to management, it generates an avatar that looks like a management representative. This avatar is displayed on the user's screen for the user to confirm.

[1327] Automatic generation and checking of documents

[1328] User: The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they input the outline of "Plan for Introducing a New Robot Arm".

[1329] Server: The server automatically generates presentation materials using generative AI based on information received from the user. These materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal and provided to the user.

[1330] Presentation practice and feedback

[1331] User: The user starts presentation practice mode on the device interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[1332] Terminal: The terminal converts the recorded speech into text data and sends it to the server.

[1333] Server: The server analyzes the received text data and evaluates its consistency with the document. Based on the evaluation results, it identifies unclear sections, suggests areas for improvement, and generates a list of anticipated questions (FAQs), which are then sent to the terminal.

[1334] Follow-up during the actual presentation

[1335] Device: During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[1336] User: When a question comes in, enter the content into the terminal and send it to the server.

[1337] Server: The server analyzes the received question and processes it to understand its intent. It generates hints for an appropriate answer and sends them to the terminal.

[1338] The hardware used includes smartphones, tablets, personal computers, and industrial robots. The software used utilizes generative AI models (PromptGenerator, AvatarGenerator, PresentationGenerator, FeedbackAnalyzer).

[1339] Specific example:

[1340] For example, if a user is giving a presentation proposing the introduction of a new robotic arm, the configuration information might include the following:

[1341] Opponent: Management

[1342] Objective: Proposal for the introduction of a new robotic arm.

[1343] Presentation time: 10 minutes

[1344] Opponent's knowledge level: High

[1345] Industry: Automobile manufacturing

[1346] Example of a prompt:

[1347] "Please generate a presentation document to propose a plan to introduce a new robotic arm to management, focusing on efficiency and cost reduction."

[1348] This makes it possible to efficiently create, practice, and perform presentations.

[1349] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1350] Step 1:

[1351] Entering presentation settings information

[1352] User: Enters and submits setting information such as the presentation's purpose, audience, presentation time, audience knowledge level, and industry into the terminal's interface. This provides the system with basic presentation information. The entered information is sent from the terminal to the server and used for the next step.

[1353] Step 2:

[1354] Prompt generation

[1355] Server: Based on the received configuration information, the server uses an AI model (PromptGenerator) to generate prompts tailored to the presentation content and audience. These prompts serve as a guide for the user to conduct the presentation effectively. The generated prompts are sent to the terminal.

[1356] Step 3:

[1357] Avatar generation

[1358] Terminal: Based on prompts received from the server, an AI model (AvatarGenerator) is used to generate an avatar appropriate for the presentation audience. The generated avatar is displayed on the user's screen. For example, in a presentation to management, an avatar resembling a management representative will be displayed.

[1359] Step 4:

[1360] Automatic generation of documents

[1361] User: Enters the outline and basic information of the presentation materials (e.g., "Plan for Introducing a New Robotic Arm") into the terminal and sends it. This provides the server with the information necessary for creating the specific materials.

[1362] Server: Based on the received information, it automatically generates presentation materials using an AI model (PresentationGenerator). The materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal.

[1363] Step 5:

[1364] Presentation practice and feedback

[1365] User: Using the generated materials, start presentation practice mode on your device. Your speech will be recorded during practice. This allows you to simulate an actual presentation.

[1366] Terminal: Converts recorded speech into text data and sends it to the server. This converts the speech into a format that can be analyzed.

[1367] Server: Analyzes received text data and evaluates its consistency with the document. Using an AI model (FeedbackAnalyzer), it identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them to the user's device. The user reviews the feedback and uses it to improve their presentation.

[1368] Step 6:

[1369] Follow-up during the actual presentation

[1370] Terminal: During the presentation, it monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to alleviate the user's anxiety.

[1371] User: When a question comes in, enter the content into the terminal and send it to the server. This ensures that the question is sent to the server in a parseable format.

[1372] Server: Analyzes received questions and processes them to understand their intent. Generates appropriate answer hints using an AI model and sends them to the terminal. Users can answer questions quickly and accurately based on the provided hints.

[1373] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1374] This invention is a support system for users to give presentations efficiently and effectively, and by using an emotion engine that recognizes the user's emotions, it provides detailed support tailored to individual needs. The specific operation of the system for implementing this invention will be described below.

[1375] The "AI Presentation Master" system of the present invention primarily operates through the cooperation of three parties: a server, a terminal, and a user. This system has the function of recognizing the user's emotions in real time and dynamically adjusting the support provided at each step.

[1376] Entering presentation settings information

[1377] User:

[1378] First, the user accesses the terminal's interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. After entering the information, the user clicks the submit button to send the data from the terminal to the server.

[1379] Prompt generation and avatar generation

[1380] server:

[1381] The server receives configuration information sent by the user and analyzes the user's emotions in real time using an emotion engine. The prompt generation means generates the optimal prompt based on the user's emotions recognized by the emotion engine. For example, if the user is tense, a prompt to help them relax will be selected. The generated prompt is sent to the terminal.

[1382] Terminal:

[1383] The device generates an avatar that responds to the user's emotions based on prompts received from the server. The avatar's facial expressions and movements are also adjusted by the emotion engine, allowing the user to relax. The generated avatar is then displayed on the user's screen.

[1384] Automatic generation and checking of documents

[1385] User:

[1386] Next, the user enters the basic information and outline of the presentation materials into the terminal and clicks the send button. This information is sent to the server.

[1387] server:

[1388] The server receives basic information sent by the user and automatically generates materials using an AI model. The automatically generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. The emotion engine considers the impact of the check results on the user's emotions and generates appropriate feedback. This material and feedback are sent to the terminal.

[1389] Presentation practice and feedback

[1390] User:

[1391] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[1392] Terminal:

[1393] The device converts the recorded speech into text data and sends it to the server.

[1394] server:

[1395] The server analyzes the received text data and evaluates its consistency with the document. This evaluation also reflects the user's emotions. For example, if the user is feeling anxious, positive feedback is prioritized. The evaluation results, along with points of confusion, improvement suggestions, and anticipated questions (FAQs), are generated and sent to the terminal.

[1396] Follow-up during the actual presentation

[1397] Terminal:

[1398] During the presentation, the device monitors the user's progress in real time and checks the time allocation. The emotion engine recognizes the user's emotions and displays reminders and advice accordingly. For example, if the user is nervous, a message to help them relax will be displayed.

[1399] User:

[1400] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[1401] server:

[1402] The server analyzes the received question and uses an emotion engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[1403] Terminal:

[1404] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1405] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows the emotion engine to recognize the user's tension and provide prompts and avatars to help them relax. Furthermore, appropriate support tailored to the user's emotions is provided during both practice and the actual presentation, improving the quality of the presentation and increasing its success rate.

[1406] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotions, and effectively assists throughout the entire process from presentation preparation to the actual presentation.

[1407] The following describes the processing flow.

[1408] Step 1:

[1409] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. Once the information is entered, the user clicks the submit button to send the settings information to the server.

[1410] Step 2:

[1411] The server receives presentation settings information sent by the user and stores it in an internal database. Next, it activates the emotion engine and analyzes the user's emotional state. Using this analysis, the prompt generation system generates the most appropriate prompts according to the presentation content. If the user is nervous, it generates prompts to help them relax. The prompts are then sent to the terminal.

[1412] Step 3:

[1413] The terminal analyzes prompts received from the server and generates an avatar designed to help the user relax. For example, it might generate an avatar with a gentle expression or one performing relaxed movements. The generated avatar is displayed on the user's screen for the user to see.

[1414] Step 4:

[1415] The user inputs the basic information and outline necessary for creating the presentation materials into the terminal. For example, they might input "Advantages of Cloud Services" or "Features of the New Product" and click the submit button. The input data is then sent to the server.

[1416] Step 5:

[1417] The server receives basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. An emotion engine evaluates the impact of the check results on the user's emotions and generates appropriate feedback. These materials and feedback are sent to the device.

[1418] Step 6:

[1419] The terminal displays the materials and feedback received from the server to the user. The user reviews the materials and makes corrections based on the feedback as needed. If corrections are required, the user resends them to the server.

[1420] Step 7:

[1421] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[1422] Step 8:

[1423] The device converts the recorded speech into text data and sends that text data to the server.

[1424] Step 9:

[1425] The server analyzes the received text data and evaluates its consistency with the document. It also assesses the user's emotional state and generates feedback on the clarity of the speech and any omissions or missing important points. The evaluation results, feedback, and anticipated questions (FAQs) are sent to the terminal.

[1426] Step 10:

[1427] The terminal displays feedback received from the server and FAQs to the user. The user can then revise the materials accordingly and practice again.

[1428] Step 11:

[1429] The user prepares for their presentation. During the presentation, the device monitors the progress and time allocation of the presentation in real time. The emotion engine analyzes the user's emotional state in real time and displays reminders and advice. For example, a message such as "Please take a deep breath" might be displayed.

[1430] Step 12:

[1431] If a user receives a question during live operation, the user enters the question into their terminal and sends it to the server.

[1432] Step 13:

[1433] The server analyzes the received question and processes it to understand its intent. The emotion engine generates response guidelines and hints appropriate to the user's emotional state. These generated hints are then sent to the terminal.

[1434] Step 14:

[1435] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1436] Through the above process, users receive comprehensive support and can deliver high-quality presentations. This system allows users to approach presentations with confidence and receive appropriate answers to questions through real-time support.

[1437] (Example 2)

[1438] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1439] Traditional presentation support systems often provided simplistic advice without considering the user's emotions. As a result, they failed to adequately alleviate the tension and anxiety users felt during presentations, making it difficult to improve the quality and success rate of presentations. Furthermore, even in presentation practice and automated material generation, there was a lack of feedback and advice tailored to the individual user's emotional state.

[1440] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for the user to input presentation setting information, an emotion analysis means for analyzing the user's emotions in real time based on the input setting information, a prompt generation means for generating prompts based on the analyzed emotion information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials from the viewpoints of design consistency, appropriateness of expression, and copyright infringement, a practice recording means for the user to practice the presentation and record the content of their remarks, a feedback means for evaluating the consistency between the recorded remarks and the materials and providing feedback, and a follow-up means for monitoring the user's progress and emotions in real time during the actual presentation and providing support. This makes it possible to alleviate the user's tension and anxiety while providing consistent support from the creation of high-quality presentation materials to support during the actual presentation.

[1441] An "input method" is an interface for users to input presentation settings information.

[1442] "Emotion analysis means" refers to an engine or system for analyzing a user's emotions in real time based on input configuration information.

[1443] The "prompt generation means" is a function for generating appropriate prompts based on emotional information obtained by the emotion analysis means.

[1444] An "avatar generation method" is a system for generating the facial expressions and movements of an avatar based on the generated prompts.

[1445] The "material generation method" is a function that automatically generates presentation materials based on the basic information of the presentation materials entered by the user.

[1446] A "document checking method" refers to a system or function that checks generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[1447] The "practice recording function" is a feature that allows users to record and save their speech when practicing a presentation.

[1448] A "feedback mechanism" is a system or function for evaluating the consistency between recorded statements and materials and providing appropriate feedback.

[1449] "Follow-up features" are functions that monitor the user's progress and emotions in real time during the presentation and provide support as needed.

[1450] This invention is a support system for users to give presentations efficiently and effectively, and it provides detailed support tailored to individual needs by using an emotion engine that analyzes the user's emotions in real time. This system mainly operates through the cooperation of three parties: a server, a terminal, and the user.

[1451] Entering presentation settings information

[1452] User:

[1453] The user enters presentation settings information using the device's interface (e.g., a web browser or dedicated application). This information includes the audience's name, company, purpose, presentation time, audience's knowledge level, and industry. After entering the information, the user clicks a submit button to send the information from the device to the server.

[1454] Hardware and software used:

[1455] Devices: PC, tablet, smartphone

[1456] Software: Web browser, dedicated application, HTML form, JavaScript

[1457] Sentiment analysis and prompt generation

[1458] server:

[1459] The server receives configuration information sent by the user and uses this information to analyze the user's emotions in real time using an emotion engine (e.g., Python's Emotion API or an open-source emotion analysis library). Based on the analysis results, the prompt generation means generates the optimal prompt using a generative AI model (e.g., OpenAI's GPT-4). For example, if the user is feeling anxious, a prompt to help them relax will be generated. This prompt is then sent to the terminal.

[1460] Hardware and software used:

[1461] Servers: Cloud servers, physical servers

[1462] Software: Python, Emotion API, open-source analysis library, GPT-4

[1463] Examples of prompt statements:

[1464] "Please speak calmly without being nervous. Take a slow, deep breath."

[1465] "On the next slide, highlight the points that will capture the audience's interest."

[1466] Avatar generation

[1467] Terminal:

[1468] The device generates an avatar based on prompts received from the server. The avatar's facial expressions and movements are adjusted based on the output of the emotion engine. For example, if the user is tense, an avatar with a relaxed expression will be generated. The generated avatar is then displayed in 3D on the user's screen.

[1469] Hardware and software used:

[1470] Devices: PC, tablet, smartphone

[1471] Software: JavaScript libraries (e.g., Three.js), WebGL

[1472] Automatic document generation and checking

[1473] User:

[1474] The user enters basic information and outlines of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[1475] server:

[1476] The server receives and analyzes basic information sent by the user and automatically generates materials using an AI model (e.g., OpenAI's DALLE 2 or GPT-4). The generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. Based on the check results, the sentiment engine generates appropriate feedback, and this material and feedback are sent to the terminal.

[1477] Hardware and software used:

[1478] Servers: Cloud servers, physical servers

[1479] Software: Python, DALLE 2, GPT-4, Google Cloud Vision API

[1480] Presentation practice and feedback

[1481] User:

[1482] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[1483] Terminal:

[1484] The device converts the recorded audio into text data and sends it to the server.

[1485] server:

[1486] The server analyzes the received text data and evaluates its consistency with the presentation materials. The evaluation results also reflect the user's emotions, with positive feedback given priority. Along with the evaluation results, points of confusion, improvement suggestions, and FAQs (expected questions) are generated and sent to the terminal.

[1487] Hardware and software used:

[1488] Devices: PC, tablet, smartphone

[1489] Software: Speech recognition APIs (e.g., Google Speech-to-Text API, Amazon Transcribe)

[1490] Follow-up during the actual presentation

[1491] Terminal:

[1492] During the presentation, the device monitors the user's progress in real time, and the emotion engine recognizes the user's emotions. Reminders and advice are displayed according to the user's state. For example, messages to help the user relax are provided.

[1493] User:

[1494] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[1495] server:

[1496] The server analyzes the received question and uses an emotion engine to generate answer hints and guidelines appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[1497] Terminal:

[1498] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1499] Hardware and software used:

[1500] Devices: PC, tablet, smartphone

[1501] Software: JavaScript time tracking function, real-time WebSocket communication

[1502] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotional state, and effectively assists the user from presentation preparation to the actual presentation.

[1503] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1504] Step 1: Enter presentation settings information

[1505] User:

[1506] The user enters presentation settings information using the terminal interface. For example, they might enter the audience's name, organization, presentation purpose, presentation time, audience knowledge level, and industry. To do this, the user fills in the information in a form and clicks the submit button. The entered information is sent to the server using the JavaScript fetch API.

[1507] Inputs and outputs:

[1508] Input: Presentation setup information (audience, purpose, presentation time, audience knowledge level, industry, etc.)

[1509] Output: Configuration information is sent to the server.

[1510] Specific actions:

[1511] The user enters information using an HTML form and clicks the submit button.

[1512] The configuration information is sent to the server as a POST request using the JavaScript fetch API.

[1513] Step 2: Emotion Analysis

[1514] server:

[1515] The server receives configuration information sent by the user and performs sentiment analysis. This sentiment analysis utilizes Python's Emotion API or open-source sentiment analysis libraries. This process analyzes the user's emotional state (e.g., tension or relaxation) in real time.

[1516] Inputs and outputs:

[1517] Input: Presentation settings information

[1518] Output: Emotion analysis results

[1519] Specific actions:

[1520] The server processes the received configuration information using a Python-based API.

[1521] The sentiment analysis library is called to analyze the user's emotions.

[1522] The analysis results are stored in JSON format.

[1523] Step 3: Generate prompt

[1524] server:

[1525] Based on the emotion analysis results, the prompt generation means generates an appropriate prompt. Using a generation AI model (e.g., OpenAI's GPT-4), prompts are generated that correspond to the user's emotional state. For example, if the user is tense, a prompt to help them relax is generated. The generated prompt is sent to the terminal.

[1526] Inputs and outputs:

[1527] Input: Sentiment analysis results

[1528] Output: Generated prompt

[1529] Specific actions:

[1530] The emotion analysis results are input into the generating AI model.

[1531] The model is used to generate prompts.

[1532] The generated prompt is sent to the terminal in JSON format.

[1533] Step 4: Avatar Creation

[1534] Terminal:

[1535] The terminal generates an avatar based on prompts received from the server. The avatar's facial expressions and movements are adjusted based on the emotion analysis results. For example, an avatar with a relaxed expression is generated. The generated avatar is displayed in 3D.

[1536] Inputs and outputs:

[1537] Input: Generated prompt

[1538] Output: The displayed avatar

[1539] Specific actions:

[1540] Analyze the prompt received from the server.

[1541] This project uses a JavaScript library (e.g., Three.js) to render a 3D avatar via WebGL.

[1542] Set the avatar's facial expressions based on prompts.

[1543] Step 5: Automatic document generation and checking

[1544] User:

[1545] The user enters basic information and outlines of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[1546] Inputs and outputs:

[1547] Input: Basic information and outline of the presentation materials

[1548] Output: Data information sent to the server

[1549] Specific actions:

[1550] The user enters information about the document into the form and submits it.

[1551] Use the JavaScript fetch API to send information to the server as a POST request.

[1552] server:

[1553] The server analyzes the received document information and automatically generates documents using an AI model (e.g., OpenAI's DALLE 2 or GPT-4). The generated documents are checked for design consistency, appropriateness of expression, and copyright infringement. Appropriate feedback is also added using sentiment analysis. These documents and feedback are sent to the terminal.

[1554] Inputs and outputs:

[1555] Input: Basic information and outline of the presentation materials

[1556] Output: Generated presentation materials and feedback

[1557] Specific actions:

[1558] The server analyzes the received data information.

[1559] Use an AI model to generate documents.

[1560] Check the design, consistency, and copyright of the materials.

[1561] Feedback is generated based on the emotion analysis results.

[1562] Send the documents and feedback back to the device.

[1563] Step 6: Presentation practice and feedback

[1564] User:

[1565] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[1566] Inputs and outputs:

[1567] Input: Presentation materials

[1568] Output: Recorded speech

[1569] Specific actions:

[1570] The user displays the presentation materials and begins practicing.

[1571] The device uses its recording function to record what is said.

[1572] Terminal:

[1573] The device converts the recorded audio into text data and sends it to the server.

[1574] Inputs and outputs:

[1575] Input: Recorded speech

[1576] Output: Text data sent to the server

[1577] Specific actions:

[1578] The recorded data is converted to text using a speech recognition API (e.g., Google Speech-to-Text API).

[1579] Send the converted text data to the server.

[1580] server:

[1581] The server analyzes the received text data and evaluates its consistency with the document. Sentiment analysis is also incorporated into this evaluation. Positive feedback is prioritized, and along with the evaluation results, points out unclear areas, suggestions for improvement, and FAQs are generated and sent to the terminal.

[1582] Inputs and outputs:

[1583] Input: Text data

[1584] Output: Feedback and FAQ

[1585] Specific actions:

[1586] Analyze the received text data.

[1587] Evaluate the consistency with the presentation materials.

[1588] Based on the results of the emotion analysis, feedback, improvement suggestions, and FAQs are generated.

[1589] Send feedback and FAQs to your device.

[1590] Step 7: Follow-up during the actual presentation

[1591] Terminal:

[1592] During the presentation, the device monitors the user's progress in real time, and the emotion engine recognizes the user's emotions. If the user is nervous, messages to help them relax and reminders about time management are displayed.

[1593] Inputs and outputs:

[1594] Input: User's progress, emotional state

[1595] Output: Reminders and advice

[1596] Specific actions:

[1597] Use JavaScript's time tracking feature to monitor progress.

[1598] It performs real-time sentiment analysis and displays appropriate reminders and advice.

[1599] User:

[1600] If a question comes in during the presentation, the question is entered into the terminal and sent to the server.

[1601] Inputs and outputs:

[1602] Input: Question content

[1603] Output: Question content sent to the server

[1604] Specific actions:

[1605] The questions received by the user are entered into the terminal.

[1606] Send the question to the server.

[1607] server:

[1608] The server analyzes the received question and uses an emotion engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. These hints are then sent to the terminal.

[1609] Inputs and outputs:

[1610] Input: Question content

[1611] Output: Hints and guidelines for answering the question.

[1612] Specific actions:

[1613] Analyze the content of the question.

[1614] Based on the results of the emotion analysis, hints and guidelines for the response are generated.

[1615] The generated hints and guidelines are sent to the device.

[1616] Terminal:

[1617] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1618] Inputs and outputs:

[1619] Input: Hints and guidelines for the answer

[1620] Output: Hints and guidance displayed on the screen.

[1621] Specific actions:

[1622] The received hints and instructions are displayed on the screen.

[1623] This system helps users answer questions while referring to hints.

[1624] (Application Example 2)

[1625] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1626] Traditional presentation support systems lacked the flexibility to adapt to users' emotions and transaction situations. This meant that appropriate support could not be provided when users felt nervous or anxious, potentially leading to a decline in the quality of presentations and transactions. Furthermore, in electronic payment services, ignoring users' emotional states during transactions resulted in insufficient support for anxious or nervous users, impacting transaction security and smooth progress.

[1627] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes an input means for the user to input presentation and transaction setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, an emotion recognition means for recognizing the user's emotions in real time, and an emotion response means for providing support messages based on the recognized emotions. This enables timely and appropriate support according to the user's emotional state.

[1628] "Input means" refers to a device or interface for a user to input presentation or transaction setting information into the system.

[1629] A "prompt generation means" is a device or program for generating instructions or advice presented to the user based on the input configuration information.

[1630] An "avatar generation means" is a device or program for generating characters or images that correspond to the user's emotions and presentation situation based on the generated prompts.

[1631] "Document generation means" refers to a device or system that automatically creates presentation materials based on basic information entered by the user.

[1632] A "document checking tool" is a device or program that verifies the consistency of the design, the appropriateness of the expression, and whether or not there are any copyright infringements in the generated presentation materials.

[1633] A "practice recording device" is a device or system that records the content of a user's speech during a presentation practice session.

[1634] A "feedback mechanism" is a device or program that evaluates the consistency between recorded statements and generated materials, and provides the user with suggestions for improvement and advice based on the evaluation results.

[1635] A "follow-up device" is a device or program that provides real-time advice and reminders to support the user during the actual presentation.

[1636] An "emotion recognition means" is a device or program for recognizing a user's emotional state in real time from the user's facial expressions, voice, gestures, etc.

[1637] An "emotional response device" is a device or program that provides appropriate support messages or advice based on the recognized emotional state of the user.

[1638] This invention is a support system for users to conduct presentations and electronic transactions efficiently and effectively, recognizing the user's emotions in real time and providing support tailored to individual needs. The specific operation of the system for implementing this invention will be described below.

[1639] Hardware and software configuration

[1640] hardware

[1641] Device: A computer, smartphone, tablet, etc., used by the user for presentations or transactions.

[1642] Webcam: Used to capture the user's facial expressions and recognize emotions.

[1643] Server: This server centralizes processes such as prompt generation, avatar generation, data generation, and emotion recognition.

[1644] software

[1645] Face detection engine: Face detection libraries such as dlib.

[1646] Emotion recognition engine: An emotion recognition model using Keras.

[1647] Prompt generation engine: A prompt generation algorithm equipped with a generative AI model.

[1648] Avatar generation engine: Software that generates avatars based on specified prompts.

[1649] Document generation engine and checking engine: Software for automatically generating and checking presentation materials.

[1650] System operation

[1651] Entering presentation settings information

[1652] User: First, the user accesses the terminal interface and enters presentation and transaction settings information. This information includes the other party, purpose, time, the other party's knowledge level, and industry. After entering the information, the user clicks the submit button to send the data from the terminal to the server.

[1653] Prompt generation and avatar generation

[1654] Server: The server receives configuration information sent by the user and generates the optimal prompt using a generative AI model. For example, if the user is stressed, a prompt to help them relax will be generated. The generated prompt is then sent to the terminal.

[1655] Terminal: Based on the received prompts, the terminal generates an avatar that responds to the user's emotions. The avatar's facial expressions and movements are also adjusted by the emotion recognition engine, allowing the user to relax. The generated avatar is displayed on the user's screen.

[1656] Automatic generation and checking of documents

[1657] User: Next, the user enters the basic information and outline of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[1658] Server: The server automatically generates presentation materials based on the received basic information. The materials are checked for design consistency, appropriateness of expression, and copyright infringement. The emotion recognition engine considers the impact of the check results on the user's emotions and generates appropriate feedback. This material and feedback are sent to the terminal.

[1659] Presentation practice and feedback

[1660] User: The user starts presentation practice mode on the device interface and practices using the generated materials. The device records what the user says during practice.

[1661] Terminal: The terminal converts the recorded speech into text data and sends it to the server.

[1662] Server: The server analyzes the received text data and evaluates its consistency with the material. This evaluation also reflects the user's emotions. For example, if the user is feeling anxious, positive feedback is prioritized. The evaluation results, along with points of confusion, improvement suggestions, and anticipated questions (FAQs), are generated and sent to the terminal.

[1663] Follow-up during the actual presentation

[1664] Terminal: During the presentation, the terminal monitors the user's progress in real time and checks the time allocation. The emotion recognition engine recognizes the user's emotions and displays reminders and advice according to their state. For example, if the user is nervous, a message to help them relax will be displayed.

[1665] User: If a question comes in during the presentation, enter the question into the terminal and send it to the server.

[1666] Server: The server analyzes the received question and uses an emotion recognition engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. The generated hints are sent to the terminal.

[1667] Terminal: The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1668] Examples of prompt statements

[1669] Example of a prompt:

[1670] "Relax and take a deep breath. This transaction is safe."

[1671] "That's fantastic! Keep it up."

[1672] "Please proceed as is."

[1673] In this way, by using this system, users can effectively conduct presentations and electronic transactions while receiving appropriate support through emotion recognition.

[1674] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1675] Step 1:

[1676] User: Access the terminal interface and enter presentation and transaction settings.

[1677] (Input): Information such as the other party, purpose, time, the other party's knowledge level, and industry.

[1678] (Data processing): The input data is formatted on the terminal and converted into a format that can be sent to the server.

[1679] (Output): Sends formatted configuration data to the server.

[1680] Step 2:

[1681] Server: Analyzes the received configuration information and generates prompts using a generation AI model.

[1682] (Input): Configuration data submitted by the user.

[1683] (Data processing): Use a generative AI model to generate prompts based on the configuration information.

[1684] (Output): Sends the generated prompt data to the terminal.

[1685] Step 3:

[1686] Terminal: Based on the received prompt, it generates an avatar using the avatar generation engine.

[1687] (Input): Prompt data sent from the server.

[1688] (Data Processing): An avatar generation engine is used to create avatars that respond to prompts. Facial expressions and movements are adjusted according to the user's emotions and presentation situation.

[1689] (Output): The generated avatar is displayed on the user's screen.

[1690] Step 4:

[1691] User: Enter the basic information and outline of the presentation materials into the terminal and click the send button.

[1692] (Input): Basic information and outline of the presentation materials.

[1693] (Data processing): The input information is formatted on the terminal and converted into a format that can be sent to the server.

[1694] (Output): Sends formatted data information to the server.

[1695] Step 5:

[1696] Server: Automatically generates presentation materials based on received basic information, and uses a material checking engine to verify design consistency, appropriateness of expression, and copyright infringement.

[1697] (Input): Basic information data submitted by the user.

[1698] (Data processing: Automatically generate presentation materials and evaluate them using a material checking engine.)

[1699] (Output): Sends the generated presentation materials and check results to the terminal.

[1700] Step 6:

[1701] User: Use the generated materials to practice your presentation on your device and record what you say.

[1702] (Input): Presentation materials and user comments.

[1703] (Data processing: The terminal records the spoken content, converts it to text, and sends it to the server.)

[1704] (Output): Sends the text data of the recorded speech to the server.

[1705] Step 7:

[1706] Server: Analyzes received text data, evaluates its consistency with the document, and generates feedback.

[1707] (Input: Text data and generated materials.)

[1708] (Data processing): Evaluate consistency with the document and generate areas for improvement and positive feedback.

[1709] (Output): Sends evaluation results and feedback data to the terminal.

[1710] Step 8:

[1711] Terminal: Monitors the progress of the presentation in real time and recognizes the user's emotions.

[1712] (Input): Real-time progress data and camera footage.

[1713] (Data Processing): Use an emotion recognition engine to recognize the user's emotions and monitor their progress. Generate reminders and advice.

[1714] (Output): Displays the generated reminders and advice to the user.

[1715] Step 9:

[1716] User: If a question comes in during the presentation, enter the content into the terminal and send it to the server.

[1717] (Input): Question content.

[1718] (Data processing): Format the question content and send it to the server.

[1719] (Output): Sends formatted question data to the server.

[1720] Step 10:

[1721] Server: Analyzes received questions and uses an emotion recognition engine to generate hints and guidelines for answers that are appropriate to the user's emotional state.

[1722] (Input): Question content data and user sentiment data.

[1723] (Data processing): Analyze the question content and generate hints and guidelines for responses that are appropriate to the user's emotional state.

[1724] (Output): Sends the generated answer hint data to the terminal.

[1725] Step 11:

[1726] Terminal: Displays answer hints from the server to the user, supporting the user in appropriately responding to questions.

[1727] (Input): Answer hint data sent from the server.

[1728] (Data processing): Convert the answer hint data into a displayable format and notify the user.

[1729] (Output): Displays answer hints on the user's screen.

[1730] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1731] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1732] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1733] [Fourth Embodiment]

[1734] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1735] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1736] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1737] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1738] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1739] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1740] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1741] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1742] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1743] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1744] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1745] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1746] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1747] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[1748] The "AI Presentation Master" system of the present invention is designed to allow users to receive support at each step of their presentation. The system primarily operates through the cooperation of three parties: the server, the terminal, and the user.

[1749] Entering presentation settings information

[1750] User:

[1751] The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[1752] Prompt generation and avatar generation

[1753] server:

[1754] The server receives configuration information sent by the user and generates an appropriate prompt. This prompt will be professional and effective, tailored to the content of the presentation and the audience. The generated prompt is then sent to the terminal.

[1755] Terminal:

[1756] The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to executives, an avatar resembling an executive is generated. This avatar is displayed on the user's screen for the user to confirm.

[1757] Automatic generation and checking of documents

[1758] User:

[1759] The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they might input an outline such as "Advantages of Cloud Services."

[1760] server:

[1761] The server uses AI to automatically generate presentation materials based on information received from the user. These materials undergo checks for design consistency, appropriateness of expression, and copyright infringement. The generated materials are then sent to the user's device and provided to them.

[1762] Presentation practice and feedback

[1763] User:

[1764] The user starts presentation practice mode on the device's interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[1765] Terminal:

[1766] The device converts the recorded speech into text data and sends it to the server.

[1767] server:

[1768] The server analyzes the received text data and evaluates its consistency with the document. It then identifies unclear sections, suggests improvements, generates a list of anticipated questions (FAQs), and sends them to the terminal.

[1769] Follow-up during the actual presentation

[1770] Terminal:

[1771] During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[1772] User:

[1773] When a question comes in, the content is entered into the terminal and sent to the server.

[1774] server:

[1775] The server analyzes the received question and processes it to understand its intent. It then generates hints for an appropriate answer and sends them to the terminal.

[1776] This system provides users with comprehensive support from presentation preparation to the actual presentation. Specifically, it reduces the effort required to create materials and provides a sense of security through prior practice, thereby increasing the success rate of the actual presentation. Furthermore, real-time support during the presentation allows for smooth handling of questions and other inquiries.

[1777] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows them to quickly create high-quality presentation materials and deliver their presentation with confidence through practice. Furthermore, it enables them to respond accurately to questions, maximizing the effectiveness of their presentation.

[1778] The following describes the processing flow.

[1779] Step 1:

[1780] The user accesses the terminal and enters presentation settings (audience, purpose, presentation time, audience knowledge level, industry, etc.). Clicking the submit button sends the entered data from the terminal to the server.

[1781] Step 2:

[1782] The server receives configuration information sent by the user and stores it in its internal database. Next, it parses the received data and processes it to generate an appropriate prompt. The generated prompt is then sent to the terminal.

[1783] Step 3:

[1784] The terminal generates an avatar tailored to the presentation audience based on prompts received from the server. This includes avatars that resemble executives or superiors. The generated avatar is displayed on the user's screen for the user to confirm.

[1785] Step 4:

[1786] The user inputs basic information and the main points of the presentation materials into the terminal. For example, they might enter "Advantages of the cloud service" or "Features of the new product" and then click the submit button.

[1787] Step 5:

[1788] The server receives basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. The checked materials are then sent to the terminal.

[1789] Step 6:

[1790] The terminal displays the completed document received from the server to the user. The user reviews the document and, if necessary, enters and submits feedback on the terminal.

[1791] Step 7:

[1792] The user starts presentation practice mode on their device and practices using the generated materials. The device records what the user says during practice.

[1793] Step 8:

[1794] The device converts the recorded speech into text data and sends it to the server.

[1795] Step 9:

[1796] The server analyzes the received text data and evaluates its consistency with the document, the clarity of the statements, and whether any important points are missing. It then generates the evaluation results, points out unclear sections, suggested corrections, and anticipated questions (FAQs), and sends them to the terminal.

[1797] Step 10:

[1798] The terminal displays feedback received from the server and FAQs to the user. The user then makes corrections and improvements accordingly.

[1799] Step 11:

[1800] The user prepares for their presentation. During the presentation, they receive real-time support from their device. For example, a timer function displays the time allocation, and reminders appear to help alleviate nervousness.

[1801] Step 12:

[1802] When a user receives a question, they input the content into their device and send it.

[1803] Step 13:

[1804] The server analyzes the received question and processes it to understand its intent. It then generates appropriate response guidelines and hints and sends them to the terminal.

[1805] Step 14:

[1806] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1807] Through the above process, users will receive comprehensive support and be able to deliver high-quality presentations.

[1808] (Example 1)

[1809] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1810] Conventional presentation support systems lacked sufficient functionality to automatically generate appropriate prompts and materials based on manual input of presentation settings by the user. Furthermore, they lacked features to provide real-time feedback during presentation practice, monitor the progress of the presentation, and offer appropriate advice and responses. As a result, it was difficult for users to deliver presentations smoothly during preparation and the actual presentation itself.

[1811] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1812] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a question analysis and answer generation means for generating appropriate answers to questions the user receives during the presentation, and a progress monitoring means for monitoring the user's progress during the presentation and displaying alerts and advice. This enables the user to receive comprehensive support from the preparation to the actual presentation.

[1813] "Input method" refers to the interface or device that allows the user to input presentation settings information.

[1814] "Prompt generation means" refers to a function that generates appropriate prompts based on the input configuration information, tailored to the presentation content and the audience.

[1815] "Avatar generation means" refers to a function that generates an avatar suitable for the presentation audience based on the generated prompt.

[1816] "Document generation means" refers to a function that automatically creates presentation materials based on basic information and outlines provided by the user.

[1817] "Document checking method" refers to a function for checking automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[1818] "Practice recording means" refers to a function that allows users to record and save what they say while practicing a presentation.

[1819] "Feedback mechanisms" refer to functions that evaluate the consistency between recorded statements and documents, and provide users with suggestions for improvement.

[1820] "Question analysis and answer generation means" refers to a function that analyzes questions received by users during a presentation, understands their intent, and generates appropriate answers.

[1821] "Progress monitoring means" refers to a function that monitors the user's progress in real time during a presentation and displays time allocation alerts and appropriate advice.

[1822] This invention is a support system for users to deliver presentations efficiently and effectively. This system primarily operates through the cooperation of a server, a terminal, and the user. The system is implemented using the following hardware and software.

[1823] Specific examples of hardware and software

[1824] A terminal refers to a computer or smart device that accepts user input and operations. It also includes input devices such as microphones and cameras. A server refers to a high-performance computer that performs processing using generative AI models. Natural language processing (NLP) technology is expected to be used for generating shapes and text, while the Google Vision API is expected to be used for image processing and the Google Speech-to-Text API for speech recognition.

[1825] Specific actions

[1826] First, the user accesses the terminal's interface and enters presentation settings information. Specifically, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it. Based on the received information, the server uses a generative AI model to generate appropriate prompts and sends them to the terminal. The terminal then generates an avatar appropriate for the audience based on the received prompts. For example, an avatar resembling an executive might be generated.

[1827] Next, the user inputs the outline and basic information of the presentation materials into the terminal and sends it. The server uses AI to automatically generate the presentation materials based on the received information. These materials are checked for design consistency, appropriateness of expression, and copyright infringement, and the generated materials are sent to the terminal and provided to the user.

[1828] The user starts a presentation practice mode on the device's interface and practices using the generated materials. The device records the user's speech, converts it into text data using speech recognition software, and sends it to the server. The server analyzes the received text data, evaluates its consistency with the materials, identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them back to the device.

[1829] During the presentation, the device monitors the user's progress in real time and displays reminders such as "5 minutes remaining." It also inputs any questions the user receives during the presentation into the device and sends them to the server. The server analyzes the received questions, processes them to understand their intent, generates hints for appropriate answers, and sends them back to the device.

[1830] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system will generate the following prompt:

[1831] "Please create an outline and materials for a presentation on the benefits of cloud services. The audience consists of executives with limited technical knowledge, and the goal of the presentation is to persuade them of the advantages of migrating to the cloud. The content should be clear and easy to understand, and include specific benefits and examples."

[1832] This allows users to receive comprehensive support from presentation preparation to the actual presentation. Through specific actions and technologies, all-encompassing support is provided from preparation to the actual presentation.

[1833] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1834] Step 1:

[1835] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation duration, audience knowledge level, and industry. The entered settings information is stored as data on the terminal for subsequent processing steps. The terminal then sends this settings information to the server.

[1836] Input: Presentation audience, purpose, presentation time, audience knowledge level, industry

[1837] Output: Configuration information is sent to the server.

[1838] Step 2:

[1839] The server receives configuration information sent by the user. Based on the received configuration information, it uses a generative AI model to generate appropriate prompts. The generated prompts are optimized for the user's presentation content and the audience. For example, it can generate a prompt explaining the benefits of cloud services to executives with limited technical knowledge. The generated prompts are then sent to the terminal.

[1840] Input: Settings information

[1841] Output: The generated prompt is sent to the terminal.

[1842] Step 3:

[1843] The terminal generates an avatar based on prompts received from the server. For example, it might generate an avatar resembling an executive using 3D modeling software. This avatar has an appearance tailored to the audience being presented to. The generated avatar is displayed on the user's screen for confirmation.

[1844] Input: Generated prompt

[1845] Output: The generated avatar is displayed on the screen.

[1846] Step 4:

[1847] Users input the main points and basic information of their presentation materials into their terminal and send it. For example, they might input "advantages of cloud services," "cost reduction," and "operational flexibility." This information is stored on the terminal and sent to the server.

[1848] Input: Outline and basic information of the presentation materials

[1849] Output: The outline of the generated document is sent to the server.

[1850] Step 5:

[1851] The server uses AI to automatically generate presentation materials based on the outline and basic information received from the user. The generated materials include checks for design consistency, appropriateness of expression, and copyright infringement. For example, the Google Vision API is used to check image copyrights. The generated materials are sent to the device and provided to the user.

[1852] Input: Outline and basic information of the presentation materials

[1853] Output: Automatically generated presentation materials

[1854] Step 6:

[1855] The user starts presentation practice mode on the device interface and practices using the generated materials. The device records the user's speech and converts it into text data using the Google Speech-to-Text API. The converted text data is sent to the server.

[1856] Input: User's statement

[1857] Output: Converted text data

[1858] Step 7:

[1859] The server analyzes the received text data and evaluates its consistency with the document. Specifically, it uses NLP (Neuro-Linguistic Programming) technology to compare the user's statements with the document content and points out unclear areas or areas for improvement. It also generates a list of frequently asked questions (FAQs) and sends them to the terminal.

[1860] Input: Converted text data

[1861] Output: Feedback and FAQ

[1862] Step 8:

[1863] During the presentation, the device monitors the user's progress in real time and displays time-out alerts (e.g., "5 minutes remaining"). It also displays messages and advice to help ease the user's anxiety.

[1864] Input: User's presentation progress

[1865] Output: Alerts and advice

[1866] Step 9:

[1867] When a question comes in during the presentation, the user enters the content into their device and sends it to the server. For example, they might enter "a question about cloud security."

[1868] Input: Question content

[1869] Output: The question content is sent to the server.

[1870] Step 10:

[1871] The server uses a generative AI model to analyze the received question and understand its intent. It then generates hints for appropriate answers and sends them to the terminal. Based on these hints, the user can respond to the question accurately.

[1872] Input: Question content

[1873] Output: Hints for the generated answer

[1874] (Application Example 1)

[1875] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1876] In today's industrial environment, efficient and effective presentations are crucial for project success and the successful adoption of new technologies. However, creating, practicing, and delivering presentations is often cumbersome, and there is a lack of efficient systems, particularly in manufacturing. Therefore, there is a need for a support system that can quickly gather detailed information on manufacturing processes and efficiency proposals, and then use that information to propose the introduction of new technologies.

[1877] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1878] In this invention, the server includes an input means for the user to input presentation setting information, a prompt generation means for generating prompts based on the input setting information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials, a practice recording means for the user to practice the presentation and record what they say, a feedback means for evaluating the consistency between the recorded speech and the materials and providing feedback, a follow-up means for supporting the user during the actual presentation, and a data processing means for collecting detailed information on manufacturing processes and efficiency improvements when giving a presentation in a factory, and for proposing the introduction of new robots based on that information. This makes it possible to efficiently create presentation materials, practice, and handle the actual presentation.

[1879] A "user" refers to one or more individuals who use this system to create, practice, and deliver presentations.

[1880] An "input method" refers to a device or interface for a user to input presentation settings information.

[1881] A "prompt generation means" is a device or program that generates prompts to guide the presentation content based on the input configuration information.

[1882] An "avatar generation means" is a device or program that generates an avatar suitable for the presentation recipient based on the generated prompt.

[1883] "Document generation means" refers to devices or programs that automatically generate presentation materials.

[1884] "Document checking tools" refer to devices or programs that check automatically generated presentation materials from the perspectives of design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement.

[1885] A "practice recording device" is a device or program that allows a user to practice a presentation and record what they say.

[1886] A "feedback mechanism" is a device or program that evaluates the consistency between recorded statements and documents and provides feedback on areas for improvement.

[1887] A "follow-up tool" is a device or program that provides real-time advice and reminders to support the user during the actual presentation.

[1888] "Data processing means" refers to devices and programs used to collect detailed information about manufacturing processes and efficiency improvements when giving presentations within a factory, and to use that information to propose the introduction of new robots.

[1889] This invention is a support system for users to give presentations efficiently and effectively. The specific operation of the system for implementing this invention will be described below.

[1890] The system of this invention primarily operates through the cooperation of three parties: a server, a terminal, and a user.

[1891] Entering presentation settings information

[1892] User: The user first accesses the terminal interface and enters presentation settings information. For example, they enter information such as the audience, purpose, presentation time, audience knowledge level, and industry into a form and submit it.

[1893] Prompt generation and avatar generation

[1894] Server: The server receives configuration information sent by the user and generates an appropriate prompt. This prompt is professional and effective, tailored to the content of the presentation and the audience. The generated prompt is sent to the terminal.

[1895] Terminal: The terminal generates an avatar appropriate for the presentation audience based on prompts received from the server. For example, in the case of a presentation to management, it generates an avatar that looks like a management representative. This avatar is displayed on the user's screen for the user to confirm.

[1896] Automatic generation and checking of documents

[1897] User: The user inputs the outline and basic information of the presentation materials into the terminal and sends it. For example, they input the outline of "Plan for Introducing a New Robot Arm".

[1898] Server: The server automatically generates presentation materials using generative AI based on information received from the user. These materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal and provided to the user.

[1899] Presentation practice and feedback

[1900] User: The user starts presentation practice mode on the device interface and practices using the generated materials. During practice, the user's speech is recorded on the device.

[1901] Terminal: The terminal converts the recorded speech into text data and sends it to the server.

[1902] Server: The server analyzes the received text data and evaluates its consistency with the document. Based on the evaluation results, it identifies unclear sections, suggests areas for improvement, and generates a list of anticipated questions (FAQs), which are then sent to the terminal.

[1903] Follow-up during the actual presentation

[1904] Device: During the presentation, the device monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to help alleviate the user's anxiety.

[1905] User: When a question comes in, enter the content into the terminal and send it to the server.

[1906] Server: The server analyzes the received question and processes it to understand its intent. It generates hints for an appropriate answer and sends them to the terminal.

[1907] The hardware used includes smartphones, tablets, personal computers, and industrial robots. The software used utilizes generative AI models (PromptGenerator, AvatarGenerator, PresentationGenerator, FeedbackAnalyzer).

[1908] Specific example:

[1909] For example, if a user is giving a presentation proposing the introduction of a new robotic arm, the configuration information might include the following:

[1910] Opponent: Management

[1911] Objective: Proposal for the introduction of a new robotic arm.

[1912] Presentation time: 10 minutes

[1913] Opponent's knowledge level: High

[1914] Industry: Automobile manufacturing

[1915] Example of a prompt:

[1916] "Please generate a presentation document to propose a plan to introduce a new robotic arm to management, focusing on efficiency and cost reduction."

[1917] This makes it possible to efficiently create, practice, and perform presentations.

[1918] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1919] Step 1:

[1920] Entering presentation settings information

[1921] User: Enters and submits setting information such as the presentation's purpose, audience, presentation time, audience knowledge level, and industry into the terminal's interface. This provides the system with basic presentation information. The entered information is sent from the terminal to the server and used for the next step.

[1922] Step 2:

[1923] Prompt generation

[1924] Server: Based on the received configuration information, the server uses an AI model (PromptGenerator) to generate prompts tailored to the presentation content and audience. These prompts serve as a guide for the user to conduct the presentation effectively. The generated prompts are sent to the terminal.

[1925] Step 3:

[1926] Avatar generation

[1927] Terminal: Based on prompts received from the server, an AI model (AvatarGenerator) is used to generate an avatar appropriate for the presentation audience. The generated avatar is displayed on the user's screen. For example, in a presentation to management, an avatar resembling a management representative will be displayed.

[1928] Step 4:

[1929] Automatic generation of documents

[1930] User: Enters the outline and basic information of the presentation materials (e.g., "Plan for Introducing a New Robotic Arm") into the terminal and sends it. This provides the server with the information necessary for creating the specific materials.

[1931] Server: Based on the received information, it automatically generates presentation materials using an AI model (PresentationGenerator). The materials are checked for design consistency, appropriateness of expression, accuracy of technical specifications, and copyright infringement. The generated materials are sent to the terminal.

[1932] Step 5:

[1933] Presentation practice and feedback

[1934] User: Using the generated materials, start presentation practice mode on your device. Your speech will be recorded during practice. This allows you to simulate an actual presentation.

[1935] Terminal: Converts recorded speech into text data and sends it to the server. This converts the speech into a format that can be analyzed.

[1936] Server: Analyzes received text data and evaluates its consistency with the document. Using an AI model (FeedbackAnalyzer), it identifies unclear points, suggests improvements, generates anticipated questions (FAQs), and sends them to the user's device. The user reviews the feedback and uses it to improve their presentation.

[1937] Step 6:

[1938] Follow-up during the actual presentation

[1939] Terminal: During the presentation, it monitors the user's progress in real time and checks the time allocation. For example, it displays reminders such as "5 minutes left." It also displays messages and advice to alleviate the user's anxiety.

[1940] User: When a question comes in, enter the content into the terminal and send it to the server. This ensures that the question is sent to the server in a parseable format.

[1941] Server: Analyzes received questions and processes them to understand their intent. Generates appropriate answer hints using an AI model and sends them to the terminal. Users can answer questions quickly and accurately based on the provided hints.

[1942] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1943] This invention is a support system for users to give presentations efficiently and effectively, and by using an emotion engine that recognizes the user's emotions, it provides detailed support tailored to individual needs. The specific operation of the system for implementing this invention will be described below.

[1944] The "AI Presentation Master" system of the present invention primarily operates through the cooperation of three parties: a server, a terminal, and a user. This system has the function of recognizing the user's emotions in real time and dynamically adjusting the support provided at each step.

[1945] Entering presentation settings information

[1946] User:

[1947] First, the user accesses the terminal's interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. After entering the information, the user clicks the submit button to send the data from the terminal to the server.

[1948] Prompt generation and avatar generation

[1949] server:

[1950] The server receives configuration information sent by the user and analyzes the user's emotions in real time using an emotion engine. The prompt generation means generates the optimal prompt based on the user's emotions recognized by the emotion engine. For example, if the user is tense, a prompt to help them relax will be selected. The generated prompt is sent to the terminal.

[1951] Terminal:

[1952] The device generates an avatar that responds to the user's emotions based on prompts received from the server. The avatar's facial expressions and movements are also adjusted by the emotion engine, allowing the user to relax. The generated avatar is then displayed on the user's screen.

[1953] Automatic generation and checking of documents

[1954] User:

[1955] Next, the user enters the basic information and outline of the presentation materials into the terminal and clicks the send button. This information is sent to the server.

[1956] server:

[1957] The server receives basic information sent by the user and automatically generates materials using an AI model. The automatically generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. The emotion engine considers the impact of the check results on the user's emotions and generates appropriate feedback. This material and feedback are sent to the terminal.

[1958] Presentation practice and feedback

[1959] User:

[1960] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[1961] Terminal:

[1962] The device converts the recorded speech into text data and sends it to the server.

[1963] server:

[1964] The server analyzes the received text data and evaluates its consistency with the document. This evaluation also reflects the user's emotions. For example, if the user is feeling anxious, positive feedback is prioritized. The evaluation results, along with points of confusion, improvement suggestions, and anticipated questions (FAQs), are generated and sent to the terminal.

[1965] Follow-up during the actual presentation

[1966] Terminal:

[1967] During the presentation, the device monitors the user's progress in real time and checks the time allocation. The emotion engine recognizes the user's emotions and displays reminders and advice accordingly. For example, if the user is nervous, a message to help them relax will be displayed.

[1968] User:

[1969] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[1970] server:

[1971] The server analyzes the received question and uses an emotion engine to generate hints and guidelines for answers that are appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[1972] Terminal:

[1973] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[1974] For example, if a user is giving a presentation on the topic of "the advantages of cloud services," this system allows the emotion engine to recognize the user's tension and provide prompts and avatars to help them relax. Furthermore, appropriate support tailored to the user's emotions is provided during both practice and the actual presentation, improving the quality of the presentation and increasing its success rate.

[1975] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotions, and effectively assists throughout the entire process from presentation preparation to the actual presentation.

[1976] The following describes the processing flow.

[1977] Step 1:

[1978] The user accesses the terminal interface and enters presentation settings information. This information includes the audience, purpose, presentation time, audience knowledge level, and industry. Once the information is entered, the user clicks the submit button to send the settings information to the server.

[1979] Step 2:

[1980] The server receives presentation settings information sent by the user and stores it in an internal database. Next, it activates the emotion engine and analyzes the user's emotional state. Using this analysis, the prompt generation system generates the most appropriate prompts according to the presentation content. If the user is nervous, it generates prompts to help them relax. The prompts are then sent to the terminal.

[1981] Step 3:

[1982] The terminal analyzes prompts received from the server and generates an avatar designed to help the user relax. For example, it might generate an avatar with a gentle expression or one performing relaxed movements. The generated avatar is displayed on the user's screen for the user to see.

[1983] Step 4:

[1984] The user inputs the basic information and outline necessary for creating the presentation materials into the terminal. For example, they might input "Advantages of Cloud Services" or "Features of the New Product" and click the submit button. The input data is then sent to the server.

[1985] Step 5:

[1986] The server receives basic information sent by the user and automatically generates presentation materials using an AI model. The generated materials are automatically checked for design consistency, appropriateness of expression, and copyright infringement. An emotion engine evaluates the impact of the check results on the user's emotions and generates appropriate feedback. These materials and feedback are sent to the device.

[1987] Step 6:

[1988] The terminal displays the materials and feedback received from the server to the user. The user reviews the materials and makes corrections based on the feedback as needed. If corrections are required, the user resends them to the server.

[1989] Step 7:

[1990] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[1991] Step 8:

[1992] The device converts the recorded speech into text data and sends that text data to the server.

[1993] Step 9:

[1994] The server analyzes the received text data and evaluates its consistency with the document. It also assesses the user's emotional state and generates feedback on the clarity of the speech and any omissions or missing important points. The evaluation results, feedback, and anticipated questions (FAQs) are sent to the terminal.

[1995] Step 10:

[1996] The terminal displays feedback received from the server and FAQs to the user. The user can then revise the materials accordingly and practice again.

[1997] Step 11:

[1998] The user prepares for their presentation. During the presentation, the device monitors the progress and time allocation of the presentation in real time. The emotion engine analyzes the user's emotional state in real time and displays reminders and advice. For example, a message such as "Please take a deep breath" might be displayed.

[1999] Step 12:

[2000] If a user receives a question during live operation, the user enters the question into their terminal and sends it to the server.

[2001] Step 13:

[2002] The server analyzes the received question and processes it to understand its intent. The emotion engine generates response guidelines and hints appropriate to the user's emotional state. These generated hints are then sent to the terminal.

[2003] Step 14:

[2004] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[2005] Through the above process, users receive comprehensive support and can deliver high-quality presentations. This system allows users to approach presentations with confidence and receive appropriate answers to questions through real-time support.

[2006] (Example 2)

[2007] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2008] Traditional presentation support systems often provided simplistic advice without considering the user's emotions. As a result, they failed to adequately alleviate the tension and anxiety users felt during presentations, making it difficult to improve the quality and success rate of presentations. Furthermore, even in presentation practice and automated material generation, there was a lack of feedback and advice tailored to the individual user's emotional state.

[2009] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for the user to input presentation setting information, an emotion analysis means for analyzing the user's emotions in real time based on the input setting information, a prompt generation means for generating prompts based on the analyzed emotion information, an avatar generation means for generating an avatar based on the generated prompts, a material generation means for automatically generating presentation materials, a material checking means for checking the automatically generated presentation materials from the viewpoints of design consistency, appropriateness of expression, and copyright infringement, a practice recording means for the user to practice the presentation and record the content of their remarks, a feedback means for evaluating the consistency between the recorded remarks and the materials and providing feedback, and a follow-up means for monitoring the user's progress and emotions in real time during the actual presentation and providing support. This makes it possible to alleviate the user's tension and anxiety while providing consistent support from the creation of high-quality presentation materials to support during the actual presentation.

[2010] An "input method" is an interface for users to input presentation settings information.

[2011] "Emotion analysis means" refers to an engine or system for analyzing a user's emotions in real time based on input configuration information.

[2012] The "prompt generation means" is a function for generating appropriate prompts based on emotional information obtained by the emotion analysis means.

[2013] An "avatar generation method" is a system for generating the facial expressions and movements of an avatar based on the generated prompts.

[2014] The "material generation method" is a function that automatically generates presentation materials based on the basic information of the presentation materials entered by the user.

[2015] A "document checking method" refers to a system or function that checks generated presentation materials from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

[2016] The "practice recording function" is a feature that allows users to record and save their speech when practicing a presentation.

[2017] A "feedback mechanism" is a system or function for evaluating the consistency between recorded statements and materials and providing appropriate feedback.

[2018] "Follow-up features" are functions that monitor the user's progress and emotions in real time during the presentation and provide support as needed.

[2019] This invention is a support system for users to give presentations efficiently and effectively, and it provides detailed support tailored to individual needs by using an emotion engine that analyzes the user's emotions in real time. This system mainly operates through the cooperation of three parties: a server, a terminal, and the user.

[2020] Entering presentation settings information

[2021] User:

[2022] The user enters presentation settings information using the device's interface (e.g., a web browser or dedicated application). This information includes the audience's name, company, purpose, presentation time, audience's knowledge level, and industry. After entering the information, the user clicks a submit button to send the information from the device to the server.

[2023] Hardware and software used:

[2024] Devices: PC, tablet, smartphone

[2025] Software: Web browser, dedicated application, HTML form, JavaScript

[2026] Sentiment analysis and prompt generation

[2027] server:

[2028] The server receives configuration information sent by the user and uses this information to analyze the user's emotions in real time using an emotion engine (e.g., Python's Emotion API or an open-source emotion analysis library). Based on the analysis results, the prompt generation means generates the optimal prompt using a generative AI model (e.g., OpenAI's GPT-4). For example, if the user is feeling anxious, a prompt to help them relax will be generated. This prompt is then sent to the terminal.

[2029] Hardware and software used:

[2030] Servers: Cloud servers, physical servers

[2031] Software: Python, Emotion API, open-source analysis library, GPT-4

[2032] Examples of prompt statements:

[2033] "Please speak calmly without being nervous. Take a slow, deep breath."

[2034] "On the next slide, highlight the points that will capture the audience's interest."

[2035] Avatar generation

[2036] Terminal:

[2037] The device generates an avatar based on prompts received from the server. The avatar's facial expressions and movements are adjusted based on the output of the emotion engine. For example, if the user is tense, an avatar with a relaxed expression will be generated. The generated avatar is then displayed in 3D on the user's screen.

[2038] Hardware and software used:

[2039] Devices: PC, tablet, smartphone

[2040] Software: JavaScript libraries (e.g., Three.js), WebGL

[2041] Automatic document generation and checking

[2042] User:

[2043] The user enters basic information and outlines of the presentation materials into the terminal and clicks the submit button. This information is sent to the server.

[2044] server:

[2045] The server receives and analyzes basic information sent by the user and automatically generates materials using an AI model (e.g., OpenAI's DALLE 2 or GPT-4). The generated materials are checked for design consistency, appropriateness of expression, and copyright infringement. Based on the check results, the sentiment engine generates appropriate feedback, and this material and feedback are sent to the terminal.

[2046] Hardware and software used:

[2047] Servers: Cloud servers, physical servers

[2048] Software: Python, DALLE 2, GPT-4, Google Cloud Vision API

[2049] Presentation practice and feedback

[2050] User:

[2051] The user starts presentation practice mode on the device's interface and practices using the generated materials. The device records what the user says during practice.

[2052] Terminal:

[2053] The device converts the recorded audio into text data and sends it to the server.

[2054] server:

[2055] The server analyzes the received text data and evaluates its consistency with the presentation materials. The evaluation results also reflect the user's emotions, with positive feedback given priority. Along with the evaluation results, points of confusion, improvement suggestions, and FAQs (expected questions) are generated and sent to the terminal.

[2056] Hardware and software used:

[2057] Devices: PC, tablet, smartphone

[2058] Software: Speech recognition APIs (e.g., Google Speech-to-Text API, Amazon Transcribe)

[2059] Follow-up during the actual presentation

[2060] Terminal:

[2061] During the presentation, the device monitors the user's progress in real time, and the emotion engine recognizes the user's emotions. Reminders and advice are displayed according to the user's state. For example, messages to help the user relax are provided.

[2062] User:

[2063] If a question comes in during the presentation, the content is entered into the terminal and sent to the server.

[2064] server:

[2065] The server analyzes the received question and uses an emotion engine to generate answer hints and guidelines appropriate to the user's emotional state. The generated hints are then sent to the terminal.

[2066] Terminal:

[2067] The terminal displays answer hints from the server to the user, supporting the user in appropriately responding to the questions.

[2068] Hardware and software used:

[2069] Devices: PC, tablet, smartphone

[2070] Software: JavaScript time tracking function, real-time WebSocket communication

[2071] Thus, the "AI Presentation Master" system of the present invention provides comprehensive support, including the user's emotional state, and effectively assists the user from presentation preparation to the actual presentation.

[2072] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2073] Step 1: Enter presentation settings information

[2074] User:

[2075] The user enters presentation settings information using the terminal interface. For example, they might enter the audience's name, organization, presentation purpose, presentation time, audience knowledge level, and industry. To do this, the user fills in the information in a form and clicks the submit button. The entered information is sent to the server using the JavaScript fetch API.

[2076] Inputs and outputs:

[2077] Input: Presentation setup information (audience, purpose, presentation time, audience knowledge level, industry, etc.)

[2078] Output: Configuration information is sent to the server.

[2079] Specific actions:

[2080] The user enters information using an HTML form and clicks the submit button.

[2081] The configuration information is sent to the server as a POST request using the JavaScript fetch API.

[2082] Step 2: Emotion Analysis

[2083] server:

[2084] The server receives configuration information sent by the user and performs sentiment analysis. This sentiment analysis utilizes ...

Claims

1. An input method for the user to enter presentation settings information, A prompt generation means that generates a prompt based on the input configuration information, An avatar generation means that generates an avatar based on a generated prompt, A document generation method that automatically generates presentation materials, A document checking method for automatically generated presentation materials, A practice recording method for users to practice presentations and record what they say, A feedback mechanism that evaluates the consistency between recorded statements and documents and provides feedback, Follow-up methods to support users during the actual presentation, A system that includes this.

2. The system according to claim 1, wherein the avatar generation means includes means for selecting from a plurality of avatars corresponding to the audience of the presentation.

3. The system according to claim 1, wherein the document checking means includes means for automatically checking documents from the perspectives of design consistency, appropriateness of expression, and copyright infringement.

Images