System

Abstract

To provide a system.SOLUTION: A system includes: first means for a user to input presentation contents; second means for generating a first prompt sentence for outputting feedback and advice to the presentation contents on the basis of the presentation contents; third means for inputting the generated first prompt sentence into a generative AI model to generate feedback and advice to the presentation contents; and fourth means for transmitting the generated feedback and advice to the presentation contents to a terminal of the user.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] The course aims to provide specific feedback and advice to improve the quality of presentations, help improve language expression and storytelling, and provide techniques to help you speak with confidence. [Means for solving the problem]

[0005] To solve this problem, we provide a system that supports the content of users' presentations and provides specific feedback and advice. This system helps improve linguistic expression and storytelling, and provides techniques to help users speak with confidence. Furthermore, it improves the quality of the presentation itself and enhances its ability to captivate the audience. [Brief description of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Diagram 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. FIG. [Diagram 3] FIG. 11 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Diagram 5] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 13 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a process flow of the data processing system in the first embodiment of the first form example. [Figure 12] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the application example 1 of the first embodiment. [Figure 13] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the second embodiment of the second embodiment. [Figure 14] FIG. 13 is a sequence diagram showing a process flow of the data processing system in application example 2 of embodiment 2. [Figure 15] FIG. 13 is a sequence diagram showing a process flow of a data processing system in a third embodiment of the present invention. [Figure 16]FIG. 13 is a sequence diagram showing a process flow of the data processing system in the third application example of the third embodiment. [Figure 17] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when combined with an emotion engine. [Figure 19] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system according to the embodiment 2 of the second embodiment in the case where an emotion engine is combined. [Figure 20] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when combined with an emotion engine. [Figure 21] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the embodiment 3 of the form example 3 in the case where an emotion engine is combined. [Figure 22] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when combined with an emotion engine. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of main functions of the data processing device 12 and the smart device 14.

[0023] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] In one embodiment of the present invention, a user inputs the contents of a presentation into the system. The system generates and provides specific feedback and advice to the user based on the input contents. The feedback and advice include support for presentation skills such as improving language expression and storytelling, and techniques for speaking with confidence.

[0029] "Example 2"

[0030] As a concrete example, if a user makes a presentation on global warming, the system will provide specific feedback and advice on the content of the presentation, such as "To make the flow of your presentation clearer, first explain the impact of global warming from a broad perspective, and then provide specific examples."

[0031] "Example 3"

[0032] In addition, the system also provides assistance in improving the quality of the presentation itself. For example, if a user asks, "How do I create slides that are visually appealing?" the system will provide advice such as, "To convey information visually, slides should have large headings and a few key points, and should use simple charts rather than complex graphs."

[0033] The process flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: The user enters the presentation content into the system.

[0036] Step 2: The system generates specific feedback and advice based on what you input.

[0037] Step 3: Provide the generated feedback and advice to the user.

[0038] "Example 2"

[0039] Step 1: The user enters “Presentation on Global Warming” into the system.

[0040] Step 2: The system generates specific feedback and advice based on the input, such as "To make the flow of your story clearer, first explain the impact of global warming from a broad perspective, and then provide specific examples."

[0041] Step 3: Provide the generated feedback and advice to the user.

[0042] "Example 3"

[0043] Step 1: The user asks a question about "how to create a visually appealing slide." Step 2: The system generates specific feedback and advice based on the question. For example, the system provides advice such as "To convey information visually, slides should have large headings and a few key points, and should use simple charts rather than complex graphs."

[0044] Step 3: Provide the generated feedback and advice to the user.

[0045] Example 1

[0046] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0047] Conventional presentation support systems have the problem that it is difficult for users to get specific feedback or advice even when they input the content of their presentation. In addition, there is a lack of means to improve linguistic expression and storytelling, or provide techniques for speaking with confidence, making it difficult to improve the quality of presentations. Furthermore, there is a lack of specific support to improve the ability to captivate the audience.

[0048] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0049] In this invention, the server includes a means for inputting the contents of a presentation by a user, a means for transmitting the input contents of the presentation to the server, a means for the server to receive the input contents and store them as text data, a means for passing the stored text data to the generative AI model, a means for the generative AI model to generate feedback and advice, a means for the server to receive the generated feedback and advice, a means for the server to transmit the feedback and advice to the terminal, a means for the terminal to display the feedback and advice to the user, a means for supporting the improvement of language expression and storytelling, a means for providing techniques for speaking with confidence, and a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience. This allows the user to obtain specific feedback and advice, making it possible to improve the quality of the presentation.

[0050] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[0051] "Presentation content" refers to text data and information that a user inputs for a presentation.

[0052] A "server" is a computer system that receives, stores, and passes on announcements sent by users to the generative AI model.

[0053] A "terminal" is a device on which a user inputs the contents of a presentation and displays feedback and advice sent from the server.

[0054] A "generative AI model" is an artificial intelligence model that analyzes the input presentation content and generates specific feedback and advice.

[0055] "Feedback" refers to specific improvements or advice that the generative AI model generates based on what is presented.

[0056] "Advice" is specific suggestions or guidance for improving the user's presentation.

[0057] "Linguistic expression" refers to the choice of words and phrases that users use to communicate their presentation.

[0058] "Storytelling" is a method of structuring and developing a story that allows users to effectively communicate the content of their presentation.

[0059] "Speech techniques" are specific ways of speaking and expressing oneself that allow users to make presentations with confidence.

[0060] "Presentation quality" is a measure of how effectively a user communicates their presentation to the audience.

[0061] "Audience captivation" refers to the ability of a user's presentation to capture the audience's attention and interest.

[0062] An "interactive program" is software that interacts with a user to provide information, feedback, or advice.

[0063] This invention is a system in which a user inputs the contents of a presentation and receives specific feedback and advice based on the contents. The system aims to improve the quality of presentations and increase the ability to captivate an audience by supporting the contents of the user's presentation and providing techniques to improve linguistic expression and storytelling and to give speeches with confidence.

[0064] Hardware and Software Used

[0065] The system uses the following hardware and software:

[0066] Terminal: A device on which a user enters presentation content and receives feedback and advice. Examples include personal computers and smartphones.

[0067] Server: A computer system that receives, stores, and passes user-submitted announcements to the generative AI model.

[0068] Generative AI model: An artificial intelligence model that analyzes input presentation content and generates specific feedback and advice. An example is GPT-4 (registered trademark).

[0069] Data processing and calculation

[0070] When a user uses a terminal to input presentation content, the content is sent to the server. The server receives the input content and saves it as text data. The saved text data is passed to the generative AI model. The generative AI model analyzes the input text and generates feedback and advice. The generated feedback and advice is sent back to the terminal via the server and displayed to the user.

[0071] Examples

[0072] For example, if a user enters the following presentation content:

[0073] "My presentation will be about the importance of protecting the environment. Specifically, I will talk about ways to reduce plastic waste and ideas for reusing it."

[0074] Once this is entered into the system, the server passes the text to a generative AI model that generates feedback and advice like this:

[0075] "Your presentation covers a very important topic. It would be even more effective if you improved it in the following ways:

[0076] 1. In your introduction, it would be a good idea to add some concrete data or statistics that highlight the importance of protecting the environment.

[0077] 2. When talking about ways to reduce plastic waste, sharing real-life success stories can help capture your audience’s attention.

[0078] 3. Using visual aids (e.g. slides, pictures) when explaining reuse ideas helps improve understanding.”

[0079] Example of a prompt to be input to a generative AI model:

[0080] "Please generate specific feedback and advice based on the presentation below:

[0081] "My presentation will be about the importance of environmental protection. Specifically, I will talk about ways to reduce plastic waste and ideas for reusing it."

[0082] In this way, users receive specific feedback and advice to improve the quality of their presentations.

[0083] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0084] Step 1:

[0085] The user inputs the presentation content.

[0086] The user inputs the contents of the presentation into an input form on the terminal. This input form includes fields for the title, main text, supplementary information, etc. The input data is saved in the terminal in text format.

[0087] Step 2:

[0088] The terminal sends the input information to the server.

[0089] The device sends the presentation content entered by the user to the server using an HTTP POST request, including metadata such as the user ID and a timestamp.

[0090] Step 3:

[0091] The server receives the input and stores it as text data.

[0092] The server receives the data sent from the terminal and stores it in the database as text data. When storing it, metadata such as the user ID and timestamp are also recorded. The input is the HTTP POST request data, and the output is the text data stored in the database.

[0093] Step 4:

[0094] The server passes the stored text data to the generative AI model.

[0095] The server converts the stored text data into an appropriate format to be passed to the generative AI model. The converted data is input to the generative AI model. The input is the text data obtained from the database, and the output is the data passed to the generative AI model.

[0096] Step 5:

[0097] Generative AI models generate feedback and advice.

[0098] A generative AI model (e.g., GPT-4) analyzes the text data passed to it and generates feedback and advice. The generated content includes improvements to linguistic expression, strengthening storytelling, and techniques for speaking with confidence. The input is the text data passed to the generative AI model, and the output is the generated feedback and advice.

[0099] Step 6:

[0100] The server receives the generated feedback and advice.

[0101] The server receives the feedback and advice returned by the generative AI model. This data is returned to the server again in text format. The input is the feedback and advice returned by the generative AI model, and the output is the feedback and advice stored on the server.

[0102] Step 7:

[0103] The server sends feedback and advice to the device.

[0104] The server sends the received feedback and advice to the terminal using HTTP responses. The input is the feedback and advice stored on the server, and the output is the feedback and advice sent to the terminal.

[0105] Step 8:

[0106] The device displays feedback and advice to the user.

[0107] The terminal displays the feedback and advice received from the server to the user. The user can check the displayed content and use it to improve the presentation. The input is the feedback and advice received from the server, and the output is the feedback and advice displayed to the user.

[0108] (Application example 1)

[0109] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0110] Conventional presentation support systems only provide limited functionality for providing specific feedback and advice when users input the content of their presentation, making it difficult for them to provide effective support, particularly when store staff are explaining products or introducing services. In addition, the lack of automated generation of feedback using generative AI models or effective advice using prompts makes it difficult to improve the quality of presentations or their ability to captivate the audience.

[0111] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0112] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for inputting the content of a presentation when a staff member of a physical store is explaining a product or introducing a service, and for the system to provide specific feedback and advice based on the content, means for generating feedback and advice using a generative AI model, means for generating prompt sentences and inputting them into the generative AI model, and means for displaying the generated feedback and advice to a user. This enables staff members of a physical store to give more effective presentations when explaining a product or introducing a service.

[0113] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[0114] "Presentation content" refers to the information and materials that a user uses during a presentation.

[0115] "Feedback" refers to specific evaluations and suggestions for improvement provided to users regarding their submissions.

[0116] "Advice" is specific suggestions or guidance to help users improve their presentations.

[0117] "Linguistic expressions" are the words and phrases that users use in their presentations.

[0118] "Storytelling" refers to the structure and development of a story that users use in their presentations.

[0119] "Techniques" are specific methods and techniques that help users deliver speeches with confidence.

[0120] "Quality" refers to the overall execution or effectiveness of the presentation.

[0121] The "audience" is the people who listen to the presentation.

[0122] A "brick and mortar store" means a sales or service establishment that is located in a physical location.

[0123] "Staff" refers to employees working in physical stores.

[0124] A "product description" is an explanation of a product's features and benefits given to customers by store staff.

[0125] "Service introduction" refers to an explanation of the services offered by store staff to customers.

[0126] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate feedback or advice based on user input.

[0127] A "prompt" is an instruction or question that is input into a generative AI model.

[0128] A system for implementing the present invention allows a user to input the contents of a presentation and provides specific feedback and advice based on the contents. The system is realized using the following hardware and software.

[0129] Hardware

[0130] Smartphone: A device that allows users to enter presentation content and receive feedback and advice.

[0131] software

[0132] Python (registered trademark): A programming language used to implement programs.

[0133] OpenAI (registered trademark) API: An API for generating feedback and advice using generative AI models.

[0134] Data processing and calculation

[0135] 1. User input: The user inputs the presentation content using their smartphone.

[0136] 2. Prompt generation: The server generates a prompt based on the presentation content entered by the user.

[0137] 3. Use of generative AI model: The server sends the generated prompt text to the OpenAI API and uses the generative AI model to generate feedback and advice.

[0138] 4. Displaying feedback: The server displays the generated feedback and advice on the smartphone.

[0139] Examples

[0140] If a user enters a presentation of their new smartphone, the following feedback is generated:

[0141] Presentation content entered:

[0142] "This new smartphone is equipped with the latest camera technology, allowing you to take clear photos even at night. Plus, it has a long battery life, so you can use it all day without having to worry about charging."

[0143] Generated feedback and advice:

[0144] "This presentation is very informative, but it would be even more effective if you added some more concrete examples. For example, you could show a specific situation where you took a photo at night, or show a specific amount of time to highlight the long battery life. You could also use questions to get the customer's attention."

[0145] Example prompt:

[0146] "Please provide your feedback and suggestions on the presentation below:\n\nThis new smartphone is equipped with the latest camera technology, allowing you to take clear photos even at night. In addition, it has a long battery life, so you can use it all day without worrying about charging.\n\nFeedback and Suggestions:"

[0147] In this way, store staff can give more effective presentations when explaining products and introducing services.

[0148] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0149] Step 1:

[0150] A user inputs the contents of a presentation using a smartphone. The input contents are saved on the smartphone as text data.

[0151] Step 2:

[0152] The terminal transmits the input presentation content to the server, which receives the text data and prepares it for generating a prompt sentence.

[0153] Step 3:

[0154] The server generates a prompt based on the received presentation content. Specifically, the server inserts the presentation content into a prompt template and converts it into a format suitable for the generative AI model. For example, the format is "Please provide feedback and advice on the following presentation content:\n\n[Presentation content]\n\nFeedback and advice:".

[0155] Step 4:

[0156] The server sends the generated prompt text to the OpenAI API. The API request includes parameters such as the prompt text, the AI ​​model used to generate the prompt text, and the token count limit.

[0157] Step 5:

[0158] The OpenAI API uses a generative AI model to generate feedback and advice based on the prompt text, which is then returned to the server as an API response.

[0159] Step 6:

[0160] The server receives the API response and extracts the generated feedback and advice, which is in text format and prepared for display to the user.

[0161] Step 7:

[0162] The server then sends the extracted feedback and advice to the smartphone, which receives the data and displays it to the user.

[0163] Step 8:

[0164] The user can check the generated feedback and advice on the screen of their smartphone, which allows them to obtain specific advice and improve their presentation content.

[0165] Example 2

[0166] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0167] Conventional presentation support systems do not provide users with sufficient concrete feedback or advice on the content of their presentations, making it difficult to improve the quality of their presentations or their ability to captivate the audience. In addition, there was a lack of methods to help users speak with confidence, or to help them improve their language expression and storytelling.

[0168] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for supporting the content of the user's presentation and providing specific feedback and advice, a means for analyzing the content of the user's presentation using natural language processing technology, a means for generating feedback based on the analysis result using a generative AI model, a means for providing the generated feedback to the user, and a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience. This allows the user to receive specific and automatically generated feedback and improve the quality of the presentation.

[0169] "User" means an individual or organization that uses the system to give a presentation.

[0170] "Presentation content" is text data that includes the information or message that the user wants to convey in the presentation.

[0171] "Feedback" refers to specific improvements or advice provided to users regarding their submissions.

[0172] "Advice" is a specific suggestion or instruction to help the user improve their presentation.

[0173] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.

[0174] A "generative AI model" is a model that uses artificial intelligence to analyze the content of users' presentations and generate feedback.

[0175] "Analysis results" are the information obtained after the generative AI model analyzes the content of a user's presentation.

[0176] A "conversational agent" is software that interacts with users and provides feedback and advice.

[0177] "Presentation quality" is a comprehensive assessment of the clarity, persuasiveness, and impact of the user's presentation on the audience.

[0178] The "audience" is the people who will be listening to the user's presentation.

[0179] The present invention is a system for providing specific feedback and advice to a user when he or she is giving a presentation. A specific embodiment of this system will be described below.

[0180] System Configuration

[0181] This system mainly consists of three elements: a server, a terminal, and a user. The server is responsible for analyzing the content of the user's presentation using a generative AI model and generating feedback. The terminal is a device through which the user inputs the content of the presentation and receives feedback. The user is the individual or group that gives the presentation.

[0182] Hardware and Software Used

[0183] Server: A computer system with high-performance computing power that serves as a platform for running generative AI models.

[0184] Generative AI models: For example, use models with advanced natural language processing techniques, such as OpenAI's GPT-4.

[0185] Device: The device used by the user, such as a computer, tablet, or smartphone.

[0186] Data processing and calculation

[0187] 1. Data Entry:

[0188] The user enters the presentation content into the device's text input field, for example:

[0189] "I will be giving a presentation on global warming. Here is the content:

[0190] 1. Definition of Global Warming

[0191] 2. Its Impact

[0192] 3. Specific Examples

[0193] 4. Countermeasures

[0194] 2. Data reception:

[0195] The data sent from the device reaches the server's API endpoint. The server receives the data and temporarily stores it in a database.

[0196] 3. Data Analysis:

[0197] The server passes the stored data to the generative AI model, which runs on the cloud and analyzes the text data. The analysis uses natural language processing techniques to evaluate the structure, grammar, and consistency of the text.

[0198] 4. Feedback Generation:

[0199] The server generates specific feedback and advice for the user based on the analysis results obtained from the generative AI model. For example, it generates the following feedback:

[0200] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[0201] 5. Providing feedback:

[0202] The server transmits the generated feedback to the user's terminal, where the user can view the feedback on the terminal screen.

[0203] Examples

[0204] If a user wants to give a presentation on global warming, they can input the following prompt into the generative AI model:

[0205] Example prompt:

[0206] "I will be giving a presentation on global warming. Below is the content. I would appreciate your feedback and suggestions.

[0207] 1. Definition of Global Warming

[0208] 2. Its Impact

[0209] 3. Specific Examples

[0210] 4. Countermeasures

[0211] The server receives this prompt, analyzes it using a generative AI model, and provides feedback like this:

[0212] Feedback example:

[0213] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[0214] In this way, users receive specific feedback and can improve the quality of their presentations.

[0215] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0216] Step 1:

[0217] The user inputs the presentation content.

[0218] The user inputs the contents of the presentation into the text input field of the terminal and clicks the "Send" button. The input data is text data that contains the information or message that the user wants to convey in the presentation. For example, the following contents are input:

[0219] "I will be giving a presentation on global warming. Here is the content:

[0220] 1. Definition of Global Warming

[0221] 2. Its Impact

[0222] 3. Specific Examples

[0223] 4. Countermeasures

[0224] Input: Text data of the presentation content entered by the user

[0225] Output: Data sent from the device to the server

[0226] Step 2:

[0227] The server receives the input data.

[0228] The data sent from the terminal reaches the server's API endpoint. The server receives this data and temporarily stores it in a database. The received data is text data of the presentation content entered by the user.

[0229] Input: Text data of the presentation content sent from the terminal

[0230] Output: Text data stored on the server

[0231] Step 3:

[0232] The server analyzes the data using a generative AI model.

[0233] The server passes the stored data to the generative AI model, which runs on the cloud and analyzes the text data. The analysis uses natural language processing techniques to evaluate the structure, grammar, and consistency of the text.

[0234] Input: Text data of the presentation content stored on the server

[0235] Output: Analysis results from generative AI models

[0236] Step 4:

[0237] The server generates the feedback.

[0238] The server generates specific feedback and advice for the user based on the analysis results obtained from the generative AI model. The generated feedback includes specific suggestions and instructions for the user to improve their presentation. For example, the server generates the following feedback:

[0239] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[0240] Input: Analysis results by generative AI model

[0241] Output: The generated feedback

[0242] Step 5:

[0243] The server provides feedback to the user.

[0244] The server transmits the generated feedback to the user's terminal, where the user can view the feedback on the terminal's screen. The provided feedback includes specific suggestions and instructions for the user to improve the presentation.

[0245] Input: Generated feedback

[0246] Output: Feedback displayed on the user's device

[0247] (Application example 2)

[0248] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0249] Conventional presentation support systems have difficulty providing specific feedback and advice to help users effectively communicate their presentation content. In addition, staff who explain products in physical stores lack the means to receive appropriate feedback in real time, which results in inconsistent quality of explanations to customers.

[0250] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience, a means for providing feedback and advice in real time when the user is explaining a product, a means for generating feedback based on the content of the user's presentation using a generative AI model, and a means for displaying feedback through smart glasses. This allows the user to receive appropriate feedback in real time, making it possible to improve the quality of presentations and product explanations.

[0251] "User" means an individual or organization that uses the system to make presentations and provide product information.

[0252] "Presentation content" refers to the information or message that the user wishes to convey in a presentation or product description.

[0253] "Feedback" refers to evaluation and advice for improvement provided to users regarding their submissions.

[0254] "Advice" is a specific suggestion or instruction to help a user improve their post.

[0255] "Linguistic expression" refers to the choice of words and phrases that users use to communicate their presentation.

[0256] "Storytelling" is a method of structuring and developing a story that allows users to effectively communicate the content of their presentation.

[0257] "Techniques" are techniques and methods that help users deliver speeches with confidence.

[0258] "Presentation quality" is a measure of how effectively a user communicates their presentation to the audience.

[0259] The "audience" is the people listening to user presentations and product explanations.

[0260] "Real-time" refers to feedback and advice being provided to users at the exact moment they are making their post.

[0261] A "generative AI model" is an artificial intelligence model that automatically generates feedback and advice based on what a user submits.

[0262] "Smart glasses" are wearable devices that can be worn by a user and display visual information.

[0263] A system for carrying out the present invention provides feedback and advice in real time to a user when making a presentation or explaining a product. The system includes means for supporting the content of a presentation by a user and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for providing feedback and advice in real time to a user when explaining a product, means for generating feedback based on the content of the presentation by the user using a generative AI model, and means for displaying the feedback through smart glasses.

[0264] The server uses the generative AI model to generate feedback based on the user's speech. Specifically, when a user wears the smart glasses and explains a product to a customer, the speech is converted into text using voice recognition software. The text is sent to the server, which uses the generative AI model to generate feedback and advice. This feedback is displayed in real time on the smart glasses' display.

[0265] The hardware used includes smart glasses (e.g., Google® Glass®) and voice recognition software. The software used includes OpenAI's GPT-3® API, which allows users to receive appropriate feedback in real time, improving the quality of their presentations and product explanations.

[0266] As a concrete example, consider a case where a user puts on smart glasses and explains a new smartphone to a customer. The explanation is, "This smartphone is equipped with the latest processor and is very fast. It also has an excellent camera function, so you can take clear photos even at night." This explanation is converted to text by speech recognition software and sent to the server. The server sends the following prompt sentence to the generative AI model.

[0267] Example prompt:

[0268] Here's how a user describes the product: Please provide feedback and advice.

[0269] This smartphone is equipped with the latest processor, making it extremely fast, and it also has a great camera that can take clear photos even at night.

[0270] advice:

[0271] The generative AI model will generate feedback based on the prompt text, which will then be displayed on the smart glasses display, allowing users to receive appropriate feedback in real time and improve the quality of their explanations to customers.

[0272] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0273] Step 1:

[0274] A user puts on the smart glasses and starts to explain the product. The user's voice is collected through the microphone of the smart glasses. The input is the user's voice data, and the output is the voice data sent to the voice recognition software.

[0275] Step 2:

[0276] The smart glasses have speech recognition software that converts the user's speech into text data. The input is speech data, and the output is text data. This text data represents the content of the user's speech.

[0277] Step 3:

[0278] The smart glasses send the converted text data to the server. The input is the text data and the output is the text data sent to the server.

[0279] Step 4:

[0280] Based on the text data received by the server, a prompt is sent to the generative AI model. The input is text data containing the user's announcement, and the output is the prompt sent to the generative AI model. An example of a specific prompt is as follows:

[0281] Here's how a user describes the product: Please provide feedback and advice.

[0282] This smartphone is equipped with the latest processor, making it extremely fast, and it also has a great camera that can take clear photos even at night.

[0283] advice:

[0284] Step 5:

[0285] The generative AI model generates feedback and advice based on the prompt sentence. The input is the prompt sentence, and the output is text data containing the feedback and advice.

[0286] Step 6:

[0287] The server transmits the generated feedback or advice to the smart glasses. The input is text data containing the feedback or advice, and the output is text data transmitted to the smart glasses.

[0288] Step 7:

[0289] The smart glasses display the received feedback and advice to the user. The input is text data containing the feedback and advice, and the output is the feedback and advice displayed on the display of the smart glasses. This allows the user to receive appropriate feedback in real time.

[0290] Example 3

[0291] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0292] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on their presentation content, and are insufficient in providing techniques for improving language expression and storytelling, or for speaking with confidence. They also lack specific support for improving the quality of the presentation itself and increasing the ability to captivate the audience. Furthermore, they lack the ability to generate and display appropriate answers to questions entered by the user.

[0293] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, a means for analyzing a question input by the user and generating an answer using a generative AI model, and a means for displaying the generated answer to the user. This allows the user to receive specific feedback and advice, improves the quality of the presentation, and allows the user to obtain an appropriate answer to the user's question.

[0294] "User" means an individual or organization that uses the system to receive presentation support.

[0295] "Presentation content" is a general term for the information and messages that a user wishes to convey in a presentation.

[0296] "Feedback" is specific evaluation and suggestions for improvement provided to users regarding their presentations.

[0297] "Advice" refers to specific advice or guidance given to users regarding the content of their presentation or presentation techniques.

[0298] "Linguistic expression" refers to the choice and use of words and phrases that a user uses in a presentation.

[0299] "Storytelling" is a method of structuring and developing a narrative that allows users to effectively convey information in a presentation.

[0300] A "speech" is an oral announcement or explanation given by a User in a presentation.

[0301] "Techniques" are specific methods and skills that help users deliver speeches with confidence.

[0302] "Presentation quality" is an indicator of how good a user's presentation is visually and content-wise.

[0303] "Audience" refers collectively to those who will be listening to the user's presentation.

[0304] A "generative AI model" is an artificial intelligence model that generates appropriate answers or advice based on user questions or input.

[0305] A "question" is a question or inquiry that a user inputs into the system.

[0306] "Analysis" is the process of understanding the user's question or post and generating appropriate answers or advice.

[0307] An "Answer" is a solution or advice provided by a generative AI model in response to a user's question.

[0308] "Display" refers to providing the generated answer or advice to the user in a visible form.

[0309] This invention is a system that supports users in their presentations, specifically by providing feedback and advice on the content of their presentation, supporting the improvement of linguistic expression and storytelling, and providing techniques for speaking with confidence. It also improves the quality of the presentation itself and supports the ability to captivate the audience.

[0310] Hardware and Software Used

[0311] The system uses the following hardware and software:

[0312] Server: A server with high-performance computing power is required. The server receives questions from users and generates answers using generative AI models.

[0313] Terminal: A device on which a user enters a question and receives a response from the server. Terminals can be computers, tablets, smartphones, etc.

[0314] Generative AI models: For example, using advanced natural language processing models such as GPT-4. Generative AI models are used to generate appropriate answers to user questions.

[0315] Natural Language Processing Libraries: Use natural language processing libraries to parse questions.

[0316] Data processing and calculation

[0317] When the server receives a question from a user, it first analyzes the question. A natural language processing library is used for the analysis to understand the intent of the question. The analysis results are then input into a generative AI model to generate an appropriate answer. The generated answer is then sent from the server to the terminal and displayed to the user.

[0318] Examples

[0319] For example, if a user enters the prompt text:

[0320] Example prompt:

[0321] "How do I create visually appealing slides?"

[0322] In response to this prompt, the server would generate the following advice:

[0323] An example of the generated advice:

[0324] "To convey information visually, slides should have large headings and a few key points, and use simple charts rather than complex graphs. It is also effective to use color contrast to highlight important information."

[0325] In this way, the user can receive specific and practical advice. This system enables the user to improve the quality of their presentation and increase their ability to captivate the audience. The flow of the specific process in the third embodiment will be described with reference to FIG. 15.

[0326] Step 1:

[0327] The user inputs a question. The user inputs a question about "how to create visually appealing slides" through the terminal interface. For example, the user inputs "Please tell me how to create visually appealing slides." The input data is in text format.

[0328] Step 2:

[0329] The device sends a question to the server. The device sends the question entered by the user to the server as an HTTP request. The device transmits data over an Internet connection. The input is the user's question text, and the output is an HTTP request to the server.

[0330] Step 3:

[0331] The server analyzes the question. The server analyzes the received HTTP request and extracts the question. The server uses a natural language processing library to analyze the question and understand the user's intent. The input is the text data of the HTTP request, and the output is the analyzed question.

[0332] Step 4:

[0333] The server generates an answer using a generative AI model. The server generates an answer using a generative AI model (e.g. GPT-4) based on the analysis results. The generative AI model refers to an internal database to generate the optimal answer to the question and generates appropriate advice. The input is the analyzed question content, and the output is the generated answer text.

[0334] Step 5:

[0335] The server sends the generated answer to the terminal. The server converts the generated answer to JSON format and sends it to the terminal as an HTTP response. The response includes the generated advice. The input is the generated answer text, and the output is the HTTP response to the terminal.

[0336] Step 6:

[0337] The terminal displays the answer to the user. The terminal analyzes the HTTP response received from the server and extracts the generated advice. The terminal displays the advice on the web page so that the user can confirm it. The user confirms the advice on the screen, such as "To convey information visually, it is better to include large headings and a few key points on slides, and to use simple diagrams rather than complex graphs." The input is the HTTP response data, and the output is the advice displayed to the user.

[0338] (Application example 3)

[0339] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0340] Conventional presentation support systems can provide specific feedback and advice on the content of a user's presentation, but they lack the functionality to support the creation of visually appealing slides. In addition, when store clerks explain products in brick-and-mortar stores, they have no way to quickly create visually appealing slides and display them on smart devices, making it difficult to give effective presentations to customers.

[0341] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience, a means for supporting the creation of visually appealing slides, a means for displaying on a smart device, and a means for generating advice based on a prompt sentence using a generative AI model. This allows the user to quickly create visually appealing slides and give effective presentations even in physical stores.

[0342] "A means of supporting the user's presentation content and providing specific feedback and advice" is a function that provides the user with suggestions for improving the content and specific advice for their presentation or speech.

[0343] "Means to help improve language expression and storytelling" are functions that help users to use language and structure stories more effectively.

[0344] "Means of providing techniques for speaking with confidence" is a function that provides techniques and methods for users to give speeches with confidence.

[0345] "Means of improving the quality of the presentation itself and increasing its ability to captivate the audience" refers to functions that improve the overall quality of a presentation and help capture the audience's attention.

[0346] "Means to assist in the creation of visually appealing slides" is a function that assists users in creating visually appealing slides.

[0347] "Means for displaying on a smart device" refers to a function for displaying the created slides and advice on a device such as smart glasses or a smartphone.

[0348] A "means for generating advice based on a prompt sentence using a generative AI model" is a function that uses a generative AI model to automatically generate appropriate advice based on a prompt sentence entered by a user.

[0349] A system for implementing this invention includes means for supporting a user's presentation content and providing specific feedback and advice, means for assisting in improving linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and increasing the ability to captivate an audience, means for assisting in the creation of visually appealing slides, means for displaying on a smart device, and means for generating advice based on prompt sentences using a generative AI model.

[0350] System Programming

[0351] The program of this system operates as follows.

[0352] Hardware and Software

[0353] Hardware: smart glasses (e.g. Google Glass), smartphones, servers

[0354] Software: Python, OpenAI API

[0355] Data processing and calculation

[0356] The server converts the user's voice input into text and sends the text as a prompt to the generative AI model, which then generates appropriate advice based on the prompt and displays the advice on the smart device.

[0357] Examples

[0358] For example, when a store clerk is explaining a new smartphone product, he or she puts on the smart glasses and gives voice instructions such as, "Create a slide to visually appeal to the features of this smartphone." This voice instruction is converted into text and sent to the generative AI model as the following prompt sentence.

[0359] Example prompt:

[0360] Please provide some advice on how to create visually appealing slides. User Question: Can you create a slide that visually appeals the features of this smartphone?

[0361] The generative AI model will generate appropriate advice based on the prompt text and display it on the smart glasses display, allowing store associates to quickly create visually appealing slides and deliver effective presentations to customers.

[0362] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0363] Step 1:

[0364] The user puts on the smart glasses and is told aloud, "Create a slide to visually highlight the features of this smartphone."

[0365] Input: User's voice command

[0366] Output: Audio data

[0367] Step 2:

[0368] The smart glasses convert the voice data into text. Voice recognition software is used to convert the voice data into text.

[0369] Input: Audio data

[0370] Output: Text data

[0371] Step 3:

[0372] The smart glasses transmit the text data to the server. The smart glasses transmit the text data to the server via the network.

[0373] Input: Text data

[0374] Output: Text data sent to the server

[0375] Step 4:

[0376] The server receives the text data and sends it to the generative AI model as a prompt sentence. The server processes the text data into a format suitable for the generative AI model and generates the prompt sentence.

[0377] Input: Text data

[0378] Output: Prompt statement

[0379] Step 5:

[0380] A generative AI model generates advice based on the prompt. A generative AI model (e.g., OpenAI API) is used to generate advice based on the prompt.

[0381] Input: prompt statement

[0382] Output: Advice text

[0383] Step 6:

[0384] The server transmits the generated advice text to the smart glasses via a network.

[0385] Input: Advice text

[0386] Output: Advice text sent to smart glasses

[0387] Step 7:

[0388] The smart glasses display the advice text. The advice text is displayed on the display of the smart glasses, providing a visual to the user.

[0389] Input: Advice text

[0390] Output: Advice text displayed on the smart glasses display

[0391] This enables users to quickly create visually appealing slides and deliver effective presentations even in physical stores.

[0392] Furthermore, an emotion engine that estimates the emotion of the user may be combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[0393] "Example 1"

[0394] In one embodiment of the present invention, a system for supporting a user's presentation and providing specific feedback and advice includes an emotion engine that infers an emotional state from the user's presentation and provides feedback and advice based on the emotional state. For example, if the user feels nervous, the emotion engine provides relaxation techniques and advice for speaking with confidence.

[0395] "Example 2"

[0396] In another embodiment, the emotion engine monitors the user's emotional state in real time and updates the feedback and advice according to the changes in the emotional state, for example, if the user feels nervous in the middle of a presentation, the emotion engine provides relaxation techniques at that moment.

[0397] "Example 3"

[0398] In yet another embodiment, the emotion engine analyzes the user's emotional state and provides feedback to the user accordingly, for example, if the user feels angry or anxious during a presentation, the emotion engine communicates that emotion to the user and provides specific advice on how to deal with it.

[0399] The process flow of each embodiment will be described below.

[0400] "Example 1"

[0401] Step 1: The user enters the announcement into the system.

[0402] Step 2: The emotion engine infers the user's emotional state from what they say.

[0403] Step 3: Provide specific feedback and advice to the user based on the emotional state estimated by the emotion engine.

[0404] "Example 2"

[0405] Step 1: The user enters the announcement into the system.

[0406] Step 2: The emotion engine monitors the user's emotional state in real time.

[0407] Step 3: The emotion engine updates and provides feedback and advice to the user based on changes in the emotional state.

[0408] "Example 3"

[0409] Step 1: The user enters the announcement into the system.

[0410] Step 2: The emotion engine analyzes the user's emotional state.

[0411] Step 3: The sentiment engine feeds back the analysis results to the user and provides specific advice on how to deal with it.

[0412] Example 1

[0413] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0414] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on the content of their presentation, and are insufficient in providing techniques for improving linguistic expression and storytelling, or for speaking with confidence. In addition, they do not provide feedback that takes into account the user's emotional state, so users cannot receive appropriate advice in situations where they feel nervous or anxious. This makes it difficult to improve the quality of presentations or their ability to captivate the audience.

[0415] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0416] In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of language expression and storytelling, a means for providing techniques for speaking with confidence, a means for estimating an emotional state from the content of a user's presentation and providing feedback and advice based on the emotional state, a means for automatically generating feedback and advice using a generative AI model, and a means for transmitting data input from a user terminal to the server, which analyzes and generates using an emotion engine and a generative AI model. This makes it possible to provide feedback and advice that is specific and in accordance with the emotional state of the user's presentation content, thereby improving the quality of the presentation and increasing the ability to captivate the audience.

[0417] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[0418] "Presentation content" refers to the presentation text and materials that the user enters into the system.

[0419] "Feedback" refers to specific improvements or advice provided to users regarding their submissions.

[0420] "Advice" refers to suggestions and guidance to help users give more effective presentations.

[0421] "Linguistic expression" refers to the use of words and expressions in a presentation.

[0422] "Storytelling" refers to the method of structuring and developing a story in a presentation.

[0423] "Techniques for speaking with confidence" refers to methods and techniques that help users speak with confidence when giving a presentation.

[0424] "Presentation quality" refers to the overall merits of the presentation's content, structure, and method of expression.

[0425] "Audience captivation" refers to the ability to capture and interest the audience through a presentation.

[0426] "Emotional state" refers to the psychological state, such as tension, anxiety, or joy, that a user feels when giving a presentation.

[0427] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to automatically generate feedback and advice based on user submissions.

[0428] An "emotion engine" is a system that infers a user's emotional state from what they say and provides feedback and advice based on that emotional state.

[0429] "User terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to input presentation content.

[0430] "Server" refers to a computer system that receives data sent from a user device and analyzes and generates emotions using an emotion engine and generative AI model.

[0431] This invention is a system that allows a user to input the contents of a presentation and provides specific feedback and advice based on the contents. The system supports the user's presentation content, provides techniques for improving linguistic expression and storytelling, and for speaking with confidence. It also includes a means for improving the quality of the presentation and increasing the ability to captivate the audience.

[0432] Hardware and Software Used

[0433] Hardware: Servers, user devices (PCs, tablets, smartphones)

[0434] Software: Generative AI models (e.g. GPT-4), emotion engines, user interfaces (web applications)

[0435] Specific operation of the system

[0436] User Input

[0437] The user inputs the contents of the presentation into the terminal. For example, the user inputs "Presentation on the features and market strategy of the new product."

[0438] Sending Data

[0439] The terminal transmits the input presentation content to the server. Specifically, the terminal transmits the input data to the server using an HTTP request.

[0440] Analysis by emotion engine

[0441] The server passes the received presentation content to the emotion engine. The emotion engine infers the user's emotional state from the presentation content. For example, the emotion engine infers that "the user is nervous."

[0442] Feedback generation using generative AI models

[0443] The server inputs the results of the emotion engine and the presentation content into the generative AI model. The generative AI model generates feedback and advice. For example, it generates feedback such as "Try relaxation techniques. Taking deep breaths can help relieve tension."

[0444] Providing feedback

[0445] The server transmits the generated feedback and advice to the user terminal. The user checks the feedback and advice on the terminal. For example, the user reads the feedback "Try a relaxation technique. Taking a deep breath can help relieve tension" and tries to take a deep breath.

[0446] Examples and prompts

[0447] Example: If a user enters "A presentation on new product features and market strategy," the system provides the following feedback: "Try some relaxation techniques. Taking deep breaths can help relieve tension."

[0448] Example prompt: "I'm going to give a presentation about our new product features and market strategy. Can you give me some advice on how to ease my nerves?"

[0449] In this way, users receive specific, emotionally-sensitive feedback and advice, helping them improve the quality of their presentations and their ability to engage their audiences.

[0450] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0451] Step 1:

[0452] User Input

[0453] The user inputs the contents of the presentation into the terminal. Specifically, the user inputs the text of the presentation using the keyboard or touch screen of the terminal.

[0454] Input: Presentation text (e.g. "Presentation on new product features and market strategy")

[0455] Output: Text data of the input presentation

[0456] Step 2:

[0457] Sending Data

[0458] The terminal transmits the input presentation content to the server. In particular, the terminal transmits the input data to the server using an HTTP request.

[0459] Input: Presentation text data

[0460] Output: The text data of the presentation sent to the server.

[0461] Step 3:

[0462] Analysis by emotion engine

[0463] The server passes the received presentation content to the emotion engine. Specifically, the server passes the presentation content to the emotion engine's API and performs emotion analysis.

[0464] Input: Presentation text data

[0465] Data processing: The emotion engine analyzes the text data and estimates the user's emotional state (e.g., nervous).

[0466] Output: Emotional state data (e.g. "The user is nervous")

[0467] Step 4:

[0468] Feedback generation using generative AI models

[0469] The server inputs the results of the emotion engine and the presentation content into the generative AI model. In concrete terms, the server combines the emotional state obtained from the emotion engine with the presentation content, and inputs it as a prompt into the generative AI model. The generative AI model generates feedback and advice.

[0470] Input: Emotional state data, text data of presentation

[0471] Data transformation: Generative AI models generate feedback and advice based on prompts (e.g., "Try relaxation techniques. Taking deep breaths can help relieve tension.")

[0472] Output: generated feedback and advice

[0473] Step 5:

[0474] Providing feedback

[0475] The server sends the generated feedback and advice to the user's device. Specifically, the server sends the feedback obtained from the generative AI model to the user's device as an HTTP response. The user checks the feedback and advice on the device.

[0476] Input: Generated feedback and advice

[0477] Output: Feedback and advice sent to the user's device.

[0478] Specific Action: The user reads the feedback displayed on the device screen and takes the required action (e.g., tries to take a deep breath)

[0479] The above is the specific processing flow of the program of this system.

[0480] (Application example 1)

[0481] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0482] Conventional presentation support systems can provide feedback and advice on the content of a user's presentation, but they cannot provide feedback or advice that takes into account the user's emotional state. In addition, there is a lack of concrete measures to improve the quality of customer service in physical stores. This makes it difficult for users and staff to make presentations and serve customers with confidence, and improving customer satisfaction has been an issue.

[0483] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for giving speeches with confidence, a means for estimating the emotional state of a user using an emotion engine and providing feedback and advice based on the emotional state, a means for a staff member of a physical store to input the content of a conversation with a customer in real time and provide improvements and advice on customer service, and a means for estimating the emotional state of the customer and providing advice on adjusting the customer service method based on the input. This enables users and staff to make presentations and serve customers with confidence, and improves customer satisfaction.

[0484] "A means of supporting the user's presentation content and providing specific feedback and advice" is a function that automatically generates and provides suggestions for improvement and advice based on the presentation content entered by the user.

[0485] "Means to help improve language expression and storytelling" is a feature that provides advice to users to make the language and narrative structure of their presentations more effective.

[0486] "Means of providing techniques for speaking with confidence" is a function that provides specific methods and techniques to enable users to speak with confidence.

[0487] "Means to improve the quality of the presentation itself and its ability to captivate the audience" is a feature that provides advice and techniques to improve the overall quality of a presentation and capture the audience's attention.

[0488] "A means for inferring a user's emotional state using an emotion engine and providing feedback and advice based on that emotional state" is a function that infers emotions from the content of the user's speech and facial expressions, etc., and provides appropriate feedback and advice according to those emotions.

[0489] "A means for store staff to input the content of conversations with customers in real time and provide advice and suggestions for improving customer service" refers to a function that enables store staff to input the content of conversations with customers into the system in real time and provide advice and suggestions for improving customer service based on that content.

[0490] "A means for estimating a customer's emotional state and providing advice on adjusting customer service methods based on that" is a function that estimates the customer's emotions from their facial expressions and language, and advises staff on the appropriate customer service methods based on those emotions.

[0491] The system for implementing the present invention includes a program for supporting the user's published content and providing specific feedback and advice. The processing of the program of this system will be explained below in natural language.

[0492] System Configuration

[0493] The system uses the following hardware and software:

[0494] Hardware: Smart glasses, server, user terminal (e.g. smartphone, tablet)

[0495] Software: OpenAI API, Emotion Recognition Module

[0496] Data processing and calculation

[0497] 1. Enter your announcement:

[0498] The user wears the smart glasses and inputs the contents of the conversation with the customer in real time, and the input data is sent to the server.

[0499] 2. Emotional state estimation:

[0500] The server uses an emotion recognition module to estimate the customer's emotional state from the input conversation content. This module analyzes text data and voice data and quantifies the emotional state.

[0501] 3. Generate feedback and advice:

[0502] The server uses the OpenAI API to generate feedback and advice based on the user's speech and estimated emotional state, which is then displayed in real time on the user's smart glasses.

[0503] Examples

[0504] For example, if a customer looks anxious while a store staff member is explaining a new product, the emotion recognition module will detect this and send a prompt message like the following to the OpenAI API:

[0505] Example prompt:

[0506] Presentation content: I'm explaining a new product. The customer seems a little anxious.

[0507] Emotional state: Anxiety

[0508] Please provide feedback and advice.

[0509] Based on this prompt, the OpenAI API generates advice such as, "The customer seems anxious. Please explain the product to them in a way that reassures them," and this advice is provided to staff in real time through the smart glasses.

[0510] In this way, the system can provide appropriate feedback and advice based on the content of the user's presentation and the emotional state of the customer, allowing users and staff to make presentations and serve customers with confidence, which is expected to improve customer satisfaction.

[0511] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0512] Step 1:

[0513] The user wears the smart glasses and inputs the contents of the conversation with the customer in real time. The input data is sent from the smart glasses to the server. The input data is in text format and includes the contents of the conversation with the customer.

[0514] Step 2:

[0515] The server passes the received text data to an emotion recognition module. The emotion recognition module analyzes the text data and estimates the customer's emotional state. Specifically, it quantifies the emotion in the text using natural language processing technology and assigns an emotion label, such as "anxiety," "joy," or "anger." The output is data indicating the estimated emotional state.

[0516] Step 3:

[0517] The server sends a prompt to the generative AI model (OpenAI API) based on the estimated emotional state and the user's speech. The prompt includes the user's speech and the estimated emotional state. Specific examples of prompts are as follows:

[0518] Presentation content: I'm explaining a new product. The customer seems a little anxious.

[0519] Emotional state: Anxiety

[0520] Please provide feedback and advice.

[0521] The input data is the prompt text, and the output data is the generated feedback and advice.

[0522] Step 4:

[0523] The generative AI model generates feedback and advice based on the prompt sentence. The generated feedback and advice are returned to the server. Specifically, the generative AI model uses natural language generation technology to output specific advice to the user in text format.

[0524] Step 5:

[0525] The server transmits the generated feedback and advice to the smart glasses, which display the received feedback and advice to the user in real time, so that the user can receive appropriate advice during the interaction with the customer.

[0526] Step 6:

[0527] The user continues to interact with the customer based on the feedback and advice displayed on the smart glasses, allowing the user to respond appropriately based on the customer's emotional state.

[0528] Example 2

[0529] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0530] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on the content of their presentation, and lack the functionality to monitor the user's emotional state in real time and provide appropriate feedback. This makes it difficult for users to receive specific guidance on how to improve the quality of their presentation, and they are unable to receive appropriate support to reduce tension and anxiety.

[0531] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0532] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for monitoring the user's emotional state in real time and updating the feedback and advice according to changes in the emotional state, means for converting voice data into text data, means for analyzing video data to detect the user's emotional state, means for analyzing the text data using a generative AI model to generate feedback and advice, and means for providing the generated feedback and advice to the user. This enables the user to receive specific feedback and advice in real time, improve the quality of the presentation, and obtain appropriate support to reduce tension and anxiety.

[0533] "User" means an individual or organization that uses the system to give a presentation.

[0534] "Presentation content" refers to the entirety of the information or message that the user wishes to convey in the presentation.

[0535] "Feedback" refers to specific evaluations and suggestions for improvement provided to users regarding their presentations.

[0536] "Advice" is specific guidance or suggestions provided to help a user improve their presentation.

[0537] "Linguistic expression" refers to the choice and use of words and phrases that a user uses in a presentation.

[0538] "Storytelling" is a method of structuring and developing a narrative that allows users to effectively convey information in a presentation.

[0539] "Confident Speaking Techniques" are specific methods and techniques that help users speak with confidence during presentations.

[0540] "Presentation Quality" is a measure of how effective and engaging your presentation is to your audience.

[0541] An "emotional state" is the psychological state, such as tension, anxiety, or joy, that a user feels during a presentation.

[0542] "Real-time monitoring" means continuously monitoring the user's emotional state during the presentation.

[0543] "Audio data" refers to data in which the contents of a user's speech are recorded as audio.

[0544] "Text data" refers to voice data converted into character information.

[0545] "Video data" refers to video data that records a user's facial expressions and actions.

[0546] A "generative AI model" is an algorithm or program that uses artificial intelligence to analyze text data and generate feedback and advice.

[0547] An "interactive program" is software that interacts with a user to provide information, feedback, or advice.

[0548] The present invention provides a system for providing specific feedback and advice to a user on a presentation, and further monitors the emotional state of the user in real time to update the appropriate feedback. A specific embodiment of this system is described below.

[0549] Hardware and Software Used

[0550] Hardware: High-performance servers, user devices (PCs, tablets, smartphones, etc.)

[0551] Software: Generative AI models (e.g. GPT-4), emotion engines, speech recognition technology

[0552] Data processing and calculation

[0553] Data Entry: Audio and video data when a user gives a presentation

[0554] Data processing: Voice data is converted into text data using voice recognition technology. Facial expression recognition technology is used to analyze the user's emotional state from video data.

[0555] Data Computation: A generative AI model analyzes text data and generates feedback and advice on the content of the presentation. An emotion engine monitors the emotional state in real time and provides advice such as relaxation techniques as needed.

[0556] Examples

[0557] Example 1: When a user gives a presentation on "global warming"

[0558] The user starts a presentation using the terminal.

[0559] The terminal captures the audio and video of the presentation in real time and transmits them to the server.

[0560] The server uses voice recognition technology to convert the voice data into text data, and then analyzes the text data using a generative AI model.

[0561] The server generates advice such as, "To make the flow of your talk clear, it would be a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples," and sends it to the terminal.

[0562] The device displays the feedback it receives to the user.

[0563] Example 2: The emotion engine detects that the user is nervous during a presentation.

[0564] The server analyzes the video data and detects the user's level of tension from their facial expressions and tone of voice.

[0565] The server generates relaxation techniques, such as "We recommend that you take a deep breath and relax," and sends them to the terminal.

[0566] The device displays the advice received to the user.

[0567] Examples of prompt statements

[0568] Prompt 1: "I am giving a presentation on global warming. Can you give me some advice on how to clarify the flow of my speech?"

[0569] Prompt 2: "I feel nervous during presentations. Can you teach me some relaxation techniques?"

[0570] In this way, the system supports the user in their presentation and provides feedback and advice in real time.

[0571] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0572] Step 1:

[0573] The user starts a presentation using the terminal.

[0574] Input: User's audio and video

[0575] Specific behavior: A user launches the presentation software and begins a presentation. The device captures audio and video using the built-in microphone and camera.

[0576] Output: Captured audio and video data

[0577] Step 2:

[0578] The terminal transmits the captured audio and video data to the server.

[0579] Input: Captured audio and video data

[0580] Specific operation: The terminal compresses audio data and encodes video data and sends it to the server.

[0581] Output: Audio and video data sent to the server

[0582] Step 3:

[0583] The server converts the voice data into text data using voice recognition technology.

[0584] Input: Audio data sent to the server

[0585] Specific operation: The server converts the voice data into text data.

[0586] Output: Converted text data

[0587] Step 4:

[0588] The server analyzes the video data and monitors the user's emotional state in real time based on their facial expressions and tone of voice.

[0589] Input: Video data sent to the server

[0590] How it works: The server analyzes the video data and detects the user's emotional state from their facial expressions and tone of voice.

[0591] Output: Detected emotional state data

[0592] Step 5:

[0593] The server uses a generative AI model to analyze the text data and generate feedback and advice on the content of the presentation.

[0594] Input: Transduced text data, detected emotion state data

[0595] Specific operation: The server inputs text data into the generative AI model (GPT-4) and generates feedback and advice on the content of the presentation. It also generates feedback and advice according to the user's emotional state based on the emotional state data.

[0596] Output: generated feedback and advice

[0597] Step 6:

[0598] The server sends the generated feedback and advice to the device.

[0599] Input: Generated feedback and advice

[0600] Specific behavior: The server sends the generated feedback and advice to the device.

[0601] Output: Feedback and advice sent to the device.

[0602] Step 7:

[0603] The device displays any feedback or advice it receives to the user.

[0604] Input: Feedback and advice sent to the device

[0605] What it does: Your device receives feedback or advice and displays it as text on the screen or reads it aloud.

[0606] Output: Feedback and advice displayed to the user

[0607] In this way, the system supports the user in their presentation and provides feedback and advice in real time.

[0608] (Application example 2)

[0609] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0610] Conventional presentation support systems were limited to providing specific feedback and advice on the content of the user's presentation, and lacked the ability to monitor the user's emotional state in real time and provide feedback accordingly. Furthermore, there were no systems that provided real-time feedback or advice based on the emotional state for work instructions and training within factories. This made it difficult to reduce stress and tension for workers and provide efficient training.

[0611] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0612] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for monitoring the emotional state of the user in real time and updating the feedback and advice according to changes in the emotional state, means for providing feedback and advice in real time when giving work instructions or training in a factory, and means for monitoring the emotional state of workers and providing relaxation techniques if they are nervous. This makes it possible to provide more specific and appropriate feedback in real time for the content of the user's presentation or work instructions, and to support the user and workers according to their emotional states.

[0613] "A means of supporting the user's presentation content and providing specific feedback and advice" is a function that provides the user with real-time suggestions for improving the content and specific advice for their presentation or speech.

[0614] "Means to help improve language expression and storytelling" is a feature that provides advice and feedback to help users improve their language expression and narrative structure.

[0615] "Means of providing techniques for speaking with confidence" is a function that provides specific techniques and advice to help users give speeches with confidence.

[0616] "Means of improving the quality of the presentation itself and its ability to captivate the audience" is a function that provides advice and feedback to improve the overall quality of the presentation and capture the audience's attention.

[0617] "Means for monitoring a user's emotional state in real time and updating feedback and advice in response to changes in the emotional state" is a function for monitoring a user's emotional state in real time and providing appropriate feedback and advice in response to those changes.

[0618] "A means for providing real-time feedback and advice when giving work instructions or training in a factory" refers to a function that provides specific feedback and advice in real time during work instructions or training in a factory.

[0619] "Means for monitoring the emotional state of a worker and providing relaxation techniques if the worker feels tense" is a function for monitoring the emotional state of a worker and providing specific techniques or advice for relaxing if the worker feels tense.

[0620] The system for implementing the present invention includes a program for supporting the content of a user's presentation and providing specific feedback and advice. A specific embodiment of this system will be described below.

[0621] System Configuration

[0622] The system uses the following hardware and software:

[0623] Hardware: cameras, microphones, factory robots

[0624] Software: EmotionEngine (emotion detection engine), FeedbackGenerator (feedback generation engine)

[0625] Program processing explanation

[0626] Support for user announcements

[0627] The server uses a camera and microphone to capture the user's facial expressions and tone of voice in real time while the user is giving a presentation. The EmotionEngine analyzes this data to detect the user's emotional state. The FeedbackGenerator generates appropriate feedback and advice based on the user's presentation content and emotional state. The generated feedback is provided to the user through audio and display.

[0628] In-factory work instructions and training

[0629] The server monitors the behavior of workers using factory robots when giving instructions and training in the factory. The EmotionEngine analyzes the emotional state of the workers in real time and provides relaxation techniques if they are tense. The FeedbackGenerator generates specific feedback and advice based on the work content and provides it to the workers.

[0630] Examples

[0631] Presentation Support

[0632] Scenario: A user gives a presentation on "global warming".

[0633] Feedback: "To make the flow of your talk clearer, you should first explain the impact of global warming from a broader perspective, and then give specific examples."

[0634] Work instructions in the factory

[0635] Scenario: A new worker is learning how to operate machines in a factory.

[0636] Feedback: "Next, please do a safety check before you turn on the machine. You seem nervous, so please take a deep breath and relax."

[0637] Examples of prompt statements

[0638] Presentation Support: "Design a system that provides real-time feedback and advice to users as they learn to operate a machine. Include functionality to monitor the user's emotional state and offer relaxation techniques if they are nervous."

[0639] In this way, it is possible to provide more specific and appropriate feedback in real time in response to the content of user presentations and work instructions within the factory, enabling support that is tailored to the emotional state of the user or worker.

[0640] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0641] Step 1:

[0642] The server uses a camera and microphone to capture the user's facial expressions and tone of voice in real time. As input, it obtains the user's video and audio data. These data are sent to the EmotionEngine and become input data for analyzing the user's emotional state. In concrete terms, the camera takes a picture of the user's face and the microphone records the user's voice.

[0643] Step 2:

[0644] The server uses the EmotionEngine to analyze the acquired video and audio data to detect the user's emotional state. The video and audio data acquired in step 1 are used as input. The EmotionEngine analyzes facial expressions and voice tone, and outputs the user's emotional state, such as whether they are tense or relaxed. In concrete terms, the EmotionEngine extracts facial feature points and analyzes the pitch and tone of the voice.

[0645] Step 3:

[0646] The server uses the FeedbackGenerator to generate feedback and advice based on the user's presentation and emotional state. As input, it uses the text data of the user's presentation and the emotional state detected in step 2. The FeedbackGenerator uses a generative AI model to output appropriate feedback and advice. In concrete terms, the generative AI model analyzes the user's presentation and generates advice according to the user's emotional state.

[0647] Step 4:

[0648] The server provides the generated feedback and advice to the user. As input, it uses the text data of the feedback and advice generated in step 3. As output, it provides the feedback to the user through speech and display. In concrete terms, the speech synthesis engine converts the feedback into speech and transmits it to the user through the speaker. It also displays the text of the feedback on the display.

[0649] Step 5:

[0650] The server uses factory robots to monitor the movements of workers when giving work instructions and training in the factory. As input, it uses the movement data of workers acquired from cameras and sensors. These data are sent to EmotionEngine and become input data for analyzing the emotional state of workers. In terms of specific operations, the factory robot tracks the movements of workers, and the cameras and sensors collect data.

[0651] Step 6:

[0652] The server uses the EmotionEngine to analyze the acquired motion data and detect the worker's emotional state. The motion data acquired in step 5 is used as input. The EmotionEngine analyzes the worker's movements and facial expressions, and outputs the worker's emotional state, such as whether he or she is tense or relaxed. As for specific movements, the EmotionEngine extracts the feature points of the movements and analyzes the emotional state.

[0653] Step 7:

[0654] The server uses the FeedbackGenerator to generate feedback and advice based on the task content and the emotional state. As input, it uses the text data of the task content and the emotional state detected in step 6. The FeedbackGenerator uses a generative AI model to output appropriate feedback and advice. In concrete terms, the generative AI model analyzes the task content and generates advice according to the emotional state.

[0655] Step 8:

[0656] The server provides the generated feedback and advice to the worker. As input, it uses the text data of the feedback and advice generated in step 7. As output, it provides the feedback to the worker through voice or display. In concrete terms, the voice synthesis engine converts the feedback into voice and conveys it to the worker through the speaker. It also displays the text of the feedback on the display.

[0657] In this way, it is possible to provide more specific and appropriate feedback in real time in response to the content of user presentations and work instructions within the factory, enabling support that is tailored to the emotional state of the user or worker.

[0658] Example 3

[0659] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0660] Conventional presentation support systems did not provide users with sufficient specific feedback or advice on the content of their presentation, nor were they able to analyze the user's emotional state in real time and provide feedback based on that. As a result, it was difficult for users to obtain specific guidelines for improving the quality of their presentation, and there was a lack of effective ways to reduce tension and anxiety during the presentation.

[0661] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0662] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for accepting questions from the user and generating answers using a generative AI model, and means for analyzing the user's emotional state and feeding back the results. This allows the user to receive specific feedback and advice in real time, improving the quality of the presentation and effectively reducing tension and anxiety during the presentation.

[0663] "User" means an individual or organization that uses the system to give a presentation.

[0664] "Presentation content" refers to the information or message that the user wishes to convey in the presentation.

[0665] "Feedback" refers to specific evaluations or advice provided to a user regarding their presentation content or progress.

[0666] "Advice" is specific guidance or a suggestion to help users improve their presentation.

[0667] "Linguistic expressions" are the words and phrases that users use in their presentations.

[0668] "Storytelling" refers to the structure and development of a narrative that allows users to effectively convey information in a presentation.

[0669] "Techniques" are specific methods and techniques that help users deliver speeches with confidence.

[0670] "Presentation quality" refers to how effectively your presentation informs and engages your audience.

[0671] A "generative AI model" is artificial intelligence that generates appropriate answers to user questions.

[0672] "Emotional state" refers to the emotions a user feels during a presentation, such as nervousness, anxiety, anger, etc.

[0673] "Feedback measures" refer to methods and techniques for analyzing the user's emotional state and communicating the results to the user.

[0674] This invention is a system that supports users in their presentations and provides specific feedback and advice. The system accepts questions from users, generates answers using a generative AI model, and provides feedback by analyzing the user's emotional state.

[0675] Hardware and Software Used

[0676] Hardware: Servers, terminals (PCs, tablets, smartphones)

[0677] Software: Generative AI models (e.g. GPT-4), emotion engines, presentation software

[0678] Specific operation of the system

[0679] 1. Accepting user questions

[0680] A user uses a terminal to input a question about the presentation.

[0681] Example: "How do I create visually appealing slides?"

[0682] 2. Submit your question

[0683] The terminal transmits the user's question to the server.

[0684] 3. Answer generation using generative AI models

[0685] The server inputs the received question into a generative AI model to generate an appropriate answer.

[0686] Example: "To convey information visually, slides should have large headlines, a few key points, and simple charts rather than complex graphs."

[0687] 4. Submit your answer

[0688] The server sends the generated answer to the terminal.

[0689] 5. Display to the User

[0690] The terminal displays the received response to the user.

[0691] 6. Emotional state analysis

[0692] While the user is giving a presentation, the device uses a camera and microphone to collect the user's facial expressions and tone of voice.

[0693] 7. Sentiment engine analysis

[0694] The server uses an emotion engine to analyze the user's emotional state from the collected data.

[0695] Example: Determining that the user is feeling angry or anxious.

[0696] 8. Emotional state feedback

[0697] The server transmits the analysis results to the terminal, which displays the feedback to the user.

[0698] For example: "It seems like you're feeling angry or anxious right now. I suggest you take a deep breath and relax."

[0699] Examples

[0700] Examples of prompt statements

[0701] "How do I create visually appealing slides?"

[0702] "How can I reduce my nervousness during a presentation?"

[0703] This system allows users to receive specific feedback and advice in real time, improving the quality of their presentation and effectively reducing tension and anxiety during the presentation. The flow of the specific process in the third embodiment will be described with reference to FIG.

[0704] Step 1:

[0705] A user uses a terminal to input a question about the presentation.

[0706] Specific Action: A user types, using a keyboard or touchscreen, "Can you help me create visually appealing slides?"

[0707] Input: The text of the user's question

[0708] Output: The question text is typed into the terminal.

[0709] Step 2:

[0710] The terminal transmits the user's question to the server.

[0711] Specific operation: The device sends the entered question to the server via the Internet as an HTTP request.

[0712] Input: Question text

[0713] Output: The question text is sent to the server.

[0714] Step 3:

[0715] The server inputs the received question into a generative AI model to generate an appropriate answer.

[0716] How it works: The server passes the question to a generative AI model (e.g., GPT-4), which generates an answer such as, "To convey information visually, slides should have large headlines and a few key points, and use simple charts rather than complex graphs."

[0717] Input: Question text

[0718] Output: The generated answer text

[0719] Step 4:

[0720] The server sends the generated answer to the terminal.

[0721] Specific operation: The server sends the generated answer to the terminal as an HTTP response.

[0722] Input: Generated answer text

[0723] Output: The answer text is sent to the terminal.

[0724] Step 5:

[0725] The terminal displays the received response to the user.

[0726] What it does: The device displays the following text on the screen: "To convey information visually, slides should include large headlines, a few key points, and use simple charts rather than complex graphs."

[0727] Input: Answer text

[0728] Output: The answer text is displayed on the terminal screen.

[0729] Step 6:

[0730] While the user is giving a presentation, the device uses a camera and microphone to collect the user's facial expressions and tone of voice.

[0731] Specific actions: The device takes a picture of the user's face with the camera and records their voice with the microphone.

[0732] Input: User's facial expression data, voice tone data

[0733] Output: Collected facial expression data and tone of voice data are saved on the device.

[0734] Step 7:

[0735] The server uses an emotion engine to analyze the user's emotional state from the collected data.

[0736] How it works: The server inputs data from the camera and microphone into an emotion engine to analyze whether the user is feeling anger or anxiety.

[0737] Input: facial expression data, tone of voice data

[0738] Output: Emotional state analysis result

[0739] Step 8:

[0740] The server transmits the analysis results to the terminal, which displays the feedback to the user.

[0741] Specific behavior: The server sends a message to the device saying, "It appears that you are currently feeling angry or anxious. We recommend that you take a deep breath and relax," and the device displays the message on its screen.

[0742] Input: Emotional state analysis results

[0743] Output: Feedback messages are printed to the terminal screen.

[0744] (Application example 3)

[0745] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0746] Conventional presentation support systems only provide feedback and advice on the content of a user's presentation, but lack the ability to analyze the user's emotional state in real time and provide feedback, or the ability to provide advice on creating visually appealing slides. This makes it difficult for users to reduce the anxiety and tension they feel during a presentation and give a more effective presentation.

[0747] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, a means for analyzing the user's emotional state in real time and feeding back the results, and a means for providing advice on creating visually appealing slides. This allows the user to reduce anxiety and tension felt during the presentation and to give a more effective and attractive presentation.

[0748] "User" means an individual or organization that uses the system to give a presentation.

[0749] "Presentation content" refers to the information or message that the user wishes to convey in the presentation.

[0750] "Feedback" refers to evaluation or advice provided to a user regarding their presentation content or progress.

[0751] "Advice" is specific suggestions or instructions to help users give more effective presentations.

[0752] "Linguistic expression" refers to the words and phrases a user chooses to use in a presentation.

[0753] "Storytelling" is a method of structuring and developing a narrative that allows users to effectively convey information in a presentation.

[0754] "Techniques" are specific methods and skills that help users deliver speeches with confidence.

[0755] "Quality" refers to the overall excellence of the presentation's content, structure, visual elements, etc.

[0756] The "audience" is the people who will be listening to the user's presentation.

[0757] An "emotional state" is the psychological state or mood a user feels during a presentation.

[0758] "Real-time" refers to the instantaneous processing and analysis that occurs at the moment the user is making a presentation.

[0759] "Visually appealing" refers to slides and visual elements that are visually appealing and have the ability to convey information effectively.

[0760] "Slide creation" is the process of designing and arranging content on slides for use in a presentation.

[0761] A system for implementing this invention includes means for supporting a user's presentation content and providing specific feedback and advice, means for assisting in improving linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and increasing the ability to captivate an audience, means for analyzing a user's emotional state in real time and feeding back the results, and means for providing advice on creating visually appealing slides.

[0762] Hardware and Software Used

[0763] Hardware: Smartphones, smart glasses, cameras

[0764] Software: OpenCV (registered trademark), EmotionRecognizer (emotion recognition library), SlideAdvisor (slide advice library)

[0765] Data processing and calculation

[0766] Camera Input

[0767] The device's camera captures the user's image in real time, allowing it to capture the user's facial expressions and movements.

[0768] sentiment analysis

[0769] The device uses EmotionRecognizer to analyze the user's emotions from captured video frames. The emotion recognition model identifies emotions such as "anger," "anxiety," and "happiness" from the user's facial expressions.

[0770] Provide feedback

[0771] The server provides real-time feedback to the user based on the results of emotion analysis. For example, if the user is feeling angry or anxious, the server will display advice such as "try to speak calmly."

[0772] Slide Advice

[0773] The device uses SlideAdvisor to provide advice on the slide content entered by the user, such as making the headings larger or using simpler charts and graphs.

[0774] Examples

[0775] scenario

[0776] Staff at a physical store wear smart glasses while giving a presentation on new products.

[0777] operation

[0778] When a staff member gives a presentation, the smart glasses analyze the staff member's emotions in real time and provide feedback such as "speak calmly" as necessary. It also displays advice on the content of the presentation slides such as "make the heading larger" and "use simple charts and graphs."

[0779] Examples of prompt statements

[0780] When presenting new products, offer advice on how to create visually appealing slides. Also, analyze the emotional state during the presentation and provide feedback if necessary.

[0781] In this way, users can reduce anxiety and tension during presentations, enabling them to deliver more effective and engaging presentations.

[0782] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0783] Step 1:

[0784] The device's camera captures the user's image in real time. The input is the camera image, and the output is the image frame. The specific operation is that the camera captures the user's face and facial expressions.

[0785] Step 2:

[0786] The device inputs the captured video frames into EmotionRecognizer to analyze the user's emotions. The input is the video frame, and the output is emotion data (e.g. "anger," "anxiety," "joy," etc.). Specifically, EmotionRecognizer analyzes the facial features in the frame and identifies the emotion.

[0787] Step 3:

[0788] The server provides real-time feedback to the user based on the results of the emotion analysis. The input is emotion data, and the output is a feedback message. Specifically, the server generates advice such as "speak calmly" and sends it to the terminal.

[0789] Step 4:

[0790] The device inputs the slide content entered by the user into SlideAdvisor and provides advice on creating visually appealing slides. The input is the slide content, and the output is advice messages. Specifically, SlideAdvisor analyzes the placement of slide headings and figures, and generates specific suggestions such as "make the heading larger" or "use simple figures."

[0791] Step 5:

[0792] The terminal displays the feedback messages received from the server and the advice messages received from SlideAdvisor to the user. The input is the feedback message and the advice message, and the output is the display to the user. In concrete terms, the messages are displayed on the terminal display or smart glasses so that the user can check them in real time.

[0793] In this way, users can reduce anxiety and tension during presentations, enabling them to deliver more effective and engaging presentations.

[0794] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0795] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0796] Another example of generative AI is Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0797] In the above embodiment, an example was given in which the specific process was performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0798] [Second embodiment]

[0799] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0800] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0801] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0802] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0803] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0804] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0805] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0806] Fig. 4 shows an example of main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0807] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0808] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0809] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0810] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0811] "Example 1"

[0812] In one embodiment of the present invention, a user inputs the contents of a presentation into the system. The system generates and provides specific feedback and advice to the user based on the input contents. The feedback and advice include support for presentation skills such as improving language expression and storytelling, and techniques for speaking with confidence.

[0813] "Example 2"

[0814] As a concrete example, if a user makes a presentation on global warming, the system will provide specific feedback and advice on the content of the presentation, such as "To make the flow of your presentation clearer, first explain the impact of global warming from a broad perspective, and then provide specific examples."

[0815] "Example 3"

[0816] In addition, the system also provides assistance in improving the quality of the presentation itself. For example, if a user asks, "How do I create slides that are visually appealing?" the system will provide advice such as, "To convey information visually, slides should have large headings and a few key points, and should use simple charts rather than complex graphs."

[0817] The process flow of each embodiment will be described below.

[0818] "Example 1"

[0819] Step 1: The user enters the presentation content into the system.

[0820] Step 2: The system generates specific feedback and advice based on what you input.

[0821] Step 3: Provide the generated feedback and advice to the user.

[0822] "Example 2"

[0823] Step 1: The user enters “Presentation on Global Warming” into the system.

[0824] Step 2: The system generates specific feedback and advice based on the input, such as "To make the flow of your story clearer, first explain the impact of global warming from a broad perspective, and then provide specific examples."

[0825] Step 3: Provide the generated feedback and advice to the user.

[0826] "Example 3"

[0827] Step 1: The user asks a question about "how to create a visually appealing slide." Step 2: The system generates specific feedback and advice based on the question. For example, the system provides advice such as "To convey information visually, slides should have large headings and a few key points, and should use simple charts rather than complex graphs."

[0828] Step 3: Provide the generated feedback and advice to the user.

[0829] Example 1

[0830] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0831] Conventional presentation support systems have the problem that it is difficult for users to get specific feedback or advice even when they input the content of their presentation. In addition, there is a lack of means to improve linguistic expression and storytelling, or provide techniques for speaking with confidence, making it difficult to improve the quality of presentations. Furthermore, there is a lack of specific support to improve the ability to captivate the audience.

[0832] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0833] In this invention, the server includes a means for inputting the contents of a presentation by a user, a means for transmitting the input contents of the presentation to the server, a means for the server to receive the input contents and store them as text data, a means for passing the stored text data to the generative AI model, a means for the generative AI model to generate feedback and advice, a means for the server to receive the generated feedback and advice, a means for the server to transmit the feedback and advice to the terminal, a means for the terminal to display the feedback and advice to the user, a means for supporting the improvement of language expression and storytelling, a means for providing techniques for speaking with confidence, and a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience. This allows the user to obtain specific feedback and advice, making it possible to improve the quality of the presentation.

[0834] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[0835] "Presentation content" refers to text data and information that a user inputs for a presentation.

[0836] A "server" is a computer system that receives, stores, and passes on announcements sent by users to the generative AI model.

[0837] A "terminal" is a device on which a user inputs the contents of a presentation and displays feedback and advice sent from the server.

[0838] A "generative AI model" is an artificial intelligence model that analyzes the input presentation content and generates specific feedback and advice.

[0839] "Feedback" refers to specific improvements or advice that the generative AI model generates based on what is presented.

[0840] "Advice" is specific suggestions or guidance for improving the user's presentation.

[0841] "Linguistic expression" refers to the choice of words and phrases that users use to communicate their presentation.

[0842] "Storytelling" is a method of structuring and developing a story that allows users to effectively communicate the content of their presentation.

[0843] "Speech techniques" are specific ways of speaking and expressing oneself that allow users to make presentations with confidence.

[0844] "Presentation quality" is a measure of how effectively a user communicates their presentation to the audience.

[0845] "Audience captivation" refers to the ability of a user's presentation to capture the audience's attention and interest.

[0846] An "interactive program" is software that interacts with a user to provide information, feedback, or advice.

[0847] This invention is a system in which a user inputs the contents of a presentation and receives specific feedback and advice based on the contents. The system aims to improve the quality of presentations and increase the ability to captivate an audience by supporting the contents of the user's presentation and providing techniques to improve linguistic expression and storytelling and to give speeches with confidence.

[0848] Hardware and Software Used

[0849] The system uses the following hardware and software:

[0850] Terminal: A device on which a user enters presentation content and receives feedback and advice. Examples include personal computers and smartphones.

[0851] Server: A computer system that receives, stores, and passes user-submitted announcements to the generative AI model.

[0852] Generative AI model: An artificial intelligence model that analyzes input presentation content and generates specific feedback and advice. An example is GPT-4.

[0853] Data processing and calculation

[0854] When a user uses a terminal to input presentation content, the content is sent to the server. The server receives the input content and saves it as text data. The saved text data is passed to the generative AI model. The generative AI model analyzes the input text and generates feedback and advice. The generated feedback and advice is sent back to the terminal via the server and displayed to the user.

[0855] Examples

[0856] For example, if a user enters the following presentation content:

[0857] "My presentation will be about the importance of protecting the environment. Specifically, I will talk about ways to reduce plastic waste and ideas for reusing it."

[0858] Once this is entered into the system, the server passes the text to a generative AI model that generates feedback and advice like this:

[0859] "Your presentation covers a very important topic. It would be even more effective if you improved it in the following ways:

[0860] 1. In your introduction, it would be a good idea to add some concrete data or statistics that highlight the importance of protecting the environment.

[0861] 2. When talking about ways to reduce plastic waste, sharing real-life success stories can help capture your audience’s attention.

[0862] 3. Using visual aids (e.g. slides, pictures) when explaining reuse ideas helps improve understanding.”

[0863] Example of a prompt to be input to a generative AI model:

[0864] "Please generate specific feedback and advice based on the presentation below:

[0865] "My presentation will be about the importance of environmental protection. Specifically, I will talk about ways to reduce plastic waste and ideas for reusing it."

[0866] In this way, users receive specific feedback and advice to improve the quality of their presentations.

[0867] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0868] Step 1:

[0869] The user inputs the presentation content.

[0870] The user inputs the contents of the presentation into an input form on the terminal. This input form includes fields for the title, main text, supplementary information, etc. The input data is saved in text format on the terminal.

[0871] Step 2:

[0872] The terminal sends the input information to the server.

[0873] The device sends the presentation content entered by the user to the server using an HTTP POST request, including metadata such as the user ID and a timestamp.

[0874] Step 3:

[0875] The server receives the input and stores it as text data.

[0876] The server receives the data sent from the terminal and stores it in the database as text data. When storing it, metadata such as the user ID and timestamp are also recorded. The input is the HTTP POST request data, and the output is the text data stored in the database.

[0877] Step 4:

[0878] The server passes the stored text data to the generative AI model.

[0879] The server converts the stored text data into an appropriate format to be passed to the generative AI model. The converted data is input to the generative AI model. The input is the text data obtained from the database, and the output is the data passed to the generative AI model.

[0880] Step 5:

[0881] Generative AI models generate feedback and advice.

[0882] A generative AI model (e.g., GPT-4) analyzes the text data passed to it and generates feedback and advice. The generated content includes improvements to linguistic expression, strengthening storytelling, and techniques for speaking with confidence. The input is the text data passed to the generative AI model, and the output is the generated feedback and advice.

[0883] Step 6:

[0884] The server receives the generated feedback and advice.

[0885] The server receives the feedback and advice returned by the generative AI model. This data is returned to the server again in text format. The input is the feedback and advice returned by the generative AI model, and the output is the feedback and advice stored on the server.

[0886] Step 7:

[0887] The server sends feedback and advice to the device.

[0888] The server sends the received feedback and advice to the terminal using HTTP responses. The input is the feedback and advice stored on the server, and the output is the feedback and advice sent to the terminal.

[0889] Step 8:

[0890] The device displays feedback and advice to the user.

[0891] The terminal displays the feedback and advice received from the server to the user. The user can check the displayed content and use it to improve the presentation. The input is the feedback and advice received from the server, and the output is the feedback and advice displayed to the user.

[0892] (Application example 1)

[0893] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0894] Conventional presentation support systems only provide limited functionality for providing specific feedback and advice when users input the content of their presentation, making it difficult for them to provide effective support, particularly when store staff are explaining products or introducing services. In addition, the lack of automated generation of feedback using generative AI models or effective advice using prompts makes it difficult to improve the quality of presentations or their ability to captivate the audience.

[0895] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0896] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for inputting the content of a presentation when a staff member of a physical store is explaining a product or introducing a service, and for the system to provide specific feedback and advice based on the content, means for generating feedback and advice using a generative AI model, means for generating prompt sentences and inputting them into the generative AI model, and means for displaying the generated feedback and advice to a user. This enables staff members of a physical store to give more effective presentations when explaining a product or introducing a service.

[0897] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[0898] "Presentation content" refers to the information and materials that a user uses during a presentation.

[0899] "Feedback" refers to specific evaluations and suggestions for improvement provided to users regarding their submissions.

[0900] "Advice" is specific suggestions or guidance to help users improve their presentations.

[0901] "Linguistic expressions" are the words and phrases that users use in their presentations.

[0902] "Storytelling" refers to the structure and development of a story that users use in their presentations.

[0903] "Techniques" are specific methods and techniques that help users deliver speeches with confidence.

[0904] "Quality" refers to the overall execution or effectiveness of the presentation.

[0905] The "audience" is the people who listen to the presentation.

[0906] A "brick and mortar store" means a sales or service establishment that is located in a physical location.

[0907] "Staff" refers to employees working in physical stores.

[0908] A "product description" is an explanation of a product's features and benefits given to customers by store staff.

[0909] "Service introduction" refers to an explanation of the services offered by store staff to customers.

[0910] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate feedback or advice based on user input.

[0911] A "prompt" is an instruction or question that is input into a generative AI model.

[0912] A system for implementing the present invention allows a user to input the contents of a presentation and provides specific feedback and advice based on the contents. The system is realized using the following hardware and software.

[0913] Hardware

[0914] Smartphone: A device that allows users to enter presentation content and receive feedback and advice.

[0915] software

[0916] Python: A programming language used to implement programs.

[0917] OpenAI API: An API for generating feedback and advice using generative AI models.

[0918] Data processing and calculation

[0919] 1. User input: The user inputs the presentation content using their smartphone.

[0920] 2. Prompt generation: The server generates a prompt based on the presentation content entered by the user.

[0921] 3. Use of generative AI model: The server sends the generated prompt text to the OpenAI API and uses the generative AI model to generate feedback and advice.

[0922] 4. Displaying feedback: The server displays the generated feedback and advice on the smartphone.

[0923] Examples

[0924] If a user enters a presentation of their new smartphone, the following feedback is generated:

[0925] Presentation content entered:

[0926] "This new smartphone is equipped with the latest camera technology, allowing you to take clear photos even at night. Plus, it has a long battery life, so you can use it all day without having to worry about charging."

[0927] Generated feedback and advice:

[0928] "This presentation is very informative, but it would be even more effective if you added some more concrete examples. For example, you could show a specific situation where you took a photo at night, or show a specific amount of time to highlight the long battery life. You could also use questions to get the customer's attention."

[0929] Example prompt:

[0930] "Please provide your feedback and suggestions on the presentation below:\n\nThis new smartphone is equipped with the latest camera technology, allowing you to take clear photos even at night. In addition, it has a long battery life, so you can use it all day without worrying about charging.\n\nFeedback and Suggestions:"

[0931] In this way, store staff can give more effective presentations when explaining products and introducing services.

[0932] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0933] Step 1:

[0934] A user inputs the contents of a presentation using a smartphone. The input contents are saved on the smartphone as text data.

[0935] Step 2:

[0936] The terminal transmits the input presentation content to the server, which receives the text data and prepares it for generating a prompt sentence.

[0937] Step 3:

[0938] The server generates a prompt based on the received presentation content. Specifically, the server inserts the presentation content into a prompt template and converts it into a format suitable for the generative AI model. For example, the format is "Please provide feedback and advice on the following presentation content:\n\n[Presentation content]\n\nFeedback and advice:".

[0939] Step 4:

[0940] The server sends the generated prompt text to the OpenAI API. The API request includes parameters such as the prompt text, the AI ​​model used to generate the prompt text, and the token count limit.

[0941] Step 5:

[0942] The OpenAI API uses a generative AI model to generate feedback and advice based on the prompt text, which is then returned to the server as an API response.

[0943] Step 6:

[0944] The server receives the API response and extracts the generated feedback and advice, which is in text format and prepared for display to the user.

[0945] Step 7:

[0946] The server then sends the extracted feedback and advice to the smartphone, which receives the data and displays it to the user.

[0947] Step 8:

[0948] The user can check the generated feedback and advice on the screen of their smartphone, which allows them to obtain specific advice and improve their presentation content.

[0949] Example 2

[0950] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[0951] Conventional presentation support systems do not provide users with sufficient concrete feedback or advice on the content of their presentations, making it difficult to improve the quality of their presentations or their ability to captivate the audience. In addition, there was a lack of methods to help users speak with confidence, or to help them improve their language expression and storytelling.

[0952] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for supporting the content of the user's presentation and providing specific feedback and advice, a means for analyzing the content of the user's presentation using natural language processing technology, a means for generating feedback based on the analysis result using a generative AI model, a means for providing the generated feedback to the user, and a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience. This allows the user to receive specific and automatically generated feedback and improve the quality of the presentation.

[0953] "User" means an individual or organization that uses the system to give a presentation.

[0954] "Presentation content" is text data that includes the information or message that the user wants to convey in the presentation.

[0955] "Feedback" refers to specific improvements or advice provided to users regarding their submissions.

[0956] "Advice" is a specific suggestion or instruction to help the user improve their presentation.

[0957] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.

[0958] A "generative AI model" is a model that uses artificial intelligence to analyze the content of users' presentations and generate feedback.

[0959] "Analysis results" are the information obtained after the generative AI model analyzes the content of a user's presentation.

[0960] A "conversational agent" is software that interacts with users and provides feedback and advice.

[0961] "Presentation quality" is a comprehensive evaluation of the clarity, persuasiveness, and impact of the user's presentation on the audience.

[0962] The "audience" is the people who will be listening to the user's presentation.

[0963] The present invention is a system for providing specific feedback and advice to a user when he or she is giving a presentation. A specific embodiment of this system will be described below.

[0964] System Configuration

[0965] This system mainly consists of three elements: a server, a terminal, and a user. The server is responsible for analyzing the content of the user's presentation using a generative AI model and generating feedback. The terminal is a device through which the user inputs the content of the presentation and receives feedback. The user is the individual or group that gives the presentation.

[0966] Hardware and Software Used

[0967] Server: A computer system with high-performance computing power that serves as a platform for running generative AI models.

[0968] Generative AI models: For example, use models with advanced natural language processing techniques, such as OpenAI's GPT-4.

[0969] Device: The device used by the user, such as a computer, tablet, or smartphone.

[0970] Data processing and calculation

[0971] 1. Data Entry:

[0972] The user enters the presentation content into the device's text input field, for example:

[0973] "I will be giving a presentation on global warming. Here is the content:

[0974] 1. Definition of Global Warming

[0975] 2. Its Impact

[0976] 3. Specific Examples

[0977] 4. Countermeasures

[0978] 2. Data reception:

[0979] The data sent from the device reaches the server's API endpoint. The server receives the data and temporarily stores it in a database.

[0980] 3. Data Analysis:

[0981] The server passes the stored data to the generative AI model, which runs on the cloud and analyzes the text data. The analysis uses natural language processing techniques to evaluate the structure, grammar, and consistency of the text.

[0982] 4. Feedback Generation:

[0983] The server generates specific feedback and advice for the user based on the analysis results obtained from the generative AI model. For example, it generates the following feedback:

[0984] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[0985] 5. Providing feedback:

[0986] The server transmits the generated feedback to the user's terminal, where the user can view the feedback on the terminal screen.

[0987] Examples

[0988] If a user wants to give a presentation on global warming, they can input the following prompt into the generative AI model:

[0989] Example prompt:

[0990] "I will be giving a presentation on global warming. Below is the content. I would appreciate your feedback and suggestions.

[0991] 1. Definition of Global Warming

[0992] 2. Its Impact

[0993] 3. Specific Examples

[0994] 4. Countermeasures

[0995] The server receives this prompt, analyzes it using a generative AI model, and provides feedback like this:

[0996] Feedback example:

[0997] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[0998] In this way, users receive specific feedback and can improve the quality of their presentations.

[0999] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1000] Step 1:

[1001] The user inputs the presentation content.

[1002] The user inputs the contents of the presentation into the text input field of the terminal and clicks the "Send" button. The input data is text data that contains the information or message that the user wants to convey in the presentation. For example, the following contents are input:

[1003] "I will be giving a presentation on global warming. Here is the content:

[1004] 1. Definition of Global Warming

[1005] 2. Its Impact

[1006] 3. Specific Examples

[1007] 4. Countermeasures

[1008] Input: Text data of the presentation content entered by the user

[1009] Output: Data sent from the device to the server

[1010] Step 2:

[1011] The server receives the input data.

[1012] The data sent from the terminal reaches the server's API endpoint. The server receives this data and temporarily stores it in a database. The received data is text data of the presentation content entered by the user.

[1013] Input: Text data of the presentation content sent from the terminal

[1014] Output: Text data stored on the server

[1015] Step 3:

[1016] The server analyzes the data using a generative AI model.

[1017] The server passes the stored data to the generative AI model, which runs on the cloud and analyzes the text data. The analysis uses natural language processing techniques to evaluate the structure, grammar, and consistency of the text.

[1018] Input: Text data of the presentation content stored on the server

[1019] Output: Analysis results from generative AI models

[1020] Step 4:

[1021] The server generates the feedback.

[1022] The server generates specific feedback and advice for the user based on the analysis results obtained from the generative AI model. The generated feedback includes specific suggestions and instructions for the user to improve their presentation. For example, the server generates the following feedback:

[1023] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[1024] Input: Analysis results by generative AI model

[1025] Output: The generated feedback

[1026] Step 5:

[1027] The server provides feedback to the user.

[1028] The server transmits the generated feedback to the user's terminal, where the user can view the feedback on the terminal's screen. The provided feedback includes specific suggestions and instructions for the user to improve the presentation.

[1029] Input: Generated feedback

[1030] Output: Feedback displayed on the user's device

[1031] (Application example 2)

[1032] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1033] Conventional presentation support systems have difficulty providing specific feedback and advice to help users effectively communicate their presentation content. In addition, staff who explain products in physical stores lack the means to receive appropriate feedback in real time, which results in inconsistent quality of explanations to customers.

[1034] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience, a means for providing feedback and advice in real time when the user is explaining a product, a means for generating feedback based on the content of the user's presentation using a generative AI model, and a means for displaying feedback through smart glasses. This allows the user to receive appropriate feedback in real time, making it possible to improve the quality of presentations and product explanations.

[1035] "User" means an individual or organization that uses the system to make presentations and provide product information.

[1036] "Presentation content" refers to the information or message that the user wishes to convey in a presentation or product description.

[1037] "Feedback" refers to evaluation and advice for improvement provided to users regarding their submissions.

[1038] "Advice" is a specific suggestion or instruction to help a user improve their post.

[1039] "Linguistic expression" refers to the choice of words and phrases that users use to communicate their presentation.

[1040] "Storytelling" is a method of structuring and developing a story that allows users to effectively communicate the content of their presentation.

[1041] "Techniques" are techniques and methods that help users deliver speeches with confidence.

[1042] "Presentation quality" is a measure of how effectively a user communicates their presentation to the audience.

[1043] The "audience" is the people listening to the user presentation or product explanation.

[1044] "Real-time" refers to feedback and advice being provided to users at the exact moment they are making their post.

[1045] A "generative AI model" is an artificial intelligence model that automatically generates feedback and advice based on what a user posts.

[1046] "Smart glasses" are wearable devices that can be worn by a user and display visual information.

[1047] A system for carrying out the present invention provides feedback and advice in real time to a user when making a presentation or explaining a product. The system includes means for supporting the content of a presentation by a user and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for providing feedback and advice in real time to a user when explaining a product, means for generating feedback based on the content of the presentation by the user using a generative AI model, and means for displaying the feedback through smart glasses.

[1048] The server uses the generative AI model to generate feedback based on the user's speech. Specifically, when a user wears the smart glasses and explains a product to a customer, the speech is converted into text using voice recognition software. The text is sent to the server, which uses the generative AI model to generate feedback and advice. This feedback is displayed in real time on the smart glasses' display.

[1049] The hardware used includes smart glasses (e.g. Google Glass) and voice recognition software. The software used includes OpenAI's GPT-3 API, which allows users to receive appropriate feedback in real time to improve the quality of their presentations and product explanations.

[1050] As a concrete example, consider a case where a user puts on smart glasses and explains a new smartphone to a customer. The explanation is, "This smartphone is equipped with the latest processor and is very fast. It also has an excellent camera function, so you can take clear photos even at night." This explanation is converted to text by speech recognition software and sent to the server. The server sends the following prompt sentence to the generative AI model.

[1051] Example prompt:

[1052] Here's how a user describes the product: Please provide feedback and advice.

[1053] This smartphone is equipped with the latest processor, making it extremely fast, and it also has a great camera that can take clear photos even at night.

[1054] advice:

[1055] The generative AI model will generate feedback based on the prompt text, which will then be displayed on the smart glasses display, allowing users to receive appropriate feedback in real time and improve the quality of their explanations to customers.

[1056] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1057] Step 1:

[1058] A user puts on the smart glasses and starts to explain the product. The user's voice is collected through the microphone of the smart glasses. The input is the user's voice data, and the output is the voice data sent to the voice recognition software.

[1059] Step 2:

[1060] The smart glasses have speech recognition software that converts the user's speech into text data. The input is speech data, and the output is text data. This text data represents the content of the user's speech.

[1061] Step 3:

[1062] The smart glasses send the converted text data to the server. The input is the text data and the output is the text data sent to the server.

[1063] Step 4:

[1064] Based on the text data received by the server, a prompt is sent to the generative AI model. The input is text data containing the user's announcement, and the output is the prompt sent to the generative AI model. An example of a specific prompt is as follows:

[1065] Here's how a user describes the product: Please provide feedback and advice.

[1066] This smartphone is equipped with the latest processor, making it extremely fast, and it also has a great camera that can take clear photos even at night.

[1067] advice:

[1068] Step 5:

[1069] The generative AI model generates feedback and advice based on the prompt sentence. The input is the prompt sentence, and the output is text data containing the feedback and advice.

[1070] Step 6:

[1071] The server transmits the generated feedback or advice to the smart glasses. The input is text data containing the feedback or advice, and the output is text data transmitted to the smart glasses.

[1072] Step 7:

[1073] The smart glasses display the received feedback and advice to the user. The input is text data containing the feedback and advice, and the output is the feedback and advice displayed on the display of the smart glasses. This allows the user to receive appropriate feedback in real time.

[1074] Example 3

[1075] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1076] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on their presentation content, and are insufficient in providing techniques for improving language expression and storytelling, or for speaking with confidence. They also lack specific support for improving the quality of the presentation itself and increasing the ability to captivate the audience. Furthermore, they lack the ability to generate and display appropriate answers to questions entered by the user.

[1077] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, a means for analyzing a question input by the user and generating an answer using a generative AI model, and a means for displaying the generated answer to the user. This allows the user to receive specific feedback and advice, improves the quality of the presentation, and allows the user to obtain an appropriate answer to the user's question.

[1078] "User" means an individual or organization that uses the system to receive presentation support.

[1079] "Presentation content" is a general term for the information and messages that a user wishes to convey in a presentation.

[1080] "Feedback" is specific evaluation and suggestions for improvement provided to users regarding their presentations.

[1081] "Advice" refers to specific advice or guidance given to users regarding the content of their presentation or presentation techniques.

[1082] "Linguistic expression" refers to the choice and use of words and phrases that a user uses in a presentation.

[1083] "Storytelling" is a method of structuring and developing a narrative that allows users to effectively convey information in a presentation.

[1084] A "speech" is an oral announcement or explanation given by a User in a presentation.

[1085] "Techniques" are specific methods and skills that help users deliver speeches with confidence.

[1086] "Presentation quality" is an indicator of how good a user's presentation is visually and content-wise.

[1087] "Audience" refers collectively to those who will be listening to the user's presentation.

[1088] A "generative AI model" is an artificial intelligence model that generates appropriate answers or advice based on user questions or input.

[1089] A "question" is a question or inquiry that a user inputs into the system.

[1090] "Analysis" is the process of understanding the user's question or post and generating appropriate answers or advice.

[1091] An "Answer" is a solution or advice provided by a generative AI model in response to a user's question.

[1092] "Display" refers to providing the generated answer or advice to the user in a visible form.

[1093] This invention is a system that supports users in their presentations, specifically by providing feedback and advice on the content of their presentation, supporting the improvement of linguistic expression and storytelling, and providing techniques for speaking with confidence. It also improves the quality of the presentation itself and supports the ability to captivate the audience.

[1094] Hardware and Software Used

[1095] The system uses the following hardware and software:

[1096] Server: A server with high-performance computing power is required. The server receives questions from users and generates answers using generative AI models.

[1097] Terminal: A device on which a user enters a question and receives a response from the server. Terminals can be computers, tablets, smartphones, etc.

[1098] Generative AI models: For example, using advanced natural language processing models such as GPT-4. Generative AI models are used to generate appropriate answers to user questions.

[1099] Natural Language Processing Libraries: Use natural language processing libraries to parse questions.

[1100] Data processing and calculation

[1101] When the server receives a question from a user, it first analyzes the question. A natural language processing library is used for the analysis to understand the intent of the question. The analysis results are then input into a generative AI model to generate an appropriate answer. The generated answer is then sent from the server to the terminal and displayed to the user.

[1102] Examples

[1103] For example, if a user enters the prompt text:

[1104] Example prompt:

[1105] "How do I create visually appealing slides?"

[1106] In response to this prompt, the server would generate the following advice:

[1107] An example of the generated advice:

[1108] "To convey information visually, slides should have large headings and a few key points, and use simple charts rather than complex graphs. It is also effective to use color contrast to highlight important information."

[1109] In this way, the user can receive specific and practical advice. This system enables the user to improve the quality of their presentation and increase their ability to captivate the audience. The flow of the specific process in the third embodiment will be described with reference to FIG. 15.

[1110] Step 1:

[1111] The user inputs a question. The user inputs a question about "how to create visually appealing slides" through the terminal interface. For example, the user inputs "Please tell me how to create visually appealing slides." The input data is in text format.

[1112] Step 2:

[1113] The device sends a question to the server. The device sends the question entered by the user to the server as an HTTP request. The device transmits data over an Internet connection. The input is the user's question text, and the output is an HTTP request to the server.

[1114] Step 3:

[1115] The server analyzes the question. The server analyzes the received HTTP request and extracts the question. The server uses a natural language processing library to analyze the question and understand the user's intent. The input is the text data of the HTTP request, and the output is the analyzed question.

[1116] Step 4:

[1117] The server generates an answer using a generative AI model. The server generates an answer using a generative AI model (e.g. GPT-4) based on the analysis results. The generative AI model refers to an internal database to generate the optimal answer to the question and generates appropriate advice. The input is the analyzed question content, and the output is the generated answer text.

[1118] Step 5:

[1119] The server sends the generated answer to the terminal. The server converts the generated answer to JSON format and sends it to the terminal as an HTTP response. The response includes the generated advice. The input is the generated answer text, and the output is the HTTP response to the terminal.

[1120] Step 6:

[1121] The terminal displays the answer to the user. The terminal analyzes the HTTP response received from the server and extracts the generated advice. The terminal displays the advice on the web page so that the user can confirm it. The user confirms the advice on the screen, such as "To convey information visually, it is better to include large headings and a few key points on slides, and to use simple diagrams rather than complex graphs." The input is the HTTP response data, and the output is the advice displayed to the user.

[1122] (Application example 3)

[1123] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1124] Conventional presentation support systems can provide specific feedback and advice on the content of a user's presentation, but they lack the functionality to support the creation of visually appealing slides. In addition, when store clerks explain products in brick-and-mortar stores, they have no way to quickly create visually appealing slides and display them on smart devices, making it difficult to give effective presentations to customers.

[1125] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience, a means for supporting the creation of visually appealing slides, a means for displaying on a smart device, and a means for generating advice based on a prompt sentence using a generative AI model. This allows the user to quickly create visually appealing slides and give effective presentations even in physical stores.

[1126] "A means of supporting the user's presentation content and providing specific feedback and advice" is a function that provides the user with suggestions for improving the content and specific advice for their presentation or speech.

[1127] "Means to help improve language expression and storytelling" are functions that help users to use language and structure stories more effectively.

[1128] "Means of providing techniques for speaking with confidence" is a function that provides techniques and methods for users to give speeches with confidence.

[1129] "Means of improving the quality of the presentation itself and increasing its ability to captivate the audience" refers to functions that improve the overall quality of a presentation and help capture the audience's attention.

[1130] "Means to assist in the creation of visually appealing slides" is a function that assists users in creating visually appealing slides.

[1131] "Means for displaying on a smart device" refers to a function for displaying the created slides and advice on a device such as smart glasses or a smartphone.

[1132] A "means for generating advice based on a prompt sentence using a generative AI model" is a function that uses a generative AI model to automatically generate appropriate advice based on a prompt sentence entered by a user.

[1133] A system for implementing this invention includes means for supporting a user's presentation content and providing specific feedback and advice, means for assisting in improving linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and increasing the ability to captivate an audience, means for assisting in the creation of visually appealing slides, means for displaying on a smart device, and means for generating advice based on prompt sentences using a generative AI model.

[1134] System Programming

[1135] The program of this system operates as follows.

[1136] Hardware and Software

[1137] Hardware: smart glasses (e.g. Google Glass), smartphones, servers

[1138] Software: Python, OpenAI API

[1139] Data processing and calculation

[1140] The server converts the user's voice input into text and sends the text as a prompt to the generative AI model, which then generates appropriate advice based on the prompt and displays the advice on the smart device.

[1141] Examples

[1142] For example, when a store clerk is explaining a new smartphone product, he or she puts on the smart glasses and gives voice instructions such as, "Create a slide to visually appeal to the features of this smartphone." This voice instruction is converted into text and sent to the generative AI model as the following prompt sentence.

[1143] Example prompt:

[1144] Please provide some advice on how to create visually appealing slides. User Question: Can you create a slide that visually appeals the features of this smartphone?

[1145] The generative AI model will generate appropriate advice based on the prompt text and display it on the smart glasses display, allowing store associates to quickly create visually appealing slides and deliver effective presentations to customers.

[1146] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1147] Step 1:

[1148] The user puts on the smart glasses and is told aloud, "Create a slide to visually highlight the features of this smartphone."

[1149] Input: User's voice command

[1150] Output: Audio data

[1151] Step 2:

[1152] The smart glasses convert the voice data into text. Voice recognition software is used to convert the voice data into text.

[1153] Input: Audio data

[1154] Output: Text data

[1155] Step 3:

[1156] The smart glasses transmit the text data to the server. The smart glasses transmit the text data to the server via the network.

[1157] Input: Text data

[1158] Output: Text data sent to the server

[1159] Step 4:

[1160] The server receives the text data and sends it to the generative AI model as a prompt sentence. The server processes the text data into a format suitable for the generative AI model and generates the prompt sentence.

[1161] Input: Text data

[1162] Output: Prompt statement

[1163] Step 5:

[1164] A generative AI model generates advice based on the prompt. A generative AI model (e.g., OpenAI API) is used to generate advice based on the prompt.

[1165] Input: prompt statement

[1166] Output: Advice text

[1167] Step 6:

[1168] The server transmits the generated advice text to the smart glasses via a network.

[1169] Input: Advice text

[1170] Output: Advice text sent to smart glasses

[1171] Step 7:

[1172] The smart glasses display the advice text. The advice text is displayed on the display of the smart glasses, providing a visual to the user.

[1173] Input: Advice text

[1174] Output: Advice text displayed on the smart glasses display

[1175] This enables users to quickly create visually appealing slides and deliver effective presentations even in physical stores.

[1176] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1177] "Example 1"

[1178] In one embodiment of the present invention, a system for supporting a user's presentation and providing specific feedback and advice includes an emotion engine that infers an emotional state from the user's presentation and provides feedback and advice based on the emotional state. For example, if the user feels nervous, the emotion engine provides relaxation techniques and advice for speaking with confidence.

[1179] "Example 2"

[1180] In another embodiment, the emotion engine monitors the user's emotional state in real time and updates the feedback and advice according to the changes in the emotional state, for example, if the user feels nervous in the middle of a presentation, the emotion engine provides relaxation techniques at that moment.

[1181] "Example 3"

[1182] In yet another embodiment, the emotion engine analyzes the user's emotional state and provides feedback to the user accordingly, for example, if the user feels angry or anxious during a presentation, the emotion engine communicates that emotion to the user and provides specific advice on how to deal with it.

[1183] The process flow of each embodiment will be described below.

[1184] "Example 1"

[1185] Step 1: The user enters the announcement into the system.

[1186] Step 2: The emotion engine infers the user's emotional state from what they say.

[1187] Step 3: Provide specific feedback and advice to the user based on the emotional state estimated by the emotion engine.

[1188] "Example 2"

[1189] Step 1: The user enters the announcement into the system.

[1190] Step 2: The emotion engine monitors the user's emotional state in real time.

[1191] Step 3: The emotion engine updates and provides feedback and advice to the user based on changes in the emotional state.

[1192] "Example 3"

[1193] Step 1: The user enters the announcement into the system.

[1194] Step 2: The emotion engine analyzes the user's emotional state.

[1195] Step 3: The sentiment engine feeds back the analysis results to the user and provides specific advice on how to deal with it.

[1196] Example 1

[1197] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1198] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on the content of their presentation, and are insufficient in providing techniques for improving linguistic expression and storytelling, or for speaking with confidence. In addition, they do not provide feedback that takes into account the user's emotional state, so users cannot receive appropriate advice in situations where they feel nervous or anxious. This makes it difficult to improve the quality of presentations or their ability to captivate the audience.

[1199] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1200] In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of language expression and storytelling, a means for providing techniques for speaking with confidence, a means for estimating an emotional state from the content of a user's presentation and providing feedback and advice based on the emotional state, a means for automatically generating feedback and advice using a generative AI model, and a means for transmitting data input from a user terminal to the server, which analyzes and generates using an emotion engine and a generative AI model. This makes it possible to provide feedback and advice that is specific and in accordance with the emotional state of the user's presentation content, thereby improving the quality of the presentation and increasing the ability to captivate the audience.

[1201] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[1202] "Presentation content" refers to the presentation text and materials that the user enters into the system.

[1203] "Feedback" refers to specific improvements or advice provided to users regarding their submissions.

[1204] "Advice" refers to suggestions and guidance to help users give more effective presentations.

[1205] "Linguistic expression" refers to the use of words and expressions in a presentation.

[1206] "Storytelling" refers to the method of structuring and developing a story in a presentation.

[1207] "Techniques for speaking with confidence" refers to methods and techniques that help users speak with confidence when giving a presentation.

[1208] "Presentation quality" refers to the overall merits of the presentation's content, structure, and method of expression.

[1209] "Audience captivation" refers to the ability to capture and interest the audience through a presentation.

[1210] "Emotional state" refers to the psychological state, such as tension, anxiety, or joy, that a user feels when giving a presentation.

[1211] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to automatically generate feedback and advice based on user submissions.

[1212] An "emotion engine" is a system that infers a user's emotional state from what they say and provides feedback and advice based on that emotional state.

[1213] "User terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to input presentation content.

[1214] "Server" refers to a computer system that receives data sent from a user device and analyzes and generates emotions using an emotion engine and generative AI model.

[1215] This invention is a system that allows a user to input the contents of a presentation and provides specific feedback and advice based on the contents. The system supports the user's presentation content, provides techniques for improving linguistic expression and storytelling, and for speaking with confidence. It also includes a means for improving the quality of the presentation and increasing the ability to captivate the audience.

[1216] Hardware and Software Used

[1217] Hardware: Servers, user devices (PCs, tablets, smartphones)

[1218] Software: Generative AI models (e.g. GPT-4), emotion engines, user interfaces (web applications)

[1219] Specific operation of the system

[1220] User Input

[1221] The user inputs the contents of the presentation into the terminal. For example, the user inputs "Presentation on the features and market strategy of the new product."

[1222] Sending Data

[1223] The terminal transmits the input presentation content to the server. Specifically, the terminal transmits the input data to the server using an HTTP request.

[1224] Analysis by emotion engine

[1225] The server passes the received presentation content to the emotion engine. The emotion engine infers the user's emotional state from the presentation content. For example, the emotion engine infers that "the user is nervous."

[1226] Feedback generation using generative AI models

[1227] The server inputs the results of the emotion engine and the presentation content into the generative AI model. The generative AI model generates feedback and advice. For example, it generates feedback such as "Try relaxation techniques. Taking deep breaths can help relieve tension."

[1228] Providing feedback

[1229] The server transmits the generated feedback and advice to the user terminal. The user checks the feedback and advice on the terminal. For example, the user reads the feedback "Try a relaxation technique. Taking a deep breath can help relieve tension" and tries to take a deep breath.

[1230] Examples and prompts

[1231] Example: If a user enters "A presentation on new product features and market strategy," the system provides the following feedback: "Try some relaxation techniques. Taking deep breaths can help relieve tension."

[1232] Example prompt: "I'm going to give a presentation about our new product features and market strategy. Can you give me some advice on how to ease my nerves?"

[1233] In this way, users receive specific, emotionally-sensitive feedback and advice, helping them improve the quality of their presentations and their ability to engage their audiences.

[1234] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1235] Step 1:

[1236] User Input

[1237] The user inputs the contents of the presentation into the terminal. Specifically, the user inputs the text of the presentation using the keyboard or touch screen of the terminal.

[1238] Input: Presentation text (e.g. "Presentation on new product features and market strategy")

[1239] Output: Text data of the input presentation

[1240] Step 2:

[1241] Sending Data

[1242] The terminal transmits the input presentation content to the server. In particular, the terminal transmits the input data to the server using an HTTP request.

[1243] Input: Presentation text data

[1244] Output: The text data of the presentation sent to the server.

[1245] Step 3:

[1246] Analysis by emotion engine

[1247] The server passes the received presentation content to the emotion engine. Specifically, the server passes the presentation content to the emotion engine's API and performs emotion analysis.

[1248] Input: Presentation text data

[1249] Data processing: The emotion engine analyzes the text data and estimates the user's emotional state (e.g., nervous).

[1250] Output: Emotional state data (e.g. "The user is nervous")

[1251] Step 4:

[1252] Feedback generation using generative AI models

[1253] The server inputs the results of the emotion engine and the presentation content into the generative AI model. In concrete terms, the server combines the emotional state obtained from the emotion engine with the presentation content, and inputs it as a prompt into the generative AI model. The generative AI model generates feedback and advice.

[1254] Input: Emotional state data, text data of presentation

[1255] Data transformation: Generative AI models generate feedback and advice based on prompts (e.g., "Try relaxation techniques. Taking deep breaths can help relieve tension.")

[1256] Output: generated feedback and advice

[1257] Step 5:

[1258] Providing feedback

[1259] The server sends the generated feedback and advice to the user's device. Specifically, the server sends the feedback obtained from the generative AI model to the user's device as an HTTP response. The user checks the feedback and advice on the device.

[1260] Input: Generated feedback and advice

[1261] Output: Feedback and advice sent to the user's device.

[1262] Specific Action: The user reads the feedback displayed on the device screen and takes the required action (e.g., tries to take a deep breath)

[1263] The above is the specific processing flow of the program of this system.

[1264] (Application example 1)

[1265] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1266] Conventional presentation support systems can provide feedback and advice on the content of a user's presentation, but they cannot provide feedback or advice that takes into account the user's emotional state. In addition, there is a lack of concrete measures to improve the quality of customer service in physical stores. This makes it difficult for users and staff to make presentations and serve customers with confidence, and improving customer satisfaction has been an issue.

[1267] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for giving speeches with confidence, a means for estimating the emotional state of a user using an emotion engine and providing feedback and advice based on the emotional state, a means for a staff member of a physical store to input the content of a conversation with a customer in real time and provide improvements and advice on customer service, and a means for estimating the emotional state of the customer and providing advice on adjusting the customer service method based on the input. This enables users and staff to make presentations and serve customers with confidence, and improves customer satisfaction.

[1268] "A means of supporting the user's presentation content and providing specific feedback and advice" is a function that automatically generates and provides suggestions for improvement and advice based on the presentation content entered by the user.

[1269] "Means to help improve language expression and storytelling" is a feature that provides advice to users to make the language and narrative structure of their presentations more effective.

[1270] "Means of providing techniques for speaking with confidence" is a function that provides specific methods and techniques to enable users to speak with confidence.

[1271] "Means to improve the quality of the presentation itself and its ability to captivate the audience" is a feature that provides advice and techniques to improve the overall quality of a presentation and capture the audience's attention.

[1272] "A means for inferring a user's emotional state using an emotion engine and providing feedback and advice based on that emotional state" is a function that infers emotions from the content of the user's speech and facial expressions, etc., and provides appropriate feedback and advice according to those emotions.

[1273] "A means for store staff to input the content of conversations with customers in real time and provide advice and suggestions for improving customer service" refers to a function that enables store staff to input the content of conversations with customers into the system in real time and provide advice and suggestions for improving customer service based on that content.

[1274] "A means for estimating a customer's emotional state and providing advice on adjusting customer service methods based on that" is a function that estimates the customer's emotions from their facial expressions and language, and advises staff on the appropriate customer service methods based on those emotions.

[1275] The system for implementing the present invention includes a program for supporting the user's published content and providing specific feedback and advice. The processing of the program of this system will be explained below in natural language.

[1276] System Configuration

[1277] The system uses the following hardware and software:

[1278] Hardware: Smart glasses, server, user terminal (e.g. smartphone, tablet)

[1279] Software: OpenAI API, Emotion Recognition Module

[1280] Data processing and calculation

[1281] 1. Enter your announcement:

[1282] The user wears the smart glasses and inputs the contents of the conversation with the customer in real time, and the input data is sent to the server.

[1283] 2. Emotional state estimation:

[1284] The server uses an emotion recognition module to estimate the customer's emotional state from the input conversation content. This module analyzes text data and voice data and quantifies the emotional state.

[1285] 3. Generate feedback and advice:

[1286] The server uses the OpenAI API to generate feedback and advice based on the user's speech and estimated emotional state, which is then displayed in real time on the user's smart glasses.

[1287] Examples

[1288] For example, if a customer looks anxious while a store staff member is explaining a new product, the emotion recognition module will detect this and send a prompt message like the following to the OpenAI API:

[1289] Example prompt:

[1290] Presentation content: I'm explaining a new product. The customer seems a little anxious.

[1291] Emotional state: Anxiety

[1292] Please provide feedback and advice.

[1293] Based on this prompt, the OpenAI API generates advice such as, "The customer seems anxious. Please explain the product to them in a way that reassures them," and this advice is provided to staff in real time through the smart glasses.

[1294] In this way, the system can provide appropriate feedback and advice based on the content of the user's presentation and the emotional state of the customer, allowing users and staff to make presentations and serve customers with confidence, which is expected to improve customer satisfaction.

[1295] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1296] Step 1:

[1297] The user wears the smart glasses and inputs the contents of the conversation with the customer in real time. The input data is sent from the smart glasses to the server. The input data is in text format and includes the contents of the conversation with the customer.

[1298] Step 2:

[1299] The server passes the received text data to an emotion recognition module. The emotion recognition module analyzes the text data and estimates the customer's emotional state. Specifically, it quantifies the emotion in the text using natural language processing technology and assigns an emotion label, such as "anxiety," "joy," or "anger." The output is data indicating the estimated emotional state.

[1300] Step 3:

[1301] The server sends a prompt to the generative AI model (OpenAI API) based on the estimated emotional state and the user's speech. The prompt includes the user's speech and the estimated emotional state. Specific examples of prompts are as follows:

[1302] Presentation content: I'm explaining a new product. The customer seems a little anxious.

[1303] Emotional state: Anxiety

[1304] Please provide feedback and advice.

[1305] The input data is the prompt text, and the output data is the generated feedback and advice.

[1306] Step 4:

[1307] The generative AI model generates feedback and advice based on the prompt sentence. The generated feedback and advice are returned to the server. Specifically, the generative AI model uses natural language generation technology to output specific advice to the user in text format.

[1308] Step 5:

[1309] The server transmits the generated feedback and advice to the smart glasses, which display the received feedback and advice to the user in real time, so that the user can receive appropriate advice during the interaction with the customer.

[1310] Step 6:

[1311] The user continues to interact with the customer based on the feedback and advice displayed on the smart glasses, allowing the user to respond appropriately based on the customer's emotional state.

[1312] Example 2

[1313] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[1314] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on the content of their presentation, and lack the functionality to monitor the user's emotional state in real time and provide appropriate feedback. This makes it difficult for users to receive specific guidance on how to improve the quality of their presentation, and they are unable to receive appropriate support to reduce tension and anxiety.

[1315] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1316] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for monitoring the user's emotional state in real time and updating the feedback and advice according to changes in the emotional state, means for converting voice data into text data, means for analyzing video data to detect the user's emotional state, means for analyzing the text data using a generative AI model to generate feedback and advice, and means for providing the generated feedback and advice to the user. This enables the user to receive specific feedback and advice in real time, improve the quality of the presentation, and obtain appropriate support to reduce tension and anxiety.

[1317] "User" means an individual or organization that uses the system to give a presentation.

[1318] "Presentation content" refers to the entirety of the information or message that the user wishes to convey in the presentation.

[1319] "Feedback" refers to specific evaluations and suggestions for improvement provided to users regarding their presentations.

[1320] "Advice" is specific guidance or suggestions provided to help a user improve their presentation.

[1321] "Linguistic expression" refers to the choice and use of words and phrases that a user uses in a presentation.

[1322] "Storytelling" is a method of structuring and developing a narrative that allows users to effectively convey information in a presentation.

[1323] "Confident Speaking Techniques" are specific methods and techniques that help users speak with confidence during presentations.

[1324] "Presentation Quality" is a measure of how effective and engaging your presentation is to your audience.

[1325] An "emotional state" is the psychological state, such as tension, anxiety, or joy, that a user feels during a presentation.

[1326] "Real-time monitoring" means continuously monitoring the user's emotional state during the presentation.

[1327] "Audio data" refers to data in which the contents of a user's speech are recorded as audio.

[1328] "Text data" refers to voice data converted into character information.

[1329] "Video data" refers to video data that records a user's facial expressions and actions.

[1330] A "generative AI model" is an algorithm or program that uses artificial intelligence to analyze text data and generate feedback and advice.

[1331] An "interactive program" is software that interacts with a user to provide information, feedback, or advice.

[1332] The present invention provides a system for providing specific feedback and advice to a user on a presentation, and further monitors the emotional state of the user in real time to update the appropriate feedback. A specific embodiment of this system is described below.

[1333] Hardware and Software Used

[1334] Hardware: High-performance servers, user devices (PCs, tablets, smartphones, etc.)

[1335] Software: Generative AI models (e.g. GPT-4), emotion engines, speech recognition technology

[1336] Data processing and calculation

[1337] Data Entry: Audio and video data when a user gives a presentation

[1338] Data processing: Voice data is converted into text data using voice recognition technology. Facial expression recognition technology is used to analyze the user's emotional state from video data.

[1339] Data Computation: A generative AI model analyzes text data and generates feedback and advice on the content of the presentation. An emotion engine monitors the emotional state in real time and provides advice such as relaxation techniques as needed.

[1340] Examples

[1341] Example 1: When a user gives a presentation on "global warming"

[1342] The user starts a presentation using the terminal.

[1343] The terminal captures the audio and video of the presentation in real time and transmits them to the server.

[1344] The server uses voice recognition technology to convert the voice data into text data, and then analyzes the text data using a generative AI model.

[1345] The server generates advice such as, "To make the flow of your talk clear, it would be a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples," and sends it to the terminal.

[1346] The device displays the feedback it receives to the user.

[1347] Example 2: The emotion engine detects that the user is nervous during a presentation.

[1348] The server analyzes the video data and detects the user's level of tension from their facial expressions and tone of voice.

[1349] The server generates relaxation techniques, such as "We recommend that you take a deep breath and relax," and sends them to the terminal.

[1350] The device displays the advice received to the user.

[1351] Examples of prompt statements

[1352] Prompt 1: "I am giving a presentation on global warming. Can you give me some advice on how to clarify the flow of my speech?"

[1353] Prompt 2: "I feel nervous during presentations. Can you teach me some relaxation techniques?"

[1354] In this way, the system supports the user in their presentation and provides feedback and advice in real time.

[1355] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1356] Step 1:

[1357] The user starts a presentation using the terminal.

[1358] Input: User's audio and video

[1359] Specific behavior: A user launches the presentation software and begins a presentation. The device captures audio and video using the built-in microphone and camera.

[1360] Output: Captured audio and video data

[1361] Step 2:

[1362] The terminal transmits the captured audio and video data to the server.

[1363] Input: Captured audio and video data

[1364] Specific operation: The terminal compresses audio data and encodes video data and sends it to the server.

[1365] Output: Audio and video data sent to the server

[1366] Step 3:

[1367] The server converts the voice data into text data using voice recognition technology.

[1368] Input: Audio data sent to the server

[1369] Specific operation: The server converts the voice data into text data.

[1370] Output: Converted text data

[1371] Step 4:

[1372] The server analyzes the video data and monitors the user's emotional state in real time based on their facial expressions and tone of voice.

[1373] Input: Video data sent to the server

[1374] How it works: The server analyzes the video data and detects the user's emotional state from their facial expressions and tone of voice.

[1375] Output: Detected emotional state data

[1376] Step 5:

[1377] The server uses a generative AI model to analyze the text data and generate feedback and advice on the content of the presentation.

[1378] Input: Transduced text data, detected emotion state data

[1379] Specific operation: The server inputs text data into the generative AI model (GPT-4) and generates feedback and advice on the content of the presentation. It also generates feedback and advice according to the user's emotional state based on the emotional state data.

[1380] Output: generated feedback and advice

[1381] Step 6:

[1382] The server sends the generated feedback and advice to the device.

[1383] Input: Generated feedback and advice

[1384] Specific behavior: The server sends the generated feedback and advice to the device.

[1385] Output: Feedback and advice sent to the device.

[1386] Step 7:

[1387] The device displays any feedback or advice it receives to the user.

[1388] Input: Feedback and advice sent to the device

[1389] What it does: Your device receives feedback or advice and displays it as text on the screen or reads it aloud.

[1390] Output: Feedback and advice displayed to the user

[1391] In this way, the system supports the user in their presentation and provides feedback and advice in real time.

[1392] (Application example 2)

[1393] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1394] Conventional presentation support systems were limited to providing specific feedback and advice on the content of the user's presentation, and lacked the ability to monitor the user's emotional state in real time and provide feedback accordingly. Furthermore, there were no systems that provided real-time feedback or advice based on the emotional state for work instructions and training within factories. This made it difficult to reduce stress and tension for workers and provide efficient training.

[1395] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1396] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for monitoring the emotional state of the user in real time and updating the feedback and advice according to changes in the emotional state, means for providing feedback and advice in real time when giving work instructions or training in a factory, and means for monitoring the emotional state of workers and providing relaxation techniques if they are nervous. This makes it possible to provide more specific and appropriate feedback in real time for the content of the user's presentation or work instructions, and to support the user and workers according to their emotional states.

[1397] "A means of supporting the user's presentation content and providing specific feedback and advice" is a function that provides the user with real-time suggestions for improving the content and specific advice for their presentation or speech.

[1398] "Means to help improve language expression and storytelling" is a feature that provides advice and feedback to help users improve their language expression and narrative structure.

[1399] "Means of providing techniques for speaking with confidence" is a function that provides specific techniques and advice to help users give speeches with confidence.

[1400] "Means of improving the quality of the presentation itself and its ability to captivate the audience" is a function that provides advice and feedback to improve the overall quality of the presentation and capture the audience's attention.

[1401] "Means for monitoring a user's emotional state in real time and updating feedback and advice in response to changes in the emotional state" is a function for monitoring a user's emotional state in real time and providing appropriate feedback and advice in response to those changes.

[1402] "A means for providing real-time feedback and advice when giving work instructions or training in a factory" refers to a function that provides specific feedback and advice in real time during work instructions or training in a factory.

[1403] "Means for monitoring the emotional state of a worker and providing relaxation techniques if the worker feels tense" is a function for monitoring the emotional state of a worker and providing specific techniques or advice for relaxing if the worker feels tense.

[1404] The system for implementing the present invention includes a program for supporting the content of a user's presentation and providing specific feedback and advice. A specific embodiment of this system will be described below.

[1405] System Configuration

[1406] The system uses the following hardware and software:

[1407] Hardware: cameras, microphones, factory robots

[1408] Software: EmotionEngine (emotion detection engine), FeedbackGenerator (feedback generation engine)

[1409] Program processing explanation

[1410] Support for user announcements

[1411] The server uses a camera and microphone to capture the user's facial expressions and tone of voice in real time while the user is giving a presentation. The EmotionEngine analyzes this data to detect the user's emotional state. The FeedbackGenerator generates appropriate feedback and advice based on the user's presentation content and emotional state. The generated feedback is provided to the user through audio and display.

[1412] In-factory work instructions and training

[1413] The server monitors the behavior of workers using factory robots when giving instructions and training in the factory. The EmotionEngine analyzes the emotional state of the workers in real time and provides relaxation techniques if they are tense. The FeedbackGenerator generates specific feedback and advice based on the work content and provides it to the workers.

[1414] Examples

[1415] Presentation Support

[1416] Scenario: A user gives a presentation on "global warming".

[1417] Feedback: "To make the flow of your talk clearer, you should first explain the impact of global warming from a broader perspective, and then give specific examples."

[1418] Work instructions in the factory

[1419] Scenario: A new worker is learning how to operate machines in a factory.

[1420] Feedback: "Next, please do a safety check before you turn on the machine. You seem nervous, so please take a deep breath and relax."

[1421] Examples of prompt statements

[1422] Presentation Support: "Design a system that provides real-time feedback and advice to users as they learn to operate a machine. Include functionality to monitor the user's emotional state and offer relaxation techniques if they are nervous."

[1423] In this way, it is possible to provide more specific and appropriate feedback in real time in response to the content of user presentations and work instructions within the factory, enabling support that is tailored to the emotional state of the user or worker.

[1424] The flow of the identification process in the application example 2 will be described with reference to FIG.

[1425] Step 1:

[1426] The server uses a camera and microphone to capture the user's facial expressions and tone of voice in real time. As input, it obtains the user's video and audio data. These data are sent to the EmotionEngine and become input data for analyzing the user's emotional state. In concrete terms, the camera takes a picture of the user's face and the microphone records the user's voice.

[1427] Step 2:

[1428] The server uses the EmotionEngine to analyze the acquired video and audio data to detect the user's emotional state. The video and audio data acquired in step 1 are used as input. The EmotionEngine analyzes facial expressions and voice tone, and outputs the user's emotional state, such as whether they are tense or relaxed. In concrete terms, the EmotionEngine extracts facial feature points and analyzes the pitch and tone of the voice.

[1429] Step 3:

[1430] The server uses the FeedbackGenerator to generate feedback and advice based on the user's presentation and emotional state. As input, it uses the text data of the user's presentation and the emotional state detected in step 2. The FeedbackGenerator uses a generative AI model to output appropriate feedback and advice. In concrete terms, the generative AI model analyzes the user's presentation and generates advice according to the user's emotional state.

[1431] Step 4:

[1432] The server provides the generated feedback and advice to the user. As input, it uses the text data of the feedback and advice generated in step 3. As output, it provides the feedback to the user through speech and display. In concrete terms, the speech synthesis engine converts the feedback into speech and transmits it to the user through the speaker. It also displays the text of the feedback on the display.

[1433] Step 5:

[1434] The server uses factory robots to monitor the movements of workers when giving work instructions and training in the factory. As input, it uses the movement data of workers acquired from cameras and sensors. These data are sent to EmotionEngine and become input data for analyzing the emotional state of workers. In terms of specific operations, the factory robot tracks the movements of workers, and the cameras and sensors collect data.

[1435] Step 6:

[1436] The server uses the EmotionEngine to analyze the acquired motion data and detect the worker's emotional state. The motion data acquired in step 5 is used as input. The EmotionEngine analyzes the worker's movements and facial expressions, and outputs the worker's emotional state, such as whether he or she is tense or relaxed. As for specific movements, the EmotionEngine extracts the feature points of the movements and analyzes the emotional state.

[1437] Step 7:

[1438] The server uses the FeedbackGenerator to generate feedback and advice based on the task content and the emotional state. As input, it uses the text data of the task content and the emotional state detected in step 6. The FeedbackGenerator uses a generative AI model to output appropriate feedback and advice. In concrete terms, the generative AI model analyzes the task content and generates advice according to the emotional state.

[1439] Step 8:

[1440] The server provides the generated feedback and advice to the worker. As input, it uses the text data of the feedback and advice generated in step 7. As output, it provides the feedback to the worker through voice or display. In concrete terms, the voice synthesis engine converts the feedback into voice and conveys it to the worker through the speaker. It also displays the text of the feedback on the display.

[1441] In this way, it is possible to provide more specific and appropriate feedback in real time in response to the content of user presentations and work instructions within the factory, enabling support that is tailored to the emotional state of the user or worker.

[1442] Example 3

[1443] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1444] Conventional presentation support systems did not provide users with sufficient specific feedback or advice on the content of their presentation, nor were they able to analyze the user's emotional state in real time and provide feedback based on that. As a result, it was difficult for users to obtain specific guidelines for improving the quality of their presentation, and there was a lack of effective ways to reduce tension and anxiety during the presentation.

[1445] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1446] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for accepting questions from the user and generating answers using a generative AI model, and means for analyzing the user's emotional state and feeding back the results. This allows the user to receive specific feedback and advice in real time, improving the quality of the presentation and effectively reducing tension and anxiety during the presentation.

[1447] "User" means an individual or organization that uses the system to give a presentation.

[1448] "Presentation content" refers to the information or message that the user wishes to convey in the presentation.

[1449] "Feedback" refers to specific evaluations or advice provided to a user regarding their presentation content or progress.

[1450] "Advice" is specific guidance or a suggestion to help users improve their presentation.

[1451] "Linguistic expressions" are the words and phrases that users use in their presentations.

[1452] "Storytelling" refers to the structure and development of a narrative that allows users to effectively convey information in a presentation.

[1453] "Techniques" are specific methods and techniques that help users deliver speeches with confidence.

[1454] "Presentation quality" refers to how effectively your presentation informs and engages your audience.

[1455] A "generative AI model" is artificial intelligence that generates appropriate answers to user questions.

[1456] An "emotional state" is the emotion a user feels during a presentation, such as nervousness, anxiety, anger, etc.

[1457] "Feedback measures" refer to methods and techniques for analyzing the user's emotional state and communicating the results to the user.

[1458] This invention is a system that supports users in their presentations and provides specific feedback and advice. The system accepts questions from users, generates answers using a generative AI model, and provides feedback by analyzing the user's emotional state.

[1459] Hardware and Software Used

[1460] Hardware: Servers, terminals (PCs, tablets, smartphones)

[1461] Software: Generative AI models (e.g. GPT-4), emotion engines, presentation software

[1462] Specific operation of the system

[1463] 1. Accepting user questions

[1464] A user uses a terminal to input a question about the presentation.

[1465] Example: "How do I create visually appealing slides?"

[1466] 2. Submit your question

[1467] The terminal transmits the user's question to the server.

[1468] 3. Answer generation using generative AI models

[1469] The server inputs the received question into a generative AI model to generate an appropriate answer.

[1470] Example: "To convey information visually, slides should have large headlines, a few key points, and simple charts rather than complex graphs."

[1471] 4. Submit your answer

[1472] The server sends the generated answer to the terminal.

[1473] 5. Display to the User

[1474] The terminal displays the received response to the user.

[1475] 6. Emotional state analysis

[1476] While the user is giving a presentation, the device uses a camera and microphone to collect the user's facial expressions and tone of voice.

[1477] 7. Sentiment engine analysis

[1478] The server uses an emotion engine to analyze the user's emotional state from the collected data.

[1479] Example: Determining that the user is feeling angry or anxious.

[1480] 8. Emotional state feedback

[1481] The server transmits the analysis results to the terminal, which displays the feedback to the user.

[1482] For example: "It seems like you're feeling angry or anxious right now. I suggest you take a deep breath and relax."

[1483] Examples

[1484] Examples of prompt statements

[1485] "How do I create visually appealing slides?"

[1486] "How can I reduce my nervousness during a presentation?"

[1487] This system allows users to receive specific feedback and advice in real time, improving the quality of their presentation and effectively reducing tension and anxiety during the presentation. The flow of the specific process in the third embodiment will be described with reference to FIG.

[1488] Step 1:

[1489] A user uses a terminal to input a question about the presentation.

[1490] Specific Action: A user types, using a keyboard or touchscreen, "Can you help me create visually appealing slides?"

[1491] Input: The text of the user's question

[1492] Output: The question text is typed into the terminal.

[1493] Step 2:

[1494] The terminal transmits the user's question to the server.

[1495] Specific operation: The device sends the entered question to the server via the Internet as an HTTP request.

[1496] Input: Question text

[1497] Output: The question text is sent to the server.

[1498] Step 3:

[1499] The server inputs the received question into a generative AI model to generate an appropriate answer.

[1500] How it works: The server passes the question to a generative AI model (e.g., GPT-4), which generates an answer such as, "To convey information visually, slides should have large headlines and a few key points, and use simple charts rather than complex graphs."

[1501] Input: Question text

[1502] Output: The generated answer text

[1503] Step 4:

[1504] The server sends the generated answer to the terminal.

[1505] Specific operation: The server sends the generated answer to the terminal as an HTTP response.

[1506] Input: Generated answer text

[1507] Output: The answer text is sent to the terminal.

[1508] Step 5:

[1509] The terminal displays the received response to the user.

[1510] What it does: The device displays the following text on the screen: "To convey information visually, slides should include large headlines, a few key points, and use simple charts rather than complex graphs."

[1511] Input: Answer text

[1512] Output: The answer text is displayed on the terminal screen.

[1513] Step 6:

[1514] While the user is giving a presentation, the device uses a camera and microphone to collect the user's facial expressions and tone of voice.

[1515] Specific actions: The device takes a picture of the user's face with the camera and records their voice with the microphone.

[1516] Input: User's facial expression data, voice tone data

[1517] Output: Collected facial expression data and tone of voice data are saved on the device.

[1518] Step 7:

[1519] The server uses an emotion engine to analyze the user's emotional state from the collected data.

[1520] How it works: The server inputs data from the camera and microphone into an emotion engine to analyze whether the user is feeling anger or anxiety.

[1521] Input: facial expression data, tone of voice data

[1522] Output: Emotional state analysis result

[1523] Step 8:

[1524] The server transmits the analysis results to the terminal, which displays the feedback to the user.

[1525] Specific behavior: The server sends a message to the device saying, "You seem to be feeling angry or anxious right now. We recommend that you take a deep breath and relax," and the device displays the message on its screen.

[1526] Input: Emotional state analysis results

[1527] Output: Feedback messages are printed to the terminal screen.

[1528] (Application example 3)

[1529] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1530] Conventional presentation support systems only provide feedback and advice on the content of a user's presentation, but lack the ability to analyze the user's emotional state in real time and provide feedback, or the ability to provide advice on creating visually appealing slides. This makes it difficult for users to reduce the anxiety and tension they feel during a presentation and give a more effective presentation.

[1531] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means. In this invention, the server includes a means for supporting the content of the user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience, a means for analyzing the user's emotional state in real time and feeding back the results, and a means for providing advice on creating visually appealing slides. This allows the user to reduce anxiety and tension felt during the presentation and to give a more effective and attractive presentation.

[1532] "User" means an individual or organization that uses the system to give a presentation.

[1533] "Presentation content" refers to the information or message that the user wishes to convey in the presentation.

[1534] "Feedback" refers to evaluation or advice provided to a user regarding their presentation content or progress.

[1535] "Advice" is specific suggestions or instructions to help users give more effective presentations.

[1536] "Linguistic expression" refers to the words and phrases a user chooses to use in a presentation.

[1537] "Storytelling" is a method of structuring and developing a narrative that allows users to effectively convey information in a presentation.

[1538] "Techniques" are specific methods and skills that help users deliver speeches with confidence.

[1539] "Quality" refers to the overall excellence of the presentation's content, structure, visual elements, etc.

[1540] The "audience" is the people who will be listening to the user's presentation.

[1541] An "emotional state" is the psychological state or mood a user feels during a presentation.

[1542] "Real-time" refers to the instantaneous processing and analysis that occurs at the moment the user is making a presentation.

[1543] "Visually appealing" refers to slides and visual elements that are visually appealing and have the ability to convey information effectively.

[1544] "Slide creation" is the process of designing and arranging content on slides for use in a presentation.

[1545] A system for implementing this invention includes means for supporting a user's presentation content and providing specific feedback and advice, means for assisting in improving linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and increasing the ability to captivate an audience, means for analyzing a user's emotional state in real time and feeding back the results, and means for providing advice on creating visually appealing slides.

[1546] Hardware and Software Used

[1547] Hardware: Smartphones, smart glasses, cameras

[1548] Software: OpenCV, EmotionRecognizer (emotion recognition library), SlideAdvisor (slide advice library)

[1549] Data processing and calculation

[1550] Camera Input

[1551] The device's camera captures the user's image in real time, allowing it to capture the user's facial expressions and movements.

[1552] sentiment analysis

[1553] The device uses EmotionRecognizer to analyze the user's emotions from captured video frames. The emotion recognition model identifies emotions such as "anger," "anxiety," and "happiness" from the user's facial expressions.

[1554] Provide feedback

[1555] The server provides real-time feedback to the user based on the results of emotion analysis. For example, if the user is feeling angry or anxious, the server will display advice such as "try to speak calmly."

[1556] Slide Advice

[1557] The device uses SlideAdvisor to provide advice on the slide content entered by the user, such as making the headings larger or using simpler charts and graphs.

[1558] Examples

[1559] scenario

[1560] Staff at a physical store wear smart glasses while giving a presentation on new products.

[1561] operation

[1562] When a staff member gives a presentation, the smart glasses analyze the staff member's emotions in real time and provide feedback such as "speak calmly" as necessary. It also displays advice on the content of the presentation slides such as "make the heading larger" and "use simple charts and graphs."

[1563] Examples of prompt statements

[1564] When presenting new products, offer advice on how to create visually appealing slides. Also, analyze the emotional state during the presentation and provide feedback if necessary.

[1565] In this way, users can reduce anxiety and tension during presentations, enabling them to deliver more effective and engaging presentations.

[1566] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1567] Step 1:

[1568] The device's camera captures the user's image in real time. The input is the camera image, and the output is the image frame. The specific operation is that the camera captures the user's face and facial expressions.

[1569] Step 2:

[1570] The device inputs the captured video frames into EmotionRecognizer to analyze the user's emotions. The input is the video frame, and the output is emotion data (e.g. "anger," "anxiety," "joy," etc.). Specifically, EmotionRecognizer analyzes the facial features in the frame and identifies the emotion.

[1571] Step 3:

[1572] The server provides real-time feedback to the user based on the results of the emotion analysis. The input is emotion data, and the output is a feedback message. Specifically, the server generates advice such as "speak calmly" and sends it to the terminal.

[1573] Step 4:

[1574] The device inputs the slide content entered by the user into SlideAdvisor and provides advice on creating visually appealing slides. The input is the slide content, and the output is advice messages. Specifically, SlideAdvisor analyzes the placement of slide headings and figures, and generates specific suggestions such as "make the heading larger" or "use simple figures."

[1575] Step 5:

[1576] The terminal displays the feedback messages received from the server and the advice messages received from SlideAdvisor to the user. The input is the feedback message and the advice message, and the output is the display to the user. In concrete terms, the messages are displayed on the terminal display or smart glasses so that the user can check them in real time.

[1577] In this way, users can reduce anxiety and tension during presentations, enabling them to deliver more effective and engaging presentations.

[1578] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1579] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1580] Another example of generative AI is Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1581] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1582] [Third embodiment]

[1583] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1584] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1585] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[1586] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1587] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[1588] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[1589] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[1590] Fig. 6 shows an example of main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1591] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1592] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1593] In the headset type terminal 314, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1594] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1595] "Example 1"

[1596] In one embodiment of the present invention, a user inputs the contents of a presentation into the system. The system generates and provides specific feedback and advice to the user based on the input contents. The feedback and advice include support for presentation skills such as improving language expression and storytelling, and techniques for speaking with confidence.

[1597] "Example 2"

[1598] As a concrete example, if a user makes a presentation on global warming, the system will provide specific feedback and advice on the content of the presentation, such as "To make the flow of your presentation clearer, first explain the impact of global warming from a broad perspective, and then provide specific examples."

[1599] "Example 3"

[1600] In addition, the system also provides assistance in improving the quality of the presentation itself. For example, if a user asks, "How do I create slides that are visually appealing?" the system will provide advice such as, "To convey information visually, slides should have large headings and a few key points, and should use simple charts rather than complex graphs."

[1601] The process flow of each embodiment will be described below.

[1602] "Example 1"

[1603] Step 1: The user enters the presentation content into the system.

[1604] Step 2: The system generates specific feedback and advice based on what you input.

[1605] Step 3: Provide the generated feedback and advice to the user.

[1606] "Example 2"

[1607] Step 1: The user enters “Presentation on Global Warming” into the system.

[1608] Step 2: The system generates specific feedback and advice based on the input, such as "To make the flow of your story clearer, first explain the impact of global warming from a broad perspective, and then provide specific examples."

[1609] Step 3: Provide the generated feedback and advice to the user.

[1610] "Example 3"

[1611] Step 1: The user asks a question about "how to create a visually appealing slide." Step 2: The system generates specific feedback and advice based on the question. For example, the system provides advice such as "To convey information visually, slides should have large headings and a few key points, and should use simple charts rather than complex graphs."

[1612] Step 3: Provide the generated feedback and advice to the user.

[1613] Example 1

[1614] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1615] Conventional presentation support systems have the problem that it is difficult for users to get specific feedback or advice even when they input the content of their presentation. In addition, there is a lack of means to improve linguistic expression and storytelling, or provide techniques for speaking with confidence, making it difficult to improve the quality of presentations. Furthermore, there is a lack of specific support to improve the ability to captivate the audience.

[1616] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1617] In this invention, the server includes a means for inputting the contents of a presentation by a user, a means for transmitting the input contents of the presentation to the server, a means for the server to receive the input contents and store them as text data, a means for passing the stored text data to the generative AI model, a means for the generative AI model to generate feedback and advice, a means for the server to receive the generated feedback and advice, a means for the server to transmit the feedback and advice to the terminal, a means for the terminal to display the feedback and advice to the user, a means for supporting the improvement of language expression and storytelling, a means for providing techniques for speaking with confidence, and a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience. This allows the user to obtain specific feedback and advice, making it possible to improve the quality of the presentation.

[1618] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[1619] "Presentation content" refers to text data and information that a user inputs for a presentation.

[1620] A "server" is a computer system that receives, stores, and passes on announcements sent by users to the generative AI model.

[1621] A "terminal" is a device on which a user inputs the contents of a presentation and displays feedback and advice sent from the server.

[1622] A "generative AI model" is an artificial intelligence model that analyzes the input presentation content and generates specific feedback and advice.

[1623] "Feedback" refers to specific improvements or advice that the generative AI model generates based on what is presented.

[1624] "Advice" is specific suggestions or guidance for improving the user's presentation.

[1625] "Linguistic expression" refers to the choice of words and phrases that users use to communicate their presentation.

[1626] "Storytelling" is a method of structuring and developing a story that allows users to effectively communicate the content of their presentation.

[1627] "Speech techniques" are specific ways of speaking and expressing oneself that allow users to make presentations with confidence.

[1628] "Presentation quality" is a measure of how effectively a user communicates their presentation to the audience.

[1629] "Audience captivation" refers to the ability of a user's presentation to capture the audience's attention and interest.

[1630] An "interactive program" is software that interacts with a user to provide information, feedback, or advice.

[1631] This invention is a system in which a user inputs the contents of a presentation and receives specific feedback and advice based on the contents. The system aims to improve the quality of presentations and increase the ability to captivate an audience by supporting the contents of the user's presentation and providing techniques to improve linguistic expression and storytelling and to give speeches with confidence.

[1632] Hardware and Software Used

[1633] The system uses the following hardware and software:

[1634] Terminal: A device on which a user enters presentation content and receives feedback and advice. Examples include personal computers and smartphones.

[1635] Server: A computer system that receives, stores, and passes user-submitted announcements to the generative AI model.

[1636] Generative AI model: An artificial intelligence model that analyzes input presentation content and generates specific feedback and advice. An example is GPT-4.

[1637] Data processing and calculation

[1638] When a user uses a terminal to input presentation content, the content is sent to the server. The server receives the input content and saves it as text data. The saved text data is passed to the generative AI model. The generative AI model analyzes the input text and generates feedback and advice. The generated feedback and advice is sent back to the terminal via the server and displayed to the user.

[1639] Examples

[1640] For example, if a user enters the following presentation description:

[1641] "My presentation will be about the importance of protecting the environment. Specifically, I will talk about ways to reduce plastic waste and ideas for reusing it."

[1642] Once this is entered into the system, the server passes the text to a generative AI model that generates feedback and advice like this:

[1643] "Your presentation covers a very important topic. It would be even more effective if you improved the following:

[1644] 1. In your introduction, it's a good idea to add some concrete data or statistics that highlight the importance of protecting the environment.

[1645] 2. When talking about ways to reduce plastic waste, sharing real-life success stories can help capture your audience’s attention.

[1646] 3. Using visual aids (e.g. slides, pictures) when explaining reuse ideas helps improve understanding.”

[1647] Example of a prompt to be input to a generative AI model:

[1648] "Please generate specific feedback and advice based on the presentation below:

[1649] "My presentation will be about the importance of environmental protection. Specifically, I will talk about ways to reduce plastic waste and ideas for reusing it."

[1650] In this way, users receive specific feedback and advice to improve the quality of their presentations.

[1651] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1652] Step 1:

[1653] The user inputs the presentation content.

[1654] The user inputs the contents of the presentation into an input form on the terminal. This input form includes fields for the title, main text, supplementary information, etc. The input data is saved in the terminal in text format.

[1655] Step 2:

[1656] The terminal sends the input information to the server.

[1657] The device sends the presentation content entered by the user to the server using an HTTP POST request, including metadata such as the user ID and a timestamp.

[1658] Step 3:

[1659] The server receives the input and stores it as text data.

[1660] The server receives the data sent from the terminal and stores it in the database as text data. When storing it, metadata such as the user ID and timestamp are also recorded. The input is the HTTP POST request data, and the output is the text data stored in the database.

[1661] Step 4:

[1662] The server passes the stored text data to the generative AI model.

[1663] The server converts the stored text data into an appropriate format to be passed to the generative AI model. The converted data is input to the generative AI model. The input is the text data obtained from the database, and the output is the data passed to the generative AI model.

[1664] Step 5:

[1665] Generative AI models generate feedback and advice.

[1666] A generative AI model (e.g., GPT-4) analyzes the text data passed to it and generates feedback and advice. The generated content includes improvements to linguistic expression, strengthening storytelling, and techniques for speaking with confidence. The input is the text data passed to the generative AI model, and the output is the generated feedback and advice.

[1667] Step 6:

[1668] The server receives the generated feedback and advice.

[1669] The server receives the feedback and advice returned by the generative AI model. This data is returned to the server again in text format. The input is the feedback and advice returned by the generative AI model, and the output is the feedback and advice stored on the server.

[1670] Step 7:

[1671] The server sends feedback and advice to the device.

[1672] The server sends the received feedback and advice to the terminal using HTTP responses. The input is the feedback and advice stored on the server, and the output is the feedback and advice sent to the terminal.

[1673] Step 8:

[1674] The device displays feedback and advice to the user.

[1675] The terminal displays the feedback and advice received from the server to the user. The user can check the displayed content and use it to improve the presentation. The input is the feedback and advice received from the server, and the output is the feedback and advice displayed to the user.

[1676] (Application example 1)

[1677] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1678] Conventional presentation support systems only provide limited functionality for providing specific feedback and advice when users input the content of their presentation, making it difficult for them to provide effective support, particularly when store staff are explaining products or introducing services. In addition, the lack of automated generation of feedback using generative AI models or effective advice using prompts makes it difficult to improve the quality of presentations or their ability to captivate the audience.

[1679] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1680] In this invention, the server includes means for supporting the content of a user's presentation and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for inputting the content of a presentation when a staff member of a physical store is explaining a product or introducing a service, and for the system to provide specific feedback and advice based on the content, means for generating feedback and advice using a generative AI model, means for generating prompt sentences and inputting them into the generative AI model, and means for displaying the generated feedback and advice to a user. This enables staff members of a physical store to give more effective presentations when explaining a product or introducing a service.

[1681] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[1682] "Presentation content" refers to the information and materials that a user uses during a presentation.

[1683] "Feedback" refers to specific evaluations and suggestions for improvement provided to users regarding their submissions.

[1684] "Advice" is specific suggestions or guidance to help users improve their presentations.

[1685] "Linguistic expressions" are the words and phrases that users use in their presentations.

[1686] "Storytelling" refers to the structure and development of a story that users use in their presentations.

[1687] "Techniques" are specific methods and techniques that help users deliver speeches with confidence.

[1688] "Quality" refers to the overall execution or effectiveness of the presentation.

[1689] The "audience" is the people who listen to the presentation.

[1690] A "brick and mortar store" means a sales or service establishment that is located in a physical location.

[1691] "Staff" refers to employees working in physical stores.

[1692] "Product description" refers to the explanation of a product's features and benefits given to customers by store staff.

[1693] "Service introduction" refers to an explanation of the services offered by store staff to customers.

[1694] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate feedback or advice based on user input.

[1695] A "prompt" is an instruction or question that is input into a generative AI model.

[1696] A system for implementing the present invention allows a user to input the contents of a presentation and provides specific feedback and advice based on the contents. The system is realized using the following hardware and software.

[1697] Hardware

[1698] Smartphone: A device that allows users to enter presentation content and receive feedback and advice.

[1699] software

[1700] Python: A programming language used to implement programs.

[1701] OpenAI API: An API for generating feedback and advice using generative AI models.

[1702] Data processing and calculation

[1703] 1. User input: The user inputs the presentation content using their smartphone.

[1704] 2. Prompt generation: The server generates a prompt based on the presentation content entered by the user.

[1705] 3. Use of generative AI model: The server sends the generated prompt text to the OpenAI API and uses the generative AI model to generate feedback and advice.

[1706] 4. Displaying feedback: The server displays the generated feedback and advice on the smartphone.

[1707] Examples

[1708] If a user enters a presentation of their new smartphone, the following feedback is generated:

[1709] Presentation content entered:

[1710] "This new smartphone is equipped with the latest camera technology, allowing you to take clear photos even at night. Plus, it has a long battery life, so you can use it all day without having to worry about charging."

[1711] Generated feedback and advice:

[1712] "This presentation is very informative, but it would be even more effective if you added some more concrete examples. For example, you could show a specific situation where you took a photo at night, or show a specific amount of time to highlight the long battery life. You could also use questions to get the customer's attention."

[1713] Example prompt:

[1714] "Please provide your feedback and suggestions on the presentation below:\n\nThis new smartphone is equipped with the latest camera technology, allowing you to take clear photos even at night. In addition, it has a long battery life, so you can use it all day without worrying about charging.\n\nFeedback and Suggestions:"

[1715] In this way, store staff can give more effective presentations when explaining products and introducing services.

[1716] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1717] Step 1:

[1718] A user inputs the contents of a presentation using a smartphone. The input contents are saved on the smartphone as text data.

[1719] Step 2:

[1720] The terminal transmits the input presentation content to the server, which receives the text data and prepares it for generating a prompt sentence.

[1721] Step 3:

[1722] The server generates a prompt based on the received presentation content. Specifically, the server inserts the presentation content into a prompt template and converts it into a format suitable for the generative AI model. For example, the format is "Please provide feedback and advice on the following presentation content:\n\n[Presentation content]\n\nFeedback and advice:".

[1723] Step 4:

[1724] The server sends the generated prompt text to the OpenAI API. The API request includes parameters such as the prompt text, the AI ​​model used to generate the prompt, and the token count limit.

[1725] Step 5:

[1726] The OpenAI API uses a generative AI model to generate feedback and advice based on the prompt text, which is then returned to the server as an API response.

[1727] Step 6:

[1728] The server receives the API response and extracts the generated feedback and advice, which is in text format and prepared for display to the user.

[1729] Step 7:

[1730] The server then sends the extracted feedback and advice to the smartphone, which receives the data and displays it to the user.

[1731] Step 8:

[1732] The user can check the generated feedback and advice on the screen of their smartphone, which allows them to obtain specific advice and improve their presentation content.

[1733] Example 2

[1734] Next, a second embodiment of the second form will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1735] Conventional presentation support systems do not provide users with sufficient concrete feedback or advice on the content of their presentations, making it difficult to improve the quality of their presentations or their ability to captivate the audience. In addition, there was a lack of methods to help users speak with confidence, or to help them improve their language expression and storytelling.

[1736] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for supporting the content of the user's presentation and providing specific feedback and advice, a means for analyzing the content of the user's presentation using natural language processing technology, a means for generating feedback based on the analysis result using a generative AI model, a means for providing the generated feedback to the user, and a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience. This allows the user to receive specific and automatically generated feedback and improve the quality of the presentation.

[1737] "User" means an individual or organization that uses the system to give a presentation.

[1738] "Presentation content" is text data that includes the information or message that the user wants to convey in the presentation.

[1739] "Feedback" refers to specific improvements or advice provided to users regarding their submissions.

[1740] "Advice" is a specific suggestion or instruction to help a user improve their presentation.

[1741] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.

[1742] A "generative AI model" is a model that uses artificial intelligence to analyze the content of users' presentations and generate feedback.

[1743] "Analysis results" are the information obtained after the generative AI model analyzes the content of a user's presentation.

[1744] A "conversational agent" is software that interacts with users and provides feedback and advice.

[1745] "Presentation quality" is a comprehensive evaluation of the clarity, persuasiveness, and impact of the user's presentation on the audience.

[1746] The "audience" is the people who will be listening to the user's presentation.

[1747] The present invention is a system for providing specific feedback and advice to a user when he or she is giving a presentation. A specific embodiment of this system will be described below.

[1748] System Configuration

[1749] This system mainly consists of three elements: a server, a terminal, and a user. The server is responsible for analyzing the content of the user's presentation using a generative AI model and generating feedback. The terminal is a device through which the user inputs the content of the presentation and receives feedback. The user is the individual or group that gives the presentation.

[1750] Hardware and Software Used

[1751] Server: A computer system with high-performance computing power that serves as a platform for running generative AI models.

[1752] Generative AI models: For example, use models with advanced natural language processing techniques, such as OpenAI's GPT-4.

[1753] Device: The device used by the user, such as a computer, tablet, or smartphone.

[1754] Data processing and calculation

[1755] 1. Data Entry:

[1756] The user enters the presentation content into the device's text input field, for example:

[1757] "I will be giving a presentation on global warming. Here is the content:

[1758] 1. Definition of Global Warming

[1759] 2. Its Impact

[1760] 3. Specific Examples

[1761] 4. Countermeasures

[1762] 2. Data reception:

[1763] The data sent from the device reaches the server's API endpoint. The server receives the data and temporarily stores it in a database.

[1764] 3. Data Analysis:

[1765] The server passes the stored data to the generative AI model, which runs on the cloud and analyzes the text data. The analysis uses natural language processing techniques to evaluate the structure, grammar, and content consistency of the text.

[1766] 4. Feedback Generation:

[1767] The server generates specific feedback and advice for the user based on the analysis results obtained from the generative AI model. For example, it generates the following feedback:

[1768] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[1769] 5. Providing feedback:

[1770] The server transmits the generated feedback to the user's terminal, where the user can view the feedback on the terminal screen.

[1771] Examples

[1772] If a user wants to give a presentation on global warming, they can input the following prompt into the generative AI model:

[1773] Example prompt:

[1774] "I will be giving a presentation on global warming. Below is the content. I would appreciate your feedback and suggestions.

[1775] 1. Definition of Global Warming

[1776] 2. Its Impact

[1777] 3. Specific Examples

[1778] 4. Countermeasures

[1779] The server receives this prompt, analyzes it using a generative AI model, and provides feedback like this:

[1780] Feedback example:

[1781] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[1782] In this way, users receive specific feedback and can improve the quality of their presentations.

[1783] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1784] Step 1:

[1785] The user inputs the presentation content.

[1786] The user inputs the contents of the presentation into the text input field of the terminal and clicks the "Send" button. The input data is text data that contains the information or message that the user wants to convey in the presentation. For example, the following contents are input:

[1787] "I will be giving a presentation on global warming. Here is the content:

[1788] 1. Definition of Global Warming

[1789] 2. Its Impact

[1790] 3. Specific Examples

[1791] 4. Countermeasures

[1792] Input: Text data of the presentation content entered by the user

[1793] Output: Data sent from the device to the server

[1794] Step 2:

[1795] The server receives the input data.

[1796] The data sent from the terminal reaches the server's API endpoint. The server receives this data and temporarily stores it in a database. The received data is text data of the presentation content entered by the user.

[1797] Input: Text data of the presentation content sent from the terminal

[1798] Output: Text data stored on the server

[1799] Step 3:

[1800] The server analyzes the data using a generative AI model.

[1801] The server passes the stored data to the generative AI model, which runs on the cloud and analyzes the text data. The analysis uses natural language processing techniques to evaluate the structure, grammar, and content consistency of the text.

[1802] Input: Text data of the presentation content stored on the server

[1803] Output: Analysis results from generative AI models

[1804] Step 4:

[1805] The server generates the feedback.

[1806] The server generates specific feedback and advice for the user based on the analysis results obtained from the generative AI model. The generated feedback includes specific suggestions and instructions for the user to improve their presentation. For example, the server generates the following feedback:

[1807] "To make the flow of your talk clear, it's a good idea to first explain the impact of global warming from a broad perspective, and then give specific examples. It will be even more effective if you present a concrete action plan for countermeasures."

[1808] Input: Analysis results by generative AI model

[1809] Output: The generated feedback

[1810] Step 5:

[1811] The server provides feedback to the user.

[1812] The server transmits the generated feedback to the user's terminal, where the user can view the feedback on the terminal's screen. The provided feedback includes specific suggestions and instructions for the user to improve the presentation.

[1813] Input: Generated feedback

[1814] Output: Feedback displayed on the user's device

[1815] (Application example 2)

[1816] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1817] Conventional presentation support systems have difficulty providing specific feedback and advice to help users effectively communicate their presentation content. In addition, staff who explain products in physical stores lack the means to receive appropriate feedback in real time, which results in inconsistent quality of explanations to customers.

[1818] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience, a means for providing feedback and advice in real time when the user is explaining a product, a means for generating feedback based on the content of the user's presentation using a generative AI model, and a means for displaying feedback through smart glasses. This allows the user to receive appropriate feedback in real time, making it possible to improve the quality of presentations and product explanations.

[1819] "User" means an individual or organization that uses the system to make presentations and provide product information.

[1820] "Presentation content" refers to the information or message that the user wishes to convey in a presentation or product description.

[1821] "Feedback" refers to evaluation and advice for improvement provided to users regarding their submissions.

[1822] "Advice" is a specific suggestion or instruction to help a user improve their post.

[1823] "Linguistic expression" refers to the choice of words and phrases that users use to communicate their presentation.

[1824] "Storytelling" is a method of structuring and developing a story that allows users to effectively communicate the content of their presentation.

[1825] "Techniques" are techniques and methods that help users deliver speeches with confidence.

[1826] "Presentation quality" is a measure of how effectively a user communicates their presentation to the audience.

[1827] The "audience" is the people listening to the user presentation or product explanation.

[1828] "Real-time" refers to feedback and advice being provided to users at the exact moment they are making their post.

[1829] A "generative AI model" is an artificial intelligence model that automatically generates feedback and advice based on what a user posts.

[1830] "Smart glasses" are wearable devices that can be worn by a user and display visual information.

[1831] A system for carrying out the present invention provides feedback and advice in real time to a user when making a presentation or explaining a product. The system includes means for supporting the content of a presentation by a user and providing specific feedback and advice, means for supporting improvement of linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, means for providing feedback and advice in real time to a user when explaining a product, means for generating feedback based on the content of the presentation by the user using a generative AI model, and means for displaying the feedback through smart glasses.

[1832] The server uses the generative AI model to generate feedback based on the user's speech. Specifically, when a user wears the smart glasses and explains a product to a customer, the speech is converted into text using voice recognition software. The text is sent to the server, which uses the generative AI model to generate feedback and advice. This feedback is displayed in real time on the smart glasses' display.

[1833] The hardware used includes smart glasses (e.g. Google Glass) and voice recognition software. The software used includes OpenAI's GPT-3 API, which allows users to receive appropriate feedback in real time to improve the quality of their presentations and product explanations.

[1834] As a concrete example, consider a case where a user puts on smart glasses and explains a new smartphone to a customer. The explanation is, "This smartphone is equipped with the latest processor and is very fast. It also has an excellent camera function, so you can take clear photos even at night." This explanation is converted to text by speech recognition software and sent to the server. The server sends the following prompt sentence to the generative AI model.

[1835] Example prompt:

[1836] Here's how a user describes the product: Please provide feedback and advice.

[1837] This smartphone is equipped with the latest processor, making it extremely fast, and it also has a great camera that can take clear photos even at night.

[1838] advice:

[1839] The generative AI model will generate feedback based on the prompt text, which will then be displayed on the smart glasses display, allowing users to receive appropriate feedback in real time and improve the quality of their explanations to customers.

[1840] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1841] Step 1:

[1842] A user puts on the smart glasses and starts to explain the product. The user's voice is collected through the microphone of the smart glasses. The input is the user's voice data, and the output is the voice data sent to the voice recognition software.

[1843] Step 2:

[1844] The smart glasses have speech recognition software that converts the user's speech into text data. The input is speech data, and the output is text data. This text data represents the content of the user's speech.

[1845] Step 3:

[1846] The smart glasses send the converted text data to the server. The input is the text data and the output is the text data sent to the server.

[1847] Step 4:

[1848] Based on the text data received by the server, a prompt is sent to the generative AI model. The input is text data containing the user's announcement, and the output is the prompt sent to the generative AI model. An example of a specific prompt is as follows:

[1849] Here's how a user describes the product: Please provide feedback and advice.

[1850] This smartphone is equipped with the latest processor, making it extremely fast, and it also has a great camera that can take clear photos even at night.

[1851] advice:

[1852] Step 5:

[1853] The generative AI model generates feedback and advice based on the prompt sentence. The input is the prompt sentence, and the output is text data containing the feedback and advice.

[1854] Step 6:

[1855] The server transmits the generated feedback or advice to the smart glasses. The input is text data containing the feedback or advice, and the output is text data transmitted to the smart glasses.

[1856] Step 7:

[1857] The smart glasses display the received feedback and advice to the user. The input is text data containing the feedback and advice, and the output is the feedback and advice displayed on the display of the smart glasses. This allows the user to receive appropriate feedback in real time.

[1858] Example 3

[1859] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1860] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on their presentation content, and are insufficient in providing techniques for improving language expression and storytelling, or for speaking with confidence. They also lack specific support for improving the quality of the presentation itself and increasing the ability to captivate the audience. Furthermore, they lack the ability to generate and display appropriate answers to questions entered by the user.

[1861] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate an audience, a means for analyzing a question input by the user and generating an answer using a generative AI model, and a means for displaying the generated answer to the user. This allows the user to receive specific feedback and advice, improves the quality of the presentation, and allows the user to obtain an appropriate answer to the user's question.

[1862] "User" means an individual or organization that uses the system to receive presentation support.

[1863] "Presentation content" is a general term for the information and messages that a user wishes to convey in a presentation.

[1864] "Feedback" is specific evaluation and suggestions for improvement provided to users regarding their presentations.

[1865] "Advice" refers to specific advice or guidance given to users regarding the content of their presentation or presentation techniques.

[1866] "Linguistic expression" refers to the choice and use of words and phrases that a user uses in a presentation.

[1867] "Storytelling" is a method of structuring and developing a narrative that allows users to effectively convey information in a presentation.

[1868] A "speech" is an oral announcement or explanation given by a User in a presentation.

[1869] "Techniques" are specific methods and skills that help users deliver speeches with confidence.

[1870] "Presentation quality" is an indicator of how good a user's presentation is visually and content-wise.

[1871] "Audience" refers collectively to those who will be listening to the user's presentation.

[1872] A "generative AI model" is an artificial intelligence model that generates appropriate answers or advice based on user questions or input.

[1873] A "question" is a question or inquiry that a user inputs into the system.

[1874] "Analysis" is the process of understanding the user's question or presentation and generating appropriate answers or advice.

[1875] An "Answer" is a solution or advice provided by a generative AI model in response to a user's question.

[1876] "Display" refers to providing the generated answer or advice to the user in a visible form.

[1877] This invention is a system that supports users in their presentations, specifically by providing feedback and advice on the content of their presentation, supporting the improvement of linguistic expression and storytelling, and providing techniques for speaking with confidence. It also improves the quality of the presentation itself and supports the ability to captivate the audience.

[1878] Hardware and Software Used

[1879] The system uses the following hardware and software:

[1880] Server: A server with high-performance computing power is required. The server receives questions from users and generates answers using generative AI models.

[1881] Terminal: A device on which a user enters a question and receives a response from the server. Terminals can be computers, tablets, smartphones, etc.

[1882] Generative AI models: For example, using advanced natural language processing models such as GPT-4. Generative AI models are used to generate appropriate answers to user questions.

[1883] Natural Language Processing Libraries: Use natural language processing libraries to parse questions.

[1884] Data processing and calculation

[1885] When the server receives a question from a user, it first analyzes the question. A natural language processing library is used for the analysis to understand the intent of the question. The analysis results are then input into a generative AI model to generate an appropriate answer. The generated answer is then sent from the server to the terminal and displayed to the user.

[1886] Examples

[1887] For example, if a user enters the prompt text:

[1888] Example prompt:

[1889] "How do I create visually appealing slides?"

[1890] In response to this prompt, the server would generate the following advice:

[1891] An example of the generated advice:

[1892] "To convey information visually, slides should have large headings and a few key points, and use simple charts rather than complex graphs. It is also effective to use color contrast to highlight important information."

[1893] In this way, the user can receive specific and practical advice. This system enables the user to improve the quality of their presentation and increase their ability to captivate the audience. The flow of the specific process in the third embodiment will be described with reference to FIG. 15.

[1894] Step 1:

[1895] The user inputs a question. The user inputs a question about "how to create visually appealing slides" through the terminal interface. For example, the user inputs "Please tell me how to create visually appealing slides." The input data is in text format.

[1896] Step 2:

[1897] The device sends a question to the server. The device sends the question entered by the user to the server as an HTTP request. The device transmits data over an Internet connection. The input is the user's question text, and the output is an HTTP request to the server.

[1898] Step 3:

[1899] The server analyzes the question. The server analyzes the received HTTP request and extracts the question. The server uses a natural language processing library to analyze the question and understand the user's intent. The input is the text data of the HTTP request, and the output is the analyzed question.

[1900] Step 4:

[1901] The server generates an answer using a generative AI model. The server generates an answer using a generative AI model (e.g. GPT-4) based on the analysis results. The generative AI model refers to an internal database to generate the optimal answer to the question and generates appropriate advice. The input is the analyzed question content, and the output is the generated answer text.

[1902] Step 5:

[1903] The server sends the generated answer to the terminal. The server converts the generated answer to JSON format and sends it to the terminal as an HTTP response. The response includes the generated advice. The input is the generated answer text, and the output is the HTTP response to the terminal.

[1904] Step 6:

[1905] The terminal displays the answer to the user. The terminal analyzes the HTTP response received from the server and extracts the generated advice. The terminal displays the advice on the web page so that the user can confirm it. The user confirms the advice on the screen, such as "To convey information visually, it is better to include large headings and a few key points on slides, and to use simple diagrams rather than complex graphs." The input is the HTTP response data, and the output is the advice displayed to the user.

[1906] (Application example 3)

[1907] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1908] Conventional presentation support systems can provide specific feedback and advice on the content of a user's presentation, but they lack the functionality to support the creation of visually appealing slides. In addition, when store clerks explain products in brick-and-mortar stores, they have no way to quickly create visually appealing slides and display them on smart devices, making it difficult to give effective presentations to customers.

[1909] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means. In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of linguistic expression and storytelling, a means for providing techniques for speaking with confidence, a means for improving the quality of the presentation itself and enhancing the ability to captivate the audience, a means for supporting the creation of visually appealing slides, a means for displaying on a smart device, and a means for generating advice based on a prompt sentence using a generative AI model. This allows the user to quickly create visually appealing slides and give effective presentations even in physical stores.

[1910] "A means of supporting the user's presentation content and providing specific feedback and advice" is a function that provides the user with suggestions for improving the content and specific advice for their presentation or speech.

[1911] "Means to help improve language expression and storytelling" are functions that help users to use language and structure stories more effectively.

[1912] "Means of providing techniques for speaking with confidence" is a function that provides techniques and methods for users to give speeches with confidence.

[1913] "Means of improving the quality of the presentation itself and increasing its ability to captivate the audience" refers to functions that improve the overall quality of a presentation and help capture the audience's attention.

[1914] "Means to assist in the creation of visually appealing slides" is a function that assists users in creating visually appealing slides.

[1915] "Means for displaying on a smart device" refers to a function for displaying the created slides and advice on a device such as smart glasses or a smartphone.

[1916] A "means for generating advice based on a prompt sentence using a generative AI model" is a function that uses a generative AI model to automatically generate appropriate advice based on a prompt sentence entered by a user.

[1917] A system for implementing this invention includes means for supporting a user's presentation content and providing specific feedback and advice, means for assisting in improving linguistic expression and storytelling, means for providing techniques for speaking with confidence, means for improving the quality of the presentation itself and increasing the ability to captivate an audience, means for assisting in the creation of visually appealing slides, means for displaying on a smart device, and means for generating advice based on prompt sentences using a generative AI model.

[1918] System Programming

[1919] The program of this system operates as follows.

[1920] Hardware and Software

[1921] Hardware: smart glasses (e.g. Google Glass), smartphones, servers

[1922] Software: Python, OpenAI API

[1923] Data processing and calculation

[1924] The server converts the user's voice input into text and sends the text as a prompt to the generative AI model, which then generates appropriate advice based on the prompt and displays the advice on the smart device.

[1925] Examples

[1926] For example, when a store clerk is explaining a new smartphone product, he or she puts on the smart glasses and gives voice instructions such as, "Create a slide to visually appeal to the features of this smartphone." This voice instruction is converted into text and sent to the generative AI model as the following prompt sentence.

[1927] Example prompt:

[1928] Please provide some advice on how to create visually appealing slides. User Question: Can you create a slide that visually appeals the features of this smartphone?

[1929] The generative AI model will generate appropriate advice based on the prompt and display it on the smart glasses' display, allowing store associates to quickly create visually appealing slides and deliver effective presentations to customers.

[1930] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1931] Step 1:

[1932] The user puts on the smart glasses and is told aloud, "Create a slide to visually highlight the features of this smartphone."

[1933] Input: User's voice command

[1934] Output: Audio data

[1935] Step 2:

[1936] The smart glasses convert the voice data into text. Voice recognition software is used to convert the voice data into text.

[1937] Input: Audio data

[1938] Output: Text data

[1939] Step 3:

[1940] The smart glasses transmit the text data to the server. The smart glasses transmit the text data to the server via the network.

[1941] Input: Text data

[1942] Output: Text data sent to the server

[1943] Step 4:

[1944] The server receives the text data and sends it to the generative AI model as a prompt sentence. The server processes the text data into a format suitable for the generative AI model and generates the prompt sentence.

[1945] Input: Text data

[1946] Output: Prompt statement

[1947] Step 5:

[1948] A generative AI model generates advice based on the prompt. A generative AI model (e.g., OpenAI API) is used to generate advice based on the prompt.

[1949] Input: prompt statement

[1950] Output: Advice text

[1951] Step 6:

[1952] The server transmits the generated advice text to the smart glasses via a network.

[1953] Input: Advice text

[1954] Output: Advice text sent to smart glasses

[1955] Step 7:

[1956] The smart glasses display the advice text. The advice text is displayed on the display of the smart glasses, providing a visual to the user.

[1957] Input: Advice text

[1958] Output: Advice text displayed on the smart glasses display

[1959] This enables users to quickly create visually appealing slides and deliver effective presentations even in physical stores.

[1960] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1961] "Example 1"

[1962] In one embodiment of the present invention, a system for supporting a user's presentation and providing specific feedback and advice includes an emotion engine that infers an emotional state from the user's presentation and provides feedback and advice based on the emotional state. For example, if the user feels nervous, the emotion engine provides relaxation techniques and advice for speaking with confidence.

[1963] "Example 2"

[1964] In another embodiment, the emotion engine monitors the user's emotional state in real time and updates the feedback and advice according to the changes in the emotional state, for example, if the user feels nervous in the middle of a presentation, the emotion engine provides relaxation techniques at that moment.

[1965] "Example 3"

[1966] In yet another embodiment, the emotion engine analyzes the user's emotional state and provides feedback to the user accordingly, for example, if the user feels angry or anxious during a presentation, the emotion engine communicates that emotion to the user and provides specific advice on how to deal with it.

[1967] The process flow of each embodiment will be described below.

[1968] "Example 1"

[1969] Step 1: The user enters the announcement into the system.

[1970] Step 2: The emotion engine infers the user's emotional state from what they say.

[1971] Step 3: Provide specific feedback and advice to the user based on the emotional state estimated by the emotion engine.

[1972] "Example 2"

[1973] Step 1: The user enters the announcement into the system.

[1974] Step 2: The emotion engine monitors the user's emotional state in real time.

[1975] Step 3: The emotion engine updates and provides feedback and advice to the user based on the changes in the emotional state.

[1976] "Example 3"

[1977] Step 1: The user enters the announcement into the system.

[1978] Step 2: The emotion engine analyzes the user's emotional state.

[1979] Step 3: The sentiment engine feeds back the analysis results to the user and provides specific advice on how to deal with it.

[1980] Example 1

[1981] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1982] Conventional presentation support systems do not provide users with sufficient specific feedback or advice on the content of their presentation, and are insufficient in providing techniques for improving linguistic expression and storytelling, or for speaking with confidence. In addition, they do not provide feedback that takes into account the user's emotional state, so users cannot receive appropriate advice in situations where they feel nervous or anxious. This makes it difficult to improve the quality of presentations or their ability to captivate the audience.

[1983] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1984] In this invention, the server includes a means for supporting the content of a user's presentation and providing specific feedback and advice, a means for supporting improvement of language expression and storytelling, a means for providing techniques for speaking with confidence, a means for estimating an emotional state from the content of a user's presentation and providing feedback and advice based on the emotional state, a means for automatically generating feedback and advice using a generative AI model, and a means for transmitting data input from a user terminal to the server, which analyzes and generates using an emotion engine and a generative AI model. This makes it possible to provide feedback and advice that is specific and in accordance with the emotional state of the user's presentation content, thereby improving the quality of the presentation and increasing the ability to captivate the audience.

[1985] "User" means an individual or organization that utilizes the system to input presentation content and receive feedback and advice.

[1986] "Presentation content" refers to the presentation text and materials that the user enters into the system.

[1987] "Feedback" refers to specific improvements or advice provided to users regarding their submissions.

[1988] "Advice" refers to suggestions and guidance to help users give more effective presentations.

[1989] "Linguistic expression" refers to the use of words and expressions in a presentation.

[1990] "Storytelling" refers to the method of structuring and developing a story in a presentation.

[1991] "Techniques for speaking with confidence" refers to methods and techniques that help users speak with confidence when giving a presentation.

[1992] "Presentation quality" refers to the overall merits of the presentation's content, structure, and method of expression.

[1993] "Audience captivation" refers to the ability to capture and interest the audience through a presentation.

[1994] "Emotional state" refers to the psychological state, such as tension, anxiety, or joy, that a user feels when giving a presentation.

[1995] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to automatically generate feedback and advice based on user submissions.

[1996] An "emotion engine" is a...

Claims

1. a first means for a user to input presentation content; a second means for generating a first prompt sentence based on the presentation content, for outputting feedback and advice regarding the presentation content; a third means for inputting the generated first prompt sentence into a generative AI model to generate feedback and advice for the presentation content; a fourth means for transmitting feedback and advice on the generated presentation content to the user's terminal; A system including:

2. A fifth means for collecting a voice of the user explaining the product through a microphone of smart glasses worn by the user, The second means generates a second prompt sentence for outputting feedback and advice regarding the product description based on text data including the content of the user's speech obtained by converting the voice data of the voice, The third means inputs the generated second prompt sentence into a generative AI model to generate feedback and advice for the product description; The fourth means transmits feedback and advice regarding the generated product description to the smart glasses. The system of claim 1 .

3. A sixth means for estimating an emotional state of the user from a voice of the user describing a product using an emotion engine, the second means generates a third prompt sentence based on the text data and the emotional state of the user for outputting feedback and advice according to the emotional state of the user; The third means inputs the generated third prompt sentence into a generative AI model to generate feedback and advice according to the emotional state of the user. The system of claim 2.

Images