System
The system addresses the limitation of existing presentation services by storing and automatically creating high-quality presentation materials specific to a company, and adjusting them based on user emotions, enhancing efficiency and usability.
Patent Information
- Application Number
- JP2024164515
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-21
- Filing Date
- 2024-09-20
- Publication Date
- 2025-04-03
AI Technical Summary
Existing presentation creation services are limited to using general templates and internal materials, unable to leverage high-quality presentation materials specific to a company.
A system that stores externally deployable materials within a particular organization in a database, automatically creates presentation materials using AI, and adjusts content based on user emotions recognized by an emotional engine.
Enables efficient management and quick access to presentation materials, improves usability through automatic creation and emotional adjustment, and provides these materials as paid services.
Smart Images

Figure 2025049206000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Existing presentation creation services can only use general templates or materials stored on each company's internal servers as a base, and are unable to utilize the high-quality presentation materials that exist within a specific company. [Means for solving the problem]
[0005] As a means for solving this problem, the system of the present invention includes means for storing externally deployable materials that exist within a specific organization in a database, means for automatically creating presentation materials using the materials stored in the database, an emotion engine that recognizes the user's emotions, means for generating presentation materials by inputting specific prompt sentences into a generative AI model, and means for adjusting the content of the presentation materials in accordance with the emotions. [Brief explanation of the drawings]
[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0008] First, the terms used in the following description will be explained.
[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).
[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0014] [First embodiment]
[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[0027] "Example 1"
[0028] In one embodiment of the present invention, presentation materials available for external use within a specific company are stored in a dedicated database. Employees can freely access this database and add new presentation materials. For example, when a presentation material summarizing the results of a new project is created, the material is added to the database.
[0029] "Example 2"
[0030] Next, presentation materials are automatically created based on the materials in the database. This automatic creation is done using AI technology, which learns the content, structure, design, etc. of the materials in the database and generates new presentation materials. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on these.
[0031] "Example 3"
[0032] Finally, we offer a paid service for automatically generated presentation materials. This service is available to employees of specific companies as well as general users. For example, if a user wants to create a presentation on a specific topic, they can use this service to quickly create high-quality presentation materials based on the materials in the database.
[0033] The processing flow of each embodiment will be described below.
[0034] "Example 1"
[0035] Step 1: All presentation materials available for external use within a specific company are stored in a dedicated database. Employees can freely access this database and add new presentation materials. For example, if a presentation document summarizing the results of a new project is created, the document is added to the database.
[0036] "Example 2"
[0037] Step 1: Automatically create presentation materials based on the materials in the database. This automatic creation is done using AI technology, which learns the content, structure, and design of the materials in the database.
[0038] Step 2: Generate new presentation materials based on the results of learning. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on these.
[0039] "Example 3"
[0040] Step 1: Automatically created presentation materials are provided as a paid service. This service can be used not only by employees of specific companies, but also by general users. Step 2: When a user wants to create presentation materials on a specific topic, they can use this service to quickly create high-quality presentation materials based on materials in the database.
[0041] Example 1
[0042] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0043] Presentation materials created within a particular company often need to be distributed externally and shared with other employees and departments. However, there is a lack of a system for efficiently managing these materials and quickly accessing them when needed. Furthermore, there is a lack of integrated functionality for automatically creating, searching, and viewing presentation materials, which reduces work efficiency. Furthermore, there is no system in place for providing these materials as a paid service.
[0044] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0045] In this invention, the server includes a means for storing presentation materials available for external use within a specific company in a dedicated database, a means for employees to freely access the database and add new presentation materials, a means for automatically creating presentation materials based on the materials in the database, a means for providing the automatically created presentation materials, and a means for searching and viewing the presentation materials. This enables efficient management and rapid access to presentation materials, thereby improving business efficiency. Furthermore, the integration of the functions for automatically creating, searching, and viewing materials improves usability and also provides a mechanism for providing these materials as a paid service.
[0046] A "specific enterprise" is a legal entity with a specific business or purpose.
[0047] "Externally applicable presentation materials" are information materials created in a format that can be provided to parties outside the company.
[0048] A "special-purpose database" is a database system designed for a specific purpose to efficiently store, manage, and retrieve specific data.
[0049] An "employee" is an individual employed by a particular company and engaged in its work.
[0050] "Access" is the act of reading or writing data to a database or system.
[0051] "Presentation materials" are slides and documents created to convey information visually.
[0052] "Automatic generation" is the process by which a system generates materials based on specific algorithms or rules without the need for manual user interaction.
[0053] "Providing" is the act of making a particular service or information available to others.
[0054] "Searching" is the act of locating information in a database based on specific criteria or keywords.
[0055] "Viewing" is the act of visually checking data or materials.
[0056] A "paid service" is a business model in which a fee is charged in exchange for providing a specific service or information.
[0057] The present invention provides a system for efficiently managing presentation materials created within a specific company that can be used externally and for quickly accessing them when needed. A specific embodiment of this system will be described below.
[0058] System configuration
[0059] 1. Hardware and Software
[0060] Server: MySQL (registered trademark) is used as the database management system (DBMS), and a dedicated database is created to store presentation materials.
[0061] Device: Use a device such as a PC or tablet to access a dedicated web application.
[0062] User: An employee employed by a particular company who uses a terminal to access the system.
[0063] System Operation
[0064] 1. User login
[0065] Users access a dedicated web application from their device and enter their authentication information (user ID and password) to log in. The device sends the entered authentication information to the server, which then collates it with a database to perform authentication.
[0066] 2. Upload your presentation materials
[0067] After logging in, the user accesses a form for uploading presentation materials. The terminal displays a form for entering the title, description, and file of the material, and the user enters the required information, selects the file, and clicks the upload button. The terminal then sends the entered information and file to the server, which stores them in a database.
[0068] 3. Search and view presentation materials
[0069] The user accesses a search screen to search for presentation materials in the database, enters search keywords, and clicks the search button. The terminal sends the entered search keywords to the server, which searches the database to generate a list of relevant presentation materials and sends it to the terminal. The user selects a specific presentation material from the search results, checks the detailed information, and clicks the view button. The terminal downloads the material file from the server and displays it to the user.
[0070] Specific examples
[0071] For example, if employee A creates a presentation document summarizing the results of a new project, employee A logs into a dedicated web application from his / her terminal, enters the document title "Results of Project X," the description "Document summarizing the detailed results of Project X," and the file name "projectX_results.pptx," and uploads it. The server stores this information in a database, making it freely accessible to other employees.
[0072] Prompt Sentence Examples
[0073] "What are the steps to add a presentation document outlining the results of a new project to the database?"
[0074] By inputting this prompt into a generative AI model, specific steps and operation methods can be explained in natural language.
[0075] The above is a concrete example of how to implement this invention. This system enables efficient management and rapid access to presentation materials, improving business efficiency. Furthermore, by integrating the functions of automatic creation, search, and viewing of materials, usability is improved, and a mechanism for providing these materials as a paid service is also established.
[0076] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0077] Step 1: User Login
[0078] Input: The user accesses a dedicated web application from their device and enters their user ID and password.
[0079] Operation: The terminal sends the entered authentication information to the server, which checks it against its database and starts the session if authentication is successful.
[0080] Output: If authentication is successful, the user is logged into the system and redirected to a dedicated dashboard.
[0081] Step 2: Upload your presentation materials
[0082] Input: After logging in, the user accesses a form to upload presentation materials and enters the title, description, and file of the materials.
[0083] Operation: The terminal sends the input information and files to the server, which stores the received information in a database.
[0084] Output: If the upload is successful, the server notifies the user that the upload was successful.
[0085] Step 3: Find your presentation materials
[0086] Input: The user accesses a search screen to search for presentation materials in the database and enters search keywords.
[0087] Operation: The terminal sends the entered search keywords to the server, which searches the database and generates a list of relevant presentation materials.
[0088] Output: The server sends the generated list to the terminal, which displays the list to the user.
[0089] Step 4: View the presentation materials
[0090] Input: The user selects a specific presentation from the search results and clicks the View button.
[0091] Operation: The terminal displays detailed information about the selected material and downloads the material file from the server.
[0092] Output: The terminal displays the downloaded file to the user.
[0093] Step 5: Automatically create presentation materials
[0094] Input: The user requests the automatic creation of a presentation based on specific criteria and templates.
[0095] How it works: The server processes the information in the database based on specified conditions and templates, and automatically generates presentation materials.
[0096] Output: The server stores the automatically created presentation materials in a database and notifies the user.
[0097] Step 6: Offering it as a paid service
[0098] Input: A user requests a presentation that is offered as a paid service.
[0099] Operation: Based on the user's request, the server processes the payment and provides the materials after the payment is confirmed.
[0100] Output: The server makes the presentation available for download to users whose payment has been confirmed.
[0101] (Application example 1)
[0102] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0103] In traditional presentation management systems, creating and sharing materials is often done manually, which is inefficient. Furthermore, when introducing new product lines or explaining manufacturing processes in factories, there are limited ways to visually share materials, which can lead to insufficient information transmission.
[0104] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0105] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for a robot used in the factory to acquire the presentation materials and visually explain them, and means for the robot to display the materials through smart glasses or a head-mounted display. This enables efficient creation and sharing of presentation materials, and by communicating information visually within the factory, information can be communicated more effectively.
[0106] "Specific enterprise" refers to a legal entity or organization that carries out a specific business or activity.
[0107] "Externally deployable presentation materials" refers to presentation documents and slides that can be provided or shared with parties outside the company.
[0108] "Purpose-built database" refers to a data collection system designed for a specific purpose or use.
[0109] "Means for automatically creating presentation materials" refers to a method or device for automatically generating presentation materials based on input data or information.
[0110] The term "means for providing" refers to a method or device for distributing or displaying the generated presentation materials to users.
[0111] "Robots used in factories" refers to automated machinery and devices operated in factories to assist with manufacturing operations and tasks.
[0112] "Visual explanation means" refers to a method or device for visually displaying information or materials and explaining them to a user.
[0113] "Smart glasses" refers to a wearable device in the form of glasses that has a display function for displaying information.
[0114] A "head-mounted display" is a display device worn on the head, used to display information within the user's field of vision.
[0115] As a form for implementing this invention, a system is constructed in which presentation materials that exist within a specific company and can be used externally are stored in a dedicated database, and robots used in factories retrieve the materials and provide visual explanations.
[0116] First, the server stores presentation materials created within a specific company that can be distributed externally in a dedicated database. The dedicated database is designed to enable efficient management and access of data. The database stores the metadata and content of presentation materials, and employees can freely access and add new materials.
[0117] The server then automatically creates presentation materials based on the materials in the database. This process uses a generative AI model, which generates presentation slides and documents based on the input data and information. This process streamlines the creation of materials and automatically generates high-quality presentation materials.
[0118] The generated presentation materials are provided to the robots used in the factory. The robots retrieve the materials from a dedicated database and visually explain them to the factory staff. The robots display the materials through smart glasses or a head-mounted display, allowing the staff to work while checking the materials.
[0119] As a concrete example, consider a presentation document for the introduction of a new product line. This document includes product specifications, manufacturing processes, quality control points, etc. The robot can retrieve this document and visually explain it to factory staff. Staff can then wear smart glasses or a head-mounted display and proceed with the introduction of the new product line while reviewing the document.
[0120] An example of a prompt is, "Please retrieve presentation materials from the database regarding the introduction of a new product line and explain them to the staff in the factory." Using this prompt, the robot can retrieve the appropriate materials and explain them visually.
[0121] In this way, presentation materials can be created and shared efficiently, and information can be communicated visually within the factory, making it possible to communicate information more effectively.
[0122] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0123] Step 1:
[0124] The server stores presentation materials created within a specific company that can be distributed externally in a dedicated database. The input is presentation materials created by employees, which are saved in the database. The database stores the materials' metadata (author, creation date, project name, etc.) and content. This allows for efficient management of the materials and makes them easily accessible later.
[0125] Step 2:
[0126] The server automatically creates presentation materials based on the materials in the database. The input is the materials stored in the database, and new presentation materials are generated using a generative AI model. The generative AI model analyzes the content of the materials and automatically creates appropriate slides and documents. The output is the newly generated presentation materials.
[0127] Step 3:
[0128] The server provides the generated presentation materials to the robots used in the factory. The server receives the generated presentation materials as input and sends them to the robot. The robot receives the materials and stores them in its internal memory, allowing the robot to retrieve and use the materials.
[0129] Step 4:
[0130] The robot retrieves materials from a dedicated database and visually explains them to factory staff. The input is presentation materials stored on the robot, which are displayed through smart glasses or a head-mounted display. The robot analyzes the content of the materials and displays slides at the appropriate time. The output is that staff can visually review the materials.
[0131] Step 5:
[0132] The user (factory staff) wears smart glasses or a head-mounted display and checks the presentation materials displayed by the robot. The input is the materials displayed by the robot, which the user visually checks. The user can proceed with their work while checking the materials. The output is that the user will be able to understand the introduction of new product lines and manufacturing processes, allowing them to work more efficiently.
[0133] In this way, presentation materials can be created and shared efficiently, and information can be communicated visually within the factory, making it possible to communicate information more effectively.
[0134] Example 2
[0135] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0136] Creating presentation materials in the past required a lot of manual work, which required time and effort, making it difficult to efficiently create high-quality materials. Furthermore, there was a lack of technology to effectively utilize internal materials and automatically generate new presentation materials. Furthermore, maintaining the quality and consistency of the generated materials was also difficult.
[0137] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0138] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for generating prompt sentences based on the materials in the database, means for sending the prompt sentences to a generative AI model, means for automatically creating presentation materials using the generative AI model, and means for providing the automatically created presentation materials, thereby enabling the efficient automatic generation of high-quality presentation materials.
[0139] A "specific organization" refers to a group with a specific purpose, such as a company, association, or government agency.
[0140] "Externally deployable materials" refers to documents and data created for the purpose of being made available to parties outside the organization or the general public.
[0141] "Purpose-built database" refers to a database system designed for a specific use or purpose.
[0142] A "prompt sentence" refers to a text-based input sentence used to give instructions or ask questions to a generative AI model.
[0143] "Generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to generate text or data.
[0144] "Presentation materials" refers to slides and documents used to visually convey information.
[0145] "Automated creation" refers to the process of generating materials or data using systems or algorithms without human intervention.
[0146] "Means for providing" refers to a method or system for displaying, distributing, or making the generated materials or data accessible to users.
[0147] The present invention provides a system for automatically and efficiently creating high-quality presentation materials based on externally deployable materials that exist within a specific organization. A specific embodiment of this system is described below.
[0148] Hardware and software used
[0149] Hardware: Servers, devices (PCs, tablets, smartphones, etc.)
[0150] Software: Database management systems (e.g., MySQL, PostgreSQL), generative AI models (e.g., OpenAI® GPT-4®), presentation software (e.g., Microsoft® PowerPoint, Google® Slides)
[0151] System configuration
[0152] Subject: Server
[0153] The server stores externally deployable materials that exist within a specific organization in a dedicated database. The server generates prompt text based on the materials in the database and sends it to a generative AI model. The generative AI model automatically creates presentation materials based on the prompt text, and the server sends the generated presentation materials to the device.
[0154] Subject: Terminal
[0155] The device accesses a database specified by the user and sends prompts to the generative AI model to automatically create presentation materials.The device displays the generated presentation materials to the user and provides an interface for editing and modifying them as needed.
[0156] Subject: User
[0157] The user can use the terminal to select materials from the database and start the automatic creation of presentation materials. The user can then review the generated presentation materials and make corrections or additions as necessary.
[0158] Specific examples
[0159] Example 1
[0160] Suppose a user wants to create a new presentation based on a company's annual report. The user uses a terminal to access a database and select a past annual report. The terminal generates a prompt based on the content, structure, and design of the selected document and sends it to the generative AI model. The server uses the generative AI model to create a new presentation and sends it to the terminal. The user reviews the generated presentation and makes any necessary corrections.
[0161] Prompt Sentence Examples
[0162] "Create a new presentation based on your company's annual reports for the past five years. Include key achievements, financial data, and future plans for each year."
[0163] In this way, users can efficiently create high-quality presentation materials. This system significantly reduces the amount of manual work required to create materials, and enables effective use of materials within an organization.
[0164] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0165] Step 1:
[0166] A user accesses the database
[0167] A user logs in to the system using a terminal and accesses the database, and searches for materials in the database to select materials that will be used as the basis for presentation materials.
[0168] Input: User login information, search query
[0169] Output: ID of the selected item
[0170] Specific behavior:
[0171] The user opens a browser on the terminal and accesses the system's login page.
[0172] The user logs in by entering a username and password.
[0173] Users use the database search function to search for the materials they need.
[0174] Step 2:
[0175] The terminal retrieves the information from the database.
[0176] The terminal retrieves the materials selected by the user from the database, and the retrieved materials are used to generate the presentation materials.
[0177] Input: ID of selected material
[0178] Output: Contents of the retrieved material
[0179] Specific behavior:
[0180] The terminal queries the database for the ID of the material selected by the user.
[0181] The database returns the relevant materials to the terminal.
[0182] The terminal temporarily stores the acquired materials.
[0183] Step 3:
[0184] The terminal generates a prompt
[0185] The device generates a prompt based on the content of the acquired material, and sends this prompt to the generative AI model.
[0186] Input: Contents of the acquired material
[0187] Output: Generated prompt statement
[0188] Specific behavior:
[0189] The terminal analyzes the content of the acquired materials.
[0190] The terminal generates a prompt sentence based on the analysis result.
[0191] The generated prompt sentence is then ready to be sent to the generative AI model.
[0192] Step 4:
[0193] The device sends the prompt to the generative AI model
[0194] The device sends the generated prompt to the generative AI model, which then generates presentation materials based on the prompt.
[0195] Input: Generated prompt text
[0196] Output: Request to the generative AI model
[0197] Specific behavior:
[0198] The device sends the generated prompt sentence to the API of the generation AI model.
[0199] The generative AI model receives the prompt sentence and begins processing.
[0200] Step 5:
[0201] The server generates presentation materials using the generative AI model
[0202] The server generates presentation materials using a generative AI model, which creates new presentation materials based on the prompt sentence.
[0203] Input: A request to the generative AI model
[0204] Output: The generated presentation
[0205] Specific behavior:
[0206] The server receives the response from the generative AI model.
[0207] The generative AI model generates presentation materials based on prompt text.
[0208] The server temporarily stores the generated presentation materials.
[0209] Step 6:
[0210] The server sends the generated presentation materials to the terminal.
[0211] The server transmits the generated presentation materials to the terminal, which displays the materials to the user.
[0212] Input: Generated presentation materials
[0213] Output: Sending data to the terminal
[0214] Specific behavior:
[0215] The server transmits the generated presentation materials to the terminal.
[0216] The terminal displays the received presentation materials to the user.
[0217] Step 7:
[0218] The user reviews the generated presentation and makes any necessary corrections.
[0219] The user checks the generated presentation materials and makes corrections or additions as necessary, completing the final presentation materials.
[0220] Input: Generated presentation materials
[0221] Output: Revised presentation
[0222] Specific behavior:
[0223] The user checks the presentation materials displayed on the terminal.
[0224] The user uses editing tools to modify the material as needed.
[0225] The user saves the presentation material after completing the edits.
[0226] (Application example 2)
[0227] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0228] Conventional presentation material creation systems can automatically create presentation materials based on database data, but they do not support the automatic generation of presentation materials based on production data or quality control data within a factory. This makes it difficult to quickly and efficiently create production reports and quality improvement proposals required by factory managers and executives. Furthermore, there is a lack of means to provide these materials as a paid service.
[0229] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0230] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for automatically generating presentation materials based on production data and quality control data within a factory, and means for providing the automatically generated presentation materials to managers and executives. This enables the rapid and efficient automatic generation of presentation materials based on the factory's production data and quality control data, thereby providing appropriate information to managers and executives. It is also possible to provide these materials as a paid service.
[0231] A "specific organization" is an organization that operates with a specific purpose, such as a company or factory.
[0232] "Externally deployable materials" are documents or files containing information or data that can be provided or made public outside the organization.
[0233] A "special-purpose database" is a data collection system designed specifically for a particular purpose or use.
[0234] "Presentation materials" are slides and documents used to convey information visually.
[0235] "Automated creation means" refers to methods or devices that use AI technology or algorithms to generate materials without manual intervention.
[0236] "Providing means" refers to a method or device for distributing or making accessible the generated materials to users.
[0237] "Production data" refers to data that includes information such as production volume, operating hours, and efficiency at factories and manufacturing sites.
[0238] "Quality control data" means data that contains information for assessing and controlling the quality of a product or process.
[0239] A "manager" is a person in a position that manages or supervises operations within an organization.
[0240] "Management" refers to the people or groups in positions that make decisions regarding the management of an organization.
[0241] A "paid service" is a service provided on the premise that payment is received.
[0242] The following system configuration will be described as an embodiment of the present invention.
[0243] First, the server stores externally deployable data within a specific organization in a dedicated database. This database also includes production data and quality control data within factories. This data is managed using a relational database management system (RDBMS) such as an SQL database.
[0244] Next, the server automatically creates presentation materials based on the materials in the database. This automatic creation is achieved using a generative AI model. The generative AI model learns the content, structure, and design of the materials in the database and generates new presentation materials. Specifically, a natural language processing (NLP) model is implemented using the Python transformers library.
[0245] The generated presentation materials are saved as PowerPoint files using the Python python-pptx library, allowing users to easily view and edit the generated presentation materials.
[0246] The server then provides the automatically generated presentation materials to managers and executives. This can be done via email or cloud storage services. For example, the generated presentation materials can be uploaded to cloud storage and a link sent to the managers and executives.
[0247] As a concrete example, suppose you want to automatically generate monthly production reports for a factory, and the following data is stored in the database:
[0248] month, production, defects
[0249] January, 1000, 10
[0250] February, 1100, 15
[0251] March, 1050, 12
[0252] Based on this data, a generative AI model would generate a presentation like this:
[0253] Title Slide: "Monthly Production Report"
[0254] Data slide: Monthly production and defect counts displayed in a table format
[0255] An example of a prompt to be input to the generative AI model is as follows:
[0256] Create a presentation based on the monthly production data retrieved from the database. Title it "Monthly Production Report" and display the production volume and defect count for each month in a table.
[0257] In this way, the server can quickly and efficiently automatically generate presentation materials based on factory production data and quality control data, providing appropriate information to managers and executives. It is also possible to provide these materials as a paid service.
[0258] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0259] Step 1:
[0260] The server stores externally deployable data within a specific organization in a dedicated database. Data and data from within the organization are provided as input. The server saves these data in a relational database management system (RDBMS), such as an SQL database. The data stored in the database is obtained as output.
[0261] Step 2:
[0262] The server automatically creates presentation materials based on materials in the database. Materials retrieved from the database are provided as input. The server uses a generative AI model to learn the content, structure, and design of the materials and generate new presentation materials. Specifically, it implements a natural language processing (NLP) model using the Python transformers library to summarize and structure the materials. The generated presentation materials are obtained as output.
[0263] Step 3:
[0264] The server saves the generated presentation as a PowerPoint file. The presentation created by the generative AI model is provided as input. The server uses the Python python-pptx library to create slides and add data in a table format. The output is a PowerPoint presentation file.
[0265] Step 4:
[0266] The server provides the generated presentation materials to managers and executives. The generated presentation file is provided as input. The server distributes the presentation materials using email or a cloud storage service. Specifically, the server uploads the generated presentation materials to cloud storage and sends a link to the managers and executives. The output is that the managers and executives can access the presentation materials.
[0267] Step 5:
[0268] The user views and edits the provided presentation materials. The input is a presentation file provided by the server. The user uses presentation software such as PowerPoint to view the materials and make edits as necessary. The output is the final presentation material.
[0269] Example 3
[0270] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0271] Conventional presentation creation systems have difficulty automatically creating high-quality presentation materials based on documents from within a specific organization in a short amount of time. Furthermore, there is a lack of a means to efficiently provide materials that correspond to specific themes desired by users. Furthermore, ensuring the convenience and quality of these materials when providing them as a paid service has also been an issue.
[0272] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[0273] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for analyzing prompts based on the materials in the database and extracting and processing related data, and means for automatically creating presentation materials using a generative AI model. This makes it possible to automatically create and efficiently provide high-quality presentation materials that correspond to specific themes desired by users in a short amount of time.
[0274] A "specific organization" refers to a group that operates with a specific purpose, such as a company, association, or institution.
[0275] "Externally deployable materials" refers to documents and digital content that contain information or data that is created within a particular organization and can be made available to external users or other organizations.
[0276] A "specialized database" refers to a database system designed specifically for a specific purpose or use, to efficiently store, manage, and search materials within a particular organization.
[0277] A "prompt sentence" refers to a sentence that specifically indicates an instruction or request that a user inputs to a system.
[0278] "Parsing" refers to the process of understanding the input prompt sentence and extracting the necessary information based on its content.
[0279] "Relevant data" refers to information in a database that is searched based on the prompt sentence and is data necessary for creating presentation materials.
[0280] "Extraction" refers to the process of extracting necessary information from a database.
[0281] "Processing" refers to the process of converting the extracted data into a format suitable for presentation materials.
[0282] A "generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to analyze data and generate output for a specific purpose.
[0283] "Automatic creation" refers to the process of the system autonomously generating presentation materials with minimal human intervention.
[0284] "Presentation materials" refer to slides or documents that visually communicate a particular theme or content.
[0285] This invention is a system that stores externally deployable materials that exist within a specific organization in a dedicated database, analyzes prompts from users to extract and process relevant data, and automatically creates presentation materials using a generative AI model.
[0286] System configuration
[0287] The system consists of the following main components:
[0288] 1. Dedicated database: A database for storing externally deployable materials within a specific organization.
[0289] 2. Prompt parsing engine: A software module for receiving and parsing prompts from the user.
[0290] 3. Data extraction and processing module: A software module for extracting relevant data from the database and processing it into a format suitable for presentation materials.
[0291] 4. Generative AI model: An algorithm for automatically creating presentation materials using a generative AI model (e.g., OpenAI's GPT-4).
[0292] 5. User interface: An interface through which the user can input prompt statements and receive the generated presentation materials.
[0293] Hardware and Software Use
[0294] The server manages a dedicated database and is equipped with the hardware and software to run the prompt analysis engine, data extraction and processing module, and generative AI model. Specifically, the following hardware and software are used:
[0295] Hardware: High-performance server (including CPU, memory, and storage)
[0296] Software: Database management systems (DBMS), natural language processing engines, data analysis tools, generative AI models (e.g., GPT-4)
[0297] Program processing
[0298] The user accesses the system's user interface through a web browser and inputs a prompt. For example, they might input, "Please create a presentation on the market analysis of a new product." The server receives the prompt and analyzes it using a prompt analysis engine. Based on the analysis results, it searches for relevant materials in the database and extracts and processes the necessary data using a data extraction and processing module. Next, it uses a generative AI model to automatically create presentation materials based on the extracted and processed data. Finally, it provides the generated presentation materials to the user.
[0299] Specific examples
[0300] If the user enters the prompt "Please create a presentation about the market analysis of a new product", the server will do the following:
[0301] 1. Analyze the prompt sentence and extract keywords related to "market analysis."
[0302] 2. Search for materials related to "market analysis" in the database.
[0303] 3. Extract sales data and market share graphs from search results.
[0304] 4. Create graphs and tables based on the extracted data.
[0305] 5. Automatically create presentation materials using generative AI models.
[0306] 6. Provide the generated presentation materials to the user.
[0307] In this way, the user can obtain high-quality presentation materials in a short time. The flow of the specification process in the third embodiment will be described with reference to FIG.
[0308] Step 1:
[0309] A user accesses the system's user interface through a web browser and inputs a prompt, for example, "Please create a presentation about the market analysis of a new product." The input prompt is then sent to the server.
[0310] Step 2:
[0311] The server receives the prompt sent by the user. The received prompt is passed to the prompt analysis engine for analysis. The analysis engine understands the content of the prompt and extracts keywords and themes. For example, keywords such as "new product" and "market analysis" are extracted. The analysis results are passed to the next processing step.
[0312] Step 3:
[0313] The server searches a dedicated database based on the analysis results. Using a database search module, it searches for materials related to the extracted keywords or themes. For example, materials related to "market analysis" are searched for. The search results are passed to the next processing step.
[0314] Step 4:
[0315] The server extracts relevant data from the search results. Using a data extraction module, it selects the data needed for presentation materials. For example, sales data or market share graphs are extracted. The extracted data is then passed on to the next processing step.
[0316] Step 5:
[0317] The server processes the extracted data. Using a data processing module, it converts the data into a format suitable for presentation materials. For example, it converts the extracted sales data into a graph and arranges it in a table format. The processed data is then passed on to the next processing step.
[0318] Step 6:
[0319] The server automatically creates presentation materials using a generative AI model. The processed data is input into a generative AI model (e.g., GPT-4) to generate the presentation materials. The generative AI model also automatically adjusts the layout and design of the slides. For example, it places a graph showing sales data on the slide and adds an appropriate title and description. The generated presentation materials are then passed on to the next processing step.
[0320] Step 7:
[0321] The server provides the generated presentation materials to the user, who can then download and use the materials. For example, a download link is displayed and the user clicks it to obtain the materials.
[0322] (Application example 3)
[0323] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0324] Conventional presentation creation systems are limited to use within specific companies, making them difficult for general users to use. Creating presentation materials also requires time and effort, making it difficult to provide information quickly and effectively to customers, especially in brick-and-mortar stores. Furthermore, there was a lack of a way to generate and visually display presentation materials using voice commands, resulting in low user convenience.
[0325] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[0326] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for recognizing voice commands and generating presentation materials using a generative AI model, and means for visually displaying the generated presentation materials. This makes it possible to quickly create high-quality presentation materials that are accessible to general users and to provide information to customers in physical stores quickly and effectively.
[0327] A "specific enterprise" refers to a corporation or organization with a specific business or purpose.
[0328] "Presentation materials that can be distributed externally" refers to presentation materials in a format that can be provided not only to internal parties of a company but also to external stakeholders and general users.
[0329] A "special-purpose database" refers to a database system designed specifically for a particular purpose or use.
[0330] "Means for automatic creation" refers to a function in which the system automatically generates presentation materials without requiring manual operation by the user.
[0331] "Means for providing" refers to a function for distributing or displaying the generated presentation materials to users.
[0332] "Voice command" refers to a voice input by a user to give instructions to a system using voice.
[0333] A "generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate new information or materials from data.
[0334] "Means for visually displaying" refers to the function of displaying the generated presentation materials through a visual output device such as a display or projector.
[0335] The following system configuration will be described as an embodiment of the present invention.
[0336] System Configuration
[0337] This system includes a server that stores presentation materials that exist within a specific company and can be used externally in a dedicated database, a server that automatically creates presentation materials based on the materials in the database, a server that provides the automatically created presentation materials, a terminal that recognizes voice commands and generates presentation materials using a generative AI model, and a terminal that visually displays the created presentation materials.
[0338] Hardware and software used
[0339] Hardware: smart glasses, microphone, camera, server
[0340] Software: OpenAI API, OpenCV, SpeechRecognition
[0341] Processing flow
[0342] 1. Database storage: The server stores presentation materials available for external use within a specific company in a dedicated database, allowing for centralized management of all necessary materials.
[0343] 2. Automatic creation of presentation materials: The server automatically creates presentation materials based on the materials in the database. It uses a generative AI model to quickly generate high-quality presentation materials that meet the user's requirements.
[0344] 3. Voice command recognition: The device (smart glasses) uses its built-in microphone to recognize voice commands and converts them into text using the SpeechRecognition library.
[0345] 4. Generate presentation materials: The device uses a generative AI model based on voice commands to generate presentation materials. It uses the OpenAI API to create materials based on the user's requests.
[0346] 5. Visual display: The generated presentation materials are visually displayed on the device display (smart glasses). OpenCV is used to display the materials in an appropriate format.
[0347] Specific examples
[0348] For example, if a staff member at a physical store wears smart glasses and issues a voice command such as "Show me a presentation about our new product," the terminal recognizes this voice command and uses a generative AI model to generate presentation materials explaining the features and advantages of the new product. The generated materials are displayed on the display of the smart glasses, allowing the staff member to provide information to customers visually. The system includes a means for playing the researched presentation materials on a terminal device held by the staff member at the physical store.
[0349] Prompt Sentence Examples
[0350] Create a presentation for your new product to customers, detailing its features, benefits, price, and usage.
[0351] In this way, high-quality presentation materials that can be used by general users can be created in a short time, and information can be provided to customers in physical stores quickly and effectively.
[0352] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0353] Step 1:
[0354] The server stores presentation materials that exist within a specific company and can be used externally in a dedicated database. Presentation materials within the company are provided as input and saved in the database. The database also stores metadata about the materials (title, creation date, creator, etc.). The output is the materials stored in the database.
[0355] Step 2:
[0356] The server automatically creates presentation materials based on materials in the database. As input, it receives a user request (e.g., a specific theme or topic). It uses a generative AI model to search for related materials in the database and generate new presentation materials based on these. As output, it obtains the generated presentation materials.
[0357] Step 3:
[0358] The device recognizes voice commands using the built-in microphone. As input, the user's voice command is provided. The SpeechRecognition library is used to convert the speech to text. As output, the voice command in text format is obtained.
[0359] Step 4:
[0360] The device uses a generative AI model to generate presentation materials based on voice commands. The input is a text-based voice command. The device uses the OpenAI API to create materials based on the user's requests. The output is the generated presentation materials.
[0361] Step 5:
[0362] The terminal visually displays the generated presentation materials. As input, the generated presentation materials are provided. OpenCV is used to display the materials in an appropriate format on the display. As output, a visually displayed presentation material is obtained.
[0363] In this way, a user can use voice commands to generate and visually display presentation materials.
[0364] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0365] "Example 1"
[0366] In one embodiment of the present invention, a means is provided for storing presentation materials that exist within a specific company and can be used externally in a dedicated database. Employees can freely access this database and add new presentation materials. For example, when a presentation material summarizing the results of a new project is created, the material is added to the database.
[0367] "Example 2"
[0368] It also provides a means to automatically create presentation materials based on materials in the database. This automatic creation is performed using AI technology, which learns the content, structure, design, etc. of the materials in the database. New presentation materials are generated based on the results of that learning. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on those.
[0369] "Example 3"
[0370] Furthermore, a means is provided for using an emotion engine that recognizes a user's emotions during the process of creating automatically generated presentation materials. This emotion engine recognizes emotions from the user's tone of voice, facial expressions, choice of words, etc. For example, if the user is feeling stressed while creating the presentation materials, the emotion engine will recognize that stress and assist the user in creating the presentation materials accordingly.
[0371] "Example 4"
[0372] Also provided is a means for adjusting the colors, fonts, layout, etc. of the presentation materials based on the user's emotions recognized by the emotion engine. For example, if the user is feeling happy, the emotion engine will recognize that happiness and adjust the colors of the presentation materials to be brighter, the fonts to be larger, and the layout to be more spacious accordingly.
[0373] The processing flow of each embodiment will be described below.
[0374] "Example 1"
[0375] Step 1: Presentation materials available for external use within a specific company are stored in a dedicated database.
[0376] Step 2: An employee accesses the database and adds new presentation materials.
[0377] "Example 2"
[0378] Step 1: Automatically create presentation materials based on the materials in the database.
[0379] Step 2: Use AI technology to learn the content, structure, design, etc. of the materials in the database.
[0380] Step 3: Generate new presentation materials based on the learning results.
[0381] "Example 3"
[0382] Step 1: An emotion engine is used to recognize the user's emotions during the process of creating automatically generated presentation materials.
[0383] Step 2: The emotion engine recognizes emotions from the user's tone of voice, facial expressions, and language.
[0384] Step 3: If the user is feeling stressed about creating the presentation, the emotion engine will recognize that stress and help the user create the presentation accordingly.
[0385] "Example 4"
[0386] Step 1: Adjust the colors, fonts, layout, etc. of the presentation materials based on the user's emotions recognized by the emotion engine.
[0387] Step 2: If the user is feeling joy, the emotion engine will recognize that joy and adjust the presentation materials accordingly: brighter colors, larger fonts, and a more spacious layout.
[0388] Example 1
[0389] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0390] Conventional presentation material management systems make it difficult to efficiently share information due to the complicated process of storing, searching, and sharing materials. Furthermore, they lacked the functionality to automatically create materials, making manual creation time and effort intensive. Furthermore, there was a need for a method to efficiently manage materials that could be distributed externally and quickly provide them when needed.
[0391] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0392] In this invention, the server includes a means for storing externally deployable materials existing within a specific organization in a dedicated database, a means for accessing the database to add materials, and a means for searching and acquiring materials from the database, thereby enabling efficient management of materials and rapid search and acquisition.
[0393] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[0394] "Externally deployable materials" refers to documents and data containing information that can be provided to parties or customers outside the organization.
[0395] A "dedicated database" is a data repository designed for a specific purpose and used within a particular organization.
[0396] "Storage means" refers to a method or device for storing data or material.
[0397] "Means for accessing and adding materials" refers to a method or device that allows a user to connect to the database and register new materials.
[0398] "Means for searching and retrieving materials" refers to methods and devices for locating materials in a database and retrieving the required information.
[0399] "Means for automatically creating materials" refers to methods or devices for automatically generating new materials based on existing data or information.
[0400] The term "means for providing" refers to a method or device for distributing or making the generated materials available for viewing by users or other interested parties.
[0401] This invention is a system for efficiently managing externally available materials that exist within a specific organization and providing them promptly when needed. This system operates in cooperation with three parties: a server, a terminal, and a user.
[0402] The server hosts a dedicated database and uses MySQL as its database management system (DBMS). The server provides various APIs for storing, searching, and retrieving materials. The server receives materials sent by users and stores them in the database. It also stores the material's metadata (title, author, creation date, etc.).
[0403] The terminal provides an interface for users to upload presentation materials. The terminal connects to the server using a web browser and displays a form for uploading materials. The user enters the required information in this form, selects the material file, and clicks the upload button.
[0404] A user creates a new presentation document and accesses the server through a terminal. The user enters the necessary information in a form to upload the document and selects the document file. The server receives the document sent by the user and stores it in a database. The user can search and download documents stored in the database. The server filters the documents based on the search query and returns the results to the user.
[0405] For example, suppose a user has created a presentation document summarizing the results of a new project. The user opens a web browser on their device and accesses the dedicated database upload form. They enter information such as the document title, author's name, and creation date in the form, select the document file, and click the upload button. The server receives the document and stores it in the MySQL database.
[0406] If other users want to use these materials, they can access the database using the same web browser on their device and use the search function to find the materials. For example, if they search for the keywords "results of new projects," the relevant materials will be displayed and available for download.
[0407] An example of a prompt to be input to a generative AI model is, "Please tell me how to add a presentation document summarizing the results of a new project to the database." When this prompt is input to the generative AI model, the AI will generate an answer based on the steps above that explains how to upload and search for the document.
[0408] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0409] Step 1:
[0410] A user creates a presentation.
[0411] A user uses presentation software to create a document summarizing the results of a new project. The input is a presentation file created by the user, and the output is the finished presentation.
[0412] Step 2:
[0413] A user accesses a server using a terminal.
[0414] The user opens a web browser on the terminal and accesses the URL of the dedicated database. The input is the URL entered by the user, and the output is the display of the database upload form.
[0415] Step 3:
[0416] A user uploads a presentation.
[0417] The user enters information such as the document title, author name, and creation date into the upload form on the web browser, clicks the file selection button to select the document file, and then clicks the upload button.The input is the document metadata entered by the user and the selected document file, and the output is an upload request sent to the server.
[0418] Step 4:
[0419] The server receives the uploaded material.
[0420] The server receives an upload request sent by a user and retrieves the material file and metadata. The input is the upload request sent by the user, and the output is the retrieved material file and metadata.
[0421] Step 5:
[0422] The server stores the materials in a database.
[0423] The server stores the acquired material files in a MySQL database along with the material metadata. The input is the acquired material files and metadata, and the output is the material and metadata stored in the database.
[0424] Step 6:
[0425] A user searches for a document in a database.
[0426] A user enters keywords into a search form on a web browser and clicks the search button. The input is the search keyword entered by the user, and the output is a search request sent to the server.
[0427] Step 7:
[0428] The server filters the materials based on the search query.
[0429] The server searches the database based on the search query and lists the relevant materials. The input is the search request sent by the user, and the output is a list of materials as search results.
[0430] Step 8:
[0431] A user downloads a document from a search result.
[0432] The user selects the desired material from the displayed search results and clicks the download button. The input is the material selected by the user, and the output is the downloaded material file.
[0433] (Application example 1)
[0434] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0435] With conventional presentation material management systems, it was difficult to efficiently manage materials created within a specific company that could be used externally, and for store staff to access, share, and add them in real time. Furthermore, there was no automated creation of presentation materials or provision of paid services, so improving operational efficiency and the quality of customer service were issues.
[0436] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0437] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, and means for allowing store staff to upload, view, share, and add presentation materials using their smartphones, thereby enabling store staff to manage presentation materials in real time and use them in customer interactions.
[0438] A "specific enterprise" is a legal entity or organization organized to provide a specific business or service.
[0439] "Externally applicable presentation materials" are information materials created in a format that can be provided to stakeholders and customers outside the company.
[0440] A "special-purpose database" is a data collection system designed specifically for a particular purpose or use.
[0441] "Means for automatically creating presentation materials" refers to technology that uses programs and algorithms to automatically generate presentation materials based on information in a database.
[0442] The "means for providing presentation materials" refers to a technique for distributing the generated presentation materials to users in a viewable format.
[0443] "Store staff" are employees who perform work in a physical store.
[0444] A "smartphone" is a highly functional mobile phone that can connect to the Internet and install applications.
[0445] "Uploading" is the act of transferring data from a local device to a server or cloud.
[0446] "Viewing" is the act of checking digital data or information on a screen.
[0447] "Sharing" is the act of making specific data or information available to multiple users simultaneously.
[0448] "Addition" is the act of adding new data or information to an existing database or system.
[0449] The system for implementing this invention stores presentation materials that exist within a specific company and can be used externally in a dedicated database, and provides the ability for store staff to upload, view, share, and add presentation materials using their smartphones.
[0450] Hardware and software used
[0451] Hardware: Smartphones, servers (cloud or on-premise)
[0452] Software: Flask (a Python microweb framework), werkzeug (a dependency of Flask)
[0453] Data processing and calculation
[0454] 1. File upload:
[0455] Provides the ability to upload presentation materials from a smartphone.
[0456] Use Flask to receive HTTP POST requests and save files to the server.
[0457] The server stores the uploaded files in a dedicated database.
[0458] 2. File list display:
[0459] Provides the ability to get a list of uploaded files.
[0460] Use Flask to handle HTTP GET requests and return the filename from the database.
[0461] Specific examples
[0462] For example, a staff member at a physical store can take a photo of a new product's explanatory materials with their smartphone and upload the image file through the app. The uploaded materials can then be viewed by other staff members through the same app. This allows all staff members to share the latest information in real time, which can be useful when dealing with customers.
[0463] Prompt Sentence Examples
[0464] Please upload explanatory materials for your new product. Uploaded materials will be available for other staff to view.
[0465] In this way, store staff can share information in real time and use it to better serve customers.
[0466] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0467] Step 1:
[0468] A user uploads presentation materials using a smartphone.
[0469] Input: Presentation file on smartphone.
[0470] Specific behavior: The user opens the app, taps the upload button to display the file selection screen, selects a file, and taps the upload button again.
[0471] Output: The selected files are sent to the server as an HTTP POST request.
[0472] Step 2:
[0473] The server stores the received files in a dedicated database.
[0474] Input: HTTP POST request and file data sent by the user.
[0475] What it does: The server uses Flask to receive the request and saves the file in a temporary directory. It uses the secure_filename function to secure the filename.
[0476] Output: The file is saved to the specified directory on the server and the file name is added to the database.
[0477] Step 3:
[0478] Get a list of files uploaded by a user using their smartphone.
[0479] Input: HTTP GET request.
[0480] Specific behavior: The user taps the "File List" button in the app, which sends an HTTP GET request to the server.
[0481] Output: The server retrieves a list of filenames from the database and returns them to the user in JSON format.
[0482] Step 4:
[0483] A user views a file using a smartphone.
[0484] Input: A list of filenames returned by the server.
[0485] Specific operation: The user checks the list of file names in the app and taps the file they want to view. The app downloads the selected file from the server and displays it on the smartphone.
[0486] Output: The selected file will be displayed on your smartphone.
[0487] Step 5:
[0488] A user shares a file using a smartphone.
[0489] Input: The file you are viewing.
[0490] What happens: The user taps the "Share" button in the app and selects a sharing method (email, messaging app, etc.) The app sends the file via the selected method.
[0491] Output: The file is sent to other users using the specified sharing method.
[0492] Step 6:
[0493] A user adds new presentation materials using a smartphone.
[0494] Input: New presentation file.
[0495] What happens: A user opens the app, taps the upload button, selects a new file, and uploads it.
[0496] Output: The new file is sent to the server and added to a dedicated database.
[0497] Example 2
[0498] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0499] Conventional presentation material creation systems require users to create materials manually, which requires a great deal of time and effort. It is also difficult to maintain consistency in the content and design of the materials, which can lead to variations in quality. Furthermore, past materials cannot be effectively utilized, making it difficult to reuse them when creating new materials. To solve these problems, a system that automatically creates presentation materials based on materials stored in a database is needed.
[0500] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for storing externally deployable materials existing within a specific organization in a dedicated database; means for automatically creating presentation materials using a generative AI model based on the materials in the database; means for providing the automatically created presentation materials; means for a user to request the creation of presentation materials by operating a terminal; means for the terminal to send a request to the server; means for the server to retrieve the materials from the database; means for the server to learn the materials using the AI model; means for the server to generate new presentation materials; means for the server to send the generated presentation materials to the terminal; means for the terminal to display the generated presentation materials to the user; and means for the user to review the generated presentation materials and modify them as necessary. This eliminates the need for users to manually create materials, enabling high-quality presentation materials to be created efficiently.
[0501] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[0502] "Externally deployable materials" refers to documents and presentation materials containing information or data that can be provided to parties outside the organization.
[0503] A "special-purpose database" refers to a database system designed specifically for a particular purpose or use.
[0504] "Generative AI models" refer to algorithms or models that use artificial intelligence technology to analyze data and generate new information or materials.
[0505] "Presentation materials" refers to slides and documents used to visually convey information.
[0506] "Automated creation" refers to the process of systems automatically generating materials with minimal human intervention.
[0507] "User" refers to an individual or member of an organization who uses the system to create presentation materials.
[0508] "Terminal" refers to a device such as a computer, smartphone, or tablet that is operated by a user.
[0509] "Server" refers to a computer system for processing, storing, and managing data.
[0510] A "request" refers to a user requesting a specific operation or process from the system.
[0511] "Obtaining materials" refers to searching for and retrieving the necessary information or data from a database.
[0512] "Studying the material" refers to the process by which an AI model analyzes data and understands its content and patterns.
[0513] "Providing" refers to making the generated presentation materials available to users.
[0514] "Check and correct as necessary" means that the user checks the generated materials and makes any necessary changes or additions.
[0515] This invention relates to a system that automatically creates presentation materials using a generative AI model based on externally deployable materials that exist within a specific organization. Specific embodiments of this system are described below.
[0516] Hardware and software used
[0517] Hardware: Servers, devices (PCs, tablets, smartphones, etc.)
[0518] Software: Database management systems (e.g., MySQL, PostgreSQL), AI models (e.g., GPT-4, BERT), presentation software (e.g., Microsoft PowerPoint, Google Slides)
[0519] System configuration
[0520] 1. Database Management System
[0521] The server stores externally deployable data within a specific organization in a dedicated database, using database management systems such as MySQL or PostgreSQL.
[0522] 2. Generative AI Models
[0523] The server automatically creates presentation materials based on the materials in the database using a generative AI model, such as GPT-4 or BERT.
[0524] 3. Presentation Software
[0525] The server sends the generated presentation materials to the terminal, which then displays them to the user. Presentation software such as Microsoft PowerPoint or Google Slides is used.
[0526] System Operation
[0527] User operations
[0528] The user operates the terminal to request the creation of a presentation material. For example, the user inputs a prompt sentence such as "Please create a presentation introducing a new product."
[0529] Device behavior
[0530] The device receives the user's input and sends the request to the server, including the theme and keywords specified by the user.
[0531] Server Operation
[0532] 1. Acquisition of materials
[0533] The server receives the request and uses a database management system to search and retrieve relevant materials, such as past product introduction presentation materials.
[0534] 2. Study the material
[0535] The server inputs the acquired materials into the AI model, which learns the material's content, structure, design, etc. The AI model then extracts commonalities and patterns among the materials.
[0536] 3. Generate materials
[0537] The server generates new presentation materials based on the learning results. The generated materials include content based on the theme specified by the user. For example, slides emphasizing the features and advantages of a new product may be created.
[0538] 4. Submission of Materials
[0539] The server sends the generated presentation materials to the terminal in a format that can be opened with presentation software (e.g., .pptx).
[0540] Terminal display
[0541] The terminal displays the presentation materials received from the server to the user, who can then view the materials on the terminal screen.
[0542] User verification and correction
[0543] The user can review the generated presentation materials and make corrections or additions as necessary, for example, by fine-tuning the content of slides or adding new slides.
[0544] Specific examples
[0545] Example 1: New product introduction presentation
[0546] A user uses a terminal to send a request to the server to create a presentation on the theme of "introducing a new product." The server studies past product introduction presentations in the database and extracts common themes and structures. As a result, a presentation containing the features, benefits, and usage of the new product is automatically generated. The user can review the generated material and make any necessary revisions.
[0547] Example 2: Annual report presentation
[0548] A user uses a terminal to send a request to the server to create a presentation on the theme of "Annual Report." The server studies past annual report presentations in the database and extracts common themes and structures. As a result, a presentation containing information such as sales, profits, and major projects is automatically generated. The user can review the generated presentation and make any necessary revisions.
[0549] Prompt Sentence Examples
[0550] "Create a presentation to introduce a new product."
[0551] "Create this year's annual report presentation based on past annual reports."
[0552] The above is a specific embodiment for carrying out the present invention.
[0553] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0554] Step 1:
[0555] The user operates the terminal to request the creation of presentation materials.
[0556] Input: The user types the prompt "Create a presentation to introduce our new product" into the terminal application.
[0557] Output: The terminal receives the user's request.
[0558] Specific actions: The user opens the terminal application, enters the specified prompt sentence, and clicks the send button.
[0559] Step 2:
[0560] The device sends a request to the server.
[0561] Input: The prompt text entered by the user.
[0562] Output: The HTTP request sent to the server.
[0563] Specific operation: The terminal receives the user's input and sends it to the server as an HTTP request, which includes the prompt text entered by the user.
[0564] Step 3:
[0565] The server retrieves the information from the database.
[0566] Input: The HTTP request received by the server.
[0567] Output: Related material retrieved from the database.
[0568] Specific operation: The server executes an SQL query to a database management system (e.g., MySQL, PostgreSQL) to search and retrieve relevant materials. For example, it executes the query "SELECT FROM presentations WHERE theme = 'New product introduction'".
[0569] Step 4:
[0570] The server uses an AI model to learn the material.
[0571] Input: Materials retrieved from the database.
[0572] Output: Commonalities and patterns in the material as a result of learning.
[0573] Specific operation: The server inputs the acquired materials into an AI model (e.g., GPT-4, BERT) to analyze the content, structure, design, etc. of the materials. The AI model then extracts commonalities and patterns from the materials.
[0574] Step 5:
[0575] The server generates new presentation materials.
[0576] Input: The training results of the AI model.
[0577] Output: The newly generated presentation.
[0578] How it works: The server generates new presentation materials based on the output of the AI model. The generated materials include content based on a theme specified by the user. For example, slides highlighting the features and benefits of a new product may be created.
[0579] Step 6:
[0580] The server transmits the generated presentation materials to the terminal.
[0581] Input: The newly generated presentation.
[0582] Output: Presentation materials sent to the device.
[0583] Specific operation: The server sends the generated presentation materials to the terminal in a format (e.g., .pptx) that can be opened in presentation software (e.g., Microsoft PowerPoint, Google Slides).
[0584] Step 7:
[0585] The terminal displays the generated presentation material to the user.
[0586] Input: Presentation materials received from the server.
[0587] Output: Presentation materials displayed on the device screen.
[0588] Specific operation: The terminal displays the presentation materials received from the server to the user, who can then view them on the terminal screen.
[0589] Step 8:
[0590] The user checks the generated presentation materials and corrects them if necessary.
[0591] Input: Presentation materials displayed on the terminal.
[0592] Output: A revised presentation.
[0593] Specific Actions: The user reviews the generated presentation materials and, if necessary, edits the slide content or adds new slides.
[0594] (Application example 2)
[0595] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0596] Conventional presentation material creation systems can automatically create presentation materials based on database data, but they do not support the automatic generation of presentation materials based on work data or production data within a factory. This makes it difficult to quickly create presentation materials for efficient factory production efficiency and work reports. Furthermore, there is a lack of a way to provide these materials as a paid service.
[0597] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0598] In this invention, the server includes means for storing externally deployable presentation materials existing within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for collecting work data and production data within a factory and automatically creating presentation materials based on the data, and means for saving the automatically created presentation materials, thereby enabling the rapid creation of presentation materials for efficiently reporting factory production efficiency and work operations.
[0599] A "specific organization" is an organization or institution with a specific purpose, such as a company or factory.
[0600] "Externally deployable presentation materials" are presentation materials created in a format that can be provided to parties outside the organization.
[0601] A "specialized database" is a database designed specifically for a particular purpose or use.
[0602] "Means for automatically creating presentation materials" refers to technology that uses AI technology and algorithms to automatically generate presentation materials based on materials in a database.
[0603] The "means for providing" refers to a method or technique for distributing or enabling users to view the generated presentation materials.
[0604] "Factory work data" refers to data related to various types of work carried out within a factory.
[0605] "Production data" refers to data related to production activities in a factory.
[0606] "Means of automatic generation" refers to technology that uses AI technology and algorithms to automatically generate materials and information based on specific data.
[0607] "Storage means" refers to methods and technologies for safely and efficiently storing generated materials and data.
[0608] A system for implementing this invention includes means for storing externally deployable presentation materials that exist within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for collecting work data and production data within a factory and automatically generating presentation materials based on the data, and means for saving the automatically created presentation materials.
[0609] The server first collects work data and production data from within the factory. This requires hardware and software to acquire data from various sensors and production management systems within the factory. Specifically, a database management system (DBMS) and data collection software are used.
[0610] The collected data is then stored in a dedicated database, which incorporates an AI model to learn the content, structure, design, etc. of the data. This AI model is, for example, a generative AI model that uses natural language processing (NLP) technology.
[0611] The server automatically creates presentation materials based on the data in the database. During this process, an AI model extracts common themes and structures from the data and generates new presentation materials. The generated presentation materials are created using Python's python-pptx library, among other tools.
[0612] The generated presentation materials are provided to users, who can view and download them through a dedicated web interface or application. The generated presentation materials are also securely stored on the server.
[0613] As a concrete example, consider the case of automatically generating presentation materials based on factory production data. Factory production data (production volume, number of defects, etc.) is retrieved from a database, and presentation materials for periodic work reports are automatically generated. In this case, the following prompt sentence is input into the generation AI model:
[0614] Example prompt sentence:
[0615] Based on the factory production data, please automatically generate presentation materials that include the following information:
[0616] Production quantity by date
[0617] Number of defects by date
[0618] Production efficiency graph
[0619] In this way, it becomes possible to quickly create presentation materials for efficiently reporting on factory production efficiency and work.
[0620] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0621] Step 1:
[0622] The server collects work data and production data from various sensors and production management systems within the factory. Specifically, it acquires data from the sensors in real time and stores it in a database management system (DBMS). The input is data from the sensors and production management system, and the output is production data stored in the database.
[0623] Step 2:
[0624] The server stores the collected data in a dedicated database, which incorporates a generative AI model to learn the content, structure, design, etc. of the data. The input is the production data collected in step 1, and the output is the training data stored in the database.
[0625] Step 3:
[0626] The server automatically creates presentation materials based on the materials in the database. The generative AI model extracts common themes and structures from the data and generates new presentation materials. The input is the training data in the database, and the output is the generated presentation materials.
[0627] Step 4:
[0628] The server creates the generated presentation using Python's python-pptx library. Specifically, it sets the slide layout and adds data as tables and graphs. The input is the content of the presentation generated by the generative AI model, and the output is the completed presentation file.
[0629] Step 5:
[0630] The server provides the generated presentation materials to users, who can view and download them through a dedicated web interface or application. The input is the completed presentation file, and the output is the presentation materials that users can access.
[0631] Step 6:
[0632] The server safely stores the generated presentation materials. Specifically, it stores and backs up the data in cloud storage or a local server. The input is the completed presentation file, and the output is the saved presentation materials.
[0633] Example 3
[0634] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0635] Conventional presentation creation systems require users to create presentation materials manually, which is time-consuming and labor-intensive. Furthermore, they are unable to adjust presentation materials to take into account the user's emotions, making it difficult to increase user satisfaction. Furthermore, there is a lack of a way to automatically create high-quality presentation materials based on internal materials for a specific organization and provide them to external parties.
[0636] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[0637] In this invention, the server includes means for storing presentation materials available for external use within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for generating presentation materials by inputting prompt sentences into a generative AI model, and means for adjusting the presentation materials using an emotion engine that recognizes user emotions. This allows users to automatically create high-quality presentation materials in a short amount of time and also enables the materials to be adjusted in accordance with the user's emotions.
[0638] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[0639] "Externally deployable presentation materials" refers to presentation materials created in a format that can be provided to stakeholders outside the organization and general users.
[0640] A "special purpose database" refers to a database designed for a specific purpose and to store a specific type of data.
[0641] The term "means for automatic creation" refers to a method or device that allows a system to automatically generate presentation materials without requiring manual operation by a user.
[0642] The term "means for providing" refers to a method or device for distributing or making accessible the generated presentation materials to users.
[0643] A "generative AI model" refers to a model that uses artificial intelligence technology to generate new information and content from data.
[0644] A "prompt" is a text sentence used to input specific instructions or requests to a generative AI model.
[0645] An "emotion engine" refers to technology or equipment that analyzes and recognizes emotions from a user's tone of voice, facial expressions, and choice of words.
[0646] "Adjusting means" refers to a method or device for changing the color, font, layout, etc. of the presentation material based on the user's emotions.
[0647] The present invention is a system for automatically creating presentation materials that can be distributed externally within a specific organization and adjusting them according to the user's emotions. A specific embodiment of this system will be described below.
[0648] System configuration
[0649] This system consists of three main components: a server, a terminal, and a user. The server contains a database, a generative AI model, and an emotion engine. The terminal is a device that allows users to access and operate the system.
[0650] Hardware and software used
[0651] The server is a computer equipped with a high-performance processor and large memory capacity. The database stores presentation materials from within a specific organization that can be deployed externally. The generative AI model uses, for example, OpenAI's GPT-4. The emotion engine uses, for example, Microsoft's Azure (registered trademark) Cognitive Services' Emotion API.
[0652] Data processing and calculation
[0653] The server receives a request from the user and inputs a prompt sentence into the generative AI model. The generative AI model generates a presentation based on the prompt sentence. The generated material is composed of slides, each containing the specified points.
[0654] The server then uses an emotion engine to recognize emotions from the user's tone of voice, facial expressions, and language. Once the emotion engine recognizes the user's emotion, the server adjusts the color, font, layout, etc. of the presentation materials based on that emotion.
[0655] Specific examples
[0656] For example, if a user requests, "I want to create a presentation about environmental protection," the server will input the following prompt into the generative AI model:
[0657] Example prompt sentence:
[0658] "Please create a presentation about environmental protection. Please include the following points: 1. The importance of environmental protection 2. Current environmental issues 3. Specific measures 4. Outlook for the future"
[0659] Based on this prompt, the generative AI model generates a presentation with the specified points for each slide. The server then uses an emotion engine to recognize the emotions the user is feeling while creating the presentation. For example, if the user is feeling stressed, the emotion engine will recognize that stress and the server will adjust the content of the presentation to be concise and easy to understand.
[0660] Finally, the server provides the adjusted presentation materials to the user, who can then download or view the completed presentation materials through their terminals.
[0661] In this way, this system can provide high-quality presentation materials that meet the needs and emotions of the user.The flow of the specification process in the third embodiment will be described with reference to FIG.
[0662] Step 1:
[0663] A user requests that a presentation be created.
[0664] Input: A user uses a terminal to request the creation of a presentation on a particular topic.
[0665] Output: The user's request is sent to the server.
[0666] Specific operation: The user enters "I would like to create a presentation about environmental protection" into the input form on the terminal and presses the send button.
[0667] Step 2:
[0668] The server receives the request and inputs a prompt to the generative AI model.
[0669] Input: The user's request.
[0670] Output: The prompt sentence to be input to the generative AI model.
[0671] Specific operation: The server analyzes the user's request and generates the prompt, "Please create a presentation about environmental protection. Please include the following points: 1. The importance of environmental protection. 2. Current environmental issues. 3. Specific measures. 4. Outlook for the future."
[0672] Step 3:
[0673] A generative AI model generates presentation materials.
[0674] Input: The prompt sentence fed into the generative AI model.
[0675] Output: The generated presentation.
[0676] How it works: A generative AI model (e.g., GPT-4) generates a presentation with the specified points for each slide based on a prompt.
[0677] Step 4:
[0678] The server uses an emotion engine to recognize the user's emotion.
[0679] Input: Data such as the user's tone of voice, facial expressions, and language.
[0680] Output: The user's emotional state.
[0681] Specific operation: The server uses an emotion engine (for example, Emotion API) to analyze the emotions that the user is feeling while creating the presentation materials.
[0682] Step 5:
[0683] The server adjusts the presentation material based on the user's emotions.
[0684] Input: The user's emotional state and the generated presentation materials.
[0685] Output: Adjusted presentation materials.
[0686] Specific behavior: If the user is feeling stressed, the server adjusts the content of the materials to be simpler and easier to understand, for example, by changing the colors to more subdued ones and making the font easier to read.
[0687] Step 6:
[0688] The server provides the final presentation to the user.
[0689] Input: Tailored presentation materials.
[0690] Output: The final presentation material provided to the user.
[0691] Specific operation: The server sends the adjusted presentation materials to the user, who can then download or view the completed presentation materials through their terminals.
[0692] (Application example 3)
[0693] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0694] Conventional presentation material creation systems create materials without considering the user's emotions, which can cause stress for the user and result in poor quality materials. It is also difficult for store staff to create high-quality materials in a short amount of time when creating materials for product explanations or promotions. This creates an issue where it is difficult to make effective presentations to customers.
[0695] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[0696] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for automatically creating materials based on the materials in the database, means for providing the automatically created materials, means for using an emotion engine that recognizes the user's emotions, and means for adjusting the color, font, layout, etc. of the materials based on the user's emotions recognized by the emotion engine. This makes it possible to automatically create high-quality presentation materials that are responsive to the user's emotions.
[0697] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[0698] "Externally deployable materials" refers to materials that contain information or data that can be provided to stakeholders outside the organization or to general users.
[0699] A "dedicated database" refers to a data collection system designed and constructed for a specific purpose or use.
[0700] "Means for automatically creating documents" refers to software or algorithms that automatically generate documents based on input data.
[0701] The term "means for providing materials" refers to a method or system for distributing or displaying the generated materials to users.
[0702] An "emotion engine that recognizes user emotions" refers to software and hardware that analyzes and recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc.
[0703] "Means for adjusting the color, font, layout, etc. of materials" refers to software or algorithms that change and optimize the visual elements of materials according to the user's emotions.
[0704] "Paid Service" refers to a service that is provided to a User in exchange for payment.
[0705] To implement this invention, it is necessary to build a system that stores externally available documents from a specific organization in a dedicated database and automatically creates documents based on the documents in the database. This system has the function of adjusting the color, font, layout, etc. of the documents using an emotion engine that recognizes the user's emotions.
[0706] Hardware and software used
[0707] Hardware: Smartphone (camera, microphone)
[0708] software:
[0709] OpenCV (image processing)
[0710] Keras (emotion recognition model)
[0711] TextBlob (Text Analysis)
[0712] python-pptx (generates presentation materials)
[0713] System configuration
[0714] 1. Database: A dedicated database will be established to store externally deployable materials that exist within a specific organization.
[0715] 2. Emotion Engine: The device is equipped with an emotion engine that uses the smartphone's camera and microphone to analyze the user's facial expressions and tone of voice in order to recognize the user's emotions.
[0716] 3. Automatic document creation module: Implement a module that automatically creates documents based on the user's emotions based on the documents in the database.
[0717] 4. Material provision module: A module is installed to provide automatically created materials to users.
[0718] Processing flow
[0719] 1. Data acquisition: Capture the user's facial image and voice using the smartphone's camera and microphone.
[0720] 2. Emotion recognition: The acquired data is preprocessed using OpenCV, and the user's emotions are predicted using the Keras emotion recognition model.
[0721] 3. Document Creation: Based on the emotion recognition results, the automatic document creation module generates documents from the documents in the database. It uses TextBlob for text analysis and generates presentation documents in python-pptx.
[0722] 4. Material adjustment: The color, font, layout, etc. of the material are adjusted based on the user's emotions recognized by the emotion engine.
[0723] 5. Providing materials: Providing adjusted materials to users.
[0724] Specific examples
[0725] For example, when a store staff member uses this system to promote a new product, the system analyzes the staff member's facial expressions and tone of voice as they speak into the smartphone camera, and if the staff member appears stressed, it automatically creates a presentation with calming colors and a compact layout.
[0726] Prompt Sentence Examples
[0727] "Create promotional materials for new products. If your staff are feeling stressed, adjust the colors to be more muted and the layout to be more compact."
[0728] In this way, it becomes possible to automatically create high-quality presentation materials that reflect the user's emotions.
[0729] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0730] Step 1:
[0731] The server stores externally deployable materials within a specific organization in a dedicated database. As input, the organization's materials are provided and stored in the database. The database contains the metadata and content of the materials. As output, the stored materials are stored in the database.
[0732] Step 2:
[0733] The device uses the smartphone's camera and microphone to acquire the user's facial image and voice. As input, the user's facial image and voice are captured in real time. As output, the acquired facial image and voice data are generated.
[0734] Step 3:
[0735] The server preprocesses the acquired face images and audio data using OpenCV. The face images and audio data are provided as input. Specifically, the face images are converted to grayscale and resized to 48x48 pixels. The audio data undergoes preprocessing such as noise removal. Preprocessed image data and audio data are generated as output.
[0736] Step 4:
[0737] The server analyzes the preprocessed data with a Keras emotion recognition model to predict the user's emotion. As input, the preprocessed image data and audio data are provided. The emotion recognition model analyzes these data and outputs an emotion label (e.g., joy, stress, etc.). As an output, the user's emotion label is generated.
[0738] Step 5:
[0739] The server uses the emotion recognition results and the automatic document creation module to generate documents from the documents in the database. The user's emotion labels and the documents in the database are provided as input. Text analysis is performed using TextBlob, and presentation documents are generated in python-pptx. The initial presentation documents are generated as output.
[0740] Step 6:
[0741] The server adjusts the color, font, layout, etc. of the presentation materials based on the user's emotion recognized by the emotion engine. The initial presentation materials and the user's emotion label are provided as input. Specifically, the color of the materials is changed and the font size and layout are adjusted according to the emotion label. The adjusted presentation materials are generated as output.
[0742] Step 7:
[0743] The server provides the adjusted materials to the user. As input, the adjusted presentation materials are provided. As output, the materials are provided in a format that the user can access. Specifically, the materials are saved in PDF or PPTX format and a download link is provided to the user.
[0744] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0745] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0746] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[0747] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0748] [Second embodiment]
[0749] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0750] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0751] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0752] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0753] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0754] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0755] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0756] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0757] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0758] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0759] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0760] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[0761] "Example 1"
[0762] In one embodiment of the present invention, presentation materials available for external use within a specific company are stored in a dedicated database. Employees can freely access this database and add new presentation materials. For example, when a presentation material summarizing the results of a new project is created, the material is added to the database.
[0763] "Example 2"
[0764] Next, presentation materials are automatically created based on the materials in the database. This automatic creation is done using AI technology, which learns the content, structure, design, etc. of the materials in the database and generates new presentation materials. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on these.
[0765] "Example 3"
[0766] Finally, we offer a paid service for automatically generated presentation materials. This service is available to employees of specific companies as well as general users. For example, if a user wants to create a presentation on a specific topic, they can use this service to quickly create high-quality presentation materials based on the materials in the database.
[0767] The processing flow of each embodiment will be described below.
[0768] "Example 1"
[0769] Step 1: All presentation materials available for external use within a specific company are stored in a dedicated database. Employees can freely access this database and add new presentation materials. For example, if a presentation document summarizing the results of a new project is created, the document is added to the database.
[0770] "Example 2"
[0771] Step 1: Automatically create presentation materials based on the materials in the database. This automatic creation is done using AI technology, which learns the content, structure, and design of the materials in the database.
[0772] Step 2: Generate new presentation materials based on the learning results. For example, extract common themes and structures from multiple presentation materials in the database.
[0773] and create new presentation materials based on the results.
[0774] "Example 3"
[0775] Step 1: Automatically created presentation materials are provided as a paid service. This service can be used not only by employees of specific companies, but also by general users. Step 2: When a user wants to create presentation materials on a specific topic, they can use this service to quickly create high-quality presentation materials based on materials in the database.
[0776] Example 1
[0777] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0778] Presentation materials created within a particular company often need to be distributed externally and shared with other employees and departments. However, there is a lack of a system for efficiently managing these materials and quickly accessing them when needed. Furthermore, there is a lack of integrated functionality for automatically creating, searching, and viewing presentation materials, which reduces work efficiency. Furthermore, there is no system in place for providing these materials as a paid service.
[0779] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0780] In this invention, the server includes a means for storing presentation materials available for external use within a specific company in a dedicated database, a means for employees to freely access the database and add new presentation materials, a means for automatically creating presentation materials based on the materials in the database, a means for providing the automatically created presentation materials, and a means for searching and viewing the presentation materials. This enables efficient management and rapid access to presentation materials, thereby improving business efficiency. Furthermore, the integration of the functions for automatically creating, searching, and viewing materials improves usability and also provides a mechanism for providing these materials as a paid service.
[0781] A "specific enterprise" is a legal entity with a specific business or purpose.
[0782] "Externally applicable presentation materials" are information materials created in a format that can be provided to parties outside the company.
[0783] A "special-purpose database" is a database system designed for a specific purpose to efficiently store, manage, and retrieve specific data.
[0784] An "employee" is an individual employed by a particular company and engaged in its work.
[0785] "Access" is the act of reading or writing data to a database or system.
[0786] "Presentation materials" are slides and documents created to convey information visually.
[0787] "Automatic generation" is the process by which a system generates materials based on specific algorithms or rules without the need for manual user interaction.
[0788] "Providing" is the act of making a particular service or information available to others.
[0789] "Searching" is the act of locating information in a database based on specific criteria or keywords.
[0790] "Viewing" is the act of visually checking data or materials.
[0791] A "paid service" is a business model in which a fee is charged in exchange for providing a specific service or information.
[0792] The present invention provides a system for efficiently managing presentation materials created within a specific company that can be used externally and for quickly accessing them when needed. A specific embodiment of this system will be described below.
[0793] System configuration
[0794] 1. Hardware and Software
[0795] Server: Use MySQL as the database management system (DBMS) and build a dedicated database to store presentation materials.
[0796] Device: Use a device such as a PC or tablet to access a dedicated web application.
[0797] User: An employee employed by a particular company who uses a terminal to access the system.
[0798] System Operation
[0799] 1. User login
[0800] Users access a dedicated web application from their device and enter their authentication information (user ID and password) to log in. The device sends the entered authentication information to the server, which then collates it with a database to perform authentication.
[0801] 2. Upload your presentation materials
[0802] After logging in, the user accesses a form for uploading presentation materials. The terminal displays a form for entering the title, description, and file of the material, and the user enters the required information, selects the file, and clicks the upload button. The terminal then sends the entered information and file to the server, which stores them in a database.
[0803] 3. Search and view presentation materials
[0804] The user accesses a search screen to search for presentation materials in the database, enters search keywords, and clicks the search button. The terminal sends the entered search keywords to the server, which searches the database to generate a list of relevant presentation materials and sends it to the terminal. The user selects a specific presentation material from the search results, checks the detailed information, and clicks the view button. The terminal downloads the material file from the server and displays it to the user.
[0805] Specific examples
[0806] For example, if employee A creates a presentation document summarizing the results of a new project, employee A logs into a dedicated web application from his / her terminal, enters the document title "Results of Project X," the description "Document summarizing the detailed results of Project X," and the file name "projectX_results.pptx," and uploads it. The server stores this information in a database, making it freely accessible to other employees.
[0807] Prompt Sentence Examples
[0808] "What are the steps to add a presentation document outlining the results of a new project to the database?"
[0809] By inputting this prompt into a generative AI model, specific steps and operation methods can be explained in natural language.
[0810] The above is a concrete example of how to implement this invention. This system enables efficient management and rapid access to presentation materials, improving business efficiency. Furthermore, by integrating the functions of automatic creation, search, and viewing of materials, usability is improved, and a mechanism for providing these materials as a paid service is also established.
[0811] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0812] Step 1: User Login
[0813] Input: The user accesses a dedicated web application from their device and enters their user ID and password.
[0814] Operation: The terminal sends the entered authentication information to the server, which checks it against its database and starts the session if authentication is successful.
[0815] Output: If authentication is successful, the user is logged into the system and redirected to a dedicated dashboard.
[0816] Step 2: Upload your presentation materials
[0817] Input: After logging in, the user accesses a form to upload presentation materials and enters the title, description, and file of the materials.
[0818] Operation: The terminal sends the input information and files to the server, which stores the received information in a database.
[0819] Output: If the upload is successful, the server notifies the user that the upload was successful.
[0820] Step 3: Find your presentation materials
[0821] Input: The user accesses a search screen to search for presentation materials in the database and enters search keywords.
[0822] Operation: The terminal sends the entered search keywords to the server, which searches the database and generates a list of relevant presentation materials.
[0823] Output: The server sends the generated list to the terminal, which displays the list to the user.
[0824] Step 4: View the presentation materials
[0825] Input: The user selects a specific presentation from the search results and clicks the View button.
[0826] Operation: The terminal displays detailed information about the selected material and downloads the material file from the server.
[0827] Output: The terminal displays the downloaded file to the user.
[0828] Step 5: Automatically create presentation materials
[0829] Input: The user requests the automatic creation of a presentation based on specific criteria and templates.
[0830] How it works: The server processes the information in the database based on specified conditions and templates, and automatically generates presentation materials.
[0831] Output: The server stores the automatically created presentation materials in a database and notifies the user.
[0832] Step 6: Offering it as a paid service
[0833] Input: A user requests a presentation that is offered as a paid service.
[0834] Operation: Based on the user's request, the server processes the payment and provides the materials after the payment is confirmed.
[0835] Output: The server makes the presentation available for download to users whose payment has been confirmed.
[0836] (Application example 1)
[0837] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0838] In traditional presentation management systems, creating and sharing materials is often done manually, which is inefficient. Furthermore, when introducing new product lines or explaining manufacturing processes in factories, there are limited ways to visually share materials, which can lead to insufficient information transmission.
[0839] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0840] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for a robot used in the factory to acquire the presentation materials and visually explain them, and means for the robot to display the materials through smart glasses or a head-mounted display. This enables efficient creation and sharing of presentation materials, and by communicating information visually within the factory, information can be communicated more effectively.
[0841] "Specific enterprise" refers to a legal entity or organization that carries out a specific business or activity.
[0842] "Externally deployable presentation materials" refers to presentation documents and slides that can be provided or shared with parties outside the company.
[0843] "Purpose-built database" refers to a data collection system designed for a specific purpose or use.
[0844] "Means for automatically creating presentation materials" refers to a method or device for automatically generating presentation materials based on input data or information.
[0845] The term "means for providing" refers to a method or device for distributing or displaying the generated presentation materials to users.
[0846] "Robots used in factories" refers to automated machinery and devices operated in factories to assist with manufacturing operations and tasks.
[0847] "Visual explanation means" refers to a method or device for visually displaying information or materials and explaining them to a user.
[0848] "Smart glasses" refers to a wearable device in the form of glasses that has a display function for displaying information.
[0849] A "head-mounted display" is a display device worn on the head, used to display information within the user's field of vision.
[0850] As a form for implementing this invention, a system is constructed in which presentation materials that exist within a specific company and can be used externally are stored in a dedicated database, and robots used in factories retrieve the materials and provide visual explanations.
[0851] First, the server stores presentation materials created within a specific company that can be distributed externally in a dedicated database. The dedicated database is designed to enable efficient management and access of data. The database stores the metadata and content of presentation materials, and employees can freely access and add new materials.
[0852] The server then automatically creates presentation materials based on the materials in the database. This process uses a generative AI model, which generates presentation slides and documents based on the input data and information. This process streamlines the creation of materials and automatically generates high-quality presentation materials.
[0853] The generated presentation materials are provided to the robots used in the factory. The robots retrieve the materials from a dedicated database and visually explain them to the factory staff. The robots display the materials through smart glasses or a head-mounted display, allowing the staff to work while checking the materials.
[0854] As a concrete example, consider a presentation document for the introduction of a new product line. This document includes product specifications, manufacturing processes, quality control points, etc. The robot can retrieve this document and visually explain it to factory staff. Staff can then wear smart glasses or a head-mounted display and proceed with the introduction of the new product line while reviewing the document.
[0855] An example of a prompt is, "Please retrieve presentation materials from the database regarding the introduction of a new product line and explain them to the staff in the factory." Using this prompt, the robot can retrieve the appropriate materials and explain them visually.
[0856] In this way, presentation materials can be created and shared efficiently, and information can be communicated visually within the factory, making it possible to communicate information more effectively.
[0857] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0858] Step 1:
[0859] The server stores presentation materials created within a specific company that can be distributed externally in a dedicated database. The input is presentation materials created by employees, which are saved in the database. The database stores the materials' metadata (author, creation date, project name, etc.) and content. This allows for efficient management of the materials and makes them easily accessible later.
[0860] Step 2:
[0861] The server automatically creates presentation materials based on the materials in the database. The input is the materials stored in the database, and new presentation materials are generated using a generative AI model. The generative AI model analyzes the content of the materials and automatically creates appropriate slides and documents. The output is the newly generated presentation materials.
[0862] Step 3:
[0863] The server provides the generated presentation materials to the robots used in the factory. The server receives the generated presentation materials as input and sends them to the robot. The robot receives the materials and stores them in its internal memory, allowing the robot to retrieve and use the materials.
[0864] Step 4:
[0865] The robot retrieves materials from a dedicated database and visually explains them to factory staff. The input is presentation materials stored on the robot, which are displayed through smart glasses or a head-mounted display. The robot analyzes the content of the materials and displays slides at the appropriate time. The output is that staff can visually review the materials.
[0866] Step 5:
[0867] The user (factory staff) wears smart glasses or a head-mounted display and checks the presentation materials displayed by the robot. The input is the materials displayed by the robot, which the user visually checks. The user can proceed with their work while checking the materials. The output is that the user will be able to understand the introduction of new product lines and manufacturing processes, allowing them to work more efficiently.
[0868] In this way, presentation materials can be created and shared efficiently, and information can be communicated visually within the factory, making it possible to communicate information more effectively.
[0869] Example 2
[0870] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0871] Creating presentation materials in the past required a lot of manual work, which required time and effort, making it difficult to efficiently create high-quality materials. Furthermore, there was a lack of technology to effectively utilize internal materials and automatically generate new presentation materials. Furthermore, maintaining the quality and consistency of the generated materials was also difficult.
[0872] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0873] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for generating prompt sentences based on the materials in the database, means for sending the prompt sentences to a generative AI model, means for automatically creating presentation materials using the generative AI model, and means for providing the automatically created presentation materials, thereby enabling the efficient automatic generation of high-quality presentation materials.
[0874] A "specific organization" refers to a group with a specific purpose, such as a company, association, or government agency.
[0875] "Externally deployable materials" refers to documents and data created for the purpose of being made available to parties outside the organization or the general public.
[0876] "Purpose-built database" refers to a database system designed for a specific use or purpose.
[0877] A "prompt sentence" refers to a text-based input sentence used to give instructions or ask questions to a generative AI model.
[0878] "Generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to generate text or data.
[0879] "Presentation materials" refers to slides and documents used to visually convey information.
[0880] "Automated creation" refers to the process of generating materials or data using systems or algorithms without human intervention.
[0881] "Means for providing" refers to a method or system for displaying, distributing, or making the generated materials or data accessible to users.
[0882] The present invention provides a system for automatically and efficiently creating high-quality presentation materials based on externally deployable materials that exist within a specific organization. A specific embodiment of this system is described below.
[0883] Hardware and software used
[0884] Hardware: Servers, devices (PCs, tablets, smartphones, etc.)
[0885] Software: Database management systems (e.g., MySQL, PostgreSQL), generative AI models (e.g., OpenAI GPT-4), presentation software (e.g., Microsoft PowerPoint, Google Slides)
[0886] System configuration
[0887] Subject: Server
[0888] The server stores externally deployable materials that exist within a specific organization in a dedicated database. The server generates prompt text based on the materials in the database and sends it to a generative AI model. The generative AI model automatically creates presentation materials based on the prompt text, and the server sends the generated presentation materials to the device.
[0889] Subject: Terminal
[0890] The device accesses a database specified by the user and sends prompts to the generative AI model to automatically create presentation materials.The device displays the generated presentation materials to the user and provides an interface for editing and modifying them as needed.
[0891] Subject: User
[0892] The user can use the terminal to select materials from the database and start the automatic creation of presentation materials. The user can then review the generated presentation materials and make corrections or additions as necessary.
[0893] Specific examples
[0894] Example 1
[0895] Suppose a user wants to create a new presentation based on a company's annual report. The user uses a terminal to access a database and select a past annual report. The terminal generates a prompt based on the content, structure, and design of the selected document and sends it to the generative AI model. The server uses the generative AI model to create a new presentation and sends it to the terminal. The user reviews the generated presentation and makes any necessary corrections.
[0896] Prompt Sentence Examples
[0897] "Create a new presentation based on your company's annual reports for the past five years. Include key achievements, financial data, and future plans for each year."
[0898] In this way, users can efficiently create high-quality presentation materials. This system significantly reduces the amount of manual work required to create materials, and enables effective use of materials within an organization.
[0899] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0900] Step 1:
[0901] A user accesses the database
[0902] A user logs in to the system using a terminal and accesses the database, and searches for materials in the database to select materials that will be used as the basis for presentation materials.
[0903] Input: User login information, search query
[0904] Output: ID of the selected item
[0905] Specific behavior:
[0906] The user opens a browser on the terminal and accesses the system's login page.
[0907] The user logs in by entering a username and password.
[0908] Users use the database search function to search for the materials they need.
[0909] Step 2:
[0910] The terminal retrieves the information from the database.
[0911] The terminal retrieves the materials selected by the user from the database, and the retrieved materials are used to generate the presentation materials.
[0912] Input: ID of selected material
[0913] Output: Contents of the retrieved material
[0914] Specific behavior:
[0915] The terminal queries the database for the ID of the material selected by the user.
[0916] The database returns the relevant materials to the terminal.
[0917] The terminal temporarily stores the acquired materials.
[0918] Step 3:
[0919] The terminal generates a prompt
[0920] The device generates a prompt based on the content of the acquired material, and sends this prompt to the generative AI model.
[0921] Input: Contents of the acquired material
[0922] Output: Generated prompt statement
[0923] Specific behavior:
[0924] The terminal analyzes the content of the acquired materials.
[0925] The terminal generates a prompt sentence based on the analysis result.
[0926] The generated prompt sentence is then ready to be sent to the generative AI model.
[0927] Step 4:
[0928] The device sends the prompt to the generative AI model
[0929] The device sends the generated prompt to the generative AI model, which then generates presentation materials based on the prompt.
[0930] Input: Generated prompt text
[0931] Output: Request to the generative AI model
[0932] Specific behavior:
[0933] The device sends the generated prompt sentence to the API of the generation AI model.
[0934] The generative AI model receives the prompt sentence and begins processing.
[0935] Step 5:
[0936] The server generates presentation materials using the generative AI model
[0937] The server generates presentation materials using a generative AI model, which creates new presentation materials based on the prompt sentence.
[0938] Input: A request to the generative AI model
[0939] Output: The generated presentation
[0940] Specific behavior:
[0941] The server receives the response from the generative AI model.
[0942] The generative AI model generates presentation materials based on prompt text.
[0943] The server temporarily stores the generated presentation materials.
[0944] Step 6:
[0945] The server sends the generated presentation materials to the terminal.
[0946] The server transmits the generated presentation materials to the terminal, which displays the materials to the user.
[0947] Input: Generated presentation materials
[0948] Output: Sending data to the terminal
[0949] Specific behavior:
[0950] The server transmits the generated presentation materials to the terminal.
[0951] The terminal displays the received presentation materials to the user.
[0952] Step 7:
[0953] The user reviews the generated presentation and makes any necessary corrections.
[0954] The user checks the generated presentation materials and makes corrections or additions as necessary, completing the final presentation materials.
[0955] Input: Generated presentation materials
[0956] Output: Revised presentation
[0957] Specific behavior:
[0958] The user checks the presentation materials displayed on the terminal.
[0959] The user uses editing tools to modify the material as needed.
[0960] The user saves the presentation material after completing the edits.
[0961] (Application example 2)
[0962] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0963] Conventional presentation material creation systems can automatically create presentation materials based on database data, but they do not support the automatic generation of presentation materials based on production data or quality control data within a factory. This makes it difficult to quickly and efficiently create production reports and quality improvement proposals required by factory managers and executives. Furthermore, there is a lack of means to provide these materials as a paid service.
[0964] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0965] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for automatically generating presentation materials based on production data and quality control data within a factory, and means for providing the automatically generated presentation materials to managers and executives. This enables the rapid and efficient automatic generation of presentation materials based on the factory's production data and quality control data, thereby providing appropriate information to managers and executives. It is also possible to provide these materials as a paid service.
[0966] A "specific organization" is an organization that operates with a specific purpose, such as a company or factory.
[0967] "Externally deployable materials" are documents or files containing information or data that can be provided or made public outside the organization.
[0968] A "special-purpose database" is a data collection system designed specifically for a particular purpose or use.
[0969] "Presentation materials" are slides and documents used to convey information visually.
[0970] "Automated creation means" refers to methods or devices that use AI technology or algorithms to generate materials without manual intervention.
[0971] "Providing means" refers to a method or device for distributing or making accessible the generated materials to users.
[0972] "Production data" refers to data that includes information such as production volume, operating hours, and efficiency at factories and manufacturing sites.
[0973] "Quality control data" means data that contains information for assessing and controlling the quality of a product or process.
[0974] A "manager" is a person in a position that manages or supervises operations within an organization.
[0975] "Management" refers to the people or groups in positions that make decisions regarding the management of an organization.
[0976] A "paid service" is a service provided on the premise that payment is received.
[0977] The following system configuration will be described as an embodiment of the present invention.
[0978] First, the server stores externally deployable data within a specific organization in a dedicated database. This database also includes production data and quality control data within factories. This data is managed using a relational database management system (RDBMS) such as an SQL database.
[0979] Next, the server automatically creates presentation materials based on the materials in the database. This automatic creation is achieved using a generative AI model. The generative AI model learns the content, structure, and design of the materials in the database and generates new presentation materials. Specifically, a natural language processing (NLP) model is implemented using the Python transformers library.
[0980] The generated presentation materials are saved as PowerPoint files using the Python python-pptx library, allowing users to easily view and edit the generated presentation materials.
[0981] The server then provides the automatically generated presentation materials to managers and executives. This can be done via email or cloud storage services. For example, the generated presentation materials can be uploaded to cloud storage and a link sent to the managers and executives.
[0982] As a concrete example, suppose you want to automatically generate monthly production reports for a factory, and the following data is stored in the database:
[0983] month, production, defects
[0984] January, 1000, 10
[0985] February, 1100, 15
[0986] March, 1050, 12
[0987] Based on this data, a generative AI model would generate a presentation like this:
[0988] Title Slide: "Monthly Production Report"
[0989] Data slide: Monthly production and defect counts displayed in a table format
[0990] An example of a prompt to be input to the generative AI model is as follows:
[0991] Create a presentation based on the monthly production data retrieved from the database. Title it "Monthly Production Report" and display the production volume and defect count for each month in a table.
[0992] In this way, the server can quickly and efficiently automatically generate presentation materials based on factory production data and quality control data, providing appropriate information to managers and executives. It is also possible to provide these materials as a paid service.
[0993] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0994] Step 1:
[0995] The server stores externally deployable data within a specific organization in a dedicated database. Data and data from within the organization are provided as input. The server saves these data in a relational database management system (RDBMS), such as an SQL database. The data stored in the database is obtained as output.
[0996] Step 2:
[0997] The server automatically creates presentation materials based on materials in the database. Materials retrieved from the database are provided as input. The server uses a generative AI model to learn the content, structure, and design of the materials and generate new presentation materials. Specifically, it implements a natural language processing (NLP) model using the Python transformers library to summarize and structure the materials. The generated presentation materials are obtained as output.
[0998] Step 3:
[0999] The server saves the generated presentation as a PowerPoint file. The presentation created by the generative AI model is provided as input. The server uses the Python python-pptx library to create slides and add data in a table format. The output is a PowerPoint presentation file.
[1000] Step 4:
[1001] The server provides the generated presentation materials to managers and executives. The generated presentation file is provided as input. The server distributes the presentation materials using email or a cloud storage service. Specifically, the server uploads the generated presentation materials to cloud storage and sends a link to the managers and executives. The output is that the managers and executives can access the presentation materials.
[1002] Step 5:
[1003] The user views and edits the provided presentation materials. The input is a presentation file provided by the server. The user uses presentation software such as PowerPoint to view the materials and make edits as necessary. The output is the final presentation material.
[1004] Example 3
[1005] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1006] Conventional presentation creation systems have difficulty automatically creating high-quality presentation materials based on documents from within a specific organization in a short amount of time. Furthermore, there is a lack of a means to efficiently provide materials that correspond to specific themes desired by users. Furthermore, ensuring the convenience and quality of these materials when providing them as a paid service has also been an issue.
[1007] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1008] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for analyzing prompts based on the materials in the database and extracting and processing related data, and means for automatically creating presentation materials using a generative AI model. This makes it possible to automatically create and efficiently provide high-quality presentation materials that correspond to specific themes desired by users in a short amount of time.
[1009] A "specific organization" refers to a group that operates with a specific purpose, such as a company, association, or institution.
[1010] "Externally deployable materials" refers to documents and digital content that contain information or data that is created within a particular organization and can be made available to external users or other organizations.
[1011] A "specialized database" refers to a database system designed specifically for a specific purpose or use, to efficiently store, manage, and search materials within a particular organization.
[1012] A "prompt sentence" refers to a sentence that specifically indicates an instruction or request that a user inputs to a system.
[1013] "Parsing" refers to the process of understanding the input prompt sentence and extracting the necessary information based on its content.
[1014] "Relevant data" refers to information in a database that is searched based on the prompt sentence and is data necessary for creating presentation materials.
[1015] "Extraction" refers to the process of extracting necessary information from a database.
[1016] "Processing" refers to the process of converting the extracted data into a format suitable for presentation materials.
[1017] A "generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to analyze data and generate output for a specific purpose.
[1018] "Automatic creation" refers to the process of the system autonomously generating presentation materials with minimal human intervention.
[1019] "Presentation materials" refer to slides or documents that visually communicate a particular theme or content.
[1020] This invention is a system that stores externally deployable materials that exist within a specific organization in a dedicated database, analyzes prompts from users to extract and process relevant data, and automatically creates presentation materials using a generative AI model.
[1021] System configuration
[1022] The system consists of the following main components:
[1023] 1. Dedicated database: A database for storing externally deployable materials within a specific organization.
[1024] 2. Prompt parsing engine: A software module for receiving and parsing prompts from the user.
[1025] 3. Data extraction and processing module: A software module for extracting relevant data from the database and processing it into a format suitable for presentation materials.
[1026] 4. Generative AI model: An algorithm for automatically creating presentation materials using a generative AI model (e.g., OpenAI's GPT-4).
[1027] 5. User interface: An interface through which the user can input prompt statements and receive the generated presentation materials.
[1028] Hardware and Software Use
[1029] The server manages a dedicated database and is equipped with the hardware and software to run the prompt analysis engine, data extraction and processing module, and generative AI model. Specifically, the following hardware and software are used:
[1030] Hardware: High-performance server (including CPU, memory, and storage)
[1031] Software: Database management systems (DBMS), natural language processing engines, data analysis tools, generative AI models (e.g., GPT-4)
[1032] Program processing
[1033] The user accesses the system's user interface through a web browser and inputs a prompt. For example, they might input, "Please create a presentation on the market analysis of a new product." The server receives the prompt and analyzes it using a prompt analysis engine. Based on the analysis results, it searches for relevant materials in the database and extracts and processes the necessary data using a data extraction and processing module. Next, it uses a generative AI model to automatically create presentation materials based on the extracted and processed data. Finally, it provides the generated presentation materials to the user.
[1034] Specific examples
[1035] If the user enters the prompt "Please create a presentation about the market analysis of a new product", the server will do the following:
[1036] 1. Analyze the prompt sentence and extract keywords related to "market analysis."
[1037] 2. Search for materials related to "market analysis" in the database.
[1038] 3. Extract sales data and market share graphs from search results.
[1039] 4. Create graphs and tables based on the extracted data.
[1040] 5. Automatically create presentation materials using generative AI models.
[1041] 6. Provide the generated presentation materials to the user.
[1042] In this way, the user can obtain high-quality presentation materials in a short time. The flow of the specification process in the third embodiment will be described with reference to FIG.
[1043] Step 1:
[1044] A user accesses the system's user interface through a web browser and inputs a prompt, for example, "Please create a presentation about the market analysis of a new product." The input prompt is then sent to the server.
[1045] Step 2:
[1046] The server receives the prompt sent by the user. The received prompt is passed to the prompt analysis engine for analysis. The analysis engine understands the content of the prompt and extracts keywords and themes. For example, keywords such as "new product" and "market analysis" are extracted. The analysis results are passed to the next processing step.
[1047] Step 3:
[1048] The server searches a dedicated database based on the analysis results. Using a database search module, it searches for materials related to the extracted keywords or themes. For example, materials related to "market analysis" are searched for. The search results are passed to the next processing step.
[1049] Step 4:
[1050] The server extracts relevant data from the search results. Using a data extraction module, it selects the data needed for presentation materials. For example, sales data or market share graphs are extracted. The extracted data is then passed on to the next processing step.
[1051] Step 5:
[1052] The server processes the extracted data. Using a data processing module, it converts the data into a format suitable for presentation materials. For example, it converts the extracted sales data into a graph and arranges it in a table format. The processed data is then passed on to the next processing step.
[1053] Step 6:
[1054] The server automatically creates presentation materials using a generative AI model. The processed data is input into a generative AI model (e.g., GPT-4) to generate the presentation materials. The generative AI model also automatically adjusts the layout and design of the slides. For example, it places a graph showing sales data on the slide and adds an appropriate title and description. The generated presentation materials are then passed on to the next processing step.
[1055] Step 7:
[1056] The server provides the generated presentation materials to the user, who can then download and use the materials. For example, a download link is displayed and the user clicks it to obtain the materials.
[1057] (Application example 3)
[1058] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1059] Conventional presentation creation systems are limited to use within specific companies, making them difficult for general users to use. Creating presentation materials also requires time and effort, making it difficult to provide information quickly and effectively to customers, especially in brick-and-mortar stores. Furthermore, there was a lack of a way to generate and visually display presentation materials using voice commands, resulting in low user convenience.
[1060] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1061] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for recognizing voice commands and generating presentation materials using a generative AI model, and means for visually displaying the generated presentation materials. This makes it possible to quickly create high-quality presentation materials that are accessible to general users and to provide information to customers in physical stores quickly and effectively.
[1062] A "specific enterprise" refers to a corporation or organization with a specific business or purpose.
[1063] "Presentation materials that can be distributed externally" refers to presentation materials in a format that can be provided not only to internal parties of a company but also to external stakeholders and general users.
[1064] A "special-purpose database" refers to a database system designed specifically for a particular purpose or use.
[1065] "Means for automatic creation" refers to a function in which the system automatically generates presentation materials without requiring manual operation by the user.
[1066] "Means for providing" refers to a function for distributing or displaying the generated presentation materials to users.
[1067] "Voice command" refers to a voice input by a user to give instructions to a system using voice.
[1068] A "generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate new information or materials from data.
[1069] "Means for visually displaying" refers to the function of displaying the generated presentation materials through a visual output device such as a display or projector.
[1070] The following system configuration will be described as an embodiment of the present invention.
[1071] System Configuration
[1072] This system includes a server that stores presentation materials that exist within a specific company and can be used externally in a dedicated database, a server that automatically creates presentation materials based on the materials in the database, a server that provides the automatically created presentation materials, a terminal that recognizes voice commands and generates presentation materials using a generative AI model, and a terminal that visually displays the created presentation materials.
[1073] Hardware and software used
[1074] Hardware: smart glasses, microphone, camera, server
[1075] Software: OpenAI API, OpenCV, SpeechRecognition
[1076] Processing flow
[1077] 1. Database storage: The server stores presentation materials available for external use within a specific company in a dedicated database, allowing for centralized management of all necessary materials.
[1078] 2. Automatic creation of presentation materials: The server automatically creates presentation materials based on the materials in the database. It uses a generative AI model to quickly generate high-quality presentation materials that meet the user's requirements.
[1079] 3. Voice command recognition: The device (smart glasses) uses its built-in microphone to recognize voice commands and converts them into text using the SpeechRecognition library.
[1080] 4. Generate presentation materials: The device uses a generative AI model based on voice commands to generate presentation materials. It uses the OpenAI API to create materials based on the user's requests.
[1081] 5. Visual display: The generated presentation materials are visually displayed on the device display (smart glasses). OpenCV is used to display the materials in an appropriate format.
[1082] Specific examples
[1083] For example, if a store staff member wears smart glasses and issues a voice command such as "Show me a presentation of our new product," the device will recognize this voice command and use the generative AI model to generate a presentation explaining the features and benefits of the new product. The generated presentation will then be displayed on the smart glasses' display, allowing the staff member to provide information visually to customers.
[1084] Prompt Sentence Examples
[1085] Create a presentation for your new product to customers, detailing its features, benefits, price, and usage.
[1086] In this way, high-quality presentation materials that can be used by general users can be created in a short time, and information can be provided to customers in physical stores quickly and effectively.
[1087] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1088] Step 1:
[1089] The server stores presentation materials that exist within a specific company and can be used externally in a dedicated database. Presentation materials within the company are provided as input and saved in the database. The database also stores metadata about the materials (title, creation date, creator, etc.). The output is the materials stored in the database.
[1090] Step 2:
[1091] The server automatically creates presentation materials based on materials in the database. As input, it receives a user request (e.g., a specific theme or topic). It uses a generative AI model to search for related materials in the database and generate new presentation materials based on these. As output, it obtains the generated presentation materials.
[1092] Step 3:
[1093] The device recognizes voice commands using the built-in microphone. As input, the user's voice command is provided. The SpeechRecognition library is used to convert the speech to text. As output, the voice command in text format is obtained.
[1094] Step 4:
[1095] The device uses a generative AI model to generate presentation materials based on voice commands. The input is a text-based voice command. The device uses the OpenAI API to create materials based on the user's requests. The output is the generated presentation materials.
[1096] Step 5:
[1097] The terminal visually displays the generated presentation materials. As input, the generated presentation materials are provided. OpenCV is used to display the materials in an appropriate format on the display. As output, a visually displayed presentation material is obtained.
[1098] In this way, a user can use voice commands to generate and visually display presentation materials.
[1099] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1100] "Example 1"
[1101] In one embodiment of the present invention, a means is provided for storing presentation materials that exist within a specific company and can be used externally in a dedicated database. Employees can freely access this database and add new presentation materials. For example, when a presentation material summarizing the results of a new project is created, the material is added to the database.
[1102] "Example 2"
[1103] It also provides a means to automatically create presentation materials based on materials in the database. This automatic creation is performed using AI technology, which learns the content, structure, design, etc. of the materials in the database. New presentation materials are generated based on the results of that learning. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on those.
[1104] "Example 3"
[1105] Furthermore, a means is provided for using an emotion engine that recognizes a user's emotions during the process of creating automatically generated presentation materials. This emotion engine recognizes emotions from the user's tone of voice, facial expressions, choice of words, etc. For example, if the user is feeling stressed while creating the presentation materials, the emotion engine will recognize that stress and assist the user in creating the presentation materials accordingly.
[1106] "Example 4"
[1107] Also provided is a means for adjusting the colors, fonts, layout, etc. of the presentation materials based on the user's emotions recognized by the emotion engine. For example, if the user is feeling happy, the emotion engine will recognize that happiness and adjust the colors of the presentation materials to be brighter, the fonts to be larger, and the layout to be more spacious accordingly.
[1108] The processing flow of each embodiment will be described below.
[1109] "Example 1"
[1110] Step 1: Presentation materials available for external use within a specific company are stored in a dedicated database.
[1111] Step 2: An employee accesses the database and adds new presentation materials.
[1112] "Example 2"
[1113] Step 1: Automatically create presentation materials based on the materials in the database.
[1114] Step 2: Use AI technology to learn the content, structure, design, etc. of the materials in the database.
[1115] Step 3: Generate new presentation materials based on the learning results.
[1116] "Example 3"
[1117] Step 1: An emotion engine is used to recognize the user's emotions during the process of creating automatically generated presentation materials.
[1118] That is, the server may utilize an emotion engine that recognizes the user's emotions.
[1119] Step 2: The emotion engine recognizes emotions from the user's tone of voice, facial expressions, and language.
[1120] Step 3: If the user is feeling stressed about creating the presentation, the emotion engine will recognize that stress and help the user create the presentation accordingly.
[1121] "Example 4"
[1122] Step 1: Adjust the colors, fonts, layout, etc. of the presentation materials based on the user's emotions recognized by the emotion engine.
[1123] Step 2: If the user is feeling joy, the emotion engine will recognize that joy and adjust the presentation materials accordingly: brighter colors, larger fonts, and a more spacious layout.
[1124] Example 1
[1125] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1126] Conventional presentation material management systems make it difficult to efficiently share information due to the complicated process of storing, searching, and sharing materials. Furthermore, they lacked the functionality to automatically create materials, making manual creation time and effort intensive. Furthermore, there was a need for a method to efficiently manage materials that could be distributed externally and quickly provide them when needed.
[1127] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1128] In this invention, the server includes a means for storing externally deployable materials existing within a specific organization in a dedicated database, a means for accessing the database to add materials, and a means for searching and acquiring materials from the database, thereby enabling efficient management of materials and rapid search and acquisition.
[1129] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[1130] "Externally deployable materials" refers to documents and data containing information that can be provided to parties or customers outside the organization.
[1131] A "dedicated database" is a data repository designed for a specific purpose and used within a particular organization.
[1132] "Storage means" refers to a method or device for storing data or material.
[1133] "Means for accessing and adding materials" refers to a method or device that allows a user to connect to the database and register new materials.
[1134] "Means for searching and retrieving materials" refers to methods and devices for locating materials in a database and retrieving the required information.
[1135] "Means for automatically creating materials" refers to methods or devices for automatically generating new materials based on existing data or information.
[1136] The term "means for providing" refers to a method or device for distributing or making the generated materials available for viewing by users or other interested parties.
[1137] This invention is a system for efficiently managing externally available materials that exist within a specific organization and providing them promptly when needed. This system operates in cooperation with three parties: a server, a terminal, and a user.
[1138] The server hosts a dedicated database and uses MySQL as its database management system (DBMS). The server provides various APIs for storing, searching, and retrieving materials. The server receives materials sent by users and stores them in the database. It also stores the material's metadata (title, author, creation date, etc.).
[1139] The terminal provides an interface for users to upload presentation materials. The terminal connects to the server using a web browser and displays a form for uploading materials. The user enters the required information in this form, selects the material file, and clicks the upload button.
[1140] A user creates a new presentation document and accesses the server through a terminal. The user enters the necessary information in a form to upload the document and selects the document file. The server receives the document sent by the user and stores it in a database. The user can search and download documents stored in the database. The server filters the documents based on the search query and returns the results to the user.
[1141] For example, suppose a user has created a presentation document summarizing the results of a new project. The user opens a web browser on their device and accesses the dedicated database upload form. They enter information such as the document title, author's name, and creation date in the form, select the document file, and click the upload button. The server receives the document and stores it in the MySQL database.
[1142] If other users want to use these materials, they can access the database using the same web browser on their device and use the search function to find the materials. For example, if they search for the keywords "results of new projects," the relevant materials will be displayed and available for download.
[1143] An example of a prompt to be input to a generative AI model is, "Please tell me how to add a presentation document summarizing the results of a new project to the database." When this prompt is input to the generative AI model, the AI will generate an answer based on the steps above that explains how to upload and search for the document.
[1144] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1145] Step 1:
[1146] A user creates a presentation.
[1147] A user uses presentation software to create a document summarizing the results of a new project. The input is a presentation file created by the user, and the output is the finished presentation.
[1148] Step 2:
[1149] A user accesses a server using a terminal.
[1150] The user opens a web browser on the terminal and accesses the URL of the dedicated database. The input is the URL entered by the user, and the output is the display of the database upload form.
[1151] Step 3:
[1152] A user uploads a presentation.
[1153] The user enters information such as the document title, author name, and creation date into the upload form on the web browser, clicks the file selection button to select the document file, and then clicks the upload button.The input is the document metadata entered by the user and the selected document file, and the output is an upload request sent to the server.
[1154] Step 4:
[1155] The server receives the uploaded material.
[1156] The server receives an upload request sent by a user and retrieves the material file and metadata. The input is the upload request sent by the user, and the output is the retrieved material file and metadata.
[1157] Step 5:
[1158] The server stores the materials in a database.
[1159] The server stores the acquired material files in a MySQL database along with the material metadata. The input is the acquired material files and metadata, and the output is the material and metadata stored in the database.
[1160] Step 6:
[1161] A user searches for a document in a database.
[1162] A user enters keywords into a search form on a web browser and clicks the search button. The input is the search keyword entered by the user, and the output is a search request sent to the server.
[1163] Step 7:
[1164] The server filters the materials based on the search query.
[1165] The server searches the database based on the search query and lists the relevant materials. The input is the search request sent by the user, and the output is a list of materials as search results.
[1166] Step 8:
[1167] A user downloads a document from a search result.
[1168] The user selects the desired material from the displayed search results and clicks the download button. The input is the material selected by the user, and the output is the downloaded material file.
[1169] (Application example 1)
[1170] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1171] With conventional presentation material management systems, it was difficult to efficiently manage materials created within a specific company that could be used externally, and for store staff to access, share, and add them in real time. Furthermore, there was no automated creation of presentation materials or provision of paid services, so improving operational efficiency and the quality of customer service were issues.
[1172] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1173] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, and means for allowing store staff to upload, view, share, and add presentation materials using their smartphones, thereby enabling store staff to manage presentation materials in real time and use them in customer interactions.
[1174] A "specific enterprise" is a legal entity or organization organized to provide a specific business or service.
[1175] "Externally applicable presentation materials" are information materials created in a format that can be provided to stakeholders and customers outside the company.
[1176] A "special-purpose database" is a data collection system designed specifically for a particular purpose or use.
[1177] "Means for automatically creating presentation materials" refers to technology that uses programs and algorithms to automatically generate presentation materials based on information in a database.
[1178] The "means for providing presentation materials" refers to a technique for distributing the generated presentation materials to users in a viewable format.
[1179] "Store staff" are employees who perform work in a physical store.
[1180] A "smartphone" is a highly functional mobile phone that can connect to the Internet and install applications.
[1181] "Uploading" is the act of transferring data from a local device to a server or cloud.
[1182] "Viewing" is the act of checking digital data or information on a screen.
[1183] "Sharing" is the act of making specific data or information available to multiple users simultaneously.
[1184] "Addition" is the act of adding new data or information to an existing database or system.
[1185] The system for implementing this invention stores presentation materials that exist within a specific company and can be used externally in a dedicated database, and provides the ability for store staff to upload, view, share, and add presentation materials using their smartphones.
[1186] Hardware and software used
[1187] Hardware: Smartphones, servers (cloud or on-premise)
[1188] Software: Flask (a Python microweb framework), werkzeug (a dependency of Flask)
[1189] Data processing and calculation
[1190] 1. File upload:
[1191] Provides the ability to upload presentation materials from a smartphone.
[1192] Use Flask to receive HTTP POST requests and save files to the server.
[1193] The server stores the uploaded files in a dedicated database.
[1194] 2. File list display:
[1195] Provides the ability to get a list of uploaded files.
[1196] Use Flask to handle HTTP GET requests and return the filename from the database.
[1197] Specific examples
[1198] For example, a staff member at a physical store can take a photo of a new product's explanatory materials with their smartphone and upload the image file through the app. The uploaded materials can then be viewed by other staff members through the same app. This allows all staff members to share the latest information in real time, which can be useful when dealing with customers.
[1199] Prompt Sentence Examples
[1200] Please upload explanatory materials for your new product. Uploaded materials will be available for other staff to view.
[1201] In this way, store staff can share information in real time and use it to better serve customers.
[1202] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1203] Step 1:
[1204] A user uploads presentation materials using a smartphone.
[1205] Input: Presentation file on smartphone.
[1206] Specific behavior: The user opens the app, taps the upload button to display the file selection screen, selects a file, and taps the upload button again.
[1207] Output: The selected files are sent to the server as an HTTP POST request.
[1208] Step 2:
[1209] The server stores the received files in a dedicated database.
[1210] Input: HTTP POST request and file data sent by the user.
[1211] What it does: The server uses Flask to receive the request and saves the file in a temporary directory. It uses the secure_filename function to secure the filename.
[1212] Output: The file is saved to the specified directory on the server and the file name is added to the database.
[1213] Step 3:
[1214] Get a list of files uploaded by a user using their smartphone.
[1215] Input: HTTP GET request.
[1216] Specific behavior: The user taps the "File List" button in the app, which sends an HTTP GET request to the server.
[1217] Output: The server retrieves a list of filenames from the database and returns them to the user in JSON format.
[1218] Step 4:
[1219] A user views a file using a smartphone.
[1220] Input: A list of filenames returned by the server.
[1221] Specific operation: The user checks the list of file names in the app and taps the file they want to view. The app downloads the selected file from the server and displays it on the smartphone.
[1222] Output: The selected file will be displayed on your smartphone.
[1223] Step 5:
[1224] A user shares a file using a smartphone.
[1225] Input: The file you are viewing.
[1226] What happens: The user taps the "Share" button in the app and selects a sharing method (email, messaging app, etc.) The app sends the file via the selected method.
[1227] Output: The file is sent to other users using the specified sharing method.
[1228] Step 6:
[1229] A user adds new presentation materials using a smartphone.
[1230] Input: New presentation file.
[1231] What happens: A user opens the app, taps the upload button, selects a new file, and uploads it.
[1232] Output: The new file is sent to the server and added to a dedicated database.
[1233] Example 2
[1234] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1235] Conventional presentation material creation systems require users to create materials manually, which requires a great deal of time and effort. It is also difficult to maintain consistency in the content and design of the materials, which can lead to variations in quality. Furthermore, past materials cannot be effectively utilized, making it difficult to reuse them when creating new materials. To solve these problems, a system that automatically creates presentation materials based on materials stored in a database is needed.
[1236] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for storing externally deployable materials existing within a specific organization in a dedicated database; means for automatically creating presentation materials using a generative AI model based on the materials in the database; means for providing the automatically created presentation materials; means for a user to request the creation of presentation materials by operating a terminal; means for the terminal to send a request to the server; means for the server to retrieve the materials from the database; means for the server to learn the materials using the AI model; means for the server to generate new presentation materials; means for the server to send the generated presentation materials to the terminal; means for the terminal to display the generated presentation materials to the user; and means for the user to review the generated presentation materials and modify them as necessary. This eliminates the need for users to manually create materials, enabling high-quality presentation materials to be created efficiently.
[1237] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[1238] "Externally deployable materials" refers to documents and presentation materials containing information or data that can be provided to parties outside the organization.
[1239] A "special-purpose database" refers to a database system designed specifically for a particular purpose or use.
[1240] "Generative AI models" refer to algorithms or models that use artificial intelligence technology to analyze data and generate new information or materials.
[1241] "Presentation materials" refers to slides and documents used to visually convey information.
[1242] "Automated creation" refers to the process of systems automatically generating materials with minimal human intervention.
[1243] "User" refers to an individual or member of an organization who uses the system to create presentation materials.
[1244] "Terminal" refers to a device such as a computer, smartphone, or tablet that is operated by a user.
[1245] "Server" refers to a computer system for processing, storing, and managing data.
[1246] A "request" refers to a user requesting a specific operation or process from the system.
[1247] "Obtaining materials" refers to searching for and retrieving the necessary information or data from a database.
[1248] "Studying the material" refers to the process by which an AI model analyzes data and understands its content and patterns.
[1249] "Providing" refers to making the generated presentation materials available to users.
[1250] "Check and correct as necessary" means that the user checks the generated materials and makes any necessary changes or additions.
[1251] This invention relates to a system that automatically creates presentation materials using a generative AI model based on externally deployable materials that exist within a specific organization. Specific embodiments of this system are described below.
[1252] Hardware and software used
[1253] Hardware: Servers, devices (PCs, tablets, smartphones, etc.)
[1254] Software: Database management systems (e.g., MySQL, PostgreSQL), AI models (e.g., GPT-4, BERT), presentation software (e.g., Microsoft PowerPoint, Google Slides)
[1255] System configuration
[1256] 1. Database Management System
[1257] The server stores externally deployable data within a specific organization in a dedicated database, using database management systems such as MySQL or PostgreSQL.
[1258] 2. Generative AI Models
[1259] The server automatically creates presentation materials based on the materials in the database using a generative AI model, such as GPT-4 or BERT.
[1260] 3. Presentation Software
[1261] The server sends the generated presentation materials to the terminal, which then displays them to the user. Presentation software such as Microsoft PowerPoint or Google Slides is used.
[1262] System Operation
[1263] User operations
[1264] The user operates the terminal to request the creation of a presentation material. For example, the user inputs a prompt sentence such as "Please create a presentation introducing a new product."
[1265] Device behavior
[1266] The device receives the user's input and sends the request to the server, including the theme and keywords specified by the user.
[1267] Server Operation
[1268] 1. Acquisition of materials
[1269] The server receives the request and uses a database management system to search and retrieve relevant materials, such as past product introduction presentation materials.
[1270] 2. Study the material
[1271] The server inputs the acquired materials into the AI model, which learns the material's content, structure, design, etc. The AI model then extracts commonalities and patterns among the materials.
[1272] 3. Generate materials
[1273] The server generates new presentation materials based on the learning results. The generated materials include content based on the theme specified by the user. For example, slides emphasizing the features and advantages of a new product may be created.
[1274] 4. Submission of Materials
[1275] The server sends the generated presentation materials to the terminal in a format that can be opened with presentation software (e.g., .pptx).
[1276] Terminal display
[1277] The terminal displays the presentation materials received from the server to the user, who can then view the materials on the terminal screen.
[1278] User verification and correction
[1279] The user can review the generated presentation materials and make corrections or additions as necessary, for example, by fine-tuning the content of slides or adding new slides.
[1280] Specific examples
[1281] Example 1: New product introduction presentation
[1282] A user uses a terminal to send a request to the server to create a presentation on the theme of "introducing a new product." The server studies past product introduction presentations in the database and extracts common themes and structures. As a result, a presentation containing the features, benefits, and usage of the new product is automatically generated. The user can review the generated material and make any necessary revisions.
[1283] Example 2: Annual report presentation
[1284] A user uses a terminal to send a request to the server to create a presentation on the theme of "Annual Report." The server studies past annual report presentations in the database and extracts common themes and structures. As a result, a presentation containing information such as sales, profits, and major projects is automatically generated. The user can review the generated presentation and make any necessary revisions.
[1285] Prompt Sentence Examples
[1286] "Create a presentation to introduce a new product."
[1287] "Create this year's annual report presentation based on past annual reports."
[1288] The above is a specific embodiment for carrying out the present invention.
[1289] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1290] Step 1:
[1291] The user operates the terminal to request the creation of presentation materials.
[1292] Input: The user types the prompt "Create a presentation to introduce our new product" into the terminal application.
[1293] Output: The terminal receives the user's request.
[1294] Specific actions: The user opens the terminal application, enters the specified prompt sentence, and clicks the send button.
[1295] Step 2:
[1296] The device sends a request to the server.
[1297] Input: The prompt text entered by the user.
[1298] Output: The HTTP request sent to the server.
[1299] Specific operation: The terminal receives the user's input and sends it to the server as an HTTP request, which includes the prompt text entered by the user.
[1300] Step 3:
[1301] The server retrieves the information from the database.
[1302] Input: The HTTP request received by the server.
[1303] Output: Related material retrieved from the database.
[1304] Specific operation: The server executes an SQL query to a database management system (e.g., MySQL, PostgreSQL) to search and retrieve relevant materials. For example, it executes the query "SELECT FROM presentations WHERE theme = 'New product introduction'".
[1305] Step 4:
[1306] The server uses an AI model to learn the material.
[1307] Input: Materials retrieved from the database.
[1308] Output: Commonalities and patterns in the material as a result of learning.
[1309] Specific operation: The server inputs the acquired materials into an AI model (e.g., GPT-4, BERT) to analyze the content, structure, design, etc. of the materials. The AI model then extracts commonalities and patterns from the materials.
[1310] Step 5:
[1311] The server generates new presentation materials.
[1312] Input: The training results of the AI model.
[1313] Output: The newly generated presentation.
[1314] How it works: The server generates new presentation materials based on the output of the AI model. The generated materials include content based on a theme specified by the user. For example, slides highlighting the features and benefits of a new product may be created.
[1315] Step 6:
[1316] The server transmits the generated presentation materials to the terminal.
[1317] Input: The newly generated presentation.
[1318] Output: Presentation materials sent to the device.
[1319] Specific operation: The server sends the generated presentation materials to the terminal in a format (e.g., .pptx) that can be opened in presentation software (e.g., Microsoft PowerPoint, Google Slides).
[1320] Step 7:
[1321] The terminal displays the generated presentation material to the user.
[1322] Input: Presentation materials received from the server.
[1323] Output: Presentation materials displayed on the device screen.
[1324] Specific operation: The terminal displays the presentation materials received from the server to the user, who can then view them on the terminal screen.
[1325] Step 8:
[1326] The user checks the generated presentation materials and corrects them if necessary.
[1327] Input: Presentation materials displayed on the terminal.
[1328] Output: A revised presentation.
[1329] Specific Actions: The user reviews the generated presentation materials and, if necessary, edits the slide content or adds new slides.
[1330] (Application example 2)
[1331] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1332] Conventional presentation material creation systems can automatically create presentation materials based on database data, but they do not support the automatic generation of presentation materials based on work data or production data within a factory. This makes it difficult to quickly create presentation materials for efficient factory production efficiency and work reports. Furthermore, there is a lack of a way to provide these materials as a paid service.
[1333] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1334] In this invention, the server includes means for storing externally deployable presentation materials existing within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for collecting work data and production data within a factory and automatically creating presentation materials based on the data, and means for saving the automatically created presentation materials, thereby enabling the rapid creation of presentation materials for efficiently reporting factory production efficiency and work operations.
[1335] A "specific organization" is an organization or institution with a specific purpose, such as a company or factory.
[1336] "Externally deployable presentation materials" are presentation materials created in a format that can be provided to parties outside the organization.
[1337] A "specialized database" is a database designed specifically for a particular purpose or use.
[1338] "Means for automatically creating presentation materials" refers to technology that uses AI technology and algorithms to automatically generate presentation materials based on materials in a database.
[1339] The "means for providing" refers to a method or technique for distributing or enabling users to view the generated presentation materials.
[1340] "Factory work data" refers to data related to various types of work carried out within a factory.
[1341] "Production data" refers to data related to production activities in a factory.
[1342] "Means of automatic generation" refers to technology that uses AI technology and algorithms to automatically generate materials and information based on specific data.
[1343] "Storage means" refers to methods and technologies for safely and efficiently storing generated materials and data.
[1344] A system for implementing this invention includes means for storing externally deployable presentation materials that exist within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for collecting work data and production data within a factory and automatically generating presentation materials based on the data, and means for saving the automatically created presentation materials.
[1345] The server first collects work data and production data from within the factory. This requires hardware and software to acquire data from various sensors and production management systems within the factory. Specifically, a database management system (DBMS) and data collection software are used.
[1346] The collected data is then stored in a dedicated database, which incorporates an AI model to learn the content, structure, design, etc. of the data. This AI model is, for example, a generative AI model that uses natural language processing (NLP) technology.
[1347] The server automatically creates presentation materials based on the data in the database. During this process, an AI model extracts common themes and structures from the data and generates new presentation materials. The generated presentation materials are created using Python's python-pptx library, among other tools.
[1348] The generated presentation materials are provided to users, who can view and download them through a dedicated web interface or application. The generated presentation materials are also securely stored on the server.
[1349] As a concrete example, consider the case of automatically generating presentation materials based on factory production data. Factory production data (production volume, number of defects, etc.) is retrieved from a database, and presentation materials for periodic work reports are automatically generated. In this case, the following prompt sentence is input into the generation AI model:
[1350] Example prompt sentence:
[1351] Based on the factory production data, please automatically generate presentation materials that include the following information:
[1352] Production quantity by date
[1353] Number of defects by date
[1354] Production efficiency graph
[1355] In this way, it becomes possible to quickly create presentation materials for efficiently reporting on factory production efficiency and work.
[1356] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1357] Step 1:
[1358] The server collects work data and production data from various sensors and production management systems within the factory. Specifically, it acquires data from the sensors in real time and stores it in a database management system (DBMS). The input is data from the sensors and production management system, and the output is production data stored in the database.
[1359] Step 2:
[1360] The server stores the collected data in a dedicated database, which incorporates a generative AI model to learn the content, structure, design, etc. of the data. The input is the production data collected in step 1, and the output is the training data stored in the database.
[1361] Step 3:
[1362] The server automatically creates presentation materials based on the materials in the database. The generative AI model extracts common themes and structures from the data and generates new presentation materials. The input is the training data in the database, and the output is the generated presentation materials.
[1363] Step 4:
[1364] The server creates the generated presentation using Python's python-pptx library. Specifically, it sets the slide layout and adds data as tables and graphs. The input is the content of the presentation generated by the generative AI model, and the output is the completed presentation file.
[1365] Step 5:
[1366] The server provides the generated presentation materials to users, who can view and download them through a dedicated web interface or application. The input is the completed presentation file, and the output is the presentation materials that users can access.
[1367] Step 6:
[1368] The server safely stores the generated presentation materials. Specifically, it stores and backs up the data in cloud storage or a local server. The input is the completed presentation file, and the output is the saved presentation materials.
[1369] Example 3
[1370] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1371] Conventional presentation creation systems require users to create presentation materials manually, which is time-consuming and labor-intensive. Furthermore, they are unable to adjust presentation materials to take into account the user's emotions, making it difficult to increase user satisfaction. Furthermore, there is a lack of a way to automatically create high-quality presentation materials based on internal materials for a specific organization and provide them to external parties.
[1372] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1373] In this invention, the server includes means for storing presentation materials available for external use within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for generating presentation materials by inputting prompt sentences into a generative AI model, and means for adjusting the presentation materials using an emotion engine that recognizes user emotions. This allows users to automatically create high-quality presentation materials in a short amount of time and also enables the materials to be adjusted in accordance with the user's emotions.
[1374] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[1375] "Externally deployable presentation materials" refers to presentation materials created in a format that can be provided to stakeholders outside the organization and general users.
[1376] A "special purpose database" refers to a database designed for a specific purpose and to store a specific type of data.
[1377] The term "means for automatic creation" refers to a method or device that allows a system to automatically generate presentation materials without requiring manual operation by a user.
[1378] The term "means for providing" refers to a method or device for distributing or making accessible the generated presentation materials to users.
[1379] A "generative AI model" refers to a model that uses artificial intelligence technology to generate new information and content from data.
[1380] A "prompt" is a text sentence used to input specific instructions or requests to a generative AI model.
[1381] An "emotion engine" refers to technology or equipment that analyzes and recognizes emotions from a user's tone of voice, facial expressions, and choice of words.
[1382] "Adjusting means" refers to a method or device for changing the color, font, layout, etc. of the presentation material based on the user's emotions.
[1383] The present invention is a system for automatically creating presentation materials that can be distributed externally within a specific organization and adjusting them according to the user's emotions. A specific embodiment of this system will be described below.
[1384] System configuration
[1385] This system consists of three main components: a server, a terminal, and a user. The server contains a database, a generative AI model, and an emotion engine. The terminal is a device that allows users to access and operate the system.
[1386] Hardware and software used
[1387] The server is a computer equipped with a high-performance processor and large memory capacity. The database stores presentation materials from within a specific organization that can be deployed externally. The generative AI model used is, for example, OpenAI's GPT-4. The emotion engine used is, for example, Microsoft's Azure Cognitive Services' Emotion API.
[1388] Data processing and calculation
[1389] The server receives a request from the user and inputs a prompt sentence into the generative AI model. The generative AI model generates a presentation based on the prompt sentence. The generated material is composed of slides, each containing the specified points.
[1390] The server then uses an emotion engine to recognize emotions from the user's tone of voice, facial expressions, and language. Once the emotion engine recognizes the user's emotion, the server adjusts the color, font, layout, etc. of the presentation materials based on that emotion.
[1391] Specific examples
[1392] For example, if a user requests, "I want to create a presentation about environmental protection," the server will input the following prompt into the generative AI model:
[1393] Example prompt sentence:
[1394] "Please create a presentation about environmental protection. Please include the following points: 1. The importance of environmental protection 2. Current environmental issues 3. Specific measures 4. Outlook for the future"
[1395] Based on this prompt, the generative AI model generates a presentation with the specified points for each slide. The server then uses an emotion engine to recognize the emotions the user is feeling while creating the presentation. For example, if the user is feeling stressed, the emotion engine will recognize that stress and the server will adjust the content of the presentation to be concise and easy to understand.
[1396] Finally, the server provides the adjusted presentation materials to the user, who can then download or view the completed presentation materials through their terminals.
[1397] In this way, this system can provide high-quality presentation materials that meet the needs and emotions of the user.The flow of the specification process in the third embodiment will be described with reference to FIG.
[1398] Step 1:
[1399] A user requests that a presentation be created.
[1400] Input: A user uses a terminal to request the creation of a presentation on a particular topic.
[1401] Output: The user's request is sent to the server.
[1402] Specific operation: The user enters "I would like to create a presentation about environmental protection" into the input form on the terminal and presses the send button.
[1403] Step 2:
[1404] The server receives the request and inputs a prompt to the generative AI model.
[1405] Input: The user's request.
[1406] Output: The prompt sentence to be input to the generative AI model.
[1407] Specific operation: The server analyzes the user's request and generates the prompt, "Please create a presentation about environmental protection. Please include the following points: 1. The importance of environmental protection. 2. Current environmental issues. 3. Specific measures. 4. Outlook for the future."
[1408] Step 3:
[1409] A generative AI model generates presentation materials.
[1410] Input: The prompt sentence fed into the generative AI model.
[1411] Output: The generated presentation.
[1412] How it works: A generative AI model (e.g., GPT-4) generates a presentation with the specified points for each slide based on a prompt.
[1413] Step 4:
[1414] The server uses an emotion engine to recognize the user's emotion.
[1415] Input: Data such as the user's tone of voice, facial expressions, and language.
[1416] Output: The user's emotional state.
[1417] Specific operation: The server uses an emotion engine (for example, Emotion API) to analyze the emotions that the user is feeling while creating the presentation materials.
[1418] Step 5:
[1419] The server adjusts the presentation material based on the user's emotions.
[1420] Input: The user's emotional state and the generated presentation materials.
[1421] Output: Adjusted presentation materials.
[1422] Specific behavior: If the user is feeling stressed, the server adjusts the content of the materials to be simpler and easier to understand, for example, by changing the colors to more subdued ones and making the font easier to read.
[1423] Step 6:
[1424] The server provides the final presentation to the user.
[1425] Input: Tailored presentation materials.
[1426] Output: The final presentation material provided to the user.
[1427] Specific operation: The server sends the adjusted presentation materials to the user, who can then download or view the completed presentation materials through their terminals.
[1428] (Application example 3)
[1429] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1430] Conventional presentation material creation systems create materials without considering the user's emotions, which can cause stress for the user and result in poor quality materials. It is also difficult for store staff to create high-quality materials in a short amount of time when creating materials for product explanations or promotions. This creates an issue where it is difficult to make effective presentations to customers.
[1431] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1432] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for automatically creating materials based on the materials in the database, means for providing the automatically created materials, means for using an emotion engine that recognizes the user's emotions, and means for adjusting the color, font, layout, etc. of the materials based on the user's emotions recognized by the emotion engine. This makes it possible to automatically create high-quality presentation materials that are responsive to the user's emotions.
[1433] A "specific organization" refers to a group that operates with a specific purpose, such as a company or association.
[1434] "Externally deployable materials" refers to materials that contain information or data that can be provided to stakeholders outside the organization or to general users.
[1435] A "dedicated database" refers to a data collection system designed and constructed for a specific purpose or use.
[1436] "Means for automatically creating documents" refers to software or algorithms that automatically generate documents based on input data.
[1437] The term "means for providing materials" refers to a method or system for distributing or displaying the generated materials to users.
[1438] An "emotion engine that recognizes user emotions" refers to software and hardware that analyzes and recognizes emotions from the user's facial expressions, tone of voice, choice of words, etc.
[1439] "Means for adjusting the color, font, layout, etc. of materials" refers to software or algorithms that change and optimize the visual elements of materials according to the user's emotions.
[1440] "Paid Service" refers to a service that is provided to a User in exchange for payment.
[1441] To implement this invention, it is necessary to build a system that stores externally available documents from a specific organization in a dedicated database and automatically creates documents based on the documents in the database. This system has the function of adjusting the color, font, layout, etc. of the documents using an emotion engine that recognizes the user's emotions.
[1442] Hardware and software used
[1443] Hardware: Smartphone (camera, microphone)
[1444] software:
[1445] OpenCV (image processing)
[1446] Keras (emotion recognition model)
[1447] TextBlob (Text Analysis)
[1448] python-pptx (generates presentation materials)
[1449] System configuration
[1450] 1. Database: A dedicated database will be established to store externally deployable materials that exist within a specific organization.
[1451] 2. Emotion Engine: The device is equipped with an emotion engine that uses the smartphone's camera and microphone to analyze the user's facial expressions and tone of voice in order to recognize the user's emotions.
[1452] 3. Automatic document creation module: Implement a module that automatically creates documents based on the user's emotions based on the documents in the database.
[1453] 4. Material provision module: A module is installed to provide automatically created materials to users.
[1454] Processing flow
[1455] 1. Data acquisition: Capture the user's facial image and voice using the smartphone's camera and microphone.
[1456] 2. Emotion recognition: The acquired data is preprocessed using OpenCV, and the user's emotions are predicted using the Keras emotion recognition model.
[1457] 3. Document Creation: Based on the emotion recognition results, the automatic document creation module generates documents from the documents in the database. It uses TextBlob for text analysis and generates presentation documents in python-pptx.
[1458] 4. Material adjustment: The color, font, layout, etc. of the material are adjusted based on the user's emotions recognized by the emotion engine.
[1459] 5. Providing materials: Providing adjusted materials to users.
[1460] Specific examples
[1461] For example, when a store staff member uses this system to promote a new product, the system analyzes the staff member's facial expressions and tone of voice as they speak into the smartphone camera, and if the staff member appears stressed, it automatically creates a presentation with calming colors and a compact layout.
[1462] Prompt Sentence Examples
[1463] "Create promotional materials for new products. If your staff are feeling stressed, adjust the colors to be more muted and the layout to be more compact."
[1464] In this way, it becomes possible to automatically create high-quality presentation materials that reflect the user's emotions.
[1465] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1466] Step 1:
[1467] The server stores externally deployable materials within a specific organization in a dedicated database. As input, the organization's materials are provided and stored in the database. The database contains the metadata and content of the materials. As output, the stored materials are stored in the database.
[1468] Step 2:
[1469] The device uses the smartphone's camera and microphone to acquire the user's facial image and voice. As input, the user's facial image and voice are captured in real time. As output, the acquired facial image and voice data are generated.
[1470] Step 3:
[1471] The server preprocesses the acquired face images and audio data using OpenCV. The face images and audio data are provided as input. Specifically, the face images are converted to grayscale and resized to 48x48 pixels. The audio data undergoes preprocessing such as noise removal. Preprocessed image data and audio data are generated as output.
[1472] Step 4:
[1473] The server analyzes the preprocessed data with a Keras emotion recognition model to predict the user's emotion. As input, the preprocessed image data and audio data are provided. The emotion recognition model analyzes these data and outputs an emotion label (e.g., joy, stress, etc.). As an output, the user's emotion label is generated.
[1474] Step 5:
[1475] The server uses the emotion recognition results and the automatic document creation module to generate documents from the documents in the database. The user's emotion labels and the documents in the database are provided as input. Text analysis is performed using TextBlob, and presentation documents are generated in python-pptx. The initial presentation documents are generated as output.
[1476] Step 6:
[1477] The server adjusts the color, font, layout, etc. of the presentation materials based on the user's emotion recognized by the emotion engine. The initial presentation materials and the user's emotion label are provided as input. Specifically, the color of the materials is changed and the font size and layout are adjusted according to the emotion label. The adjusted presentation materials are generated as output.
[1478] Step 7:
[1479] The server provides the adjusted materials to the user. As input, the adjusted presentation materials are provided. As output, the materials are provided in a format that the user can access. Specifically, the materials are saved in PDF or PPTX format and a download link is provided to the user.
[1480] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1481] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1482] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[1483] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1484] [Third embodiment]
[1485] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1486] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1487] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1488] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1489] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1490] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1491] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1492] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1493] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1494] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1495] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1496] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[1497] "Example 1"
[1498] In one embodiment of the present invention, presentation materials available for external use within a specific company are stored in a dedicated database. Employees can freely access this database and add new presentation materials. For example, when a presentation material summarizing the results of a new project is created, the material is added to the database.
[1499] "Example 2"
[1500] Next, presentation materials are automatically created based on the materials in the database. This automatic creation is done using AI technology, which learns the content, structure, design, etc. of the materials in the database and generates new presentation materials. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on these.
[1501] "Example 3"
[1502] Finally, we offer a paid service for automatically generated presentation materials. This service is available to employees of specific companies as well as general users. For example, if a user wants to create a presentation on a specific topic, they can use this service to quickly create high-quality presentation materials based on the materials in the database.
[1503] The processing flow of each embodiment will be described below.
[1504] "Example 1"
[1505] Step 1: All presentation materials available for external use within a specific company are stored in a dedicated database. Employees can freely access this database and add new presentation materials. For example, if a presentation document summarizing the results of a new project is created, the document is added to the database.
[1506] "Example 2"
[1507] Step 1: Automatically create presentation materials based on the materials in the database. This automatic creation is done using AI technology, which learns the content, structure, and design of the materials in the database.
[1508] Step 2: Generate new presentation materials based on the results of learning. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on these.
[1509] "Example 3"
[1510] Step 1: Automatically created presentation materials are provided as a paid service. This service can be used not only by employees of specific companies, but also by general users. Step 2: When a user wants to create presentation materials on a specific topic, they can use this service to quickly create high-quality presentation materials based on materials in the database.
[1511] Example 1
[1512] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1513] Presentation materials created within a particular company often need to be distributed externally and shared with other employees and departments. However, there is a lack of a system for efficiently managing these materials and quickly accessing them when needed. Furthermore, there is a lack of integrated functionality for automatically creating, searching, and viewing presentation materials, which reduces work efficiency. Furthermore, there is no system in place for providing these materials as a paid service.
[1514] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1515] In this invention, the server includes a means for storing presentation materials available for external use within a specific company in a dedicated database, a means for employees to freely access the database and add new presentation materials, a means for automatically creating presentation materials based on the materials in the database, a means for providing the automatically created presentation materials, and a means for searching and viewing the presentation materials. This enables efficient management and rapid access to presentation materials, thereby improving business efficiency. Furthermore, the integration of the functions for automatically creating, searching, and viewing materials improves usability and also provides a mechanism for providing these materials as a paid service.
[1516] A "specific enterprise" is a legal entity with a specific business or purpose.
[1517] "Externally applicable presentation materials" are information materials created in a format that can be provided to parties outside the company.
[1518] A "special-purpose database" is a database system designed for a specific purpose to efficiently store, manage, and retrieve specific data.
[1519] An "employee" is an individual employed by a particular company and engaged in its work.
[1520] "Access" is the act of reading or writing data to a database or system.
[1521] "Presentation materials" are slides and documents created to convey information visually.
[1522] "Automatic generation" is the process by which a system generates materials based on specific algorithms or rules without the need for manual user interaction.
[1523] "Providing" is the act of making a particular service or information available to others.
[1524] "Searching" is the act of locating information in a database based on specific criteria or keywords.
[1525] "Viewing" is the act of visually checking data or materials.
[1526] A "paid service" is a business model in which a fee is charged in exchange for providing a specific service or information.
[1527] The present invention provides a system for efficiently managing presentation materials created within a specific company that can be used externally and for quickly accessing them when needed. A specific embodiment of this system will be described below.
[1528] System configuration
[1529] 1. Hardware and Software
[1530] Server: Use MySQL as the database management system (DBMS) and build a dedicated database to store presentation materials.
[1531] Device: Use a device such as a PC or tablet to access a dedicated web application.
[1532] User: An employee employed by a particular company who uses a terminal to access the system.
[1533] System Operation
[1534] 1. User login
[1535] Users access a dedicated web application from their device and enter their authentication information (user ID and password) to log in. The device sends the entered authentication information to the server, which then collates it with a database to perform authentication.
[1536] 2. Upload your presentation materials
[1537] After logging in, the user accesses a form for uploading presentation materials. The terminal displays a form for entering the title, description, and file of the material, and the user enters the required information, selects the file, and clicks the upload button. The terminal then sends the entered information and file to the server, which stores them in a database.
[1538] 3. Search and view presentation materials
[1539] The user accesses a search screen to search for presentation materials in the database, enters search keywords, and clicks the search button. The terminal sends the entered search keywords to the server, which searches the database to generate a list of relevant presentation materials and sends it to the terminal. The user selects a specific presentation material from the search results, checks the detailed information, and clicks the view button. The terminal downloads the material file from the server and displays it to the user.
[1540] Specific examples
[1541] For example, if employee A creates a presentation document summarizing the results of a new project, employee A logs into a dedicated web application from his / her terminal, enters the document title "Results of Project X," the description "Document summarizing the detailed results of Project X," and the file name "projectX_results.pptx," and uploads it. The server stores this information in a database, making it freely accessible to other employees.
[1542] Prompt Sentence Examples
[1543] "What are the steps to add a presentation document outlining the results of a new project to the database?"
[1544] By inputting this prompt into a generative AI model, specific steps and operation methods can be explained in natural language.
[1545] The above is a concrete example of how to implement this invention. This system enables efficient management and rapid access to presentation materials, improving business efficiency. Furthermore, by integrating the functions of automatic creation, search, and viewing of materials, usability is improved, and a mechanism for providing these materials as a paid service is also established.
[1546] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1547] Step 1: User Login
[1548] Input: The user accesses a dedicated web application from their device and enters their user ID and password.
[1549] Operation: The terminal sends the entered authentication information to the server, which checks it against its database and starts the session if authentication is successful.
[1550] Output: If authentication is successful, the user is logged into the system and redirected to a dedicated dashboard.
[1551] Step 2: Upload your presentation materials
[1552] Input: After logging in, the user accesses a form to upload presentation materials and enters the title, description, and file of the materials.
[1553] Operation: The terminal sends the input information and files to the server, which stores the received information in a database.
[1554] Output: If the upload is successful, the server notifies the user that the upload was successful.
[1555] Step 3: Find your presentation materials
[1556] Input: The user accesses a search screen to search for presentation materials in the database and enters search keywords.
[1557] Operation: The terminal sends the entered search keywords to the server, which searches the database and generates a list of relevant presentation materials.
[1558] Output: The server sends the generated list to the terminal, which displays the list to the user.
[1559] Step 4: View the presentation materials
[1560] Input: The user selects a specific presentation from the search results and clicks the View button.
[1561] Operation: The terminal displays detailed information about the selected material and downloads the material file from the server.
[1562] Output: The terminal displays the downloaded file to the user.
[1563] Step 5: Automatically create presentation materials
[1564] Input: The user requests the automatic creation of a presentation based on specific criteria and templates.
[1565] How it works: The server processes the information in the database based on specified conditions and templates, and automatically generates presentation materials.
[1566] Output: The server stores the automatically created presentation materials in a database and notifies the user.
[1567] Step 6: Offering it as a paid service
[1568] Input: A user requests a presentation that is offered as a paid service.
[1569] Operation: Based on the user's request, the server processes the payment and provides the materials after the payment is confirmed.
[1570] Output: The server makes the presentation available for download to users whose payment has been confirmed.
[1571] (Application example 1)
[1572] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1573] In traditional presentation management systems, creating and sharing materials is often done manually, which is inefficient. Furthermore, when introducing new product lines or explaining manufacturing processes in factories, there are limited ways to visually share materials, which can lead to insufficient information transmission.
[1574] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1575] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for a robot used in the factory to acquire the presentation materials and visually explain them, and means for the robot to display the materials through smart glasses or a head-mounted display. This enables efficient creation and sharing of presentation materials, and by communicating information visually within the factory, information can be communicated more effectively.
[1576] "Specific enterprise" refers to a legal entity or organization that carries out a specific business or activity.
[1577] "Externally deployable presentation materials" refers to presentation documents and slides that can be provided or shared with parties outside the company.
[1578] "Purpose-built database" refers to a data collection system designed for a specific purpose or use.
[1579] "Means for automatically creating presentation materials" refers to a method or device for automatically generating presentation materials based on input data or information.
[1580] The term "means for providing" refers to a method or device for distributing or displaying the generated presentation materials to users.
[1581] "Robots used in factories" refers to automated machinery and devices operated in factories to assist with manufacturing operations and tasks.
[1582] "Visual explanation means" refers to a method or device for visually displaying information or materials and explaining them to a user.
[1583] "Smart glasses" refers to a wearable device in the form of glasses that has a display function for displaying information.
[1584] A "head-mounted display" is a display device worn on the head, used to display information within the user's field of vision.
[1585] As a form for implementing this invention, a system is constructed in which presentation materials that exist within a specific company and can be used externally are stored in a dedicated database, and robots used in factories retrieve the materials and provide visual explanations.
[1586] First, the server stores presentation materials created within a specific company that can be distributed externally in a dedicated database. The dedicated database is designed to enable efficient management and access of data. The database stores the metadata and content of presentation materials, and employees can freely access and add new materials.
[1587] The server then automatically creates presentation materials based on the materials in the database. This process uses a generative AI model, which generates presentation slides and documents based on the input data and information. This process streamlines the creation of materials and automatically generates high-quality presentation materials.
[1588] The generated presentation materials are provided to the robots used in the factory. The robots retrieve the materials from a dedicated database and visually explain them to the factory staff. The robots display the materials through smart glasses or a head-mounted display, allowing the staff to work while checking the materials.
[1589] As a concrete example, consider a presentation document for the introduction of a new product line. This document includes product specifications, manufacturing processes, quality control points, etc. The robot can retrieve this document and visually explain it to factory staff. Staff can then wear smart glasses or a head-mounted display and proceed with the introduction of the new product line while reviewing the document.
[1590] An example of a prompt is, "Please retrieve presentation materials from the database regarding the introduction of a new product line and explain them to the staff in the factory." Using this prompt, the robot can retrieve the appropriate materials and explain them visually.
[1591] In this way, presentation materials can be created and shared efficiently, and information can be communicated visually within the factory, making it possible to communicate information more effectively.
[1592] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1593] Step 1:
[1594] The server stores presentation materials created within a specific company that can be distributed externally in a dedicated database. The input is presentation materials created by employees, which are saved in the database. The database stores the materials' metadata (author, creation date, project name, etc.) and content. This allows for efficient management of the materials and makes them easily accessible later.
[1595] Step 2:
[1596] The server automatically creates presentation materials based on the materials in the database. The input is the materials stored in the database, and new presentation materials are generated using a generative AI model. The generative AI model analyzes the content of the materials and automatically creates appropriate slides and documents. The output is the newly generated presentation materials.
[1597] Step 3:
[1598] The server provides the generated presentation materials to the robots used in the factory. The server receives the generated presentation materials as input and sends them to the robot. The robot receives the materials and stores them in its internal memory, allowing the robot to retrieve and use the materials.
[1599] Step 4:
[1600] The robot retrieves materials from a dedicated database and visually explains them to factory staff. The input is presentation materials stored on the robot, which are displayed through smart glasses or a head-mounted display. The robot analyzes the content of the materials and displays slides at the appropriate time. The output is that staff can visually review the materials.
[1601] Step 5:
[1602] The user (factory staff) wears smart glasses or a head-mounted display and checks the presentation materials displayed by the robot. The input is the materials displayed by the robot, which the user visually checks. The user can proceed with their work while checking the materials. The output is that the user will be able to understand the introduction of new product lines and manufacturing processes, allowing them to work more efficiently.
[1603] In this way, presentation materials can be created and shared efficiently, and information can be communicated visually within the factory, making it possible to communicate information more effectively.
[1604] Example 2
[1605] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1606] Creating presentation materials in the past required a lot of manual work, which required time and effort, making it difficult to efficiently create high-quality materials. Furthermore, there was a lack of technology to effectively utilize internal materials and automatically generate new presentation materials. Furthermore, maintaining the quality and consistency of the generated materials was also difficult.
[1607] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1608] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for generating prompt sentences based on the materials in the database, means for sending the prompt sentences to a generative AI model, means for automatically creating presentation materials using the generative AI model, and means for providing the automatically created presentation materials, thereby enabling the efficient automatic generation of high-quality presentation materials.
[1609] A "specific organization" refers to a group with a specific purpose, such as a company, association, or government agency.
[1610] "Externally deployable materials" refers to documents and data created for the purpose of being made available to parties outside the organization or the general public.
[1611] "Purpose-built database" refers to a database system designed for a specific use or purpose.
[1612] A "prompt sentence" refers to a text-based input sentence used to give instructions or ask questions to a generative AI model.
[1613] "Generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to generate text or data.
[1614] "Presentation materials" refers to slides and documents used to visually convey information.
[1615] "Automated creation" refers to the process of generating materials or data using systems or algorithms without human intervention.
[1616] "Means for providing" refers to a method or system for displaying, distributing, or making the generated materials or data accessible to users.
[1617] The present invention provides a system for automatically and efficiently creating high-quality presentation materials based on externally deployable materials that exist within a specific organization. A specific embodiment of this system is described below.
[1618] Hardware and software used
[1619] Hardware: Servers, devices (PCs, tablets, smartphones, etc.)
[1620] Software: Database management systems (e.g., MySQL, PostgreSQL), generative AI models (e.g., OpenAI GPT-4), presentation software (e.g., Microsoft PowerPoint, Google Slides)
[1621] System configuration
[1622] Subject: Server
[1623] The server stores externally deployable materials that exist within a specific organization in a dedicated database. The server generates prompt text based on the materials in the database and sends it to a generative AI model. The generative AI model automatically creates presentation materials based on the prompt text, and the server sends the generated presentation materials to the device.
[1624] Subject: Terminal
[1625] The device accesses a database specified by the user and sends prompts to the generative AI model to automatically create presentation materials.The device displays the generated presentation materials to the user and provides an interface for editing and modifying them as needed.
[1626] Subject: User
[1627] The user can use the terminal to select materials from the database and start the automatic creation of presentation materials. The user can then review the generated presentation materials and make corrections or additions as necessary.
[1628] Specific examples
[1629] Example 1
[1630] Suppose a user wants to create a new presentation based on a company's annual report. The user uses a terminal to access a database and select a past annual report. The terminal generates a prompt based on the content, structure, and design of the selected document and sends it to the generative AI model. The server uses the generative AI model to create a new presentation and sends it to the terminal. The user reviews the generated presentation and makes any necessary corrections.
[1631] Prompt Sentence Examples
[1632] "Create a new presentation based on your company's annual reports for the past five years. Include key achievements, financial data, and future plans for each year."
[1633] In this way, users can efficiently create high-quality presentation materials. This system significantly reduces the amount of manual work required to create materials, and enables effective use of materials within an organization.
[1634] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1635] Step 1:
[1636] A user accesses the database
[1637] A user logs in to the system using a terminal and accesses the database, and searches for materials in the database to select materials that will be used as the basis for presentation materials.
[1638] Input: User login information, search query
[1639] Output: ID of the selected item
[1640] Specific behavior:
[1641] The user opens a browser on the terminal and accesses the system's login page.
[1642] The user logs in by entering a username and password.
[1643] Users use the database search function to search for the materials they need.
[1644] Step 2:
[1645] The terminal retrieves the information from the database.
[1646] The terminal retrieves the materials selected by the user from the database, and the retrieved materials are used to generate the presentation materials.
[1647] Input: ID of selected material
[1648] Output: Contents of the retrieved material
[1649] Specific behavior:
[1650] The terminal queries the database for the ID of the material selected by the user.
[1651] The database returns the relevant materials to the terminal.
[1652] The terminal temporarily stores the acquired materials.
[1653] Step 3:
[1654] The terminal generates a prompt
[1655] The device generates a prompt based on the content of the acquired material, and sends this prompt to the generative AI model.
[1656] Input: Contents of the acquired material
[1657] Output: Generated prompt statement
[1658] Specific behavior:
[1659] The terminal analyzes the content of the acquired materials.
[1660] The terminal generates a prompt sentence based on the analysis result.
[1661] The generated prompt sentence is then ready to be sent to the generative AI model.
[1662] Step 4:
[1663] The device sends the prompt to the generative AI model
[1664] The device sends the generated prompt to the generative AI model, which then generates presentation materials based on the prompt.
[1665] Input: Generated prompt text
[1666] Output: Request to the generative AI model
[1667] Specific behavior:
[1668] The device sends the generated prompt sentence to the API of the generation AI model.
[1669] The generative AI model receives the prompt sentence and begins processing.
[1670] Step 5:
[1671] The server generates presentation materials using the generative AI model
[1672] The server generates presentation materials using a generative AI model, which creates new presentation materials based on the prompt sentence.
[1673] Input: A request to the generative AI model
[1674] Output: The generated presentation
[1675] Specific behavior:
[1676] The server receives the response from the generative AI model.
[1677] The generative AI model generates presentation materials based on prompt text.
[1678] The server temporarily stores the generated presentation materials.
[1679] Step 6:
[1680] The server sends the generated presentation materials to the terminal.
[1681] The server transmits the generated presentation materials to the terminal, which displays the materials to the user.
[1682] Input: Generated presentation materials
[1683] Output: Sending data to the terminal
[1684] Specific behavior:
[1685] The server transmits the generated presentation materials to the terminal.
[1686] The terminal displays the received presentation materials to the user.
[1687] Step 7:
[1688] The user reviews the generated presentation and makes any necessary corrections.
[1689] The user checks the generated presentation materials and makes corrections or additions as necessary, completing the final presentation materials.
[1690] Input: Generated presentation materials
[1691] Output: Revised presentation
[1692] Specific behavior:
[1693] The user checks the presentation materials displayed on the terminal.
[1694] The user uses editing tools to modify the material as needed.
[1695] The user saves the presentation material after completing the edits.
[1696] (Application example 2)
[1697] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1698] Conventional presentation material creation systems can automatically create presentation materials based on database data, but they do not support the automatic generation of presentation materials based on production data or quality control data within a factory. This makes it difficult to quickly and efficiently create production reports and quality improvement proposals required by factory managers and executives. Furthermore, there is a lack of means to provide these materials as a paid service.
[1699] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1700] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for automatically generating presentation materials based on production data and quality control data within a factory, and means for providing the automatically generated presentation materials to managers and executives. This enables the rapid and efficient automatic generation of presentation materials based on the factory's production data and quality control data, thereby providing appropriate information to managers and executives. It is also possible to provide these materials as a paid service.
[1701] A "specific organization" is an organization that operates with a specific purpose, such as a company or factory.
[1702] "Externally deployable materials" are documents or files containing information or data that can be provided or made public outside the organization.
[1703] A "special-purpose database" is a data collection system designed specifically for a particular purpose or use.
[1704] "Presentation materials" are slides and documents used to convey information visually.
[1705] "Automated creation means" refers to methods or devices that use AI technology or algorithms to generate materials without manual intervention.
[1706] "Providing means" refers to a method or device for distributing or making accessible the generated materials to users.
[1707] "Production data" refers to data that includes information such as production volume, operating hours, and efficiency at factories and manufacturing sites.
[1708] "Quality control data" means data that contains information for assessing and controlling the quality of a product or process.
[1709] A "manager" is a person in a position that manages or supervises operations within an organization.
[1710] "Management" refers to the people or groups in positions that make decisions regarding the management of an organization.
[1711] A "paid service" is a service provided on the premise that payment is received.
[1712] The following system configuration will be described as an embodiment of the present invention.
[1713] First, the server stores externally deployable data within a specific organization in a dedicated database. This database also includes production data and quality control data within factories. This data is managed using a relational database management system (RDBMS) such as an SQL database.
[1714] Next, the server automatically creates presentation materials based on the materials in the database. This automatic creation is achieved using a generative AI model. The generative AI model learns the content, structure, and design of the materials in the database and generates new presentation materials. Specifically, a natural language processing (NLP) model is implemented using the Python transformers library.
[1715] The generated presentation materials are saved as PowerPoint files using the Python python-pptx library, allowing users to easily view and edit the generated presentation materials.
[1716] The server then provides the automatically generated presentation materials to managers and executives. This can be done via email or cloud storage services. For example, the generated presentation materials can be uploaded to cloud storage and a link sent to the managers and executives.
[1717] As a concrete example, suppose you want to automatically generate monthly production reports for a factory, and the following data is stored in the database:
[1718] month, production, defects
[1719] January, 1000, 10
[1720] February, 1100, 15
[1721] March, 1050, 12
[1722] Based on this data, a generative AI model would generate a presentation like this:
[1723] Title Slide: "Monthly Production Report"
[1724] Data slide: Monthly production and defect counts displayed in a table format
[1725] An example of a prompt to be input to the generative AI model is as follows:
[1726] Create a presentation based on the monthly production data retrieved from the database. Title it "Monthly Production Report" and display the production volume and defect count for each month in a table.
[1727] In this way, the server can quickly and efficiently automatically generate presentation materials based on factory production data and quality control data, providing appropriate information to managers and executives. It is also possible to provide these materials as a paid service.
[1728] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1729] Step 1:
[1730] The server stores externally deployable data within a specific organization in a dedicated database. Data and data from within the organization are provided as input. The server saves these data in a relational database management system (RDBMS), such as an SQL database. The data stored in the database is obtained as output.
[1731] Step 2:
[1732] The server automatically creates presentation materials based on materials in the database. Materials retrieved from the database are provided as input. The server uses a generative AI model to learn the content, structure, and design of the materials and generate new presentation materials. Specifically, it implements a natural language processing (NLP) model using the Python transformers library to summarize and structure the materials. The generated presentation materials are obtained as output.
[1733] Step 3:
[1734] The server saves the generated presentation as a PowerPoint file. The presentation created by the generative AI model is provided as input. The server uses the Python python-pptx library to create slides and add data in a table format. The output is a PowerPoint presentation file.
[1735] Step 4:
[1736] The server provides the generated presentation materials to managers and executives. The generated presentation file is provided as input. The server distributes the presentation materials using email or a cloud storage service. Specifically, the server uploads the generated presentation materials to cloud storage and sends a link to the managers and executives. The output is that the managers and executives can access the presentation materials.
[1737] Step 5:
[1738] The user views and edits the provided presentation materials. The input is a presentation file provided by the server. The user uses presentation software such as PowerPoint to view the materials and make edits as necessary. The output is the final presentation material.
[1739] Example 3
[1740] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1741] Conventional presentation creation systems have difficulty automatically creating high-quality presentation materials based on documents from within a specific organization in a short amount of time. Furthermore, there is a lack of a means to efficiently provide materials that correspond to specific themes desired by users. Furthermore, ensuring the convenience and quality of these materials when providing them as a paid service has also been an issue.
[1742] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1743] In this invention, the server includes means for storing externally deployable materials existing within a specific organization in a dedicated database, means for analyzing prompts based on the materials in the database and extracting and processing related data, and means for automatically creating presentation materials using a generative AI model. This makes it possible to automatically create and efficiently provide high-quality presentation materials that correspond to specific themes desired by users in a short amount of time.
[1744] A "specific organization" refers to a group that operates with a specific purpose, such as a company, association, or institution.
[1745] "Externally deployable materials" refers to documents and digital content that contain information or data that is created within a particular organization and can be made available to external users or other organizations.
[1746] A "specialized database" refers to a database system designed specifically for a specific purpose or use, to efficiently store, manage, and search materials within a particular organization.
[1747] A "prompt sentence" refers to a sentence that specifically indicates an instruction or request that a user inputs to a system.
[1748] "Parsing" refers to the process of understanding the input prompt sentence and extracting the necessary information based on its content.
[1749] "Relevant data" refers to information in a database that is searched based on the prompt sentence and is data necessary for creating presentation materials.
[1750] "Extraction" refers to the process of extracting necessary information from a database.
[1751] "Processing" refers to the process of converting the extracted data into a format suitable for presentation materials.
[1752] A "generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to analyze data and generate output for a specific purpose.
[1753] "Automatic creation" refers to the process of the system autonomously generating presentation materials with minimal human intervention.
[1754] "Presentation materials" refer to slides or documents that visually communicate a particular theme or content.
[1755] This invention is a system that stores externally deployable materials that exist within a specific organization in a dedicated database, analyzes prompts from users to extract and process relevant data, and automatically creates presentation materials using a generative AI model.
[1756] System configuration
[1757] The system consists of the following main components:
[1758] 1. Dedicated database: A database for storing externally deployable materials within a specific organization.
[1759] 2. Prompt parsing engine: A software module for receiving and parsing prompts from the user.
[1760] 3. Data extraction and processing module: A software module for extracting relevant data from the database and processing it into a format suitable for presentation materials.
[1761] 4. Generative AI model: An algorithm for automatically creating presentation materials using a generative AI model (e.g., OpenAI's GPT-4).
[1762] 5. User interface: An interface through which the user can input prompt statements and receive the generated presentation materials.
[1763] Hardware and Software Use
[1764] The server manages a dedicated database and is equipped with the hardware and software to run the prompt analysis engine, data extraction and processing module, and generative AI model. Specifically, the following hardware and software are used:
[1765] Hardware: High-performance server (including CPU, memory, and storage)
[1766] Software: Database management systems (DBMS), natural language processing engines, data analysis tools, generative AI models (e.g., GPT-4)
[1767] Program processing
[1768] The user accesses the system's user interface through a web browser and inputs a prompt. For example, they might input, "Please create a presentation on the market analysis of a new product." The server receives the prompt and analyzes it using a prompt analysis engine. Based on the analysis results, it searches for relevant materials in the database and extracts and processes the necessary data using a data extraction and processing module. Next, it uses a generative AI model to automatically create presentation materials based on the extracted and processed data. Finally, it provides the generated presentation materials to the user.
[1769] Specific examples
[1770] If the user enters the prompt "Please create a presentation about the market analysis of a new product", the server will do the following:
[1771] 1. Analyze the prompt sentence and extract keywords related to "market analysis."
[1772] 2. Search for materials related to "market analysis" in the database.
[1773] 3. Extract sales data and market share graphs from search results.
[1774] 4. Create graphs and tables based on the extracted data.
[1775] 5. Automatically create presentation materials using generative AI models.
[1776] 6. Provide the generated presentation materials to the user.
[1777] In this way, the user can obtain high-quality presentation materials in a short time. The flow of the specification process in the third embodiment will be described with reference to FIG.
[1778] Step 1:
[1779] A user accesses the system's user interface through a web browser and inputs a prompt, for example, "Please create a presentation about the market analysis of a new product." The input prompt is then sent to the server.
[1780] Step 2:
[1781] The server receives the prompt sent by the user. The received prompt is passed to the prompt analysis engine for analysis. The analysis engine understands the content of the prompt and extracts keywords and themes. For example, keywords such as "new product" and "market analysis" are extracted. The analysis results are passed to the next processing step.
[1782] Step 3:
[1783] The server searches a dedicated database based on the analysis results. Using a database search module, it searches for materials related to the extracted keywords or themes. For example, materials related to "market analysis" are searched for. The search results are passed to the next processing step.
[1784] Step 4:
[1785] The server extracts relevant data from the search results. Using a data extraction module, it selects the data needed for presentation materials. For example, sales data or market share graphs are extracted. The extracted data is then passed on to the next processing step.
[1786] Step 5:
[1787] The server processes the extracted data. Using a data processing module, it converts the data into a format suitable for presentation materials. For example, it converts the extracted sales data into a graph and arranges it in a table format. The processed data is then passed on to the next processing step.
[1788] Step 6:
[1789] The server automatically creates presentation materials using a generative AI model. The processed data is input into a generative AI model (e.g., GPT-4) to generate the presentation materials. The generative AI model also automatically adjusts the layout and design of the slides. For example, it places a graph showing sales data on the slide and adds an appropriate title and description. The generated presentation materials are then passed on to the next processing step.
[1790] Step 7:
[1791] The server provides the generated presentation materials to the user, who can then download and use the materials. For example, a download link is displayed and the user clicks it to obtain the materials.
[1792] (Application example 3)
[1793] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1794] Conventional presentation creation systems are limited to use within specific companies, making them difficult for general users to use. Creating presentation materials also requires time and effort, making it difficult to provide information quickly and effectively to customers, especially in brick-and-mortar stores. Furthermore, there was a lack of a way to generate and visually display presentation materials using voice commands, resulting in low user convenience.
[1795] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1796] In this invention, the server includes means for storing presentation materials available for external use that exist within a specific company in a dedicated database, means for automatically creating presentation materials based on the materials in the database, means for providing the automatically created presentation materials, means for recognizing voice commands and generating presentation materials using a generative AI model, and means for visually displaying the generated presentation materials. This makes it possible to quickly create high-quality presentation materials that are accessible to general users and to provide information to customers in physical stores quickly and effectively.
[1797] A "specific enterprise" refers to a corporation or organization with a specific business or purpose.
[1798] "Presentation materials that can be distributed externally" refers to presentation materials in a format that can be provided not only to internal parties of a company but also to external stakeholders and general users.
[1799] A "special-purpose database" refers to a database system designed specifically for a particular purpose or use.
[1800] "Means for automatic creation" refers to a function in which the system automatically generates presentation materials without requiring manual operation by the user.
[1801] "Means for providing" refers to a function for distributing or displaying the generated presentation materials to users.
[1802] "Voice command" refers to a voice input by a user to give instructions to a system using voice.
[1803] A "generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate new information or materials from data.
[1804] "Means for visually displaying" refers to the function of displaying the generated presentation materials through a visual output device such as a display or projector.
[1805] The following system configuration will be described as an embodiment of the present invention.
[1806] System Configuration
[1807] This system includes a server that stores presentation materials that exist within a specific company and can be used externally in a dedicated database, a server that automatically creates presentation materials based on the materials in the database, a server that provides the automatically created presentation materials, a terminal that recognizes voice commands and generates presentation materials using a generative AI model, and a terminal that visually displays the created presentation materials.
[1808] Hardware and software used
[1809] Hardware: smart glasses, microphone, camera, server
[1810] Software: OpenAI API, OpenCV, SpeechRecognition
[1811] Processing flow
[1812] 1. Database storage: The server stores presentation materials available for external use within a specific company in a dedicated database, allowing for centralized management of all necessary materials.
[1813] 2. Automatic creation of presentation materials: The server automatically creates presentation materials based on the materials in the database. It uses a generative AI model to quickly generate high-quality presentation materials that meet the user's requirements.
[1814] 3. Voice command recognition: The device (smart glasses) uses its built-in microphone to recognize voice commands and converts them into text using the SpeechRecognition library.
[1815] 4. Generate presentation materials: The device uses a generative AI model based on voice commands to generate presentation materials. It uses the OpenAI API to create materials based on the user's requests.
[1816] 5. Visual display: The generated presentation materials are visually displayed on the device display (smart glasses). OpenCV is used to display the materials in an appropriate format.
[1817] Specific examples
[1818] For example, if a store staff member wears smart glasses and issues a voice command such as "Show me a presentation of our new product," the device will recognize this voice command and use the generative AI model to generate a presentation explaining the features and benefits of the new product. The generated presentation will then be displayed on the smart glasses' display, allowing the staff member to provide information visually to customers.
[1819] Prompt Sentence Examples
[1820] Create a presentation for your new product to customers, detailing its features, benefits, price, and usage.
[1821] In this way, high-quality presentation materials that can be used by general users can be created in a short time, and information can be provided to customers in physical stores quickly and effectively.
[1822] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1823] Step 1:
[1824] The server stores presentation materials that exist within a specific company and can be used externally in a dedicated database. Presentation materials within the company are provided as input and saved in the database. The database also stores metadata about the materials (title, creation date, creator, etc.). The output is the materials stored in the database.
[1825] Step 2:
[1826] The server automatically creates presentation materials based on materials in the database. As input, it receives a user request (e.g., a specific theme or topic). It uses a generative AI model to search for related materials in the database and generate new presentation materials based on these. As output, it obtains the generated presentation materials.
[1827] Step 3:
[1828] The device recognizes voice commands using the built-in microphone. As input, the user's voice command is provided. The SpeechRecognition library is used to convert the speech to text. As output, the voice command in text format is obtained.
[1829] Step 4:
[1830] The device uses a generative AI model to generate presentation materials based on voice commands. The input is a text-based voice command. The device uses the OpenAI API to create materials based on the user's requests. The output is the generated presentation materials.
[1831] Step 5:
[1832] The terminal visually displays the generated presentation materials. As input, the generated presentation materials are provided. OpenCV is used to display the materials in an appropriate format on the display. As output, a visually displayed presentation material is obtained.
[1833] In this way, a user can use voice commands to generate and visually display presentation materials.
[1834] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1835] "Example 1"
[1836] In one embodiment of the present invention, a means is provided for storing presentation materials that exist within a specific company and can be used externally in a dedicated database. Employees can freely access this database and add new presentation materials. For example, when a presentation material summarizing the results of a new project is created, the material is added to the database.
[1837] "Example 2"
[1838] It also provides a means to automatically create presentation materials based on materials in the database. This automatic creation is performed using AI technology, which learns the content, structure, design, etc. of the materials in the database. New presentation materials are generated based on the results of that learning. For example, common themes and structures can be extracted from multiple presentation materials in the database, and new presentation materials can be created based on those.
[1839] "Example 3"
[1840] Furthermore, a means is provided for using an emotion engine that recognizes a user's emotions during the process of creating automatically generated presentation materials. This emotion engine recognizes emotions from the user's tone of voice, facial expressions, choice of words, etc. For example, if the user is feeling stressed while creating the presentation materials, the emotion engine will recognize that stress and assist the user in creating the presentation materials accordingly.
[1841] "Example 4"
[1842] Also provided is a means for adjusting the colors, fonts, layout, etc. of the presentation materials based on the user's emotions recognized by the emotion engine. For example, if the user is feeling happy, the emotion engine will recognize that happiness and adjust the colors of the presentation materials to be brighter, the fonts to be larger, and the layout to be more spacious accordingly.
[1843] The processing flow of each embodiment will be described below.
[1844] "Example 1"
[1845] Step 1: Presentation materials available for external use within a specific company are stored in a dedicated database.
[1846] Step 2: An employee accesses the database and adds new presentation materials.
[1847] "Example 2"
[1848] Step 1: Automatically create presentation materials based on the materials in the database.
[1849] Step 2: Use AI technology to learn the content, structure, design, etc. of the materials in the database.
[1850] Step 3: Generate new presentation materials based on the learning results.
[1851] "Example 3"
[1852] Step 1: An emotion engine is used to recognize the user's emotions during the process of creating automatically generated presentation materials.
[1853] Step 2: The emotion engine recognizes emotions from the user's tone of voice, facial expressions, and language.
[1854] Step 3: If the user is feeling stressed about creating the presentation, the emotion engine will recognize that stress and help the user create the presentation accordingly.
[1855] "Example 4"
[1856] Step 1: Adjust the colors, fonts, layout, etc. of the presentation materials based on the user's emotions recognized by the emotion engine.
[1857] Step 2: If the user is feeling joy, the emotion engine will recognize that joy and adjust the presentation materials accordingly: brighter colors, larger fonts, and a more spacious layout.
[1858] Example 1
[1859] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1860] Conventional presentation material management systems make it difficult to efficiently share information due to the complicated process of storing, searching, and sharing materials. Furthermore, they lacked the functionality to automatically create materials, making manual creation time and effort intensive. Furthermore, there was a need for a...
Claims
1. A means for storing externally deployable materials existing within a specific organization in a database; means for automatically creating presentation materials using the materials stored in the database; An emotion engine that recognizes the user's emotions; A means for generating presentation materials by inputting a specific prompt sentence into a generation AI model; means for adjusting the content of the presentation material in response to the emotion; A system including:
2. The system of claim 1 , further comprising means for causing a robot used in a factory to explain the presentation material that has been surveyed.
3. The system according to claim 1 , further comprising a means for playing back the surveyed presentation materials on a terminal device held by a staff member of a physical store.
Citation Information
Patent Citations
Information processing device, information processing method, and information processing program
JP2003076678A
Presentation material generation device, presentation material generation system, computer program and presentation material generation method
JP2018055270A
Search result summarizing apparatus, program, and method
JP2018173681A
Dynamic presentation systems and methods
US20150193089A1
Reaction based real time natural language content adjustment
US20230171466A1