system

Abstract

We provide the system. [Solution] A means for analyzing string and numerical information entered by the user, A means for selecting an appropriate slide layout based on the analyzed information, A means of generating presentation materials by adding analyzed information to the selected slide layout, A means to optimize the color scheme of the generated presentation, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional method for creating presentation materials, users need to spend a large amount of time and effort, and furthermore, design consistency and visual optimization are often not ensured. Also, due to the lack of a system that can effectively utilize standard templates, there is also a problem of reduced work efficiency. To solve these problems, a system that allows users to easily create high-quality presentation materials is required.

Means for Solving the Problems

[0005] This invention provides a system that includes means for analyzing string and numerical information entered by a user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, and means for optimizing the color scheme of the generated presentation. This allows users to easily create high-quality presentation materials, ensuring design consistency and visual optimization. Furthermore, by effectively utilizing standard templates, work efficiency can be improved.

[0006] A "user" is a person or entity that operates a system and inputs strings or numerical information.

[0007] "Input" refers to string or numerical information provided by the user.

[0008] "String and numerical information" refers to text and numerical data provided by the user to create presentation materials.

[0009] "Analysis" is the process of understanding input string and numerical information and converting it into an appropriate format.

[0010] "Slide layout" refers to a design format that defines the appearance and structure of a slide.

[0011] "Selection" refers to the act of determining the most appropriate slide layout based on the analysis results.

[0012] "Adding" refers to the act of inserting the analyzed information into the selected slide layout.

[0013] A "presentation file" is the final presentation file that combines slide layout and information.

[0014] "Generation" refers to the process of creating new presentation materials based on input information.

[0015] "Color usage" refers to the selection and arrangement of colors in content such as slides, text, graphs, etc.

[0016] "Optimization" refers to the adjustment of color usage set to enhance visual appeal.

Brief Explanation of Drawings

[0017] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Embodiments for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0021] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0022] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] The system of this invention aims to analyze user input, select an appropriate slide layout, add the analyzed information to the presentation materials, and further optimize the color scheme to generate the final presentation materials.

[0039] Overview of program processing

[0040] Step 1: Input Collection

[0041] The user provides input to the system. This input may take the following form, for example:

[0042] Title: Internal Meeting

[0043] Content: On growth strategy

[0044] Charts: 12, 19, 17, 22, 31

[0045] Step 2: Input Analysis

[0046] The server analyzes the user's input. Specifically, it extracts data to display on the slides based on the entered text and numerical information.

[0047] Step 3: Initialize the presentation

[0048] The server initializes the new presentation file and prepares to add slides.

[0049] Step 4: Load the standard template

[0050] The server loads standard template files and uses them to maintain consistency in the slide layout.

[0051] Step 5: Create slides

[0052] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, it generates title slides, text slides, chart slides, etc.

[0053] Step 6: Add content to the slide

[0054] The server adds information to each slide. For example, it sets a title for the title slide, adds details to the text slides, and includes graphs generated from numerical data in the chart slides.

[0055] Step 7: Optimize color usage

[0056] The server optimizes the color scheme for all generated slides, creating visually appealing presentation materials.

[0057] Step 8: Save the file

[0058] The server saves the final generated presentation materials. For example, it might save them with a filename like "generated_presentation.pptx".

[0059] Specific example

[0060] 1. The user enters the following information:

[0061] Title: Product Announcement

[0062] Content: Features and benefits of the new product

[0063] Charts: 10, 20, 30, 40, 50

[0064] 2. The server analyzes this input and extracts the following slide information:

[0065] python

[0066] slides_data = [

[0067] {'type': 'title', 'content': 'Product Announcement'},

[0068] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[0069] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[0070] ]

[0071] 3. The server initializes the presentation files and loads the standard template.

[0072] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[0073] 5. The server optimizes the color scheme for all slides.

[0074] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[0075] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[0076] The following describes the processing flow.

[0077] Step 1:

[0078] Users input strings and numerical information into the system. For example, they might input in the format: "Title: Internal Meeting", "Content: Growth Strategy", "Chart: 12, 19, 17, 22, 31".

[0079] Step 2:

[0080] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[0081] Step 3:

[0082] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[0083] Step 4:

[0084] The server loads a standard template, which includes frequently used layouts such as introduction and conclusion slides.

[0085] Step 5:

[0086] The server generates slides based on the analyzed slide information. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[0087] Step 6:

[0088] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[0089] Step 7:

[0090] The server optimizes the color scheme of the slide content. This includes adjusting the color settings of all slides and shapes to improve visual consistency and appearance.

[0091] Step 8:

[0092] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[0093] Step 9:

[0094] The device provides users with saved presentation files in a downloadable format. This allows users to view, edit, and present presentation materials on their own devices.

[0095] (Example 1)

[0096] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0097] Traditional presentation creation systems required users to manually select slide layouts and arrange content, which was time-consuming and labor-intensive. Furthermore, maintaining consistent color schemes and design was difficult, making it challenging to create high-quality presentation materials.

[0098] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0099] In this invention, the server includes means for analyzing string and numerical information entered by the user, means for selecting an appropriate slide layout based on the analyzed information, and means for saving the generated presentation materials. This enables the user to automatically create high-quality presentation materials.

[0100] "User" refers to the individual or group that creates the presentation materials.

[0101] "String information" refers to text data entered by the user and is used for the title and content description of the presentation.

[0102] "Numerical information" refers to numerical data entered by users and is primarily used to create charts and graphs.

[0103] "Analysis means" refers to the process of analyzing input string and numerical information to extract data for application to presentation materials.

[0104] "Slide layout selection means" refers to the process of automatically selecting the optimal layout for each slide of a presentation based on the analyzed information.

[0105] "Information addition method" refers to the process of incorporating the analyzed information into the selected slide layout and preparing it as a presentation document.

[0106] "Color optimization" refers to a process that automatically applies a visually appealing color scheme to all slides in a generated presentation.

[0107] "Storage method" refers to the process of saving the generated presentation materials in a file format so that users can use them later.

[0108] A "standard template" refers to a predefined design and layout template for use in presentation materials.

[0109] "Slide information" refers to the information about the content to be displayed on each slide, created based on the analyzed user input.

[0110] This invention is a system that analyzes user input, selects an appropriate slide layout, adds the analyzed information to the presentation materials, and further optimizes the color scheme to generate the final presentation materials.

[0111] Input Collection

[0112] First, the user inputs information that will form the basis of their presentation materials into the system. This input includes, for example, the presentation title, content, and the data to be used (numerical values ​​for charts). This input is submitted via a web form and sent to the server.

[0113] Input Analysis

[0114] The server parses the input data received from the user. Specifically, it uses a string parsing library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. This parsing extracts information for each slide, which is then stored in an internal data structure.

[0115] Initializing the presentation

[0116] Next, the server initializes the new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file. This process creates the basic structure of the presentation file.

[0117] Loading standard templates

[0118] The server loads standard template files, ensuring a consistent design and layout. These loaded templates are then used when creating subsequent slides.

[0119] Creating slides

[0120] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, title slides, text slides, chart slides, etc., are generated.

[0121] Adding content to slides

[0122] The server adds extracted information to each slide. Title slides are given titles, text slides are given detailed content, and chart slides include graphs generated from numerical data. This creates a practical and easy-to-understand presentation.

[0123] Color optimization

[0124] The server optimizes the color scheme for all generated slides to enhance visibility. Custom scripts are used to apply color patterns, ensuring visually appealing presentation materials.

[0125] Saving files

[0126] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[0127] Specific example

[0128] For example, the user enters the following:

[0129] Title: Product Announcement

[0130] Content: Features and benefits of the new product

[0131] Charts: 10, 20, 30, 40, 50

[0132] In this case, the server extracts the following slide information:

[0133] slides_data = [

[0134] {'type': 'title', 'content': 'Product Announcement'},

[0135] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[0136] {'type': 'chart', 'content': [10, 20, 30, 40, 50]}

[0137] ]

[0138] The server generates slides based on the analysis results, adds appropriate information to each slide, and optimizes the color scheme. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[0139] Example of a prompt

[0140] An example of a prompt to input into a generative AI model is as follows:

[0141] Write a Python program that automatically generates high-quality slides, selects the layout, and optimizes the color scheme, based on the presentation title, content, and data charts provided by the user.

[0142] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Because the entire process is automated, users can save a significant amount of time and effort.

[0143] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0144] Step 1:

[0145] The user inputs information that forms the basis of the presentation into the system. Specific inputs include the presentation title, content, and numerical data for charts. The data is submitted through the input form in the following format:

[0146] Title: Internal Meeting

[0147] Content: On growth strategy

[0148] Charts: 12, 19, 17, 22, 31

[0149] Input: Presentation information entered by the user in the form.

[0150] Output: Raw data sent to the server

[0151] Step 2:

[0152] The server receives input data sent by the user and performs analysis. Specifically, it uses a string analysis library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. Through string analysis, it extracts the title, content, and chart data.

[0153] win re

[0154] def parse_input(input_text):

[0155] title = re.search(r'Title: (.+)', input_text).group(1)

[0156] content = re.search(r'content: (.+)', input_text).group(1)

[0157] chart_data = re.search(r'Chart: (.+)', input_text).group(1).split(', ')

[0158] return {"title": title, "content": content, "chart_data": list(map(int, chart_data))}

[0159] Input: User input data received by the server

[0160] Output: Analyzed data for presentation

[0161] Step 3:

[0162] The server initializes a new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file.

[0163] from pptx import Presentation

[0164] prs = Presentation()

[0165] Input: None (Create a presentation instance)

[0166] Output: Initialized presentation file

[0167] Step 4:

[0168] The server loads a standard template file. In this step, the template presentation file is loaded, and new slides are created based on it.

[0169] template_prs = Presentation('standard_template.pptx')

[0170] Input: Template file

[0171] Output: Loaded template

[0172] Step 5:

[0173] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. Specifically, it generates title slides, text slides, and chart slides. It applies the appropriate layout to each slide and sets the necessary information.

[0174] Title slide

[0175] title_slide_layout = template_prs.slide_layouts[0]

[0176] slide = prs.slides.add_slide(title_slide_layout)

[0177] title = slide.shapes.title

[0178] title.text = parsed_data["title"]

[0179] Text slides

[0180] text_slide_layout = template_prs.slide_layouts[1]

[0181] slide = prs.slides.add_slide(text_slide_layout)

[0182] content = slide.placeholders[1]

[0183] content.text = parsed_data["content"]

[0184] Chart slides

[0185] chart_slide_layout = template_prs.slide_layouts[2]

[0186] slide = prs.slides.add_slide(chart_slide_layout)

[0187] chart_data = parsed_data["chart_data"]

[0188] Detailed implementation information regarding the addition of charts is omitted.

[0189] Input: Analyzed data for presentation

[0190] Output: Presentation file with added slides

[0191] Step 6:

[0192] The server adds information based on the analysis results to each slide. Title slides have a title, text slides have detailed content added, and chart slides include graphs generated from numerical data.

[0193] Setting the content of the title slide

[0194] title_slide_layout = template_prs.slide_layouts[0]

[0195] slide = prs.slides.add_slide(title_slide_layout)

[0196] title = slide.shapes.title

[0197] title.text = parsed_data["title"]

[0198] Text slide content settings

[0199] text_slide_layout = template_prs.slide_layouts[1]

[0200] slide = prs.slides.add_slide(text_slide_layout)

[0201] content = slide.placeholders[1]

[0202] content.text = parsed_data["content"]

[0203] Chart slide content settings

[0204] chart_slide_layout = template_prs.slide_layouts[2]

[0205] slide = prs.slides.add_slide(chart_slide_layout)

[0206] chart_data = parsed_data["chart_data"]

[0207] Detailed implementation information regarding the addition of charts is omitted.

[0208] Input: Analyzed data for presentation

[0209] Output: Slides with added content

[0210] Step 7:

[0211] The server optimizes the color scheme for all generated slides. For example, it uses custom scripts to apply color patterns and create visually appealing presentation materials.

[0212] def optimize_colors(presentation):

[0213] Code to change an existing color theme

[0214] for slide in presentation.slides:

[0215] Example of changing the color of all text in a slide

[0216] for display in slide.shapes:

[0217] if shape.has_text_frame:

[0218] for paragraph in shape.text_frame.paragraphs:

[0219] For run in paragraph.runs:

[0220] run.font.color.rgb = RGBColor(0, 0, 128) (Example setting: blue)

[0221] Input: Slide with added content

[0222] Output: Slides with optimized color scheme

[0223] Step 8:

[0224] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[0225] prs.save('generated_presentation.pptx')

[0226] Input: Slides with optimized color scheme

[0227] Output: Saved presentation file

[0228] This allows users to easily generate high-quality presentation materials through the system. Because the entire process is automated, significant time and effort can be saved.

[0229] (Application Example 1)

[0230] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0231] In recent years, creating presentation materials for business and educational settings has become an important task. However, conventional presentation creation tools require a significant amount of time and effort to optimize design and content. In particular, it is difficult to easily generate high-quality materials on smart devices, which leads to decreased work efficiency and stress. This invention aims to solve these problems by providing a system that links smart devices and servers to enable the effective creation of presentation materials.

[0232] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0233] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for transmitting data input from a smart device to the server, means for processing and generating presentation materials on the server side based on the data received by the server, and means for making the generated presentation materials downloadable to a smart device. This enables users to easily and quickly create professional presentation materials via their smart devices.

[0234] "User-inputted text and numerical information" refers to the text and numerical data provided by the user when generating presentation materials.

[0235] "Means of analysis" refers to the process and techniques of analyzing input data provided by users and extracting useful information from that data.

[0236] "Means for selecting an appropriate slide layout" refers to the process and technology of automatically determining the most effective slide layout based on analyzed information.

[0237] "Methods for generating presentation materials" refer to the process and techniques for adding analyzed information to a selected slide layout to create a final presentation file.

[0238] "Methods for optimizing color usage" refer to the processes and techniques for appropriately adjusting and balancing colors to improve the visual readability of a generated presentation.

[0239] "Means of transmitting data entered from a smart device to a server" refers to the process and technology of transmitting input data from personal electronic devices such as smartphones and tablets to a server via the Internet Protocol.

[0240] "A means of processing and generating presentation materials on the server side based on data received by the server" refers to the process and technology of analyzing the received data on the server and performing the necessary presentation material generation processing on the server side.

[0241] "Means for making generated presentation materials downloadable to smart devices" refers to the process and technology of providing presentation files generated on a server so that they can be downloaded to smart devices.

[0242] A "standard template" is a pre-configured template file designed to maintain consistency in the layout and design of presentation materials.

[0243] To implement this invention, it is necessary to build a system that links a smart device with a server. The main function of the system is to analyze data entered by the user and automatically generate an appropriate presentation.

[0244] Hardware and software configuration

[0245] hardware

[0246] Smart devices (e.g., smartphones, tablets)

[0247] Servers (e.g., cloud servers, dedicated servers)

[0248] software

[0249] Smart device application software: iOS Swift, Kotlin for ANDROID (registered trademark)

[0250] Server-side software: Python, Flask

[0251] Data analysis libraries: Pandas, Numpy

[0252] Graphics generation libraries: Matplotlib, Plotly

[0253] File manipulation library: python-pptx

[0254] Color optimization libraries: Colorthief, OpenCV

[0255] Process Overview

[0256] 1. Data Collection

[0257] Users input data into the application using smart devices. This input data includes presentation titles, content, chart data, and other similar information.

[0258] example:

[0259] Title: Monthly Report

[0260] Contents: Income and expenditure report and plan for next month

[0261] Charts: 150, 200, 250, 300, 350

[0262] 2. Sending data

[0263] The smart device sends the entered data to the server. This transmission takes place via the Internet protocol.

[0264] 3. Data Analysis

[0265] The server analyzes the received data and extracts the information necessary to generate the presentation. For example, it analyzes text and numerical data to determine the content of each slide.

[0266] 4. Presentation Generation

[0267] The server uses the python-pptx library to generate a new presentation file based on the analyzed information. It first loads a standard template and then selects an appropriate slide layout.

[0268] The chart data is converted into graphs using Matplotlib or Plotly and added to the slides.

[0269] 5. Optimizing color usage

[0270] The completed presentation's color scheme is optimized using Colorthief and OpenCV. This results in a visually appealing and easy-to-understand presentation.

[0271] 6. Saving and downloading files

[0272] Finally, the generated presentation materials are saved on the server and made available for users to download from their smart devices.

[0273] This system allows users to easily generate professional presentation materials based on their input data. In particular, using smart devices enables rapid material creation anywhere.

[0274] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0275] Step 1:

[0276] The user inputs the title, content, and chart data of the presentation materials into the application on their smart device. The input data is formatted in JSON or another format, resulting in the following:

[0277] input:

[0278] {

[0279] "Title": "Monthly Report",

[0280] "Contents": "Income and expenditure report and plan for next month",

[0281] "Chart": [150, 200, 250, 300, 350]

[0282] }

[0283] The output is sent to the server as formatted data.

[0284] Step 2:

[0285] The server receives the data sent from the smart device and performs analysis.

[0286] Input: Formatted data

[0287] {

[0288] "title": "Monthly Report",

[0289] "content": "Income and Expense Report and Next Month's Plan",

[0290] "chart": [150, 200, 250, 300, 350]

[0291] }

[0292] The server analyzes each field and converts it into slide information.

[0293] Data processing: Use Python's Pandas and Numpy to process string and numerical data.

[0294] Output:

[0295] slides_data =

[0296] {'type': 'title', 'content': 'Monthly Report'},

[0297] {'type': 'text', 'content': 'Income and Expense Report and Next Month's Plan'},

[0298] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[0299]

[0300] Step 3:

[0301] The server initializes a new presentation file and loads the standard template. The standard template has a basic slide layout set.

[0302] Software used: python-pptx

[0303] Input: Template file

[0304] Output: Presentation object

[0305] Step 4:

[0306] The server generates slides based on the analysis results. Here, appropriate slides such as title slides, text slides, chart slides, etc. are selected and added.

[0307] Input: Slide information

[0308] slides_data =

[0309] {'type': 'title', 'content': 'Monthly Report'},

[0310] {'type': 'text', 'content': 'Income and Expense Report and Next Month's Plan'},

[0311] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[0312]

[0313] Output: Presentation object with slides set

[0314] Step 5:

[0315] ​The server converts the chart data into a graph and adds it to the chart slide. Matplotlib and Plotly are used to create the chart.

[0316] Input: Chart data

[0317] [150, 200, 250, 300, 350]

[0318] Data processing: Convert numerical data into graphs and add them to presentations as images.

[0319] Output: Slide with added graph

[0320] Step 6:

[0321] The server optimizes the color scheme of all generated slides. It uses Colorthief and OpenCV to adjust the color balance.

[0322] Input: Presentation object with slides set up

[0323] Output: A presentation object with optimized color usage.

[0324] Step 7:

[0325] The server saves the final generated presentation file and makes it available for download from smart devices.

[0326] Software used: Flask (server-side)

[0327] Input: Completed presentation object

[0328] Output: Generate download link

[0329] Users can download the generated presentation materials to their smart devices using the download link.

[0330] This series of steps allows users to quickly and easily create professional presentation materials based on their input data.

[0331] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0332] The system of this invention aims to generate final presentation materials by analyzing user input, selecting an appropriate slide layout, adding the analyzed information to the presentation materials, and further optimizing the use of color. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the content and design of the presentation are adjusted according to the user's emotions.

[0333] Overview of program processing

[0334] Step 1: Input Collection

[0335] The user inputs string and numerical information into the system. This input is in the format, for example, "Title: Internal Meeting", "Content: Growth Strategy", and "Chart: 12, 19, 17, 22, 31".

[0336] Step 2: Recognizing Emotions

[0337] The emotion engine recognizes the user's emotions as they input data. It identifies the user's emotions by analyzing multiple input data points, such as the user's facial expressions, voice tone, and keystroke patterns.

[0338] Step 3: Input Analysis

[0339] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[0340] Step 4: Initialize the presentation

[0341] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[0342] Step 5: Load the standard template

[0343] The server loads standard templates and uses them to maintain consistency in slide layouts. These templates include frequently used layouts such as introduction and conclusion slides.

[0344] Step 6: Create slides

[0345] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[0346] Step 7: Add content to the slide

[0347] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[0348] Step 8: Optimize color usage

[0349] The server optimizes the color scheme of the slides. Based on the user's emotions recognized by the emotion engine, it automatically adjusts the slide's color scheme and font style. This creates visually appealing presentation materials.

[0350] Step 9: Save the file

[0351] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[0352] Specific example

[0353] 1. The user enters the following information:

[0354] Title: Product Announcement

[0355] Content: Features and benefits of the new product

[0356] Charts: 10, 20, 30, 40, 50

[0357] At the same time, the emotion engine recognizes the user's emotions and detects that the user is feeling stressed.

[0358] 2. The server analyzes this input and extracts the following slide information:

[0359] python

[0360] slides_data = [

[0361] {'type': 'title', 'content': 'Product Announcement'},

[0362] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[0363] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[0364] ]

[0365] 3. The server initializes the presentation files and loads the standard template.

[0366] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[0367] 5. The server and emotion engine optimize the color scheme and font style for all slides based on the user's emotions. For example, they apply relaxing colors and font styles to a stressed user.

[0368] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[0369] In this way, the system of the present invention allows users to easily create high-quality presentation materials that are tailored to their emotions. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[0370] The following describes the processing flow.

[0371] Step 1:

[0372] The user inputs the necessary text and numerical information for the presentation materials into the system. For example, they might input "Title: Internal Meeting," "Content: Growth Strategy," and "Chart: 12, 19, 17, 22, 31."

[0373] Step 2:

[0374] The emotion engine analyzes user input patterns from the camera, microphone, and keyboard during user interaction to recognize the user's emotions. Specifically, it performs facial expression analysis, voice tone analysis, and keystroke analysis to determine whether the user is tense or relaxed.

[0375] Step 3:

[0376] The server receives information entered by the user and analyzes its contents. This allows it to extract the information that should be displayed on each slide (title, text, chart data, etc.).

[0377] Step 4:

[0378] The server initializes the new presentation file. During this process, it creates a pptx.Presentation object and prepares the new presentation.

[0379] Step 5:

[0380] The server loads a standard template. This standard template includes generic slide layouts, such as introduction and conclusion slides. Use this template to create a consistent presentation.

[0381] Step 6:

[0382] The server selects the layout for each slide based on the analysis results. For example, it sets a title for the first slide, adds text content to the next slide, and generates a graph based on the chart data for the slide after that.

[0383] Step 7:

[0384] The server adds the analyzed information to each slide. It adds a title to title slides, text to text slides, and graphs to chart slides, enriching the presentation materials.

[0385] Step 8:

[0386] The emotion engine optimizes the color scheme and font style of each slide based on the recognized user's emotions. For example, if the user is feeling nervous, it applies calming colors and a visually relaxing font style.

[0387] Step 9:

[0388] The server verifies that all slides are complete and saves the presentation file. For example, it saves it as "generated_presentation.pptx" and makes it available for users to download.

[0389] Step 10:

[0390] The device displays saved presentation files so that the user can view them. It also allows the user to download the presentations if needed.

[0391] This system allows users to easily create high-quality, visually optimized presentation materials, as well as generate presentations with appropriate designs that resonate with the user's emotions.

[0392] (Example 2)

[0393] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0394] Traditional presentation creation systems require users to manually select slide layouts and add content, which is time-consuming and laborious. Furthermore, they often lack optimization of color schemes and font styles based on user preferences, potentially resulting in visually unappealing presentations. Therefore, there is a need for a system that allows users to easily and efficiently create high-quality, visually appealing presentations.

[0395] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting string and numerical information input by the user, means for analyzing the user's emotions based on the collected input information, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, and means for optimizing the color scheme and font style of the generated presentation content based on the user's emotions. As a result, the user can generate high-quality, visually appealing presentation materials that are adapted to their emotions while saving time and effort.

[0396] A "user" is the entity that inputs data into the system and requests the generation of presentation materials.

[0397] "String and numerical information" refers to information that users input into the system and is fundamental information that constitutes the content of presentation materials.

[0398] "Means of collection" refers to functions for obtaining string and numerical information from users and importing it into the system.

[0399] "Means for analyzing emotions" refers to a function that identifies and analyzes the user's emotions at a given time based on the collected user input information.

[0400] The "means for selecting slide layouts" refer to a function that automatically selects the appropriate slide layout based on the analyzed information.

[0401] "Method for generating presentation materials" refers to a function that automatically creates presentation materials by adding analyzed information to a selected slide layout.

[0402] "Methods for optimizing color schemes and font styles" refers to features that automatically adjust the color schemes and font styles of generated presentation materials based on the user's emotions.

[0403] The system of the present invention supports the automatic generation of presentation materials and is implemented in the following steps.

[0404] Hardware and software to be used

[0405] The operation of the system involves servers, terminals, and users.

[0406] Server: The central server handles data analysis, slide layout selection, presentation material generation, and color optimization. The primary software tool used is the pptx presentation library.

[0407] Terminal: A device (such as a PC or smartphone) that has an interface for receiving user input. Input is performed through web forms or dedicated applications.

[0408] User: The entity that provides input information for a presentation.

[0409] System Operation Overview

[0410] The system automatically generates presentation materials based on user input. By using an emotion engine, it can apply color schemes and font styles that correspond to the user's emotional state.

[0411] Specific examples

[0412] 1. User input:

[0413] The user enters information in the following format:

[0414] Title: Product Launch Event

[0415] Content: Features and benefits of the new product

[0416] Charts: 10, 20, 30, 40, 50

[0417] 2. Emotion recognition:

[0418] The emotion engine analyzes the user's facial expressions, voice tone, and keystroke patterns to identify their emotions. For example, it can detect if the user is feeling tense while typing.

[0419] 3. Data Analysis:

[0420] The server analyzes the data received from the user and converts it into an appropriate format for slide information. For example, it might extract "Product Launch" as the title, "Features and Benefits of the New Product" as the content, and "10, 20, 30, 40, 50" as chart data.

[0421] 4. Presentation Initialization:

[0422] The server creates a pptx.Presentation object and initializes a new presentation file. It then loads a standard template and applies a consistent slide layout.

[0423] 5. Create slides and add content:

[0424] The server sequentially generates slides based on the analysis results. For example, it sets the title slide to "Product Launch" and adds a text slide titled "Features and Benefits of the New Product." For chart slides, it generates graphs based on the specified numerical data and adds them to the slides.

[0425] 6. Optimizing color scheme and font style:

[0426] The server works with an emotion engine to optimize the slide's color scheme and font style based on the user's emotions. For example, for a nervous user, it might apply a relaxing blue background and softer fonts.

[0427] 7. Save the file:

[0428] Finally, the server saves the generated presentation file as "generated_presentation.pptx". This file can be referenced and modified later.

[0429] In this way, the system of the present invention automatically generates high-quality, visually appealing presentation materials based on a small amount of information provided by the user and sentiment analysis. Users can save significant time and effort and efficiently prepare their presentations.

[0430] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0431] Step 1:

[0432] Users input information using the system's input interface. This input includes a title, text content, and chart data. For example, the input might be in the format: "Title: Product Launch," "Content: Features and Benefits of the New Product," and "Charts: 10, 20, 30, 40, 50." The input is submitted via a web form or dedicated application and sent to the server.

[0433] Step 2:

[0434] The server receives input data sent by the user and performs analysis. Specifically, it converts the input string and numerical information into an appropriate format. For example, it stores the title, text, and chart data in separate variables. Input: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart: 10, 20, 30, 40, 50". Output: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart Data: [10, 20, 30, 40, 50]".

[0435] Step 3:

[0436] The emotion engine analyzes the user's emotions. It identifies the user's emotional state by comprehensively analyzing data such as facial expressions, voice tone, and keystroke patterns. This analysis is used to optimize the presentation's color scheme and font style. Input: User's facial expression data, voice data, and keystroke data. Output: Analyzed user emotions (e.g., tension, relaxation, concentration).

[0437] Step 4:

[0438] The server initializes a new presentation file. Specifically, it creates a pptx.Presentation object and creates a new presentation. It also loads a standard template and applies a consistent slide layout. Input: None. Output: Initialized presentation file.

[0439] Step 5:

[0440] The server selects an appropriate slide layout based on the analysis results and generates the slides. For example, it sequentially creates a title slide, a text slide, and a chart slide. Input: "Title: Product Launch Event", "Content: Features and Benefits of the New Product", "Chart Data: [10, 20, 30, 40, 50]". Output: Generated slides.

[0441] Step 6:

[0442] The server adds the analyzed information to each slide. For example, it sets the title for the title slide, adds text content to the text slides, and generates and adds graphs using numerical data to the chart slides. Input: Title, text, chart data. Output: Slides with added information.

[0443] Step 7:

[0444] The server optimizes the slide's color scheme and font style based on the emotion engine's analysis results. For example, if the user is feeling stressed, it applies a relaxing blue background color and a softer font style. Input: Analyzed user emotional state, generated slide. Output: Optimized slide.

[0445] Step 8:

[0446] The server saves the generated presentation file. For example, it saves it with the filename "generated_presentation.pptx" so that it can be referenced and modified later. Input: Optimized presentation file. Output: Saved presentation file.

[0447] In this way, the entire system works together to analyze user input and automatically generate presentation materials that respond to emotions.

[0448] (Application Example 2)

[0449] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0450] In modern sales operations, visual and interactive presentations are essential for sales staff to effectively communicate the appeal of products to customers. However, manually creating presentation materials is not only time-consuming and laborious, but it is also difficult to instantly provide materials that reflect emotional elements. Furthermore, there is a challenge in that there are limited means of generating and presenting materials to customers in real time during in-store interactions.

[0451] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0452] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for recognizing emotions, means for adjusting the design of the presentation materials based on the user's emotions, and means for displaying the presentation materials in real time via smart glasses. This enables store employees to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[0453] "String and numerical information" refers to text and numerical data entered by the user.

[0454] "Means of analysis" refers to methods and techniques for processing user input data and extracting meaning and information.

[0455] "Slide layout" refers to the format and design used to visually organize and arrange information in presentation materials.

[0456] "Methods for optimizing color usage" refer to methods and techniques for adjusting colors to enhance the visual appeal of presentation materials.

[0457] "Means of recognizing emotions" refers to technologies and devices for detecting and understanding a user's emotional state.

[0458] "Methods for adjusting the design" refer to methods and techniques for changing the layout and style of presentation materials to convey information more effectively.

[0459] "Smart glasses" refer to wearable devices that display visual information on a screen and provide users with real-time information.

[0460] "Means of displaying presentation materials in real time" refers to methods and technologies for instantly displaying generated presentation materials on visual devices.

[0461] The system that realizes this application example provides a presentation material generation system that uses smart glasses to improve customer service efficiency in physical stores.

[0462] The system's program acquires user voice input, analyzes it, and generates appropriate presentation materials. Furthermore, it recognizes the user's emotions and adjusts the material design accordingly. Required hardware and software include:

[0463] Hardware: Smart glasses (typically using Google® Glass®), microphone, camera, and built-in processor

[0464] Software: Speech recognition API (Google Speech-to-Text), sentiment analysis engine (Affectiva SDK), presentation creation library (python-pptx)

[0465] System Processing Overview

[0466] 1. Input collection:

[0467] The user inputs information by voice into the microphone equipped on the smart glasses. For example, they might input information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life."

[0468] 2. Recognition of emotions:

[0469] The smart glasses use a built-in camera and microphone to analyze the user's facial expressions and voice tone, identifying their emotional state. An emotion analysis engine is used to recognize emotions such as tension, excitement, and relaxation.

[0470] 3. Input analysis:

[0471] The server or terminal's built-in processor converts the audio data into text and analyzes the user's input. The analyzed text data is then extracted as information necessary for generating presentation materials.

[0472] 4. Presentation Initialization:

[0473] Initialize a new presentation file on the server or terminal and load a standard template. This is to ensure a consistent layout for all slides.

[0474] 5. Create slides and add content:

[0475] Based on the analysis results, appropriate information is added to each slide, generating slides that include product information, features, photographs, graphs, and more.

[0476] 6. Optimizing color usage:

[0477] Based on the emotional information recognized by the emotion engine, the slide's color scheme and font style are automatically adjusted. For example, if a user is feeling nervous, calming colors will be used to help them relax.

[0478] 7. Displaying presentation materials:

[0479] The final generated presentation materials are displayed on smart glasses, providing visual support to store staff as they explain products to customers in real time.

[0480] Specific example

[0481] 1. The user enters the following information:

[0482] Product name: New smartphone

[0483] Features: High-performance camera, long battery life

[0484] The smart glasses' emotion analysis engine recognizes the user's emotions and detects when the user is feeling stressed.

[0485] 2. The server analyzes this input and extracts the presentation slide information.

[0486] 3. Load the standard template and initialize the presentation file.

[0487] 4. Create slides based on the analysis results and add appropriate information to the slides.

[0488] 5. Optimize the color scheme and font style of slides based on user emotions.

[0489] 6. Finally, display the generated presentation materials on the smart glasses in real time.

[0490] Example of a prompt

[0491] "Product name: Smartphone A, Features: High-resolution camera, Long-lasting battery, Emotion: Stress"

[0492] "Product Name: Laptop B, Features: High-resolution display, Lightweight design, Emotion: Relaxing"

[0493] This allows store staff to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[0494] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0495] Step 1:

[0496] The user inputs information by voice into the microphone of the smart glasses. For example, they might input specific information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life" as voice input. The input voice data is then sent to the server.

[0497] Step 2:

[0498] The server receives the audio data and converts it into text data using a speech recognition API (e.g., Google Speech-to-Text). The audio data becomes text data and is converted into a parseable format. The text data is then returned to the server.

[0499] Step 3:

[0500] The server analyzes the converted text data and extracts user input information. This analysis process extracts product names, features, numerical information, etc., and organizes them as structured data necessary for generating presentation materials. As a result, the analyzed information is obtained in slide format.

[0501] Step 4:

[0502] The server recognizes the user's emotions via the smart glasses' camera and microphone. At this stage, an emotion analysis engine (e.g., Affectiva SDK) is used to identify the user's emotions from facial expressions and tone of voice. The user's emotion data is recorded on the server.

[0503] Step 5:

[0504] The server initializes a new presentation file. This process includes generating presentation objects. A standard template is loaded, and a consistent slide layout is prepared. An empty presentation file is created on the terminal.

[0505] Step 6:

[0506] Based on the analysis results, the server selects the appropriate layout for each slide and adds information to that layout. For example, the title slide will have the product name added, the text slides will have a feature description, and the chart slides will have numerical information added. Slides with information placed in the optimal layout are generated.

[0507] Step 7:

[0508] The server adjusts the slide design based on emotional data. If the user is nervous, the slide's color scheme is changed to a calmer one to create a more relaxed atmosphere. The colors and fonts of the generated slides are automatically adjusted.

[0509] Step 8:

[0510] The server sends the generated presentation materials to the smart glasses for real-time display. The presentation materials appear instantly on the smart glasses' display, making them available for the user to view. As a result of this process, the user can provide real-time visual support to customers.

[0511] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0512] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0513] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0514] [Second Embodiment]

[0515] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0516] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0517] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0518] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0519] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0520] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0521] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0522] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0523] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0524] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0525] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0526] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0527] The system of this invention aims to analyze user input, select an appropriate slide layout, add the analyzed information to the presentation materials, and further optimize the color scheme to generate the final presentation materials.

[0528] Overview of program processing

[0529] Step 1: Input Collection

[0530] The user provides input to the system. This input may take the following form, for example:

[0531] Title: Internal Meeting

[0532] Content: On growth strategy

[0533] Charts: 12, 19, 17, 22, 31

[0534] Step 2: Input Analysis

[0535] The server analyzes the user's input. Specifically, it extracts data to display on the slides based on the entered text and numerical information.

[0536] Step 3: Initialize the presentation

[0537] The server initializes the new presentation file and prepares to add slides.

[0538] Step 4: Load the standard template

[0539] The server loads standard template files and uses them to maintain consistency in the slide layout.

[0540] Step 5: Create slides

[0541] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, it generates title slides, text slides, chart slides, etc.

[0542] Step 6: Add content to the slide

[0543] The server adds information to each slide. For example, it sets a title for the title slide, adds details to the text slides, and includes graphs generated from numerical data in the chart slides.

[0544] Step 7: Optimize color usage

[0545] The server optimizes the color scheme for all generated slides, creating visually appealing presentation materials.

[0546] Step 8: Save the file

[0547] The server saves the final generated presentation materials. For example, it might save them with a filename like "generated_presentation.pptx".

[0548] Specific example

[0549] 1. The user enters the following information:

[0550] Title: Product Announcement

[0551] Content: Features and benefits of the new product

[0552] Charts: 10, 20, 30, 40, 50

[0553] 2. The server analyzes this input and extracts the following slide information:

[0554] python

[0555] slides_data = [

[0556] {'type': 'title', 'content': 'Product Announcement'},

[0557] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[0558] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[0559] ]

[0560] 3. The server initializes the presentation files and loads the standard template.

[0561] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[0562] 5. The server optimizes the color scheme for all slides.

[0563] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[0564] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[0565] The following describes the processing flow.

[0566] Step 1:

[0567] Users input strings and numerical information into the system. For example, they might input in the format: "Title: Internal Meeting", "Content: Growth Strategy", "Chart: 12, 19, 17, 22, 31".

[0568] Step 2:

[0569] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[0570] Step 3:

[0571] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[0572] Step 4:

[0573] The server loads a standard template, which includes frequently used layouts such as introduction and conclusion slides.

[0574] Step 5:

[0575] The server generates slides based on the analyzed slide information. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[0576] Step 6:

[0577] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[0578] Step 7:

[0579] The server optimizes the color scheme of the slide content. This includes adjusting the color settings of all slides and shapes to improve visual consistency and appearance.

[0580] Step 8:

[0581] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[0582] Step 9:

[0583] The device provides users with saved presentation files in a downloadable format. This allows users to view, edit, and present presentation materials on their own devices.

[0584] (Example 1)

[0585] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0586] Traditional presentation creation systems required users to manually select slide layouts and arrange content, which was time-consuming and labor-intensive. Furthermore, maintaining consistent color schemes and design was difficult, making it challenging to create high-quality presentation materials.

[0587] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0588] In this invention, the server includes means for analyzing string and numerical information entered by the user, means for selecting an appropriate slide layout based on the analyzed information, and means for saving the generated presentation materials. This enables the user to automatically create high-quality presentation materials.

[0589] "User" refers to the individual or group that creates the presentation materials.

[0590] "String information" refers to text data entered by the user and is used for the title and content description of the presentation.

[0591] "Numerical information" refers to numerical data entered by users and is primarily used to create charts and graphs.

[0592] "Analysis means" refers to the process of analyzing input string and numerical information to extract data for application to presentation materials.

[0593] "Slide layout selection means" refers to the process of automatically selecting the optimal layout for each slide of a presentation based on the analyzed information.

[0594] "Information addition method" refers to the process of incorporating the analyzed information into the selected slide layout and preparing it as a presentation document.

[0595] "Color optimization" refers to a process that automatically applies a visually appealing color scheme to all slides in a generated presentation.

[0596] "Storage method" refers to the process of saving the generated presentation materials in a file format so that users can use them later.

[0597] A "standard template" refers to a predefined design and layout template for use in presentation materials.

[0598] "Slide information" refers to the information about the content to be displayed on each slide, created based on the analyzed user input.

[0599] This invention is a system that analyzes user input, selects an appropriate slide layout, adds the analyzed information to the presentation materials, and further optimizes the color scheme to generate the final presentation materials.

[0600] Input Collection

[0601] First, the user inputs information that will form the basis of their presentation materials into the system. This input includes, for example, the presentation title, content, and the data to be used (numerical values ​​for charts). This input is submitted via a web form and sent to the server.

[0602] Input Analysis

[0603] The server parses the input data received from the user. Specifically, it uses a string parsing library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. This parsing extracts information for each slide, which is then stored in an internal data structure.

[0604] Initializing the presentation

[0605] Next, the server initializes the new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file. This process creates the basic structure of the presentation file.

[0606] Loading standard templates

[0607] The server loads standard template files, ensuring a consistent design and layout. These loaded templates are then used when creating subsequent slides.

[0608] Creating slides

[0609] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, title slides, text slides, chart slides, etc., are generated.

[0610] Adding content to slides

[0611] The server adds extracted information to each slide. Title slides are given titles, text slides are given detailed content, and chart slides include graphs generated from numerical data. This creates a practical and easy-to-understand presentation.

[0612] Color optimization

[0613] The server optimizes the color scheme for all generated slides to enhance visibility. Custom scripts are used to apply color patterns, ensuring visually appealing presentation materials.

[0614] Saving files

[0615] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[0616] Specific example

[0617] For example, the user enters the following:

[0618] Title: Product Announcement

[0619] Content: Features and benefits of the new product

[0620] Charts: 10, 20, 30, 40, 50

[0621] In this case, the server extracts the following slide information:

[0622] slides_data = [

[0623] {'type': 'title', 'content': 'Product Announcement'},

[0624] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[0625] {'type': 'chart', 'content': [10, 20, 30, 40, 50]}

[0626] ]

[0627] The server generates slides based on the analysis results, adds appropriate information to each slide, and optimizes the color scheme. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[0628] Example of a prompt

[0629] An example of a prompt to input into a generative AI model is as follows:

[0630] Write a Python program that automatically generates high-quality slides, selects the layout, and optimizes the color scheme, based on the presentation title, content, and data charts provided by the user.

[0631] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Because the entire process is automated, users can save a significant amount of time and effort.

[0632] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0633] Step 1:

[0634] The user inputs information that forms the basis of the presentation into the system. Specific inputs include the presentation title, content, and numerical data for charts. The data is submitted through the input form in the following format:

[0635] Title: Internal Meeting

[0636] Content: On growth strategy

[0637] Charts: 12, 19, 17, 22, 31

[0638] Input: Presentation information entered by the user in the form.

[0639] Output: Raw data sent to the server

[0640] Step 2:

[0641] The server receives input data sent by the user and performs analysis. Specifically, it uses a string analysis library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. Through string analysis, it extracts the title, content, and chart data.

[0642] win re

[0643] def parse_input(input_text):

[0644] title = re.search(r'Title: (.+)', input_text).group(1)

[0645] content = re.search(r'content: (.+)', input_text).group(1)

[0646] chart_data = re.search(r'Chart: (.+)', input_text).group(1).split(', ')

[0647] return {"title": title, "content": content, "chart_data": list(map(int, chart_data))}

[0648] Input: User input data received by the server

[0649] Output: Analyzed data for presentation

[0650] Step 3:

[0651] The server initializes a new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file.

[0652] from pptx import Presentation

[0653] prs = Presentation()

[0654] Input: None (Create a presentation instance)

[0655] Output: Initialized presentation file

[0656] Step 4:

[0657] The server loads a standard template file. In this step, the template presentation file is loaded, and new slides are created based on it.

[0658] template_prs = Presentation('standard_template.pptx')

[0659] Input: Template file

[0660] Output: Loaded template

[0661] Step 5:

[0662] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. Specifically, it generates title slides, text slides, and chart slides. It applies the appropriate layout to each slide and sets the necessary information.

[0663] Title slide

[0664] title_slide_layout = template_prs.slide_layouts[0]

[0665] slide = prs.slides.add_slide(title_slide_layout)

[0666] title = slide.shapes.title

[0667] title.text = parsed_data["title"]

[0668] Text slides

[0669] text_slide_layout = template_prs.slide_layouts[1]

[0670] slide = prs.slides.add_slide(text_slide_layout)

[0671] content = slide.placeholders[1]

[0672] content.text = parsed_data["content"]

[0673] Chart slides

[0674] chart_slide_layout = template_prs.slide_layouts[2]

[0675] slide = prs.slides.add_slide(chart_slide_layout)

[0676] chart_data = parsed_data["chart_data"]

[0677] Detailed implementation information regarding the addition of charts is omitted.

[0678] Input: Analyzed data for presentation

[0679] Output: Presentation file with added slides

[0680] Step 6:

[0681] The server adds information based on the analysis results to each slide. Title slides have a title, text slides have detailed content added, and chart slides include graphs generated from numerical data.

[0682] Setting the content of the title slide

[0683] title_slide_layout = template_prs.slide_layouts[0]

[0684] slide = prs.slides.add_slide(title_slide_layout)

[0685] title = slide.shapes.title

[0686] title.text = parsed_data["title"]

[0687] Text slide content settings

[0688] text_slide_layout = template_prs.slide_layouts[1]

[0689] slide = prs.slides.add_slide(text_slide_layout)

[0690] content = slide.placeholders[1]

[0691] content.text = parsed_data["content"]

[0692] Chart slide content settings

[0693] chart_slide_layout = template_prs.slide_layouts[2]

[0694] slide = prs.slides.add_slide(chart_slide_layout)

[0695] chart_data = parsed_data["chart_data"]

[0696] Detailed implementation information regarding the addition of charts is omitted.

[0697] Input: Analyzed data for presentation

[0698] Output: Slides with added content

[0699] Step 7:

[0700] The server optimizes the color scheme for all generated slides. For example, it uses custom scripts to apply color patterns and create visually appealing presentation materials.

[0701] def optimize_colors(presentation):

[0702] Code to change an existing color theme

[0703] for slide in presentation.slides:

[0704] Example of changing the color of all text in a slide

[0705] for display in slide.shapes:

[0706] if shape.has_text_frame:

[0707] for paragraph in shape.text_frame.paragraphs:

[0708] For run in paragraph.runs:

[0709] run.font.color.rgb = RGBColor(0, 0, 128) (Example setting: blue)

[0710] Input: Slide with added content

[0711] Output: Slides with optimized color scheme

[0712] Step 8:

[0713] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[0714] prs.save('generated_presentation.pptx')

[0715] Input: Slides with optimized color scheme

[0716] Output: Saved presentation file

[0717] This allows users to easily generate high-quality presentation materials through the system. Because the entire process is automated, significant time and effort can be saved.

[0718] (Application Example 1)

[0719] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0720] In recent years, creating presentation materials for business and educational settings has become an important task. However, conventional presentation creation tools require a significant amount of time and effort to optimize design and content. In particular, it is difficult to easily generate high-quality materials on smart devices, which leads to decreased work efficiency and stress. This invention aims to solve these problems by providing a system that links smart devices and servers to enable the effective creation of presentation materials.

[0721] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0722] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for transmitting data input from a smart device to the server, means for processing and generating presentation materials on the server side based on the data received by the server, and means for making the generated presentation materials downloadable to a smart device. This enables users to easily and quickly create professional presentation materials via their smart devices.

[0723] "User-inputted text and numerical information" refers to the text and numerical data provided by the user when generating presentation materials.

[0724] "Means of analysis" refers to the process and techniques of analyzing input data provided by users and extracting useful information from that data.

[0725] "Means for selecting an appropriate slide layout" refers to the process and technology of automatically determining the most effective slide layout based on analyzed information.

[0726] "Methods for generating presentation materials" refer to the process and techniques for adding analyzed information to a selected slide layout to create a final presentation file.

[0727] "Methods for optimizing color usage" refer to the processes and techniques for appropriately adjusting and balancing colors to improve the visual readability of a generated presentation.

[0728] "Means of transmitting data entered from a smart device to a server" refers to the process and technology of transmitting input data from personal electronic devices such as smartphones and tablets to a server via the Internet Protocol.

[0729] "A means of processing and generating presentation materials on the server side based on data received by the server" refers to the process and technology of analyzing the received data on the server and performing the necessary presentation material generation processing on the server side.

[0730] "Means for making generated presentation materials downloadable to smart devices" refers to the process and technology of providing presentation files generated on a server so that they can be downloaded to smart devices.

[0731] A "standard template" is a pre-configured template file designed to maintain consistency in the layout and design of presentation materials.

[0732] To implement this invention, it is necessary to build a system that links a smart device with a server. The main function of the system is to analyze data entered by the user and automatically generate an appropriate presentation.

[0733] Hardware and software configuration

[0734] hardware

[0735] Smart devices (e.g., smartphones, tablets)

[0736] Servers (e.g., cloud servers, dedicated servers)

[0737] software

[0738] Smart device application software: iOS Swift, Kotlin for Android

[0739] Server-side software: Python, Flask

[0740] Data analysis libraries: Pandas, Numpy

[0741] Graphics generation libraries: Matplotlib, Plotly

[0742] File manipulation library: python-pptx

[0743] Color optimization libraries: Colorthief, OpenCV

[0744] Process Overview

[0745] 1. Data Collection

[0746] Users input data into the application using smart devices. This input data includes presentation titles, content, chart data, and other similar information.

[0747] example:

[0748] Title: Monthly Report

[0749] Contents: Income and expenditure report and plan for next month

[0750] Charts: 150, 200, 250, 300, 350

[0751] 2. Sending data

[0752] The smart device sends the entered data to the server. This transmission takes place via the Internet protocol.

[0753] 3. Data Analysis

[0754] The server analyzes the received data and extracts the information necessary to generate the presentation. For example, it analyzes text and numerical data to determine the content of each slide.

[0755] 4. Presentation Generation

[0756] The server uses the python-pptx library to generate a new presentation file based on the analyzed information. It first loads a standard template and then selects an appropriate slide layout.

[0757] The chart data is converted into graphs using Matplotlib or Plotly and added to the slides.

[0758] 5. Optimizing color usage

[0759] The completed presentation's color scheme is optimized using Colorthief and OpenCV. This results in a visually appealing and easy-to-understand presentation.

[0760] 6. Saving and downloading files

[0761] Finally, the generated presentation materials are saved on the server and made available for users to download from their smart devices.

[0762] This system allows users to easily generate professional presentation materials based on their input data. In particular, using smart devices enables rapid material creation anywhere.

[0763] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0764] Step 1:

[0765] The user inputs the title, content, and chart data of the presentation materials into the application on their smart device. The input data is formatted in JSON or another format, resulting in the following:

[0766] input:

[0767] {

[0768] "Title": "Monthly Report",

[0769] "Contents": "Income and expenditure report and plan for next month",

[0770] "Chart": [150, 200, 250, 300, 350]

[0771] }

[0772] The output is sent to the server as formatted data.

[0773] Step 2:

[0774] The server receives data sent from smart devices and performs analysis.

[0775] Input: Formatted data

[0776] {

[0777] "Title": "Monthly Report",

[0778] "Contents": "Income and expenditure report and plan for next month",

[0779] "Chart": [150, 200, 250, 300, 350]

[0780] }

[0781] The server analyzes each field and converts it into slide information.

[0782] Data processing: Use Python's Pandas and Numpy to process string and numerical data.

[0783] output:

[0784] slides_data = [

[0785] {'type': 'title', 'content': 'Monthly report'},

[0786] {'type': 'text', 'content': 'Income and expenditure report and next month'},

[0787] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[0788] ]

[0789] Step 3:

[0790] The server initializes the new presentation file and loads a standard template. The standard template has a basic slide layout.

[0791] Software used: python-pptx

[0792] Input: Template file

[0793] Output: Presentation object

[0794] Step 4:

[0795] The server generates slides based on the analysis results. Here, you select and add appropriate slides such as title slides, text slides, and chart slides.

[0796] Input: Slide information

[0797] slides_data = [

[0798] {'type': 'title', 'content': 'Monthly report'},

[0799] {'type': 'text', 'content': 'Income and expenditure report and next month'},

[0800] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[0801] ]

[0802] Output: Presentation object with slides configured.

[0803] Step 5:

[0804] The server converts the chart data into a graph and adds it to the chart slide. Matplotlib and Plotly are used to create the chart.

[0805] Input: Chart data

[0806] [150, 200, 250, 300, 350]

[0807] Data processing: Convert numerical data into graphs and add them to presentations as images.

[0808] Output: Slide with added graph

[0809] Step 6:

[0810] The server optimizes the color scheme of all generated slides. It uses Colorthief and OpenCV to adjust the color balance.

[0811] Input: Presentation object with slides set up

[0812] Output: A presentation object with optimized color usage.

[0813] Step 7:

[0814] The server saves the final generated presentation file and makes it available for download from smart devices.

[0815] Software used: Flask (server-side)

[0816] Input: Completed presentation object

[0817] Output: Generate download link

[0818] Users can download the generated presentation materials to their smart devices using the download link.

[0819] This series of steps allows users to quickly and easily create professional presentation materials based on their input data.

[0820] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0821] The system of this invention aims to generate final presentation materials by analyzing user input, selecting an appropriate slide layout, adding the analyzed information to the presentation materials, and further optimizing the use of color. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the content and design of the presentation are adjusted according to the user's emotions.

[0822] Overview of program processing

[0823] Step 1: Input Collection

[0824] The user inputs string and numerical information into the system. This input is in the format, for example, "Title: Internal Meeting", "Content: Growth Strategy", and "Chart: 12, 19, 17, 22, 31".

[0825] Step 2: Recognizing Emotions

[0826] The emotion engine recognizes the user's emotions as they input data. It identifies the user's emotions by analyzing multiple input data points, such as the user's facial expressions, voice tone, and keystroke patterns.

[0827] Step 3: Input Analysis

[0828] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[0829] Step 4: Initialize the presentation

[0830] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[0831] Step 5: Load the standard template

[0832] The server loads standard templates and uses them to maintain consistency in slide layouts. These templates include frequently used layouts such as introduction and conclusion slides.

[0833] Step 6: Create slides

[0834] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[0835] Step 7: Add content to the slide

[0836] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[0837] Step 8: Optimize color usage

[0838] The server optimizes the color scheme of the slides. Based on the user's emotions recognized by the emotion engine, it automatically adjusts the slide's color scheme and font style. This creates visually appealing presentation materials.

[0839] Step 9: Save the file

[0840] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[0841] Specific example

[0842] 1. The user enters the following information:

[0843] Title: Product Announcement

[0844] Content: Features and benefits of the new product

[0845] Charts: 10, 20, 30, 40, 50

[0846] At the same time, the emotion engine recognizes the user's emotions and detects that the user is feeling stressed.

[0847] 2. The server analyzes this input and extracts the following slide information:

[0848] python

[0849] slides_data = [

[0850] {'type': 'title', 'content': 'Product Announcement'},

[0851] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[0852] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[0853] ]

[0854] 3. The server initializes the presentation files and loads the standard template.

[0855] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[0856] 5. The server and emotion engine optimize the color scheme and font style for all slides based on the user's emotions. For example, they apply relaxing colors and font styles to a stressed user.

[0857] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[0858] In this way, the system of the present invention allows users to easily create high-quality presentation materials that are tailored to their emotions. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[0859] The following describes the processing flow.

[0860] Step 1:

[0861] The user inputs the necessary text and numerical information for the presentation materials into the system. For example, they might input "Title: Internal Meeting," "Content: Growth Strategy," and "Chart: 12, 19, 17, 22, 31."

[0862] Step 2:

[0863] The emotion engine analyzes user input patterns from the camera, microphone, and keyboard during user interaction to recognize the user's emotions. Specifically, it performs facial expression analysis, voice tone analysis, and keystroke analysis to determine whether the user is tense or relaxed.

[0864] Step 3:

[0865] The server receives information entered by the user and analyzes its contents. This allows it to extract the information that should be displayed on each slide (title, text, chart data, etc.).

[0866] Step 4:

[0867] The server initializes the new presentation file. During this process, it creates a pptx.Presentation object and prepares the new presentation.

[0868] Step 5:

[0869] The server loads a standard template. This standard template includes generic slide layouts, such as introduction and conclusion slides. Use this template to create a consistent presentation.

[0870] Step 6:

[0871] The server selects the layout for each slide based on the analysis results. For example, it sets a title for the first slide, adds text content to the next slide, and generates a graph based on the chart data for the slide after that.

[0872] Step 7:

[0873] The server adds the analyzed information to each slide. It adds a title to title slides, text to text slides, and graphs to chart slides, enriching the presentation materials.

[0874] Step 8:

[0875] The emotion engine optimizes the color scheme and font style of each slide based on the recognized user's emotions. For example, if the user is feeling nervous, it applies calming colors and a visually relaxing font style.

[0876] Step 9:

[0877] The server verifies that all slides are complete and saves the presentation file. For example, it saves it as "generated_presentation.pptx" and makes it available for users to download.

[0878] Step 10:

[0879] The device displays saved presentation files so that the user can view them. It also allows the user to download the presentations if needed.

[0880] This system allows users to easily create high-quality, visually optimized presentation materials, as well as generate presentations with appropriate designs that resonate with the user's emotions.

[0881] (Example 2)

[0882] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0883] Traditional presentation creation systems require users to manually select slide layouts and add content, which is time-consuming and laborious. Furthermore, they often lack optimization of color schemes and font styles based on user preferences, potentially resulting in visually unappealing presentations. Therefore, there is a need for a system that allows users to easily and efficiently create high-quality, visually appealing presentations.

[0884] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting string and numerical information input by the user, means for analyzing the user's emotions based on the collected input information, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, and means for optimizing the color scheme and font style of the generated presentation content based on the user's emotions. As a result, the user can generate high-quality, visually appealing presentation materials that are adapted to their emotions while saving time and effort.

[0885] A "user" is the entity that inputs data into the system and requests the generation of presentation materials.

[0886] "String and numerical information" refers to information that users input into the system and is fundamental information that constitutes the content of presentation materials.

[0887] "Means of collection" refers to functions for obtaining string and numerical information from users and importing it into the system.

[0888] "Means for analyzing emotions" refers to a function that identifies and analyzes the user's emotions at a given time based on the collected user input information.

[0889] The "means for selecting slide layouts" refer to a function that automatically selects the appropriate slide layout based on the analyzed information.

[0890] "Method for generating presentation materials" refers to a function that automatically creates presentation materials by adding analyzed information to a selected slide layout.

[0891] "Methods for optimizing color schemes and font styles" refers to features that automatically adjust the color schemes and font styles of generated presentation materials based on the user's emotions.

[0892] The system of the present invention supports the automatic generation of presentation materials and is implemented in the following steps.

[0893] Hardware and software to be used

[0894] The operation of the system involves servers, terminals, and users.

[0895] Server: The central server handles data analysis, slide layout selection, presentation material generation, and color optimization. The primary software tool used is the pptx presentation library.

[0896] Terminal: A device (such as a PC or smartphone) that has an interface for receiving user input. Input is performed through web forms or dedicated applications.

[0897] User: The entity that provides input information for a presentation.

[0898] System Operation Overview

[0899] The system automatically generates presentation materials based on user input. By using an emotion engine, it can apply color schemes and font styles that correspond to the user's emotional state.

[0900] Specific examples

[0901] 1. User input:

[0902] The user enters information in the following format:

[0903] Title: Product Launch Event

[0904] Content: Features and benefits of the new product

[0905] Charts: 10, 20, 30, 40, 50

[0906] 2. Emotion recognition:

[0907] The emotion engine analyzes the user's facial expressions, voice tone, and keystroke patterns to identify their emotions. For example, it can detect if the user is feeling tense while typing.

[0908] 3. Data Analysis:

[0909] The server analyzes the data received from the user and converts it into an appropriate format for slide information. For example, it might extract "Product Launch" as the title, "Features and Benefits of the New Product" as the content, and "10, 20, 30, 40, 50" as chart data.

[0910] 4. Presentation Initialization:

[0911] The server creates a pptx.Presentation object and initializes a new presentation file. It then loads a standard template and applies a consistent slide layout.

[0912] 5. Create slides and add content:

[0913] The server sequentially generates slides based on the analysis results. For example, it sets the title slide to "Product Launch" and adds a text slide titled "Features and Benefits of the New Product." For chart slides, it generates graphs based on the specified numerical data and adds them to the slides.

[0914] 6. Optimizing color scheme and font style:

[0915] The server works with an emotion engine to optimize the slide's color scheme and font style based on the user's emotions. For example, for a nervous user, it might apply a relaxing blue background and softer fonts.

[0916] 7. Save the file:

[0917] Finally, the server saves the generated presentation file as "generated_presentation.pptx". This file can be referenced and modified later.

[0918] In this way, the system of the present invention automatically generates high-quality, visually appealing presentation materials based on a small amount of information provided by the user and sentiment analysis. Users can save significant time and effort and efficiently prepare their presentations.

[0919] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0920] Step 1:

[0921] Users input information using the system's input interface. This input includes a title, text content, and chart data. For example, the input might be in the format: "Title: Product Launch," "Content: Features and Benefits of the New Product," and "Charts: 10, 20, 30, 40, 50." The input is submitted via a web form or dedicated application and sent to the server.

[0922] Step 2:

[0923] The server receives input data sent by the user and performs analysis. Specifically, it converts the input string and numerical information into an appropriate format. For example, it stores the title, text, and chart data in separate variables. Input: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart: 10, 20, 30, 40, 50". Output: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart Data: [10, 20, 30, 40, 50]".

[0924] Step 3:

[0925] The emotion engine analyzes the user's emotions. It identifies the user's emotional state by comprehensively analyzing data such as facial expressions, voice tone, and keystroke patterns. This analysis is used to optimize the presentation's color scheme and font style. Input: User's facial expression data, voice data, and keystroke data. Output: Analyzed user emotions (e.g., tension, relaxation, concentration).

[0926] Step 4:

[0927] The server initializes a new presentation file. Specifically, it creates a pptx.Presentation object and creates a new presentation. It also loads a standard template and applies a consistent slide layout. Input: None. Output: Initialized presentation file.

[0928] Step 5:

[0929] The server selects an appropriate slide layout based on the analysis results and generates the slides. For example, it sequentially creates a title slide, a text slide, and a chart slide. Input: "Title: Product Launch Event", "Content: Features and Benefits of the New Product", "Chart Data: [10, 20, 30, 40, 50]". Output: Generated slides.

[0930] Step 6:

[0931] The server adds the analyzed information to each slide. For example, it sets the title for the title slide, adds text content to the text slides, and generates and adds graphs using numerical data to the chart slides. Input: Title, text, chart data. Output: Slides with added information.

[0932] Step 7:

[0933] The server optimizes the slide's color scheme and font style based on the emotion engine's analysis results. For example, if the user is feeling stressed, it applies a relaxing blue background color and a softer font style. Input: Analyzed user emotional state, generated slide. Output: Optimized slide.

[0934] Step 8:

[0935] The server saves the generated presentation file. For example, it saves it with the filename "generated_presentation.pptx" so that it can be referenced and modified later. Input: Optimized presentation file. Output: Saved presentation file.

[0936] In this way, the entire system works together to analyze user input and automatically generate presentation materials that respond to emotions.

[0937] (Application Example 2)

[0938] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0939] In modern sales operations, visual and interactive presentations are essential for sales staff to effectively communicate the appeal of products to customers. However, manually creating presentation materials is not only time-consuming and laborious, but it is also difficult to instantly provide materials that reflect emotional elements. Furthermore, there is a challenge in that there are limited means of generating and presenting materials to customers in real time during in-store interactions.

[0940] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0941] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for recognizing emotions, means for adjusting the design of the presentation materials based on the user's emotions, and means for displaying the presentation materials in real time via smart glasses. This enables store employees to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[0942] "String and numerical information" refers to text and numerical data entered by the user.

[0943] "Means of analysis" refers to methods and techniques for processing user input data and extracting meaning and information.

[0944] "Slide layout" refers to the format and design used to visually organize and arrange information in presentation materials.

[0945] "Methods for optimizing color usage" refer to methods and techniques for adjusting colors to enhance the visual appeal of presentation materials.

[0946] "Means of recognizing emotions" refers to technologies and devices for detecting and understanding a user's emotional state.

[0947] "Methods for adjusting the design" refer to methods and techniques for changing the layout and style of presentation materials to convey information more effectively.

[0948] "Smart glasses" refer to wearable devices that display visual information on a screen and provide users with real-time information.

[0949] "Means of displaying presentation materials in real time" refers to methods and technologies for instantly displaying generated presentation materials on visual devices.

[0950] The system that realizes this application example provides a presentation material generation system that uses smart glasses to improve customer service efficiency in physical stores.

[0951] The system's program acquires user voice input, analyzes it, and generates appropriate presentation materials. Furthermore, it recognizes the user's emotions and adjusts the material design accordingly. Required hardware and software include:

[0952] Hardware: Smart glasses (typically Google Glass), microphone, camera, and built-in processor

[0953] Software: Speech recognition API (Google Speech-to-Text), sentiment analysis engine (Affectiva SDK), presentation creation library (python-pptx)

[0954] System Processing Overview

[0955] 1. Input collection:

[0956] The user inputs information by voice into the microphone equipped on the smart glasses. For example, they might input information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life."

[0957] 2. Recognition of emotions:

[0958] The smart glasses use a built-in camera and microphone to analyze the user's facial expressions and voice tone, identifying their emotional state. An emotion analysis engine is used to recognize emotions such as tension, excitement, and relaxation.

[0959] 3. Input analysis:

[0960] The server or terminal's built-in processor converts the audio data into text and analyzes the user's input. The analyzed text data is then extracted as information necessary for generating presentation materials.

[0961] 4. Presentation Initialization:

[0962] Initialize a new presentation file on the server or terminal and load a standard template. This is to ensure a consistent layout for all slides.

[0963] 5. Create slides and add content:

[0964] Based on the analysis results, appropriate information is added to each slide, generating slides that include product information, features, photographs, graphs, and more.

[0965] 6. Optimizing color usage:

[0966] Based on the emotional information recognized by the emotion engine, the slide's color scheme and font style are automatically adjusted. For example, if a user is feeling nervous, calming colors will be used to help them relax.

[0967] 7. Displaying presentation materials:

[0968] The final generated presentation materials are displayed on smart glasses, providing visual support to store staff as they explain products to customers in real time.

[0969] Specific example

[0970] 1. The user enters the following information:

[0971] Product name: New smartphone

[0972] Features: High-performance camera, long battery life

[0973] The smart glasses' emotion analysis engine recognizes the user's emotions and detects when the user is feeling stressed.

[0974] 2. The server analyzes this input and extracts the presentation slide information.

[0975] 3. Load the standard template and initialize the presentation file.

[0976] 4. Create slides based on the analysis results and add appropriate information to the slides.

[0977] 5. Optimize the color scheme and font style of slides based on user emotions.

[0978] 6. Finally, display the generated presentation materials on the smart glasses in real time.

[0979] Example of a prompt

[0980] "Product name: Smartphone A, Features: High-resolution camera, Long-lasting battery, Emotion: Stress"

[0981] "Product Name: Laptop B, Features: High-resolution display, Lightweight design, Emotion: Relaxing"

[0982] This allows store staff to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[0983] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0984] Step 1:

[0985] The user inputs information by voice into the microphone of the smart glasses. For example, they might input specific information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life" as voice input. The input voice data is then sent to the server.

[0986] Step 2:

[0987] The server receives the audio data and converts it into text data using a speech recognition API (e.g., Google Speech-to-Text). The audio data becomes text data and is converted into a parseable format. The text data is then returned to the server.

[0988] Step 3:

[0989] The server analyzes the converted text data and extracts user input information. This analysis process extracts product names, features, numerical information, etc., and organizes them as structured data necessary for generating presentation materials. As a result, the analyzed information is obtained in slide format.

[0990] Step 4:

[0991] The server recognizes the user's emotions via the smart glasses' camera and microphone. At this stage, an emotion analysis engine (e.g., Affectiva SDK) is used to identify the user's emotions from facial expressions and tone of voice. The user's emotion data is recorded on the server.

[0992] Step 5:

[0993] The server initializes a new presentation file. This process includes generating presentation objects. A standard template is loaded, and a consistent slide layout is prepared. An empty presentation file is created on the terminal.

[0994] Step 6:

[0995] Based on the analysis results, the server selects the appropriate layout for each slide and adds information to that layout. For example, the title slide will have the product name added, the text slides will have a feature description, and the chart slides will have numerical information added. Slides with information placed in the optimal layout are generated.

[0996] Step 7:

[0997] The server adjusts the slide design based on emotional data. If the user is nervous, the slide's color scheme is changed to a calmer one to create a more relaxed atmosphere. The colors and fonts of the generated slides are automatically adjusted.

[0998] Step 8:

[0999] The server sends the generated presentation materials to the smart glasses for real-time display. The presentation materials appear instantly on the smart glasses' display, making them available for the user to view. As a result of this process, the user can provide real-time visual support to customers.

[1000] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1001] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1002] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1003] [Third Embodiment]

[1004] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1005] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1006] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1007] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1008] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1009] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1010] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1011] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1012] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1013] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1014] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1015] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1016] The system of this invention aims to analyze user input, select an appropriate slide layout, add the analyzed information to the presentation materials, and further optimize the color scheme to generate the final presentation materials.

[1017] Overview of program processing

[1018] Step 1: Input Collection

[1019] The user provides input to the system. This input may take the following form, for example:

[1020] Title: Internal Meeting

[1021] Content: On growth strategy

[1022] Charts: 12, 19, 17, 22, 31

[1023] Step 2: Input Analysis

[1024] The server analyzes the user's input. Specifically, it extracts data to display on the slides based on the entered text and numerical information.

[1025] Step 3: Initialize the presentation

[1026] The server initializes the new presentation file and prepares to add slides.

[1027] Step 4: Load the standard template

[1028] The server loads standard template files and uses them to maintain consistency in the slide layout.

[1029] Step 5: Create slides

[1030] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, it generates title slides, text slides, chart slides, etc.

[1031] Step 6: Add content to the slide

[1032] The server adds information to each slide. For example, it sets a title for the title slide, adds details to the text slides, and includes graphs generated from numerical data in the chart slides.

[1033] Step 7: Optimize color usage

[1034] The server optimizes the color scheme for all generated slides, creating visually appealing presentation materials.

[1035] Step 8: Save the file

[1036] The server saves the final generated presentation materials. For example, it might save them with a filename like "generated_presentation.pptx".

[1037] Specific example

[1038] 1. The user enters the following information:

[1039] Title: Product Announcement

[1040] Content: Features and benefits of the new product

[1041] Charts: 10, 20, 30, 40, 50

[1042] 2. The server analyzes this input and extracts the following slide information:

[1043] python

[1044] slides_data = [

[1045] {'type': 'title', 'content': 'Product Announcement'},

[1046] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[1047] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[1048] ]

[1049] 3. The server initializes the presentation files and loads the standard template.

[1050] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[1051] 5. The server optimizes the color scheme for all slides.

[1052] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[1053] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[1054] The following describes the processing flow.

[1055] Step 1:

[1056] Users input strings and numerical information into the system. For example, they might input in the format: "Title: Internal Meeting", "Content: Growth Strategy", "Chart: 12, 19, 17, 22, 31".

[1057] Step 2:

[1058] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[1059] Step 3:

[1060] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[1061] Step 4:

[1062] The server loads a standard template, which includes frequently used layouts such as introduction and conclusion slides.

[1063] Step 5:

[1064] The server generates slides based on the analyzed slide information. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[1065] Step 6:

[1066] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[1067] Step 7:

[1068] The server optimizes the color scheme of the slide content. This includes adjusting the color settings of all slides and shapes to improve visual consistency and appearance.

[1069] Step 8:

[1070] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[1071] Step 9:

[1072] The device provides users with saved presentation files in a downloadable format. This allows users to view, edit, and present presentation materials on their own devices.

[1073] (Example 1)

[1074] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1075] Traditional presentation creation systems required users to manually select slide layouts and arrange content, which was time-consuming and labor-intensive. Furthermore, maintaining consistent color schemes and design was difficult, making it challenging to create high-quality presentation materials.

[1076] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1077] In this invention, the server includes means for analyzing string and numerical information entered by the user, means for selecting an appropriate slide layout based on the analyzed information, and means for saving the generated presentation materials. This enables the user to automatically create high-quality presentation materials.

[1078] "User" refers to the individual or group that creates the presentation materials.

[1079] "String information" refers to text data entered by the user and is used for the title and content description of the presentation.

[1080] "Numerical information" refers to numerical data entered by users and is primarily used to create charts and graphs.

[1081] "Analysis means" refers to the process of analyzing input string and numerical information to extract data for application to presentation materials.

[1082] "Slide layout selection means" refers to the process of automatically selecting the optimal layout for each slide of a presentation based on the analyzed information.

[1083] "Information addition method" refers to the process of incorporating the analyzed information into the selected slide layout and preparing it as a presentation document.

[1084] "Color optimization" refers to a process that automatically applies a visually appealing color scheme to all slides in a generated presentation.

[1085] "Storage method" refers to the process of saving the generated presentation materials in a file format so that users can use them later.

[1086] A "standard template" refers to a predefined design and layout template for use in presentation materials.

[1087] "Slide information" refers to the information about the content to be displayed on each slide, created based on the analyzed user input.

[1088] This invention is a system that analyzes user input, selects an appropriate slide layout, adds the analyzed information to the presentation materials, and further optimizes the color scheme to generate the final presentation materials.

[1089] Input Collection

[1090] First, the user inputs information that will form the basis of their presentation materials into the system. This input includes, for example, the presentation title, content, and the data to be used (numerical values ​​for charts). This input is submitted via a web form and sent to the server.

[1091] Input Analysis

[1092] The server parses the input data received from the user. Specifically, it uses a string parsing library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. This parsing extracts information for each slide, which is then stored in an internal data structure.

[1093] Initializing the presentation

[1094] Next, the server initializes the new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file. This process creates the basic structure of the presentation file.

[1095] Loading standard templates

[1096] The server loads standard template files, ensuring a consistent design and layout. These loaded templates are then used when creating subsequent slides.

[1097] Creating slides

[1098] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, title slides, text slides, chart slides, etc., are generated.

[1099] Adding content to slides

[1100] The server adds extracted information to each slide. Title slides are given titles, text slides are given detailed content, and chart slides include graphs generated from numerical data. This creates a practical and easy-to-understand presentation.

[1101] Color optimization

[1102] The server optimizes the color scheme for all generated slides to enhance visibility. Custom scripts are used to apply color patterns, ensuring visually appealing presentation materials.

[1103] Saving files

[1104] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[1105] Specific example

[1106] For example, the user enters the following:

[1107] Title: Product Announcement

[1108] Content: Features and benefits of the new product

[1109] Charts: 10, 20, 30, 40, 50

[1110] In this case, the server extracts the following slide information:

[1111] slides_data = [

[1112] {'type': 'title', 'content': 'Product Announcement'},

[1113] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[1114] {'type': 'chart', 'content': [10, 20, 30, 40, 50]}

[1115] ]

[1116] The server generates slides based on the analysis results, adds appropriate information to each slide, and optimizes the color scheme. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[1117] Example of a prompt

[1118] An example of a prompt to input into a generative AI model is as follows:

[1119] Write a Python program that automatically generates high-quality slides, selects the layout, and optimizes the color scheme, based on the presentation title, content, and data charts provided by the user.

[1120] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Because the entire process is automated, users can save a significant amount of time and effort.

[1121] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1122] Step 1:

[1123] The user inputs information that forms the basis of the presentation into the system. Specific inputs include the presentation title, content, and numerical data for charts. The data is submitted through the input form in the following format:

[1124] Title: Internal Meeting

[1125] Content: On growth strategy

[1126] Charts: 12, 19, 17, 22, 31

[1127] Input: Presentation information entered by the user in the form.

[1128] Output: Raw data sent to the server

[1129] Step 2:

[1130] The server receives input data sent by the user and performs analysis. Specifically, it uses a string analysis library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. Through string analysis, it extracts the title, content, and chart data.

[1131] win re

[1132] def parse_input(input_text):

[1133] title = re.search(r'Title: (.+)', input_text).group(1)

[1134] content = re.search(r'content: (.+)', input_text).group(1)

[1135] chart_data = re.search(r'Chart: (.+)', input_text).group(1).split(', ')

[1136] return {"title": title, "content": content, "chart_data": list(map(int, chart_data))}

[1137] Input: User input data received by the server

[1138] Output: Analyzed data for presentation

[1139] Step 3:

[1140] The server initializes a new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file.

[1141] from pptx import Presentation

[1142] prs = Presentation()

[1143] Input: None (Create a presentation instance)

[1144] Output: Initialized presentation file

[1145] Step 4:

[1146] The server loads a standard template file. In this step, the template presentation file is loaded, and new slides are created based on it.

[1147] template_prs = Presentation('standard_template.pptx')

[1148] Input: Template file

[1149] Output: Loaded template

[1150] Step 5:

[1151] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. Specifically, it generates title slides, text slides, and chart slides. It applies the appropriate layout to each slide and sets the necessary information.

[1152] Title slide

[1153] title_slide_layout = template_prs.slide_layouts[0]

[1154] slide = prs.slides.add_slide(title_slide_layout)

[1155] title = slide.shapes.title

[1156] title.text = parsed_data["title"]

[1157] Text slides

[1158] text_slide_layout = template_prs.slide_layouts[1]

[1159] slide = prs.slides.add_slide(text_slide_layout)

[1160] content = slide.placeholders[1]

[1161] content.text = parsed_data["content"]

[1162] Chart slides

[1163] chart_slide_layout = template_prs.slide_layouts[2]

[1164] slide = prs.slides.add_slide(chart_slide_layout)

[1165] chart_data = parsed_data["chart_data"]

[1166] Detailed implementation information regarding the addition of charts is omitted.

[1167] Input: Analyzed data for presentation

[1168] Output: Presentation file with added slides

[1169] Step 6:

[1170] The server adds information based on the analysis results to each slide. Title slides have a title, text slides have detailed content added, and chart slides include graphs generated from numerical data.

[1171] Setting the content of the title slide

[1172] title_slide_layout = template_prs.slide_layouts[0]

[1173] slide = prs.slides.add_slide(title_slide_layout)

[1174] title = slide.shapes.title

[1175] title.text = parsed_data["title"]

[1176] Text slide content settings

[1177] text_slide_layout = template_prs.slide_layouts[1]

[1178] slide = prs.slides.add_slide(text_slide_layout)

[1179] content = slide.placeholders[1]

[1180] content.text = parsed_data["content"]

[1181] Chart slide content settings

[1182] chart_slide_layout = template_prs.slide_layouts[2]

[1183] slide = prs.slides.add_slide(chart_slide_layout)

[1184] chart_data = parsed_data["chart_data"]

[1185] Detailed implementation information regarding the addition of charts is omitted.

[1186] Input: Analyzed data for presentation

[1187] Output: Slides with added content

[1188] Step 7:

[1189] The server optimizes the color scheme for all generated slides. For example, it uses custom scripts to apply color patterns and create visually appealing presentation materials.

[1190] def optimize_colors(presentation):

[1191] Code to change an existing color theme

[1192] for slide in presentation.slides:

[1193] Example of changing the color of all text in a slide

[1194] for display in slide.shapes:

[1195] if shape.has_text_frame:

[1196] for paragraph in shape.text_frame.paragraphs:

[1197] For run in paragraph.runs:

[1198] run.font.color.rgb = RGBColor(0, 0, 128) (Example setting: blue)

[1199] Input: Slide with added content

[1200] Output: Slides with optimized color scheme

[1201] Step 8:

[1202] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[1203] prs.save('generated_presentation.pptx')

[1204] Input: Slides with optimized color scheme

[1205] Output: Saved presentation file

[1206] This allows users to easily generate high-quality presentation materials through the system. Because the entire process is automated, significant time and effort can be saved.

[1207] (Application Example 1)

[1208] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1209] In recent years, creating presentation materials for business and educational settings has become an important task. However, conventional presentation creation tools require a significant amount of time and effort to optimize design and content. In particular, it is difficult to easily generate high-quality materials on smart devices, which leads to decreased work efficiency and stress. This invention aims to solve these problems by providing a system that links smart devices and servers to enable the effective creation of presentation materials.

[1210] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1211] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for transmitting data input from a smart device to the server, means for processing and generating presentation materials on the server side based on the data received by the server, and means for making the generated presentation materials downloadable to a smart device. This enables users to easily and quickly create professional presentation materials via their smart devices.

[1212] "User-inputted text and numerical information" refers to the text and numerical data provided by the user when generating presentation materials.

[1213] "Means of analysis" refers to the process and techniques of analyzing input data provided by users and extracting useful information from that data.

[1214] "Means for selecting an appropriate slide layout" refers to the process and technology of automatically determining the most effective slide layout based on analyzed information.

[1215] "Methods for generating presentation materials" refer to the process and techniques for adding analyzed information to a selected slide layout to create a final presentation file.

[1216] "Methods for optimizing color usage" refer to the processes and techniques for appropriately adjusting and balancing colors to improve the visual readability of a generated presentation.

[1217] "Means of transmitting data entered from a smart device to a server" refers to the process and technology of transmitting input data from personal electronic devices such as smartphones and tablets to a server via the Internet Protocol.

[1218] "A means of processing and generating presentation materials on the server side based on data received by the server" refers to the process and technology of analyzing the received data on the server and performing the necessary presentation material generation processing on the server side.

[1219] "Means for making generated presentation materials downloadable to smart devices" refers to the process and technology of providing presentation files generated on a server so that they can be downloaded to smart devices.

[1220] A "standard template" is a pre-configured template file designed to maintain consistency in the layout and design of presentation materials.

[1221] To implement this invention, it is necessary to build a system that links a smart device with a server. The main function of the system is to analyze data entered by the user and automatically generate an appropriate presentation.

[1222] Hardware and software configuration

[1223] hardware

[1224] Smart devices (e.g., smartphones, tablets)

[1225] Servers (e.g., cloud servers, dedicated servers)

[1226] software

[1227] Smart device application software: iOS Swift, Kotlin for Android

[1228] Server-side software: Python, Flask

[1229] Data analysis libraries: Pandas, Numpy

[1230] Graphics generation libraries: Matplotlib, Plotly

[1231] File manipulation library: python-pptx

[1232] Color optimization libraries: Colorthief, OpenCV

[1233] Process Overview

[1234] 1. Data Collection

[1235] Users input data into the application using smart devices. This input data includes presentation titles, content, chart data, and other similar information.

[1236] example:

[1237] Title: Monthly Report

[1238] Contents: Income and expenditure report and plan for next month

[1239] Charts: 150, 200, 250, 300, 350

[1240] 2. Sending data

[1241] The smart device sends the entered data to the server. This transmission takes place via the Internet protocol.

[1242] 3. Data Analysis

[1243] The server analyzes the received data and extracts the information necessary to generate the presentation. For example, it analyzes text and numerical data to determine the content of each slide.

[1244] 4. Presentation Generation

[1245] The server uses the python-pptx library to generate a new presentation file based on the analyzed information. It first loads a standard template and then selects an appropriate slide layout.

[1246] The chart data is converted into graphs using Matplotlib or Plotly and added to the slides.

[1247] 5. Optimizing color usage

[1248] The completed presentation's color scheme is optimized using Colorthief and OpenCV. This results in a visually appealing and easy-to-understand presentation.

[1249] 6. Saving and downloading files

[1250] Finally, the generated presentation materials are saved on the server and made available for users to download from their smart devices.

[1251] This system allows users to easily generate professional presentation materials based on their input data. In particular, using smart devices enables rapid material creation anywhere.

[1252] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1253] Step 1:

[1254] The user inputs the title, content, and chart data of the presentation materials into the application on their smart device. The input data is formatted in JSON or another format, resulting in the following:

[1255] input:

[1256] {

[1257] "Title": "Monthly Report",

[1258] "Contents": "Income and expenditure report and plan for next month",

[1259] "Chart": [150, 200, 250, 300, 350]

[1260] }

[1261] The output is sent to the server as formatted data.

[1262] Step 2:

[1263] The server receives data sent from smart devices and performs analysis.

[1264] Input: Formatted data

[1265] {

[1266] "Title": "Monthly Report",

[1267] "Contents": "Income and expenditure report and plan for next month",

[1268] "Chart": [150, 200, 250, 300, 350]

[1269] }

[1270] The server analyzes each field and converts it into slide information.

[1271] Data processing: Use Python's Pandas and Numpy to process string and numerical data.

[1272] output:

[1273] slides_data = [

[1274] {'type': 'title', 'content': 'Monthly report'},

[1275] {'type': 'text', 'content': 'Income and expenditure report and next month'},

[1276] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[1277] ]

[1278] Step 3:

[1279] The server initializes the new presentation file and loads a standard template. The standard template has a basic slide layout.

[1280] Software used: python-pptx

[1281] Input: Template file

[1282] Output: Presentation object

[1283] Step 4:

[1284] The server generates slides based on the analysis results. Here, you select and add appropriate slides such as title slides, text slides, and chart slides.

[1285] Input: Slide information

[1286] slides_data = [

[1287] {'type': 'title', 'content': 'Monthly report'},

[1288] {'type': 'text', 'content': 'Income and expenditure report and next month'},

[1289] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[1290] ]

[1291] Output: Presentation object with slides configured.

[1292] Step 5:

[1293] The server converts the chart data into a graph and adds it to the chart slide. Matplotlib and Plotly are used to create the chart.

[1294] Input: Chart data

[1295] [150, 200, 250, 300, 350]

[1296] Data processing: Convert numerical data into graphs and add them to presentations as images.

[1297] Output: Slide with added graph

[1298] Step 6:

[1299] The server optimizes the color scheme of all generated slides. It uses Colorthief and OpenCV to adjust the color balance.

[1300] Input: Presentation object with slides set up

[1301] Output: A presentation object with optimized color usage.

[1302] Step 7:

[1303] The server saves the final generated presentation file and makes it available for download from smart devices.

[1304] Software used: Flask (server-side)

[1305] Input: Completed presentation object

[1306] Output: Generate download link

[1307] Users can download the generated presentation materials to their smart devices using the download link.

[1308] This series of steps allows users to quickly and easily create professional presentation materials based on their input data.

[1309] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1310] The system of this invention aims to generate final presentation materials by analyzing user input, selecting an appropriate slide layout, adding the analyzed information to the presentation materials, and further optimizing the use of color. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the content and design of the presentation are adjusted according to the user's emotions.

[1311] Overview of program processing

[1312] Step 1: Input Collection

[1313] The user inputs string and numerical information into the system. This input is in the format, for example, "Title: Internal Meeting", "Content: Growth Strategy", and "Chart: 12, 19, 17, 22, 31".

[1314] Step 2: Recognizing Emotions

[1315] The emotion engine recognizes the user's emotions as they input data. It identifies the user's emotions by analyzing multiple input data points, such as the user's facial expressions, voice tone, and keystroke patterns.

[1316] Step 3: Input Analysis

[1317] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[1318] Step 4: Initialize the presentation

[1319] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[1320] Step 5: Load the standard template

[1321] The server loads standard templates and uses them to maintain consistency in slide layouts. These templates include frequently used layouts such as introduction and conclusion slides.

[1322] Step 6: Create slides

[1323] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[1324] Step 7: Add content to the slide

[1325] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[1326] Step 8: Optimize color usage

[1327] The server optimizes the color scheme of the slides. Based on the user's emotions recognized by the emotion engine, it automatically adjusts the slide's color scheme and font style. This creates visually appealing presentation materials.

[1328] Step 9: Save the file

[1329] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[1330] Specific example

[1331] 1. The user enters the following information:

[1332] Title: Product Announcement

[1333] Content: Features and benefits of the new product

[1334] Charts: 10, 20, 30, 40, 50

[1335] At the same time, the emotion engine recognizes the user's emotions and detects that the user is feeling stressed.

[1336] 2. The server analyzes this input and extracts the following slide information:

[1337] python

[1338] slides_data = [

[1339] {'type': 'title', 'content': 'Product Announcement'},

[1340] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[1341] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[1342] ]

[1343] 3. The server initializes the presentation files and loads the standard template.

[1344] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[1345] 5. The server and emotion engine optimize the color scheme and font style for all slides based on the user's emotions. For example, they apply relaxing colors and font styles to a stressed user.

[1346] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[1347] In this way, the system of the present invention allows users to easily create high-quality presentation materials that are tailored to their emotions. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[1348] The following describes the processing flow.

[1349] Step 1:

[1350] The user inputs the necessary text and numerical information for the presentation materials into the system. For example, they might input "Title: Internal Meeting," "Content: Growth Strategy," and "Chart: 12, 19, 17, 22, 31."

[1351] Step 2:

[1352] The emotion engine analyzes user input patterns from the camera, microphone, and keyboard during user interaction to recognize the user's emotions. Specifically, it performs facial expression analysis, voice tone analysis, and keystroke analysis to determine whether the user is tense or relaxed.

[1353] Step 3:

[1354] The server receives information entered by the user and analyzes its contents. This allows it to extract the information that should be displayed on each slide (title, text, chart data, etc.).

[1355] Step 4:

[1356] The server initializes the new presentation file. During this process, it creates a pptx.Presentation object and prepares the new presentation.

[1357] Step 5:

[1358] The server loads a standard template. This standard template includes generic slide layouts, such as introduction and conclusion slides. Use this template to create a consistent presentation.

[1359] Step 6:

[1360] The server selects the layout for each slide based on the analysis results. For example, it sets a title for the first slide, adds text content to the next slide, and generates a graph based on the chart data for the slide after that.

[1361] Step 7:

[1362] The server adds the analyzed information to each slide. It adds a title to title slides, text to text slides, and graphs to chart slides, enriching the presentation materials.

[1363] Step 8:

[1364] The emotion engine optimizes the color scheme and font style of each slide based on the recognized user's emotions. For example, if the user is feeling nervous, it applies calming colors and a visually relaxing font style.

[1365] Step 9:

[1366] The server verifies that all slides are complete and saves the presentation file. For example, it saves it as "generated_presentation.pptx" and makes it available for users to download.

[1367] Step 10:

[1368] The device displays saved presentation files so that the user can view them. It also allows the user to download the presentations if needed.

[1369] This system allows users to easily create high-quality, visually optimized presentation materials, as well as generate presentations with appropriate designs that resonate with the user's emotions.

[1370] (Example 2)

[1371] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1372] Traditional presentation creation systems require users to manually select slide layouts and add content, which is time-consuming and laborious. Furthermore, they often lack optimization of color schemes and font styles based on user preferences, potentially resulting in visually unappealing presentations. Therefore, there is a need for a system that allows users to easily and efficiently create high-quality, visually appealing presentations.

[1373] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting string and numerical information input by the user, means for analyzing the user's emotions based on the collected input information, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, and means for optimizing the color scheme and font style of the generated presentation content based on the user's emotions. As a result, the user can generate high-quality, visually appealing presentation materials that are adapted to their emotions while saving time and effort.

[1374] A "user" is the entity that inputs data into the system and requests the generation of presentation materials.

[1375] "String and numerical information" refers to information that users input into the system and is fundamental information that constitutes the content of presentation materials.

[1376] "Means of collection" refers to functions for obtaining string and numerical information from users and importing it into the system.

[1377] "Means for analyzing emotions" refers to a function that identifies and analyzes the user's emotions at a given time based on the collected user input information.

[1378] The "means for selecting slide layouts" refer to a function that automatically selects the appropriate slide layout based on the analyzed information.

[1379] "Method for generating presentation materials" refers to a function that automatically creates presentation materials by adding analyzed information to a selected slide layout.

[1380] "Methods for optimizing color schemes and font styles" refers to features that automatically adjust the color schemes and font styles of generated presentation materials based on the user's emotions.

[1381] The system of the present invention supports the automatic generation of presentation materials and is implemented in the following steps.

[1382] Hardware and software to be used

[1383] The operation of the system involves servers, terminals, and users.

[1384] Server: The central server handles data analysis, slide layout selection, presentation material generation, and color optimization. The primary software tool used is the pptx presentation library.

[1385] Terminal: A device (such as a PC or smartphone) that has an interface for receiving user input. Input is performed through web forms or dedicated applications.

[1386] User: The entity that provides input information for a presentation.

[1387] System Operation Overview

[1388] The system automatically generates presentation materials based on user input. By using an emotion engine, it can apply color schemes and font styles that correspond to the user's emotional state.

[1389] Specific examples

[1390] 1. User input:

[1391] The user enters information in the following format:

[1392] Title: Product Launch Event

[1393] Content: Features and benefits of the new product

[1394] Charts: 10, 20, 30, 40, 50

[1395] 2. Emotion recognition:

[1396] The emotion engine analyzes the user's facial expressions, voice tone, and keystroke patterns to identify their emotions. For example, it can detect if the user is feeling tense while typing.

[1397] 3. Data Analysis:

[1398] The server analyzes the data received from the user and converts it into an appropriate format for slide information. For example, it might extract "Product Launch" as the title, "Features and Benefits of the New Product" as the content, and "10, 20, 30, 40, 50" as chart data.

[1399] 4. Presentation Initialization:

[1400] The server creates a pptx.Presentation object and initializes a new presentation file. It then loads a standard template and applies a consistent slide layout.

[1401] 5. Create slides and add content:

[1402] The server sequentially generates slides based on the analysis results. For example, it sets the title slide to "Product Launch" and adds a text slide titled "Features and Benefits of the New Product." For chart slides, it generates graphs based on the specified numerical data and adds them to the slides.

[1403] 6. Optimizing color scheme and font style:

[1404] The server works with an emotion engine to optimize the slide's color scheme and font style based on the user's emotions. For example, for a nervous user, it might apply a relaxing blue background and softer fonts.

[1405] 7. Save the file:

[1406] Finally, the server saves the generated presentation file as "generated_presentation.pptx". This file can be referenced and modified later.

[1407] In this way, the system of the present invention automatically generates high-quality, visually appealing presentation materials based on a small amount of information provided by the user and sentiment analysis. Users can save significant time and effort and efficiently prepare their presentations.

[1408] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1409] Step 1:

[1410] Users input information using the system's input interface. This input includes a title, text content, and chart data. For example, the input might be in the format: "Title: Product Launch," "Content: Features and Benefits of the New Product," and "Charts: 10, 20, 30, 40, 50." The input is submitted via a web form or dedicated application and sent to the server.

[1411] Step 2:

[1412] The server receives input data sent by the user and performs analysis. Specifically, it converts the input string and numerical information into an appropriate format. For example, it stores the title, text, and chart data in separate variables. Input: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart: 10, 20, 30, 40, 50". Output: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart Data: [10, 20, 30, 40, 50]".

[1413] Step 3:

[1414] The emotion engine analyzes the user's emotions. It identifies the user's emotional state by comprehensively analyzing data such as facial expressions, voice tone, and keystroke patterns. This analysis is used to optimize the presentation's color scheme and font style. Input: User's facial expression data, voice data, and keystroke data. Output: Analyzed user emotions (e.g., tension, relaxation, concentration).

[1415] Step 4:

[1416] The server initializes a new presentation file. Specifically, it creates a pptx.Presentation object and creates a new presentation. It also loads a standard template and applies a consistent slide layout. Input: None. Output: Initialized presentation file.

[1417] Step 5:

[1418] The server selects an appropriate slide layout based on the analysis results and generates the slides. For example, it sequentially creates a title slide, a text slide, and a chart slide. Input: "Title: Product Launch Event", "Content: Features and Benefits of the New Product", "Chart Data: [10, 20, 30, 40, 50]". Output: Generated slides.

[1419] Step 6:

[1420] The server adds the analyzed information to each slide. For example, it sets the title for the title slide, adds text content to the text slides, and generates and adds graphs using numerical data to the chart slides. Input: Title, text, chart data. Output: Slides with added information.

[1421] Step 7:

[1422] The server optimizes the slide's color scheme and font style based on the emotion engine's analysis results. For example, if the user is feeling stressed, it applies a relaxing blue background color and a softer font style. Input: Analyzed user emotional state, generated slide. Output: Optimized slide.

[1423] Step 8:

[1424] The server saves the generated presentation file. For example, it saves it with the filename "generated_presentation.pptx" so that it can be referenced and modified later. Input: Optimized presentation file. Output: Saved presentation file.

[1425] In this way, the entire system works together to analyze user input and automatically generate presentation materials that respond to emotions.

[1426] (Application Example 2)

[1427] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1428] In modern sales operations, visual and interactive presentations are essential for sales staff to effectively communicate the appeal of products to customers. However, manually creating presentation materials is not only time-consuming and laborious, but it is also difficult to instantly provide materials that reflect emotional elements. Furthermore, there is a challenge in that there are limited means of generating and presenting materials to customers in real time during in-store interactions.

[1429] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1430] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for recognizing emotions, means for adjusting the design of the presentation materials based on the user's emotions, and means for displaying the presentation materials in real time via smart glasses. This enables store employees to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[1431] "String and numerical information" refers to text and numerical data entered by the user.

[1432] "Means of analysis" refers to methods and techniques for processing user input data and extracting meaning and information.

[1433] "Slide layout" refers to the format and design used to visually organize and arrange information in presentation materials.

[1434] "Methods for optimizing color usage" refer to methods and techniques for adjusting colors to enhance the visual appeal of presentation materials.

[1435] "Means of recognizing emotions" refers to technologies and devices for detecting and understanding a user's emotional state.

[1436] "Methods for adjusting the design" refer to methods and techniques for changing the layout and style of presentation materials to convey information more effectively.

[1437] "Smart glasses" refer to wearable devices that display visual information on a screen and provide users with real-time information.

[1438] "Means of displaying presentation materials in real time" refers to methods and technologies for instantly displaying generated presentation materials on visual devices.

[1439] The system that realizes this application example provides a presentation material generation system that uses smart glasses to improve customer service efficiency in physical stores.

[1440] The system's program acquires user voice input, analyzes it, and generates appropriate presentation materials. Furthermore, it recognizes the user's emotions and adjusts the material design accordingly. Required hardware and software include:

[1441] Hardware: Smart glasses (typically Google Glass), microphone, camera, and built-in processor

[1442] Software: Speech recognition API (Google Speech-to-Text), sentiment analysis engine (Affectiva SDK), presentation creation library (python-pptx)

[1443] System Processing Overview

[1444] 1. Input collection:

[1445] The user inputs information by voice into the microphone equipped on the smart glasses. For example, they might input information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life."

[1446] 2. Recognition of emotions:

[1447] The smart glasses use a built-in camera and microphone to analyze the user's facial expressions and voice tone, identifying their emotional state. An emotion analysis engine is used to recognize emotions such as tension, excitement, and relaxation.

[1448] 3. Input analysis:

[1449] The server or terminal's built-in processor converts the audio data into text and analyzes the user's input. The analyzed text data is then extracted as information necessary for generating presentation materials.

[1450] 4. Presentation Initialization:

[1451] Initialize a new presentation file on the server or terminal and load a standard template. This is to ensure a consistent layout for all slides.

[1452] 5. Create slides and add content:

[1453] Based on the analysis results, appropriate information is added to each slide, generating slides that include product information, features, photographs, graphs, and more.

[1454] 6. Optimizing color usage:

[1455] Based on the emotional information recognized by the emotion engine, the slide's color scheme and font style are automatically adjusted. For example, if a user is feeling nervous, calming colors will be used to help them relax.

[1456] 7. Displaying presentation materials:

[1457] The final generated presentation materials are displayed on smart glasses, providing visual support to store staff as they explain products to customers in real time.

[1458] Specific example

[1459] 1. The user enters the following information:

[1460] Product name: New smartphone

[1461] Features: High-performance camera, long battery life

[1462] The smart glasses' emotion analysis engine recognizes the user's emotions and detects when the user is feeling stressed.

[1463] 2. The server analyzes this input and extracts the presentation slide information.

[1464] 3. Load the standard template and initialize the presentation file.

[1465] 4. Create slides based on the analysis results and add appropriate information to the slides.

[1466] 5. Optimize the color scheme and font style of slides based on user emotions.

[1467] 6. Finally, display the generated presentation materials on the smart glasses in real time.

[1468] Example of a prompt

[1469] "Product name: Smartphone A, Features: High-resolution camera, Long-lasting battery, Emotion: Stress"

[1470] "Product Name: Laptop B, Features: High-resolution display, Lightweight design, Emotion: Relaxing"

[1471] This allows store staff to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[1472] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1473] Step 1:

[1474] The user inputs information by voice into the microphone of the smart glasses. For example, they might input specific information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life" as voice input. The input voice data is then sent to the server.

[1475] Step 2:

[1476] The server receives the audio data and converts it into text data using a speech recognition API (e.g., Google Speech-to-Text). The audio data becomes text data and is converted into a parseable format. The text data is then returned to the server.

[1477] Step 3:

[1478] The server analyzes the converted text data and extracts user input information. This analysis process extracts product names, features, numerical information, etc., and organizes them as structured data necessary for generating presentation materials. As a result, the analyzed information is obtained in slide format.

[1479] Step 4:

[1480] The server recognizes the user's emotions via the smart glasses' camera and microphone. At this stage, an emotion analysis engine (e.g., Affectiva SDK) is used to identify the user's emotions from facial expressions and tone of voice. The user's emotion data is recorded on the server.

[1481] Step 5:

[1482] The server initializes a new presentation file. This process includes generating presentation objects. A standard template is loaded, and a consistent slide layout is prepared. An empty presentation file is created on the terminal.

[1483] Step 6:

[1484] Based on the analysis results, the server selects the appropriate layout for each slide and adds information to that layout. For example, the title slide will have the product name added, the text slides will have a feature description, and the chart slides will have numerical information added. Slides with information placed in the optimal layout are generated.

[1485] Step 7:

[1486] The server adjusts the slide design based on emotional data. If the user is nervous, the slide's color scheme is changed to a calmer one to create a more relaxed atmosphere. The colors and fonts of the generated slides are automatically adjusted.

[1487] Step 8:

[1488] The server sends the generated presentation materials to the smart glasses for real-time display. The presentation materials appear instantly on the smart glasses' display, making them available for the user to view. As a result of this process, the user can provide real-time visual support to customers.

[1489] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1490] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1491] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1492] [Fourth Embodiment]

[1493] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1494] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1495] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1496] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1497] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1498] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1499] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1500] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1501] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1502] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1503] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1504] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1505] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1506] The system of this invention aims to analyze user input, select an appropriate slide layout, add the analyzed information to the presentation materials, and further optimize the color scheme to generate the final presentation materials.

[1507] Overview of program processing

[1508] Step 1: Input Collection

[1509] The user provides input to the system. This input may take the following form, for example:

[1510] Title: Internal Meeting

[1511] Content: On growth strategy

[1512] Charts: 12, 19, 17, 22, 31

[1513] Step 2: Input Analysis

[1514] The server analyzes the user's input. Specifically, it extracts data to display on the slides based on the entered text and numerical information.

[1515] Step 3: Initialize the presentation

[1516] The server initializes the new presentation file and prepares to add slides.

[1517] Step 4: Load the standard template

[1518] The server loads standard template files and uses them to maintain consistency in the slide layout.

[1519] Step 5: Create slides

[1520] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, it generates title slides, text slides, chart slides, etc.

[1521] Step 6: Add content to the slide

[1522] The server adds information to each slide. For example, it sets a title for the title slide, adds details to the text slides, and includes graphs generated from numerical data in the chart slides.

[1523] Step 7: Optimize color usage

[1524] The server optimizes the color scheme for all generated slides, creating visually appealing presentation materials.

[1525] Step 8: Save the file

[1526] The server saves the final generated presentation materials. For example, it might save them with a filename like "generated_presentation.pptx".

[1527] Specific example

[1528] 1. The user enters the following information:

[1529] Title: Product Announcement

[1530] Content: Features and benefits of the new product

[1531] Charts: 10, 20, 30, 40, 50

[1532] 2. The server analyzes this input and extracts the following slide information:

[1533] python

[1534] slides_data = [

[1535] {'type': 'title', 'content': 'Product Announcement'},

[1536] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[1537] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[1538] ]

[1539] 3. The server initializes the presentation files and loads the standard template.

[1540] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[1541] 5. The server optimizes the color scheme for all slides.

[1542] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[1543] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[1544] The following describes the processing flow.

[1545] Step 1:

[1546] Users input strings and numerical information into the system. For example, they might input in the format: "Title: Internal Meeting", "Content: Growth Strategy", "Chart: 12, 19, 17, 22, 31".

[1547] Step 2:

[1548] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[1549] Step 3:

[1550] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[1551] Step 4:

[1552] The server loads a standard template, which includes frequently used layouts such as introduction and conclusion slides.

[1553] Step 5:

[1554] The server generates slides based on the analyzed slide information. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[1555] Step 6:

[1556] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[1557] Step 7:

[1558] The server optimizes the color scheme of the slide content. This includes adjusting the color settings of all slides and shapes to improve visual consistency and appearance.

[1559] Step 8:

[1560] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[1561] Step 9:

[1562] The device provides users with saved presentation files in a downloadable format. This allows users to view, edit, and present presentation materials on their own devices.

[1563] (Example 1)

[1564] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1565] Traditional presentation creation systems required users to manually select slide layouts and arrange content, which was time-consuming and labor-intensive. Furthermore, maintaining consistent color schemes and design was difficult, making it challenging to create high-quality presentation materials.

[1566] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1567] In this invention, the server includes means for analyzing string and numerical information entered by the user, means for selecting an appropriate slide layout based on the analyzed information, and means for saving the generated presentation materials. This enables the user to automatically create high-quality presentation materials.

[1568] "User" refers to the individual or group that creates the presentation materials.

[1569] "String information" refers to text data entered by the user and is used for the title and content description of the presentation.

[1570] "Numerical information" refers to numerical data entered by users and is primarily used to create charts and graphs.

[1571] "Analysis means" refers to the process of analyzing input string and numerical information to extract data for application to presentation materials.

[1572] "Slide layout selection means" refers to the process of automatically selecting the optimal layout for each slide of a presentation based on the analyzed information.

[1573] "Information addition method" refers to the process of incorporating the analyzed information into the selected slide layout and preparing it as a presentation document.

[1574] "Color optimization" refers to a process that automatically applies a visually appealing color scheme to all slides in a generated presentation.

[1575] "Storage method" refers to the process of saving the generated presentation materials in a file format so that users can use them later.

[1576] A "standard template" refers to a predefined design and layout template for use in presentation materials.

[1577] "Slide information" refers to the information about the content to be displayed on each slide, created based on the analyzed user input.

[1578] This invention is a system that analyzes user input, selects an appropriate slide layout, adds the analyzed information to the presentation materials, and further optimizes the color scheme to generate the final presentation materials.

[1579] Input Collection

[1580] First, the user inputs information that will form the basis of their presentation materials into the system. This input includes, for example, the presentation title, content, and the data to be used (numerical values ​​for charts). This input is submitted via a web form and sent to the server.

[1581] Input Analysis

[1582] The server parses the input data received from the user. Specifically, it uses a string parsing library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. This parsing extracts information for each slide, which is then stored in an internal data structure.

[1583] Initializing the presentation

[1584] Next, the server initializes the new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file. This process creates the basic structure of the presentation file.

[1585] Loading standard templates

[1586] The server loads standard template files, ensuring a consistent design and layout. These loaded templates are then used when creating subsequent slides.

[1587] Creating slides

[1588] Based on the analysis results, the server selects an appropriate layout for each slide and generates the slides. For example, title slides, text slides, chart slides, etc., are generated.

[1589] Adding content to slides

[1590] The server adds extracted information to each slide. Title slides are given titles, text slides are given detailed content, and chart slides include graphs generated from numerical data. This creates a practical and easy-to-understand presentation.

[1591] Color optimization

[1592] The server optimizes the color scheme for all generated slides to enhance visibility. Custom scripts are used to apply color patterns, ensuring visually appealing presentation materials.

[1593] Saving files

[1594] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[1595] Specific example

[1596] For example, the user enters the following:

[1597] Title: Product Announcement

[1598] Content: Features and benefits of the new product

[1599] Charts: 10, 20, 30, 40, 50

[1600] In this case, the server extracts the following slide information:

[1601] slides_data = [

[1602] {'type': 'title', 'content': 'Product Announcement'},

[1603] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[1604] {'type': 'chart', 'content': [10, 20, 30, 40, 50]}

[1605] ]

[1606] The server generates slides based on the analysis results, adds appropriate information to each slide, and optimizes the color scheme. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[1607] Example of a prompt

[1608] An example of a prompt to input into a generative AI model is as follows:

[1609] Write a Python program that automatically generates high-quality slides, selects the layout, and optimizes the color scheme, based on the presentation title, content, and data charts provided by the user.

[1610] In this way, the system of the present invention allows users to easily create high-quality presentation materials. Because the entire process is automated, users can save a significant amount of time and effort.

[1611] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1612] Step 1:

[1613] The user inputs information that forms the basis of the presentation into the system. Specific inputs include the presentation title, content, and numerical data for charts. The data is submitted through the input form in the following format:

[1614] Title: Internal Meeting

[1615] Content: On growth strategy

[1616] Charts: 12, 19, 17, 22, 31

[1617] Input: Presentation information entered by the user in the form.

[1618] Output: Raw data sent to the server

[1619] Step 2:

[1620] The server receives input data sent by the user and performs analysis. Specifically, it uses a string analysis library (e.g., Python's re module) to convert the input information into data suitable for display in the presentation. Through string analysis, it extracts the title, content, and chart data.

[1621] win re

[1622] def parse_input(input_text):

[1623] title = re.search(r'Title: (.+)', input_text).group(1)

[1624] content = re.search(r'content: (.+)', input_text).group(1)

[1625] chart_data = re.search(r'Chart: (.+)', input_text).group(1).split(', ')

[1626] return {"title": title, "content": content, "chart_data": list(map(int, chart_data))}

[1627] Input: User input data received by the server

[1628] Output: Analyzed data for presentation

[1629] Step 3:

[1630] The server initializes a new presentation file. Here, the Python library python-pptx is used to generate a new PowerPoint file.

[1631] from pptx import Presentation

[1632] prs = Presentation()

[1633] Input: None (Create a presentation instance)

[1634] Output: Initialized presentation file

[1635] Step 4:

[1636] The server loads a standard template file. In this step, the template presentation file is loaded, and new slides are created based on it.

[1637] template_prs = Presentation('standard_template.pptx')

[1638] Input: Template file

[1639] Output: Loaded template

[1640] Step 5:

[1641] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. Specifically, it generates title slides, text slides, and chart slides. It applies the appropriate layout to each slide and sets the necessary information.

[1642] Title slide

[1643] title_slide_layout = template_prs.slide_layouts[0]

[1644] slide = prs.slides.add_slide(title_slide_layout)

[1645] title = slide.shapes.title

[1646] title.text = parsed_data["title"]

[1647] Text slides

[1648] text_slide_layout = template_prs.slide_layouts[1]

[1649] slide = prs.slides.add_slide(text_slide_layout)

[1650] content = slide.placeholders[1]

[1651] content.text = parsed_data["content"]

[1652] Chart slides

[1653] chart_slide_layout = template_prs.slide_layouts[2]

[1654] slide = prs.slides.add_slide(chart_slide_layout)

[1655] chart_data = parsed_data["chart_data"]

[1656] Detailed implementation information regarding the addition of charts is omitted.

[1657] Input: Analyzed data for presentation

[1658] Output: Presentation file with added slides

[1659] Step 6:

[1660] The server adds information based on the analysis results to each slide. Title slides have a title, text slides have detailed content added, and chart slides include graphs generated from numerical data.

[1661] Setting the content of the title slide

[1662] title_slide_layout = template_prs.slide_layouts[0]

[1663] slide = prs.slides.add_slide(title_slide_layout)

[1664] title = slide.shapes.title

[1665] title.text = parsed_data["title"]

[1666] Text slide content settings

[1667] text_slide_layout = template_prs.slide_layouts[1]

[1668] slide = prs.slides.add_slide(text_slide_layout)

[1669] content = slide.placeholders[1]

[1670] content.text = parsed_data["content"]

[1671] Chart slide content settings

[1672] chart_slide_layout = template_prs.slide_layouts[2]

[1673] slide = prs.slides.add_slide(chart_slide_layout)

[1674] chart_data = parsed_data["chart_data"]

[1675] Detailed implementation information regarding the addition of charts is omitted.

[1676] Input: Analyzed data for presentation

[1677] Output: Slides with added content

[1678] Step 7:

[1679] The server optimizes the color scheme for all generated slides. For example, it uses custom scripts to apply color patterns and create visually appealing presentation materials.

[1680] def optimize_colors(presentation):

[1681] Code to change an existing color theme

[1682] for slide in presentation.slides:

[1683] Example of changing the color of all text in a slide

[1684] for display in slide.shapes:

[1685] if shape.has_text_frame:

[1686] for paragraph in shape.text_frame.paragraphs:

[1687] For run in paragraph.runs:

[1688] run.font.color.rgb = RGBColor(0, 0, 128) (Example setting: blue)

[1689] Input: Slide with added content

[1690] Output: Slides with optimized color scheme

[1691] Step 8:

[1692] Finally, the server saves the generated presentation materials with the specified filename. This process allows the user to download and use the completed presentation materials.

[1693] prs.save('generated_presentation.pptx')

[1694] Input: Slides with optimized color scheme

[1695] Output: Saved presentation file

[1696] This allows users to easily generate high-quality presentation materials through the system. Because the entire process is automated, significant time and effort can be saved.

[1697] (Application Example 1)

[1698] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1699] In recent years, creating presentation materials for business and educational settings has become an important task. However, conventional presentation creation tools require a significant amount of time and effort to optimize design and content. In particular, it is difficult to easily generate high-quality materials on smart devices, which leads to decreased work efficiency and stress. This invention aims to solve these problems by providing a system that links smart devices and servers to enable the effective creation of presentation materials.

[1700] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1701] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for transmitting data input from a smart device to the server, means for processing and generating presentation materials on the server side based on the data received by the server, and means for making the generated presentation materials downloadable to a smart device. This enables users to easily and quickly create professional presentation materials via their smart devices.

[1702] "User-inputted text and numerical information" refers to the text and numerical data provided by the user when generating presentation materials.

[1703] "Means of analysis" refers to the process and techniques of analyzing input data provided by users and extracting useful information from that data.

[1704] "Means for selecting an appropriate slide layout" refers to the process and technology of automatically determining the most effective slide layout based on analyzed information.

[1705] "Methods for generating presentation materials" refer to the process and techniques for adding analyzed information to a selected slide layout to create a final presentation file.

[1706] "Methods for optimizing color usage" refer to the processes and techniques for appropriately adjusting and balancing colors to improve the visual readability of a generated presentation.

[1707] "Means of transmitting data entered from a smart device to a server" refers to the process and technology of transmitting input data from personal electronic devices such as smartphones and tablets to a server via the Internet Protocol.

[1708] "A means of processing and generating presentation materials on the server side based on data received by the server" refers to the process and technology of analyzing the received data on the server and performing the necessary presentation material generation processing on the server side.

[1709] "Means for making generated presentation materials downloadable to smart devices" refers to the process and technology of providing presentation files generated on a server so that they can be downloaded to smart devices.

[1710] A "standard template" is a pre-configured template file designed to maintain consistency in the layout and design of presentation materials.

[1711] To implement this invention, it is necessary to build a system that links a smart device with a server. The main function of the system is to analyze data entered by the user and automatically generate an appropriate presentation.

[1712] Hardware and software configuration

[1713] hardware

[1714] Smart devices (e.g., smartphones, tablets)

[1715] Servers (e.g., cloud servers, dedicated servers)

[1716] software

[1717] Smart device application software: iOS Swift, Kotlin for Android

[1718] Server-side software: Python, Flask

[1719] Data analysis libraries: Pandas, Numpy

[1720] Graphics generation libraries: Matplotlib, Plotly

[1721] File manipulation library: python-pptx

[1722] Color optimization libraries: Colorthief, OpenCV

[1723] Process Overview

[1724] 1. Data Collection

[1725] Users input data into the application using smart devices. This input data includes presentation titles, content, chart data, and other similar information.

[1726] example:

[1727] Title: Monthly Report

[1728] Contents: Income and expenditure report and plan for next month

[1729] Charts: 150, 200, 250, 300, 350

[1730] 2. Sending data

[1731] The smart device sends the entered data to the server. This transmission takes place via the Internet protocol.

[1732] 3. Data Analysis

[1733] The server analyzes the received data and extracts the information necessary to generate the presentation. For example, it analyzes text and numerical data to determine the content of each slide.

[1734] 4. Presentation Generation

[1735] The server uses the python-pptx library to generate a new presentation file based on the analyzed information. It first loads a standard template and then selects an appropriate slide layout.

[1736] The chart data is converted into graphs using Matplotlib or Plotly and added to the slides.

[1737] 5. Optimizing color usage

[1738] The completed presentation's color scheme is optimized using Colorthief and OpenCV. This results in a visually appealing and easy-to-understand presentation.

[1739] 6. Saving and downloading files

[1740] Finally, the generated presentation materials are saved on the server and made available for users to download from their smart devices.

[1741] This system allows users to easily generate professional presentation materials based on their input data. In particular, using smart devices enables rapid material creation anywhere.

[1742] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1743] Step 1:

[1744] The user inputs the title, content, and chart data of the presentation materials into the application on their smart device. The input data is formatted in JSON or another format, resulting in the following:

[1745] input:

[1746] {

[1747] "Title": "Monthly Report",

[1748] "Contents": "Income and expenditure report and plan for next month",

[1749] "Chart": [150, 200, 250, 300, 350]

[1750] }

[1751] The output is sent to the server as formatted data.

[1752] Step 2:

[1753] The server receives data sent from smart devices and performs analysis.

[1754] Input: Formatted data

[1755] {

[1756] "Title": "Monthly Report",

[1757] "Contents": "Income and expenditure report and plan for next month",

[1758] "Chart": [150, 200, 250, 300, 350]

[1759] }

[1760] The server analyzes each field and converts it into slide information.

[1761] Data processing: Use Python's Pandas and Numpy to process string and numerical data.

[1762] output:

[1763] slides_data = [

[1764] {'type': 'title', 'content': 'Monthly report'},

[1765] {'type': 'text', 'content': 'Income and expenditure report and next month'},

[1766] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[1767] ]

[1768] Step 3:

[1769] The server initializes the new presentation file and loads a standard template. The standard template has a basic slide layout.

[1770] Software used: python-pptx

[1771] Input: Template file

[1772] Output: Presentation object

[1773] Step 4:

[1774] The server generates slides based on the analysis results. Here, you select and add appropriate slides such as title slides, text slides, and chart slides.

[1775] Input: Slide information

[1776] slides_data = [

[1777] {'type': 'title', 'content': 'Monthly report'},

[1778] {'type': 'text', 'content': 'Income and expenditure report and next month'},

[1779] {'type': 'chart', 'content': [150, 200, 250, 300, 350]},

[1780] ]

[1781] Output: Presentation object with slides configured.

[1782] Step 5:

[1783] The server converts the chart data into a graph and adds it to the chart slide. Matplotlib and Plotly are used to create the chart.

[1784] Input: Chart data

[1785] [150, 200, 250, 300, 350]

[1786] Data processing: Convert numerical data into graphs and add them to presentations as images.

[1787] Output: Slide with added graph

[1788] Step 6:

[1789] The server optimizes the color scheme of all generated slides. It uses Colorthief and OpenCV to adjust the color balance.

[1790] Input: Presentation object with slides set up

[1791] Output: A presentation object with optimized color usage.

[1792] Step 7:

[1793] The server saves the final generated presentation file and makes it available for download from smart devices.

[1794] Software used: Flask (server-side)

[1795] Input: Completed presentation object

[1796] Output: Generate download link

[1797] Users can download the generated presentation materials to their smart devices using the download link.

[1798] This series of steps allows users to quickly and easily create professional presentation materials based on their input data.

[1799] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1800] The system of this invention aims to generate final presentation materials by analyzing user input, selecting an appropriate slide layout, adding the analyzed information to the presentation materials, and further optimizing the use of color. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the content and design of the presentation are adjusted according to the user's emotions.

[1801] Overview of program processing

[1802] Step 1: Input Collection

[1803] The user inputs string and numerical information into the system. This input is in the format, for example, "Title: Internal Meeting", "Content: Growth Strategy", and "Chart: 12, 19, 17, 22, 31".

[1804] Step 2: Recognizing Emotions

[1805] The emotion engine recognizes the user's emotions as they input data. It identifies the user's emotions by analyzing multiple input data points, such as the user's facial expressions, voice tone, and keystroke patterns.

[1806] Step 3: Input Analysis

[1807] The server receives user input and parses it. Specifically, it converts the entered string and numerical information into an appropriate format and extracts it as slide information.

[1808] Step 4: Initialize the presentation

[1809] The server initializes a new presentation file. This involves creating a pptx.Presentation object and then creating a new presentation.

[1810] Step 5: Load the standard template

[1811] The server loads standard templates and uses them to maintain consistency in slide layouts. These templates include frequently used layouts such as introduction and conclusion slides.

[1812] Step 6: Create slides

[1813] Based on the analysis results, the server selects the appropriate layout for each slide and generates the slides. For example, it sequentially creates title slides, text slides, chart slides, and so on.

[1814] Step 7: Add content to the slide

[1815] The server selects the appropriate layout for each slide and adds the analyzed information. For example, it sets a title for title slides and adds content to text slides. For chart slides, it generates a graph and adds it as an image to the slide.

[1816] Step 8: Optimize color usage

[1817] The server optimizes the color scheme of the slides. Based on the user's emotions recognized by the emotion engine, it automatically adjusts the slide's color scheme and font style. This creates visually appealing presentation materials.

[1818] Step 9: Save the file

[1819] The server saves the generated presentation file. For example, saving it with the filename "generated_presentation.pptx" allows for later reference and modification.

[1820] Specific example

[1821] 1. The user enters the following information:

[1822] Title: Product Announcement

[1823] Content: Features and benefits of the new product

[1824] Charts: 10, 20, 30, 40, 50

[1825] At the same time, the emotion engine recognizes the user's emotions and detects that the user is feeling stressed.

[1826] 2. The server analyzes this input and extracts the following slide information:

[1827] python

[1828] slides_data = [

[1829] {'type': 'title', 'content': 'Product Announcement'},

[1830] {'type': 'text', 'content': 'About the features and benefits of the new product'},

[1831] {'type': 'chart', 'content': [10, 20, 30, 40, 50]},

[1832] ]

[1833] 3. The server initializes the presentation files and loads the standard template.

[1834] 4. The server creates slides based on the analysis results and adds appropriate information to each slide.

[1835] 5. The server and emotion engine optimize the color scheme and font style for all slides based on the user's emotions. For example, they apply relaxing colors and font styles to a stressed user.

[1836] 6. Finally, the server saves the presentation materials with the filename "generated_presentation.pptx".

[1837] In this way, the system of the present invention allows users to easily create high-quality presentation materials that are tailored to their emotions. Since the entire process, from analysis and layout selection to content addition and color optimization, is automated, users can save a significant amount of time and effort.

[1838] The following describes the processing flow.

[1839] Step 1:

[1840] The user inputs the necessary text and numerical information for the presentation materials into the system. For example, they might input "Title: Internal Meeting," "Content: Growth Strategy," and "Chart: 12, 19, 17, 22, 31."

[1841] Step 2:

[1842] The emotion engine analyzes user input patterns from the camera, microphone, and keyboard during user interaction to recognize the user's emotions. Specifically, it performs facial expression analysis, voice tone analysis, and keystroke analysis to determine whether the user is tense or relaxed.

[1843] Step 3:

[1844] The server receives information entered by the user and analyzes its contents. This allows it to extract the information that should be displayed on each slide (title, text, chart data, etc.).

[1845] Step 4:

[1846] The server initializes the new presentation file. During this process, it creates a pptx.Presentation object and prepares the new presentation.

[1847] Step 5:

[1848] The server loads a standard template. This standard template includes generic slide layouts, such as introduction and conclusion slides. Use this template to create a consistent presentation.

[1849] Step 6:

[1850] The server selects the layout for each slide based on the analysis results. For example, it sets a title for the first slide, adds text content to the next slide, and generates a graph based on the chart data for the slide after that.

[1851] Step 7:

[1852] The server adds the analyzed information to each slide. It adds a title to title slides, text to text slides, and graphs to chart slides, enriching the presentation materials.

[1853] Step 8:

[1854] The emotion engine optimizes the color scheme and font style of each slide based on the recognized user's emotions. For example, if the user is feeling nervous, it applies calming colors and a visually relaxing font style.

[1855] Step 9:

[1856] The server verifies that all slides are complete and saves the presentation file. For example, it saves it as "generated_presentation.pptx" and makes it available for users to download.

[1857] Step 10:

[1858] The device displays saved presentation files so that the user can view them. It also allows the user to download the presentations if needed.

[1859] This system allows users to easily create high-quality, visually optimized presentation materials, as well as generate presentations with appropriate designs that resonate with the user's emotions.

[1860] (Example 2)

[1861] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1862] Traditional presentation creation systems require users to manually select slide layouts and add content, which is time-consuming and laborious. Furthermore, they often lack optimization of color schemes and font styles based on user preferences, potentially resulting in visually unappealing presentations. Therefore, there is a need for a system that allows users to easily and efficiently create high-quality, visually appealing presentations.

[1863] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting string and numerical information input by the user, means for analyzing the user's emotions based on the collected input information, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, and means for optimizing the color scheme and font style of the generated presentation content based on the user's emotions. As a result, the user can generate high-quality, visually appealing presentation materials that are adapted to their emotions while saving time and effort.

[1864] A "user" is the entity that inputs data into the system and requests the generation of presentation materials.

[1865] "String and numerical information" refers to information that users input into the system and is fundamental information that constitutes the content of presentation materials.

[1866] "Means of collection" refers to functions for obtaining string and numerical information from users and importing it into the system.

[1867] "Means for analyzing emotions" refers to a function that identifies and analyzes the user's emotions at a given time based on the collected user input information.

[1868] The "means for selecting slide layouts" refer to a function that automatically selects the appropriate slide layout based on the analyzed information.

[1869] "Method for generating presentation materials" refers to a function that automatically creates presentation materials by adding analyzed information to a selected slide layout.

[1870] "Methods for optimizing color schemes and font styles" refers to features that automatically adjust the color schemes and font styles of generated presentation materials based on the user's emotions.

[1871] The system of the present invention supports the automatic generation of presentation materials and is implemented in the following steps.

[1872] Hardware and software to be used

[1873] The operation of the system involves servers, terminals, and users.

[1874] Server: The central server handles data analysis, slide layout selection, presentation material generation, and color optimization. The primary software tool used is the pptx presentation library.

[1875] Terminal: A device (such as a PC or smartphone) that has an interface for receiving user input. Input is performed through web forms or dedicated applications.

[1876] User: The entity that provides input information for a presentation.

[1877] System Operation Overview

[1878] The system automatically generates presentation materials based on user input. By using an emotion engine, it can apply color schemes and font styles that correspond to the user's emotional state.

[1879] Specific examples

[1880] 1. User input:

[1881] The user enters information in the following format:

[1882] Title: Product Launch Event

[1883] Content: Features and benefits of the new product

[1884] Charts: 10, 20, 30, 40, 50

[1885] 2. Emotion recognition:

[1886] The emotion engine analyzes the user's facial expressions, voice tone, and keystroke patterns to identify their emotions. For example, it can detect if the user is feeling tense while typing.

[1887] 3. Data Analysis:

[1888] The server analyzes the data received from the user and converts it into an appropriate format for slide information. For example, it might extract "Product Launch" as the title, "Features and Benefits of the New Product" as the content, and "10, 20, 30, 40, 50" as chart data.

[1889] 4. Presentation Initialization:

[1890] The server creates a pptx.Presentation object and initializes a new presentation file. It then loads a standard template and applies a consistent slide layout.

[1891] 5. Create slides and add content:

[1892] The server sequentially generates slides based on the analysis results. For example, it sets the title slide to "Product Launch" and adds a text slide titled "Features and Benefits of the New Product." For chart slides, it generates graphs based on the specified numerical data and adds them to the slides.

[1893] 6. Optimizing color scheme and font style:

[1894] The server works with an emotion engine to optimize the slide's color scheme and font style based on the user's emotions. For example, for a nervous user, it might apply a relaxing blue background and softer fonts.

[1895] 7. Save the file:

[1896] Finally, the server saves the generated presentation file as "generated_presentation.pptx". This file can be referenced and modified later.

[1897] In this way, the system of the present invention automatically generates high-quality, visually appealing presentation materials based on a small amount of information provided by the user and sentiment analysis. Users can save significant time and effort and efficiently prepare their presentations.

[1898] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1899] Step 1:

[1900] Users input information using the system's input interface. This input includes a title, text content, and chart data. For example, the input might be in the format: "Title: Product Launch," "Content: Features and Benefits of the New Product," and "Charts: 10, 20, 30, 40, 50." The input is submitted via a web form or dedicated application and sent to the server.

[1901] Step 2:

[1902] The server receives input data sent by the user and performs analysis. Specifically, it converts the input string and numerical information into an appropriate format. For example, it stores the title, text, and chart data in separate variables. Input: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart: 10, 20, 30, 40, 50". Output: "Title: Product Launch Event" "Content: Features and Benefits of the New Product" "Chart Data: [10, 20, 30, 40, 50]".

[1903] Step 3:

[1904] The emotion engine analyzes the user's emotions. It identifies the user's emotional state by comprehensively analyzing data such as facial expressions, voice tone, and keystroke patterns. This analysis is used to optimize the presentation's color scheme and font style. Input: User's facial expression data, voice data, and keystroke data. Output: Analyzed user emotions (e.g., tension, relaxation, concentration).

[1905] Step 4:

[1906] The server initializes a new presentation file. Specifically, it creates a pptx.Presentation object and creates a new presentation. It also loads a standard template and applies a consistent slide layout. Input: None. Output: Initialized presentation file.

[1907] Step 5:

[1908] The server selects an appropriate slide layout based on the analysis results and generates the slides. For example, it sequentially creates a title slide, a text slide, and a chart slide. Input: "Title: Product Launch Event", "Content: Features and Benefits of the New Product", "Chart Data: [10, 20, 30, 40, 50]". Output: Generated slides.

[1909] Step 6:

[1910] The server adds the analyzed information to each slide. For example, it sets the title for the title slide, adds text content to the text slides, and generates and adds graphs using numerical data to the chart slides. Input: Title, text, chart data. Output: Slides with added information.

[1911] Step 7:

[1912] The server optimizes the slide's color scheme and font style based on the emotion engine's analysis results. For example, if the user is feeling stressed, it applies a relaxing blue background color and a softer font style. Input: Analyzed user emotional state, generated slide. Output: Optimized slide.

[1913] Step 8:

[1914] The server saves the generated presentation file. For example, it saves it with the filename "generated_presentation.pptx" so that it can be referenced and modified later. Input: Optimized presentation file. Output: Saved presentation file.

[1915] In this way, the entire system works together to analyze user input and automatically generate presentation materials that respond to emotions.

[1916] (Application Example 2)

[1917] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1918] In modern sales operations, visual and interactive presentations are essential for sales staff to effectively communicate the appeal of products to customers. However, manually creating presentation materials is not only time-consuming and laborious, but it is also difficult to instantly provide materials that reflect emotional elements. Furthermore, there is a challenge in that there are limited means of generating and presenting materials to customers in real time during in-store interactions.

[1919] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1920] In this invention, the server includes means for analyzing string and numerical information input by the user, means for selecting an appropriate slide layout based on the analyzed information, means for generating presentation materials by adding the analyzed information to the selected slide layout, means for optimizing the color scheme of the generated presentation, means for recognizing emotions, means for adjusting the design of the presentation materials based on the user's emotions, and means for displaying the presentation materials in real time via smart glasses. This enables store employees to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[1921] "String and numerical information" refers to text and numerical data entered by the user.

[1922] "Means of analysis" refers to methods and techniques for processing user input data and extracting meaning and information.

[1923] "Slide layout" refers to the format and design used to visually organize and arrange information in presentation materials.

[1924] "Methods for optimizing color usage" refer to methods and techniques for adjusting colors to enhance the visual appeal of presentation materials.

[1925] "Means of recognizing emotions" refers to technologies and devices for detecting and understanding a user's emotional state.

[1926] "Methods for adjusting the design" refer to methods and techniques for changing the layout and style of presentation materials to convey information more effectively.

[1927] "Smart glasses" refer to wearable devices that display visual information on a screen and provide users with real-time information.

[1928] "Means of displaying presentation materials in real time" refers to methods and technologies for instantly displaying generated presentation materials on visual devices.

[1929] The system that realizes this application example provides a presentation material generation system that uses smart glasses to improve customer service efficiency in physical stores.

[1930] The system's program acquires user voice input, analyzes it, and generates appropriate presentation materials. Furthermore, it recognizes the user's emotions and adjusts the material design accordingly. Required hardware and software include:

[1931] Hardware: Smart glasses (typically Google Glass), microphone, camera, and built-in processor

[1932] Software: Speech recognition API (Google Speech-to-Text), sentiment analysis engine (Affectiva SDK), presentation creation library (python-pptx)

[1933] System Processing Overview

[1934] 1. Input collection:

[1935] The user inputs information by voice into the microphone equipped on the smart glasses. For example, they might input information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life."

[1936] 2. Recognition of emotions:

[1937] The smart glasses use a built-in camera and microphone to analyze the user's facial expressions and voice tone, identifying their emotional state. An emotion analysis engine is used to recognize emotions such as tension, excitement, and relaxation.

[1938] 3. Input analysis:

[1939] The server or terminal's built-in processor converts the audio data into text and analyzes the user's input. The analyzed text data is then extracted as information necessary for generating presentation materials.

[1940] 4. Presentation Initialization:

[1941] Initialize a new presentation file on the server or terminal and load a standard template. This is to ensure a consistent layout for all slides.

[1942] 5. Create slides and add content:

[1943] Based on the analysis results, appropriate information is added to each slide, generating slides that include product information, features, photographs, graphs, and more.

[1944] 6. Optimizing color usage:

[1945] Based on the emotional information recognized by the emotion engine, the slide's color scheme and font style are automatically adjusted. For example, if a user is feeling nervous, calming colors will be used to help them relax.

[1946] 7. Displaying presentation materials:

[1947] The final generated presentation materials are displayed on smart glasses, providing visual support to store staff as they explain products to customers in real time.

[1948] Specific example

[1949] 1. The user enters the following information:

[1950] Product name: New smartphone

[1951] Features: High-performance camera, long battery life

[1952] The smart glasses' emotion analysis engine recognizes the user's emotions and detects when the user is feeling stressed.

[1953] 2. The server analyzes this input and extracts the presentation slide information.

[1954] 3. Load the standard template and initialize the presentation file.

[1955] 4. Create slides based on the analysis results and add appropriate information to the slides.

[1956] 5. Optimize the color scheme and font style of slides based on user emotions.

[1957] 6. Finally, display the generated presentation materials on the smart glasses in real time.

[1958] Example of a prompt

[1959] "Product name: Smartphone A, Features: High-resolution camera, Long-lasting battery, Emotion: Stress"

[1960] "Product Name: Laptop B, Features: High-resolution display, Lightweight design, Emotion: Relaxing"

[1961] This allows store staff to provide customers with visually and emotionally responsive presentation materials in real time, significantly improving the quality and efficiency of customer service.

[1962] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1963] Step 1:

[1964] The user inputs information by voice into the microphone of the smart glasses. For example, they might input specific information such as "Product name: New smartphone" and "Features: High-performance camera, long battery life" as voice input. The input voice data is then sent to the server.

[1965] Step 2:

[1966] The server receives the audio data and converts it into text data using a speech recognition API (e.g., Google Speech-to-Text). The audio data becomes text data and is converted into a parseable format. The text data is then returned to the server.

[1967] Step 3:

[1968] The server analyzes the converted text data and extracts user input information. This analysis process extracts product names, features, numerical information, etc., and organizes them as structured data necessary for generating presentation materials. As a result, the analyzed information is obtained in slide format.

[1969] Step 4:

[1970] The server recognizes the user's emotions via the smart glasses' camera and microphone. At this stage, an emotion analysis engine (e.g., Affectiva SDK) is used to identify the user's emotions from facial expressions and tone of voice. The user's emotion data is recorded on the server.

[1971] Step 5:

[1972] The server initializes a new presentation file. This process includes generating presentation objects. A standard template is loaded, and a consistent slide layout is prepared. An empty presentation file is created on the terminal.

[1973] Step 6:

[1974] Based on the analysis results, the server selects the appropriate layout for each slide and adds information to that layout. For example, the title slide will have the product name added, the text slides will have a feature description, and the chart slides will have numerical information added. Slides with information placed in the optimal layout are generated.

[1975] Step 7:

[1976] The server adjusts the slide design based on emotional data. If the user is nervous, the slide's color scheme is changed to a calmer one to create a more relaxed atmosphere. The colors and fonts of the generated slides are automatically adjusted.

[1977] Step 8:

[1978] The server sends the generated presentation materials to the smart glasses for real-time display. The presentation materials appear instantly on the smart glasses' display, making them available for the user to view. As a result of this process, the user can provide real-time visual support to customers.

[1979] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1980] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1981] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1982] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1983] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1984] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1985] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1986] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1987] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1988] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1989] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1990] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1991] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1992] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1993] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1994] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1995] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1996] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1997] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1998] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1999] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[2000] The following is further disclosed regarding the embodiments described above.

[2001] (Claim 1)

[2002] A means for analyzing string and numerical information entered by the user,

[2003] A means for selecting an appropriate slide layout based on the analyzed information,

[2004] A means of generating presentation materials by adding analyzed information to the selected slide layout,

[2005] A means to optimize the color scheme of the generated presentation,

[2006] A system that includes this.

[2007] (Claim 2)

[2008] The system according to claim 1, characterized by analyzing string and numerical information entered by the user and extracting slide information.

[2009] (Claim 3)

[2010] The system according to claim 1, characterized by preloading standard templates and applying them to generated presentation materials.

[2011] "Example 1"

[2012] (Claim 1)

[2013] A means for analyzing string and numerical information entered by the user,

[2014] A means for selecting an appropriate slide layout based on the analyzed information,

[2015] A means of generating presentation materials by adding analyzed information to the selected slide layout,

[2016] A means to optimize the color scheme of the generated presentation,

[2017] A means of saving the generated presentation materials,

[2018] A system that includes this.

[2019] (Claim 2)

[2020] The system according to claim 1, characterized by analyzing string and numerical information entered by the user and extracting slide information.

[2021] (Claim 3)

[2022] The system according to claim 1, characterized by preloading standard templates and applying them to generated presentation materials.

[2023] "Application Example 1"

[2024] (Claim 1)

[2025] A means for analyzing string and numerical information entered by the user,

[2026] A means for selecting an appropriate slide layout based on the analyzed information,

[2027] A means of generating presentation materials by adding analyzed information to the selected slide layout,

[2028] A means to optimize the color scheme of the generated presentation,

[2029] A means of sending data entered from a smart device to a server,

[2030] A method for processing and generating presentation materials on the server side based on data received by the server,

[2031] A means to make the generated presentation materials downloadable to smart devices,

[2032] A system that includes this.

[2033] (Claim 2)

[2034] The system according to claim 1, characterized by analyzing string and numerical information entered by the user and extracting slide information.

[2035] (Claim 3)

[2036] The system according to claim 1, characterized by preloading standard templates and applying them to generated presentation materials.

[2037] "Example 2 of combining an emotion engine"

[2038] (Claim 1)

[2039] A means for collecting string and numerical information entered by the user,

[2040] A means of analyzing user emotions based on collected input information,

[2041] A means for selecting an appropriate slide layout based on the analyzed information,

[2042] A means of generating presentation materials by adding analyzed information to the selected slide layout,

[2043] A method for optimizing the color scheme and font style of the generated presentation content based on the user's emotions,

[2044] A system that includes this.

[2045] (Claim 2)

[2046] The system according to claim 1, characterized by analyzing string and numerical information entered by the user and extracting slide information.

[2047] (Claim 3)

[2048] The system according to claim 1, characterized by preloading standard templates and applying them to generated presentation materials.

[2049] "Application example 2 when combining with an emotional engine"

[2050] (Claim 1)

[2051] A means for analyzing string and numerical information entered by the user,

[2052] A means for selecting an appropriate slide layout based on the analyzed information,

[2053] A means of generating presentation materials by adding analyzed information to the selected slide layout,

[2054] A means to optimize the color scheme of the generated presentation,

[2055] Means of recognizing emotions,

[2056] A means of adjusting the design of presentation materials based on user emotions,

[2057] A means of displaying presentation materials in real time via smart glasses,

[2058] A system that includes this.

[2059] (Claim 2)

[2060] The system according to claim 1, characterized by analyzing string and numerical information entered by the user and extracting slide information.

[2061] (Claim 3)

[2062] The system according to claim 1, characterized by preloading standard templates and applying them to generated presentation materials. [Explanation of Symbols]

[2063] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for analyzing string and numerical information entered by the user, A means for selecting an appropriate slide layout based on the analyzed information, A means of generating presentation materials by adding analyzed information to the selected slide layout, A means to optimize the color scheme of the generated presentation, A system that includes this.

2. The system according to claim 1, characterized by analyzing string and numerical information entered by the user and extracting slide information.

3. The system according to claim 1, characterized in that it preloads standard templates and applies them to the generated presentation materials.

Images