system

Abstract

To provide a system to be provided in a form operable even by elderly teachers who are not good at using PCs, thereby reducing the burden on teachers and enabling them to create classroom newsletters with content that parents will want to see.SOLUTION: A system includes: input means for inputting a schedule of event dates, event content, and message content to be conveyed, which an educator wants to include in a classroom newsletter, the document to inform parents and students of events and other information; means for generating a prompt sentence instructing creation of content of the classroom newsletter based on the information input by the input means; creation means for using the generated prompt sentences and a generative AI model to create the content of the classroom newsletter with illustrations and images used for easier visual comprehension, photographs selected with care to avoid bias toward specific people or things, and organized information arranged in a layout being easy to understand visually; and means for outputting the content of the created classroom newsletter.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Class newsletters are a valuable tool for mass communication with parents, but due to information protection concerns, they cannot be outsourced and teachers must carry out the tedious work of creating them. Furthermore, many factors must be considered when creating them, such as updating regular content for events, using illustrations and images that are easy to understand even with less text, selecting photos that are careful not to overemphasize one thing, and creating an easy-to-read layout, all of which require time and effort. [Means for solving the problem]

[0005] This invention provides a system in which AI is used to create class newsletters. This system uses AI to automatically update regular content such as events, use illustrations and images that are easy to understand even with less text, select photos that are careful not to overemphasize, and create easy-to-read layouts. This reduces the burden on teachers and provides a format that can be operated even by older teachers who are not good at using computers. Furthermore, class newsletters are created with content that parents will want to read. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] In the system of the present invention, AI creates class newsletters on behalf of the teacher. Specifically, the teacher inputs the information necessary to create the newsletter into the system. This information includes the schedule and content of events, the message the teacher wants to convey, and so on. The system then automatically creates the newsletter based on the input information. In this process, the AI ​​performs tasks such as automatically updating regular content for events, using illustrations and images that are easy to understand even with reduced text, selecting photos that are careful not to overemphasize content, and creating an easy-to-read layout.

[0029] "Example 2"

[0030] The system of the present invention is provided in a format that can be operated even by older teachers who are not good at using PCs. Specifically, the system's operation screen has an intuitive and simple design, allowing students to create class newsletters simply by entering the necessary information. The system is also cloud-based and can be accessed from any device connected to the Internet.

[0031] "Example 3"

[0032] The system of the present invention creates class newsletters with content that parents will want to read. Specifically, based on the input information, the system emphasizes information that parents will be interested in and creates class newsletters with a visually appealing layout. For example, the system may display large photos of the children's activities and provide concise details of those activities.

[0033] The processing flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: The teacher inputs the information necessary to create a class newsletter into the system, including the event schedule, content, and message to be conveyed.

[0036] Step 2: The system automatically creates a class newsletter based on the information entered. During this process, the AI ​​performs tasks such as automatically updating regular content such as events, using illustrations and images that are easy to understand even with less text, selecting photos that are careful not to overemphasize one thing, and creating an easy-to-read layout. "Example 2"

[0037] Step 1: The system's operation screen has an intuitive and simple design, allowing teachers to create class newsletters simply by entering the necessary information.

[0038] Step 2: The system is cloud-based and can be accessed from any internet-connected device.

[0039] "Example 3"

[0040] Step 1: Based on the information entered, the system creates a class newsletter in a visually appealing layout, highlighting information that parents will find interesting.

[0041] Step 2: For example, measures can be taken such as displaying large photos of the children's activities and providing brief details of those activities.

[0042] Example 1

[0043] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0044] Creating traditional class newsletters is a time-consuming and labor-intensive task for educators, placing a significant burden on older educators who are particularly unfamiliar with computers. It's also difficult to create compelling content that parents will want to read. Furthermore, it requires a wide range of tasks, including updating regular content for events, using illustrations and images that are easy to understand even with less text, carefully selecting photos that don't overwhelm others, and creating an easy-to-read layout. To solve these issues, a system that allows for the efficient and easy creation of class newsletters is needed.

[0045] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0046] In this invention, the server includes a means for the terminal to transmit information input by the user to the server, a means for generating a class newsletter using the generative AI model, and a means for transmitting the generated class newsletter to the terminal. This allows educators to easily create class newsletters and provide attractive content that parents will want to read.

[0047] A "class newsletter" is a document used by educators to inform parents and students about events and announcements.

[0048] "Artificial intelligence" refers to computer systems that mimic human intelligence and can learn and reason.

[0049] "Regular content such as events" is information about events and activities that are held regularly at schools or classes.

[0050] "Illustrations and images" are pictures or photographs that convey information visually.

[0051] "Photos that are careful not to favor one person or group over another" are photos that are selected so as not to favor any particular person or group.

[0052] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[0053] "Users" are educators who use this system to create class newsletters.

[0054] A "terminal" is a device such as a computer or smartphone that allows a user to input information and communicate with a server.

[0055] The "server" is a computer system that receives information sent by users and generates class newsletters using a generative AI model.

[0056] A "generative AI model" is an artificial intelligence algorithm that automatically generates text and content based on input information.

[0057] A "prompt sentence" is an instruction sentence input to a generative AI model.

[0058] The present invention relates to a system in which artificial intelligence is used to create class newsletters. A specific embodiment of this system will be described below.

[0059] System configuration

[0060] This system includes a terminal where a user (educator) inputs information, a server that receives and processes the input information, and a generative AI model. The terminal is a device such as a computer or smartphone, and the server is a high-performance computer system. The generative AI model used is, for example, GPT-4 (registered trademark) from OpenAI (registered trademark).

[0061] Program processing

[0062] The user inputs the information necessary to create a class newsletter into the terminal. This information includes the event schedule, event content, and the message to be conveyed. For example, the user might input, "The sports day is on October 15th. Let's all get ready for the sports day!"

[0063] The terminal transmits the information input by the user to the server. Specifically, the terminal transmits the input information to the server using an HTTP request.

[0064] The server generates a class newsletter using the generative AI model based on the received information. The server inputs the following prompt into the generative AI model:

[0065] Please create a class newsletter based on the information below.

[0066] Event date: October 15th

[0067] Event details: Sports day

[0068] Message to convey: "Everyone, let's get ready for the sports day!"

[0069] The content of the class newsletter should be laid out in an easy-to-read format and include appropriate illustrations and images.

[0070] The generative AI model generates the content of the class newsletter based on this prompt. For example, the following class newsletter might be generated:

[0071] Title: "About the sports day on October 15th"

[0072] Content: "Everyone, let's get ready for the sports day! The sports day will be held on October 15th. The detailed schedule is as follows..."

[0073] The server transmits the generated class newsletter to the terminal. Specifically, the server uses an HTTP response to transmit the contents of the generated class newsletter to the terminal.

[0074] The terminal displays the contents of the class newsletter received from the server to the user, who can then check the generated class newsletter on the screen of the terminal.

[0075] Specific examples

[0076] For example, if a user enters the following information:

[0077] Event date: October 15th

[0078] Event details: Sports day

[0079] Message to convey: "Everyone, let's get ready for the sports day!"

[0080] The device sends this information to a server, which uses a generative AI model to generate a class newsletter like this:

[0081] Title: "About the sports day on October 15th"

[0082] Content: "Everyone, let's get ready for the sports day! The sports day will be held on October 15th. The detailed schedule is as follows..."

[0083] The server transmits the generated class newsletter to the terminal, which displays it to the user, who can then check the generated class newsletter on the screen of the terminal.

[0084] In this way, this system allows educators to easily create class newsletters and provide attractive content that parents will want to read.

[0085] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0086] Step 1:

[0087] The user enters the information.

[0088] The user inputs the information necessary to create a class newsletter into the device. This information includes the event schedule, event content, and the message to be conveyed. For example, the user might input, "The sports day is on October 15th. Let's all get ready for the sports day!" The input information is temporarily stored in the device's memory.

[0089] Step 2:

[0090] The terminal sends the input information to the server.

[0091] The terminal sends the information entered by the user to the server. Specifically, the terminal uses an HTTP request to send the input information to the server. The input data is sent to the server in the form of the event schedule, event content, message to be conveyed, etc.

[0092] Step 3:

[0093] The server generates class newsletters using the generative AI model.

[0094] The server generates a class newsletter using the generative AI model based on the received information. The server inputs the following prompt into the generative AI model:

[0095] Please create a class newsletter based on the information below.

[0096] Event date: October 15th

[0097] Event details: Sports day

[0098] Message to convey: "Everyone, let's get ready for the sports day!"

[0099] The content of the class newsletter should be laid out in an easy-to-read format and include appropriate illustrations and images.

[0100] The generative AI model generates the content of the class newsletter based on this prompt, and the generated content is stored in the server's memory.

[0101] Step 4:

[0102] The server transmits the generated class newsletter to the terminal.

[0103] The server sends the contents of the class newsletter generated by the generative AI model to the terminal. Specifically, the server uses an HTTP response to send the contents of the generated class newsletter to the terminal. The output data is the contents of the generated class newsletter.

[0104] Step 5:

[0105] The terminal displays the class communication to the user.

[0106] The terminal displays the contents of the class newsletter received from the server to the user. The user can check the generated class newsletter on the screen of the terminal. Specifically, the terminal performs layout processing to display the received data on the screen, and displays it in a format that is visually easy for the user to understand.

[0107] (Application example 1)

[0108] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0109] Creating traditional classroom newsletters and store event information is often done manually, which takes time and effort, and can lead to variations in the readability and ease of understanding of the information. Furthermore, these tasks are often a burden for older teachers and store staff who are not good at using computers. Furthermore, the need for specialized knowledge and skills, such as creating messages that are easy for customers to understand, selecting images, and automatically updating regular events, makes it difficult to efficiently disseminate information.

[0110] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0111] In this invention, the server includes a means for using AI to create class newsletters, a means for automatically updating regular content such as events, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for automatically creating and distributing store event and sale information, a means for generating messages that are easy for customers to understand, a means for automatically selecting images and illustrations, a means for automatically updating regular events, and a means for including an application to be installed on a smartphone. This streamlines the creation of class newsletters and store event information, enabling the dissemination of information that is easy to read and understand. Furthermore, it can be easily operated even by older teachers and store staff who are not good at using computers, reducing the burden on them.

[0112] A "class newsletter" is an information newsletter issued to parents and students on a class-by-class basis at school.

[0113] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to act in a way that mimics human intelligence.

[0114] "Regular content such as events" is information about events and activities that are held regularly at schools and stores.

[0115] "Illustrations and images" are pictures or photographs that convey information visually.

[0116] "Photographs that are careful not to favor one particular person or thing" are photographs that have been selected so as not to favor one particular person or thing.

[0117] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[0118] "Store event information" is information about sales and campaigns held at the store.

[0119] "Sale information" is information about product discounts and special offers.

[0120] A "message that is easy for customers to understand" is a message that is designed to be easy for customers to understand and to attract their interest.

[0121] "Automatic selection of images and illustrations" is the process in which AI automatically selects appropriate images and illustrations.

[0122] "Automatic update of regular events" means automatically updating information about regularly scheduled events to the latest information.

[0123] An "application installed on a smartphone" is a software program that runs on a smartphone.

[0124] The system for implementing this invention consists of three elements: a server, a terminal, and a user. The server plays a central role in automatically creating and distributing class newsletters and store event information. The terminal is a device where users input information and check the generated communications. Users provide information to create class newsletters and store event information.

[0125] The server includes the following means:

[0126] 1. AI can take over the creation of class newsletters

[0127] 2. Means of automatically updating regular content such as events

[0128] 3. Using illustrations and images that are easy to understand even with less text

[0129] 4. How to select photos without bias

[0130] 5. How to create a clear layout

[0131] 6. A means to automatically create and distribute store event and sales information

[0132] 7. A way to create a message that is easy for customers to understand

[0133] 8. A method for automatically selecting images and illustrations

[0134] 9. A way to automatically update recurring events

[0135] 10. Means including an application installed on a smartphone

[0136] The server uses OpenAI's API to leverage a generative AI model to generate prompts based on the information entered by the user. For example, if a user enters event information such as "Summer Sale, August 1st - August 10th, 20% off all items," the server generates the following prompt:

[0137] Use the information below to create a message that will be easy for your customers to understand.

[0138] Event Name: Summer Sale

[0139] Dates: August 1st to August 10th

[0140] Contents: 20% off all products

[0141] Based on this prompt, the generative AI model generates a message that is easy for the customer to understand, which is then sent to the device so that the user can view it.

[0142] A terminal is a device such as a smartphone or tablet that allows users to input information and check generated communications. A dedicated application is installed on the terminal, and users can input information through an intuitive interface.

[0143] For example, when a user opens a smartphone application and enters event information, the server automatically processes the information and generates a communication in an easy-to-read layout. The generated communication includes appropriately selected images and illustrations and a message that is easy for customers to understand.

[0144] In this way, the creation of class newsletters and store event information becomes more efficient, and it becomes possible to transmit information that is easy to read and understand. Furthermore, it is easy to use even for elderly teachers and store staff who are not good at using PCs, so the burden on them is reduced.

[0145] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0146] Step 1:

[0147] A user uses a terminal to input information about a class newsletter or a store event. The input information includes the event name, date, and content. The terminal then transmits this information to the server.

[0148] Step 2:

[0149] The server generates a prompt based on the received information. Specifically, it uses a generative AI model to analyze the input information and create a prompt that will generate a message that is easy for the customer to understand. For example, the following prompt is generated:

[0150] Use the information below to create a message that will be easy for your customers to understand.

[0151] Event Name: Summer Sale

[0152] Dates: August 1st to August 10th

[0153] Contents: 20% off all products

[0154] Step 3:

[0155] The server sends the generated prompt to the generative AI model, which generates a message that is easy for customers to understand. The generative AI model performs natural language processing based on the prompt and generates an appropriate message. For example, it generates a message like, "Our big summer sale is starting! All products are 20% off from August 1st to 10th. Don't miss out!"

[0156] Step 4:

[0157] The server creates an easy-to-read layout based on the generated message. Specifically, it uses the PIL library to automatically select images and illustrations and draw the message on the image. For example, it draws the message on a background image and selects appropriate fonts and colors.

[0158] Step 5:

[0159] The server sends the generated layout to the terminal, which displays the received layout to the user, who can then review the generated communication and make any necessary corrections.

[0160] Step 6:

[0161] After the user completes the corrections, the device sends the final communication to the server, which stores it and distributes it to a designated destination, such as emailing it to a parent or client.

[0162] In this way, the creation of class newsletters and store event information becomes more efficient, and it becomes possible to transmit information that is easy to read and understand. Furthermore, it is easy to use even for elderly teachers and store staff who are not good at using PCs, so the burden on them is reduced.

[0163] Example 2

[0164] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0165] Creating a traditional class newsletter was difficult, time-consuming, and labor-intensive, especially for older educators who were not very good at using computers. Furthermore, while the content of the newsletter needed to be appealing to parents, creating the text and adjusting the layout to achieve this was also a difficult task. Furthermore, updating regular content such as events and selecting photos that could be biased were also time-consuming tasks. A system that could solve these problems was needed.

[0166] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0167] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for operating in a cloud environment and accessible from any terminal connected to the Internet, a means for saving information entered by a user in a database and generating class newsletters using a template engine, a means for outputting the generated class newsletters in PDF or HTML format, and a means for generating text based on prompts using a generative AI model. This makes it possible for even older educators who are not good at using computers to easily create class newsletters and efficiently generate class newsletters that are appealing to parents.

[0168] A "class newsletter" is a document used by teachers in educational institutions to inform parents and students about events, learning progress, and other announcements.

[0169] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and perform functions such as learning, reasoning, and recognition.

[0170] A "cloud environment" is an infrastructure for using computer resources and services provided via the Internet.

[0171] A "terminal" is a device, such as a computer, tablet, or smartphone, that a user uses to access the system.

[0172] A "database" is a system for efficiently storing, searching, and managing data.

[0173] A "template engine" is software that generates dynamic content by embedding data in templates containing placeholders.

[0174] "PDF format" is an abbreviation for Portable Document Format, a file format for electronically storing, displaying, and printing documents.

[0175] "HTML format" is an abbreviation for HyperText Markup Language, a markup language for building web pages.

[0176] A "generative AI model" is a model that uses artificial intelligence technology to generate sentences and content based on input prompts.

[0177] A "prompt" is an instruction entered into a generative AI model to specify the content and format of the content to be generated.

[0178] This invention is a system that allows even elderly educators who are not good at using PCs to easily create class newsletters. The system runs in a cloud environment and can be accessed from any device connected to the Internet. A specific embodiment of this system is described below.

[0179] The server runs on a cloud platform (e.g., Amazon Web Services, Microsoft® Azure®). When a user accesses the system from a device (PC, tablet, smartphone, etc.), the server provides an intuitive and simple operation screen. This operation screen is built using web technologies such as HTML, CSS, and JavaScript®.

[0180] The user enters the necessary information (e.g., the title, content, and image of the class newsletter) into the operation screen. The entered data is sent to the server and saved in a database (e.g., MySQL (registered trademark), PostgreSQL). The server applies a template for generating the class newsletter based on the saved data, and generates the final class newsletter. The information entered by the user is embedded in the template using a template engine (e.g., Handlebars.js, EJS).

[0181] The generated class newsletter is output in PDF or HTML format, allowing users to download or print it. To generate PDFs, libraries such as wkhtmltopdf or PDFKit are used. Furthermore, it is possible to automatically generate the content of the class newsletter using a generative AI model (e.g., OpenAI GPT-3 (registered trademark)). When the user enters a prompt, the generative AI model generates an appropriate sentence and adds it to the class newsletter.

[0182] As a concrete example, consider the case where a user wants to create a "Class Newsletter of the Month." The user enters the following information into the operation screen:

[0183] Title: "This month's class newsletter"

[0184] Contents: "This month's event information, learning progress, and messages to parents"

[0185] Image: School event photos

[0186] The server receives this information, stores it in a database, then applies a template to generate a class newsletter and outputs it in PDF format.

[0187] When using a generative AI model, the user enters a prompt like this:

[0188] "Generate this month's class newsletter. Include event information, learning progress, and parent / guardian announcements."

[0189] The generative AI model generates appropriate sentences based on this prompt and adds them to the class newsletter. For example, the following sentences might be generated:

[0190] "Information about this month's events includes the sports day, which will be held on October 15th. Regarding learning progress, the math unit has been completed and students will move on to the next unit. As a message to parents, the date for next month's parent-teacher meeting has been decided, so please check it."

[0191] In this way, users can easily create and download or print class newsletters.

[0192] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0193] Step 1:

[0194] A user accesses the system.

[0195] Users access the system's URL from a web browser using a device connected to the Internet (such as a PC, tablet, or smartphone). The server runs in a cloud environment and receives the user's access request. The input is the user's access request, and the output is the system's operation screen. The server provides the user with an intuitive and simple operation screen built using HTML, CSS, and JavaScript.

[0196] Step 2:

[0197] The user enters the information.

[0198] The user inputs the necessary information into the form displayed on the operation screen. For example, they input the title, content, and images of the class newsletter. Input is the information entered by the user, and output is the transmission of this information to the server. Specifically, the user inputs the title "This month's class newsletter," the content "This month's event information, learning progress, and messages to parents," and a photo of the school event.

[0199] Step 3:

[0200] The server receives and stores the data.

[0201] The server receives the information entered by the user and stores it in a database (e.g. MySQL, PostgreSQL). The input is the information submitted by the user, and the output is the data stored in the database. The server performs validation checks to maintain data integrity and stores the data in the correct format.

[0202] Step 4:

[0203] The server generates the class newsletter.

[0204] The server generates a class newsletter based on the saved data. It uses a template engine (e.g. Handlebars.js, EJS) to embed the information entered by the user into the template. The input is the data saved in the database, and the output is the HTML structure of the generated class newsletter. Specifically, the template contains the following structure:

[0205]

[0206] <title> {{title}}< / title>

[0207]

[0208] <h1> {{title}}< / h1>

[0209] {{Contents}}

[0210]

[0211]

[0212]

[0213] Step 5:

[0214] The server outputs the generated class newsletter.

[0215] The server outputs the generated class newsletter in PDF or HTML format. To generate PDFs, libraries such as wkhtmltopdf and PDFKit are used. The input is the HTML structure of the generated class newsletter, and the output is a PDF or HTML file. The server saves the generated file so that users can download it.

[0216] Step 6:

[0217] The user downloads or prints the class newsletter.

[0218] Users can download or print the generated class newsletter from the system's operation screen. The input is the user's download or print request, and the output is the download or print of the PDF file. Specifically, when the user clicks the download link, the PDF file is saved on the device. When the user clicks the print button, the browser's print function is called up, and the class newsletter can be printed.

[0219] Step 7:

[0220] Generate sentences using generative AI models.

[0221] When a user inputs a prompt, the server uses a generative AI model (e.g., OpenAI GPT-3) to generate an appropriate sentence. The input is the prompt entered by the user, and the output is the generated sentence. Specifically, the user inputs a prompt like this:

[0222] "Generate this month's class newsletter. Include event information, learning progress, and parent / guardian announcements."

[0223] The generative AI model generates appropriate sentences based on this prompt and adds them to the class newsletter. For example, the following sentences might be generated:

[0224] "Information about this month's events includes the sports day, which will be held on October 15th. Regarding learning progress, the math unit has been completed and students will move on to the next unit. As a message to parents, the date for next month's parent-teacher meeting has been decided, so please check it."

[0225] (Application example 2)

[0226] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0227] Creating traditional classroom and store newsletters was time-consuming and labor-intensive, placing a significant burden on older teachers and store staff who were not particularly adept at using computers. Furthermore, updating and distributing newsletter content had to be done manually, which was inefficient. Furthermore, it was difficult to create content that would appeal to customers and parents.

[0228] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a generation AI model to create class newsletters, a means for automatically updating regular content such as event content, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for a generation AI model to create store newsletters, a means for storing them in the cloud, a means for accessing them from any device connected to the Internet, and a means for distributing them to customers. This makes it possible for even older teachers and store staff who are not good at using PCs to easily create, update, and distribute class newsletters and store newsletters.

[0229] A "class newsletter" is a document used to communicate information about a school class or grade to parents and students.

[0230] A "generative AI model" is an algorithm that uses artificial intelligence to automatically generate content such as text and images.

[0231] "Regular content such as events" is information about events and campaigns that are held regularly at schools and stores.

[0232] "Utilizing illustrations and images" means using illustrations and images to complement written information and make it easier to understand visually.

[0233] "Selecting photographs with care to avoid bias" means selecting photographs with care to avoid bias towards any particular person or thing.

[0234] An "easy-to-read layout" is one in which information is organized and arranged in a way that is visually easy to understand.

[0235] "Store communications" are documents used to communicate the latest store information and campaign information to customers.

[0236] "Storing in the cloud" means storing data on a remote server via the internet.

[0237] "Any device connected to the Internet" means any device that can connect to the Internet (such as a smartphone, tablet, or PC).

[0238] "Delivery to customers" means delivering the created information to customers.

[0239] A system for implementing this invention has the function of generating classroom and store communications using a generative AI model. The system is cloud-based and can be accessed from any device connected to the Internet. A specific embodiment of the system is described below.

[0240] System configuration

[0241] The system consists of the following main components:

[0242] 1. Generative AI models: Artificial intelligence algorithms that generate text and images.

[0243] 2. Cloud storage: A remote server for storing generated communications.

[0244] 3. User Interface: An intuitive interface for users to enter information and create and edit correspondence.

[0245] 4. Distribution module: A function for distributing created communications to customers and parents.

[0246] Hardware and software used

[0247] Hardware: Internet-connected devices such as smartphones, tablets, and PCs.

[0248] Software: Python, AWS® SDK (boto3), generative AI model (e.g., GPT-3).

[0249] Data processing and calculation

[0250] 1. User interface: The user enters the store name, campaign information, additional information, etc.

[0251] 2. Generative AI model: Generates text and images for class newsletters and store newsletters based on input information.

[0252] 3. Cloud storage: The generated correspondence is stored in the cloud in JSON format.

[0253] 4. Distribution module: Distributes stored communications to clients and parents.

[0254] Specific examples

[0255] For example, a store associate enters the following information:

[0256] Store name: ABC Store

[0257] Campaign Information: Summer Sale! 20% off all items

[0258] Additional Information: Limited Time Offer: July 1st to July 31st

[0259] Based on this information, the generative AI model generates the following store communication:

[0260] Store name: ABC Store

[0261] Campaign Information: Summer Sale! 20% off all items

[0262] Additional Information: Limited Time Offer: July 1st to July 31st

[0263] Created: 2023-07-01T12:00:00

[0264] The generated communications are stored in the cloud and distributed to customers as needed, making it possible for even older teachers and store staff who are not very good at using computers to easily create, update, and distribute class and store newsletters.

[0265] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0266] Step 1:

[0267] The user accesses the user interface using a terminal. The user inputs the necessary data, such as the store name, campaign information, additional information, etc. The input data is sent from the user interface to the server.

[0268] Step 2:

[0269] The server passes the received data to the generative AI model, which generates text and images for classroom and store newsletters based on the input data. Specifically, the generative AI model analyzes the prompt text and generates appropriate documents and images.

[0270] Step 3:

[0271] The communication content generated by the generative AI model is converted to JSON format by the server. This JSON data is saved in cloud storage. The server also records metadata such as the URL of the save destination and the save date and time.

[0272] Step 4:

[0273] Users can access the cloud storage using their devices to check and edit the saved communication content. If the user makes any edits, the data is sent to the server again and the updated content is saved in the cloud storage.

[0274] Step 5:

[0275] The server passes the saved communication content to the distribution module, which then distributes the communication content to the customer or guardian via email, SMS, in-app notifications, and other methods.

[0276] Step 6:

[0277] When the distribution is complete, the server records the distribution result and notifies the user, who can then check the distribution result using their terminal.

[0278] Example 3

[0279] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0280] Creating traditional class newsletters is a time-consuming and labor-intensive task for teachers and school staff, and is particularly difficult for users who are not good at using computers. It is also difficult to create a layout and design that effectively conveys content that will interest parents. This results in a decline in the quality of class newsletters and a failure to attract parents' attention.

[0281] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0282] In this invention, the server includes a means for a user to input information, a means for the server to receive information, a means for the server to input a prompt sentence to the generative AI model, a means for the generative AI model to generate content for the class newsletter, a means for the server to send the generated content to layout software, a means for the server to generate a visually appealing layout, and a means for the server to provide the final class newsletter to the user. This automates the creation of class newsletters and makes it possible to effectively communicate content that will interest parents.

[0283] "Means for users to input information" refers to an interface that allows teachers and school staff to input information they want to include in class newsletters using a device such as a computer or tablet.

[0284] The "means for the server to receive information" is a function that allows the server to receive information entered by the user and store it in a database.

[0285] "Means for the server to input prompt sentences to the generative AI model" refers to a function that allows the server to create and input instruction sentences to the generative AI model based on the information received.

[0286] "Means by which the generative AI model generates the contents of the class newsletter" refers to the function that enables the generative AI model to automatically generate the contents of the class newsletter based on the prompt text.

[0287] "Means for the server to send the generated content to the layout software" is a function that enables the server to send the content of the class newsletter obtained from the generating AI model to the layout software.

[0288] "Means for the server to generate a visually appealing layout" refers to a function that enables the server to use layout software to automatically arrange the contents of the class newsletter in a visually appealing format.

[0289] "Means for the server to provide the final class newsletter to the user" is a function that allows the server to provide the final generated class newsletter to the user, allowing the user to review and modify it.

[0290] The present invention is a system for automating the creation of class newsletters and effectively communicating content that parents will be interested in. A specific embodiment of this system will be described below.

[0291] First, the user (teachers or school staff) uses a device (PC or tablet) to input the information they want to include in the class newsletter. This information includes the children's activities, photos, event information, etc. For example, the user inputs "photos from a field trip" and "field trip details (destination, activities, participants' impressions)."

[0292] Next, the server receives the information entered by the user from the device. The received information is stored in a database. The server then creates and inputs a prompt to the generative AI model based on the received information. For example, it generates a prompt such as, "Based on the information below, please create a class newsletter that will interest parents. Please use a visually appealing layout and emphasize important information."

[0293] The generative AI model generates content for a class newsletter based on prompts received from the server. For example, it displays large photos of the children's activities and generates text that briefly describes the activities. The generated content is then sent by the server to layout software such as Adobe InDesign or Canva.

[0294] The server uses layout software to automatically generate visually appealing class newsletters. For example, it adjusts the placement of photos and the font and color of text. The final newsletter is then provided to the user by the server. The user can review the newsletter through their device and make corrections or additions as needed.

[0295] As a concrete example, suppose the user enters the following information:

[0296] Photos of children on a field trip

[0297] Field trip details (destination, activities, participants' impressions)

[0298] The server generates a class newsletter based on this information:

[0299] View larger photos of the field trip

[0300] Add a brief description: "The children had a fun day at ____ Park. They did some nature observation and learned about different plants and animals."

[0301] Example prompts to input to a generative AI model:

[0302] "Use the information below to create a class newsletter that parents will find interesting. Use a visually appealing layout that highlights important information.

[0303] Photos of children on a field trip

[0304] Details of the trip (destination, activities, participants' impressions)

[0305] In this way, the server can automatically create class newsletters that parents will want to read. This system makes it possible to efficiently create class newsletters and effectively communicate content that will attract parents' attention. The flow of the specific processing in Example 3 will be described with reference to FIG. 15.

[0306] Step 1:

[0307] The user enters information

[0308] Users (teachers and school staff) use devices (PCs and tablets) to input the information they want to include in the class newsletter. The information input includes details of the children's activities, photos, event information, etc. For example, a user might input "photos from a field trip" and "field trip details (destination, activities, participants' impressions)." The input data is sent from the device to the server.

[0309] Step 2:

[0310] The server receives the information.

[0311] The server receives information entered by the user from the device. The received information is stored in a database. Specifically, the server receives HTTP requests and stores the information in a database. The input data includes the children's activities, photos, event information, etc., and the output is the information stored in the database.

[0312] Step 3:

[0313] The server inputs a prompt sentence into the generative AI model.

[0314] The server creates and inputs a prompt to the generative AI model based on the received information. For example, it generates a prompt such as, "Based on the information below, please create a class newsletter that will interest parents. Please use a visually appealing layout and emphasize important information." The input data is the information stored in the database, and the output is the generated prompt.

[0315] Step 4:

[0316] A generative AI model generates the content for the class newsletter.

[0317] The generative AI model generates the content of a class newsletter based on the prompt received from the server. For example, it displays a large photo of the children's activities and generates text that briefly describes the details of those activities. The input data is the prompt, and the output is the content of the generated class newsletter.

[0318] Step 5:

[0319] The server sends the generated content to the layout software.

[0320] The server sends the content of the class newsletter obtained from the generative AI model to layout software such as Adobe InDesign or Canva. Specifically, it sends data to the layout software using an API. The input data is the content of the generated class newsletter, and the output is the data sent to the layout software.

[0321] Step 6:

[0322] The server generates a visually appealing layout.

[0323] The server uses layout software to automatically generate visually appealing class communications, for example adjusting the placement of photos, text fonts, colors, etc. The input data is the data sent to the layout software, and the output is a visually appealing layout.

[0324] Step 7:

[0325] The server provides the final class communication to the user.

[0326] The server provides the final generated class newsletter to the user, who can review it through their device and make corrections or additions as needed. The input data is a visually appealing layout, and the output is the final class newsletter provided to the user.

[0327] (Application example 3)

[0328] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0329] Creating traditional classroom newsletters and store newsletters was time-consuming and laborious, placing a significant burden on older teachers and store owners who were not particularly adept at using computers. It was also difficult to effectively highlight information that would interest parents and customers and create a visually appealing layout. This resulted in a decrease in the effectiveness of information transmission and an inability to capture the attention of recipients.

[0330] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0331] In this invention, the server includes means for using AI to create class newsletters, means for automatically updating regular content such as events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize content, means for creating easy-to-read layouts, means for automatically generating store newsletters, means for emphasizing information that customers are interested in, means for creating visually appealing layouts, and means for inserting images. This makes it possible to effectively emphasize information that parents and customers are interested in, and automatically create class newsletters and newsletters with visually appealing layouts.

[0332] A "class newsletter" is a document used to inform parents about activities, events, and announcements for a school class or grade.

[0333] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to imitate human intelligence to learn and reason.

[0334] "Regular content such as events" is information about events and activities that are held regularly at schools and stores.

[0335] "Illustrations and images" are pictures or photographs that convey information visually.

[0336] "Photo selection" is the process of selecting appropriate photos based on specific criteria.

[0337] "Layout" refers to the arrangement and design of documents and images.

[0338] A "store newsletter" is an informational document issued by a store to its customers.

[0339] "Information that interests customers" is information that customers find highly interesting and valuable.

[0340] A "visually appealing layout" is a design that looks beautiful and arranges information in an easy-to-understand manner.

[0341] An "image insertion method" is a method or technique for adding an image to a document or layout.

[0342] The system for implementing this invention operates in cooperation with a server, a terminal, and a user. The server runs a program for automating the creation of class newsletters and store newsletters. Specifically, the following hardware and software are used:

[0343] Hardware:

[0344] Server: A computer with a powerful processor and large memory capacity

[0345] Devices: Smartphones, tablets, PCs, etc.

[0346] software:

[0347] Python: A programming language used to implement programs

[0348] PIL (Python Imaging Library): A library for image processing

[0349] Generative AI model: An artificial intelligence model for natural language processing and image generation

[0350] The server automatically generates class newsletters and store newsletters based on the information entered by the user. Specifically, the process is carried out as follows:

[0351] 1. The user uses a terminal to upload event information, product information, special offer information, and related images to the server.

[0352] 2. The server uses a generative AI model to analyze the input information and highlight information that will be of interest to parents and customers.

[0353] 3. The server uses PIL to create a visually appealing layout and insert images in the appropriate locations.

[0354] 4. Finally, the server saves the generated class newsletter or newsletter as an image file and provides it to the user.

[0355] Examples:

[0356] For example, if a store owner enters information about a "summer festival" or a "new product launch" and uploads related images, the server automatically highlights this information and generates a visually appealing newsletter.

[0357] Example prompt sentence:

[0358] Enter information about your "Summer Festival" or "New Product Launch" and upload relevant images. The app will automatically highlight these details and generate a visually appealing newsletter.

[0359] In this way, the server helps users to easily create attractive class newsletters and newsletters, which improves the effectiveness of information transmission and attracts the attention of recipients.

[0360] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0361] Step 1:

[0362] A user uses a terminal to upload event information, product information, special offer information, and related images to the server.

[0363] Input: Event information, product information, bonus information, image files

[0364] Output: Input data stored on the server

[0365] Specific operation: The user opens the application on their device, enters event information, product information, and special offer information into the input form, selects an image file, and presses the upload button. The server receives this data and saves it in the database.

[0366] Step 2:

[0367] The server uses a generative AI model to analyze the input information and highlight information that will be of interest to parents and customers.

[0368] Input: Event information, product information, and special offer information stored on the server

[0369] Output: Highlighted information

[0370] How it works: The server inputs event information, product information, and special offer information into the generative AI model, which then analyzes this information to identify areas that parents and customers will be interested in. The identified information is then output in an emphasized format.

[0371] Step 3:

[0372] The server uses PIL to create a visually appealing layout and insert images in the appropriate locations.

[0373] Input: Highlighted information, image file

[0374] Output: A newsletter with a visually appealing layout

[0375] What it does: The server uses PIL to create a canvas, draws the highlighted information as text, inserts image files in the appropriate locations, and adjusts the overall layout.

[0376] Step 4:

[0377] The server saves the generated class newsletter or newsletter as an image file and provides it to the user.

[0378] Enter: a newsletter with a visually appealing layout.

[0379] Output: Generated newsletter image files

[0380] What happens: The server saves the final layout as an image file and generates a download link for the user. The user then downloads the generated newsletter from their device using this link.

[0381] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0382] "Example 1"

[0383] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system has the ability to recognize a user's emotions and adjust the content and layout of a class newsletter according to those emotions. Specifically, the emotion engine infers the user's emotions from their facial expressions, tone of voice, input text, and the like. The system then adjusts the content of the class newsletter according to those emotions. For example, if the user is feeling happy, the content of the class newsletter is created with a positive tone, emphasizing positive content such as successful activities and children's growth. Furthermore, if the user is feeling sad or anxious, the content of the class newsletter is created taking those emotions into consideration and providing information on necessary support and measures. Furthermore, the emotion engine also adjusts the layout of the class newsletter. For example, if the user is feeling happy, the layout of the class newsletter will have a bright and cheerful atmosphere, while if the user is feeling sad or anxious, the layout will have a more subdued color and design. This allows for the creation of an appropriate class newsletter according to the user's emotions, improving communication with the user.

[0384] "Example 2"

[0385] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system has the ability to recognize a user's emotions and adjust the content and layout of a class newsletter according to those emotions. Specifically, the emotion engine infers the user's emotions from their facial expressions, tone of voice, input text, and the like. The system then adjusts the content of the class newsletter according to those emotions. For example, if the user is feeling happy, the content of the class newsletter is created with a positive tone, emphasizing positive content such as successful activities and children's growth. Furthermore, if the user is feeling sad or anxious, the content of the class newsletter is created taking those emotions into consideration and providing information on necessary support and measures. Furthermore, the emotion engine also adjusts the layout of the class newsletter. For example, if the user is feeling happy, the layout of the class newsletter will have a bright and cheerful atmosphere, while if the user is feeling sad or anxious, the layout will have a more subdued color and design. This allows for the creation of an appropriate class newsletter according to the user's emotions, improving communication with the user.

[0386] "Example 3"

[0387] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system has the ability to recognize a user's emotions and adjust the content and layout of a class newsletter according to those emotions. Specifically, the emotion engine infers the user's emotions from their facial expressions, tone of voice, input text, and the like. The system then adjusts the content of the class newsletter according to those emotions. For example, if the user is feeling happy, the content of the class newsletter is created with a positive tone, emphasizing positive content such as successful activities and children's growth. Furthermore, if the user is feeling sad or anxious, the content of the class newsletter is created taking those emotions into consideration and providing information on necessary support and measures. Furthermore, the emotion engine also adjusts the layout of the class newsletter. For example, if the user is feeling happy, the layout of the class newsletter will have a bright and cheerful atmosphere, while if the user is feeling sad or anxious, the layout will have a more subdued color and design. This allows for the creation of an appropriate class newsletter according to the user's emotions, improving communication with the user.

[0388] The processing flow of each embodiment will be described below.

[0389] "Example 1"

[0390] Step 1: The user starts the system and begins creating a class newsletter.

[0391] Step 2: The system activates the emotion engine to recognize the user's emotions. Emotion recognition is based on the user's facial expressions, tone of voice, and input text.

[0392] Step 3: The emotion engine adjusts the content of the class newsletter according to the recognized emotion. For example, if the user is feeling happy, the content of the class newsletter will be created with a positive tone and will emphasize positive things such as successful activities and children's growth.

[0393] Step 4: The emotion engine also adjusts the layout of the class newsletter according to the recognized emotion. For example, if the user is feeling happy, the layout of the class newsletter will be bright and cheerful.

[0394] Step 5: The system creates a class newsletter with the adjusted content and layout and provides it to the user, thereby creating an appropriate class newsletter that reflects the user's emotions and improving communication with the user.

[0395] Example 1

[0396] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0397] Creating a traditional class newsletter is a time-consuming and labor-intensive task for educators, placing a significant burden on older educators who are not particularly adept at using computers. Furthermore, the content and layout of the newsletter are uniform, making it difficult to attract parents' attention. Furthermore, the inability to adjust the content or layout to reflect the user's feelings can lead to a decline in the quality of communication.

[0398] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0399] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing diagrams and images that are easy to understand even with reduced text, a means for selecting photos that are not overly focused, a means for creating an easy-to-read layout, a means for recognizing a user's emotions and adjusting the content and layout of the class newsletter in response to those emotions, a means for extracting important keywords and phrases from input text using natural language processing technology, a means for automatically creating class newsletters using a generative AI model, a means for estimating a user's emotions using an emotion engine, and a means for adjusting the layout of the class newsletter in response to the user's emotions. This reduces the burden on educators and enables the creation of class newsletters that attract parents' attention. Furthermore, the content and layout can be adjusted in response to the user's emotions, improving the quality of communication.

[0400] A "class newsletter" is a document used by educators to inform parents and students about events, class situations, messages, etc.

[0401] "Artificial intelligence" is a technology that enables computer systems to imitate human intelligence to learn, reason, and make decisions.

[0402] "Regular content such as events" is information about events and activities that are held regularly at schools or classes.

[0403] "Diagrams and images" refers to visual content such as illustrations and photographs that convey information visually.

[0404] "Photographs that take care not to favor any particular student or event" are photographs that are selected impartially.

[0405] An "easy-to-read layout" is an arrangement or design in which information is organized and easy to understand visually.

[0406] An "emotion engine" is a technology that estimates emotions from a user's facial expressions, tone of voice, input text, etc.

[0407] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.

[0408] A "generative AI model" is an artificial intelligence model that automatically generates new content based on input data.

[0409] "Keywords and phrases" are words or parts of sentences that are particularly important in the input text.

[0410] This invention is a system in which artificial intelligence (AI) is used to create class newsletters, reducing the burden on educators and creating newsletters that attract the attention of parents. A specific embodiment of this system will be described below.

[0411] System configuration

[0412] Subject: User

[0413] The user inputs the information necessary to create a class newsletter into the terminal. This information includes the event date, content, and the message to be conveyed. For example, the user might input, "The sports day is on October 10th. I would like to convey the children's progress."

[0414] Subject: Terminal

[0415] The terminal transmits the information input by the user to the server. Specifically, the terminal transmits the input text data to the server as an HTTP request.

[0416] Subject: Server

[0417] The server analyzes the received information. Specifically, it uses natural language processing technology to extract important keywords and phrases from the input text. For example, it extracts keywords such as "sports day," "October 10th," and "growth."

[0418] Subject: Server

[0419] The server uses an emotion engine to recognize the user's emotions. The emotion engine infers emotions from the user's input text, facial expressions, tone of voice, etc. For example, if a user inputs "I want to share my children's growth," the emotion engine infers that the user is feeling happy.

[0420] Subject: Server

[0421] The server automatically creates class newsletters using a generative AI model. Specifically, the server generates appropriate text and layout based on extracted keywords and recognized emotions. For example, it creates a positive-toned newsletter that reads, "The sports day was a great success! We could see the children's growth!"

[0422] Subject: Server

[0423] The server adjusts the layout of the class newsletter according to the emotion estimated by the emotion engine. For example, if the user is feeling happy, the server applies a bright and cheerful layout, using bright colors and cheerful illustrations.

[0424] Subject: Server

[0425] The server transmits the generated class newsletter to the terminal. Specifically, the server transmits the generated class newsletter data to the terminal as an HTTP response.

[0426] Subject: Terminal

[0427] The terminal displays the class newsletter received from the server to the user. Specifically, the terminal displays the content and layout of the generated class newsletter on the screen of the terminal.

[0428] Specific examples

[0429] Example 1: Creating a positive classroom newsletter

[0430] 1. The user enters into the terminal, "The sports day is on October 10th. I would like to report on my children's growth."

[0431] 2. The terminal sends the entered information to the server.

[0432] 3. The server analyzes the information and extracts the keywords "sports day," "October 10th," and "growth."

[0433] 4. The server uses the emotion engine to recognize that the user is feeling joy.

[0434] 5. The server uses the generative AI model to create positive content such as, "The sports day was a great success! We could see the children's growth!"

[0435] 6. The server will adopt a bright and fun layout.

[0436] 7. The server sends the generated class newsletter to the terminal.

[0437] 8. The terminal displays the generated class newsletter to the user.

[0438] Example 2: Creating a class newsletter that requires support

[0439] 1. The user types into the device, "There has been some bullying in my class recently. I would like to include information about support and countermeasures."

[0440] 2. The terminal sends the entered information to the server.

[0441] 3. The server analyzes the information and extracts the keywords "bullying," "support," and "measures."

[0442] 4. The server uses an emotion engine to recognize that the user is feeling sad or anxious.

[0443] 5. The server uses the generative AI model to create content titled "Support and countermeasures for bullying issues."

[0444] 6. The server should use a layout with a calm color scheme and design.

[0445] 7. The server sends the generated class newsletter to the terminal.

[0446] 8. The terminal displays the generated class newsletter to the user.

[0447] Prompt Sentence Examples

[0448] "The sports day was a great success. I could see the children's progress. Please create a class newsletter with a positive tone."

[0449] "There has been some bullying in your class recently. Please create a class newsletter with information about support and strategies."

[0450] In this way, an appropriate class newsletter is created according to the user's feelings, improving communication with the user.

[0451] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0452] Step 1:

[0453] Subject: User

[0454] The user inputs the information necessary to create a class newsletter into the device. This input includes the date and content of the event, the message they want to convey, etc. For example, they might input, "The sports day is on October 10th. I want to convey the children's growth."

[0455] Input: Event date, content, message

[0456] Output: The input text data

[0457] Step 2:

[0458] Subject: Terminal

[0459] The terminal transmits the information input by the user to the server. Specifically, the terminal transmits the input text data to the server as an HTTP request.

[0460] Input: Text data entered by the user

[0461] Output: HTTP request sent to the server

[0462] Step 3:

[0463] Subject: Server

[0464] The server analyzes the received information. Specifically, it uses natural language processing technology to extract important keywords and phrases from the input text. For example, it extracts keywords such as "sports day," "October 10th," and "growth."

[0465] Input: Text data received as an HTTP request

[0466] Output: Extracted keywords and phrases

[0467] Step 4:

[0468] Subject: Server

[0469] The server uses an emotion engine to recognize the user's emotions. The emotion engine infers emotions from the user's input text, facial expressions, tone of voice, etc. For example, if a user inputs "I want to share my children's growth," the emotion engine infers that the user is feeling happy.

[0470] Input: Extracted keywords and phrases, user-entered text

[0471] Output: Estimated user emotion

[0472] Step 5:

[0473] Subject: Server

[0474] The server automatically creates class newsletters using a generative AI model. Specifically, the server generates appropriate text and layout based on extracted keywords and recognized emotions. For example, it creates a positive-toned newsletter that reads, "The sports day was a great success! We could see the children's growth!"

[0475] Input: extracted keywords and phrases, estimated user sentiment

[0476] Output: The text and layout of the generated class newsletter

[0477] Step 6:

[0478] Subject: Server

[0479] The server adjusts the layout of the class newsletter according to the emotion estimated by the emotion engine. For example, if the user is feeling happy, the server applies a bright and cheerful layout, using bright colors and cheerful illustrations.

[0480] Input: The text and layout of the generated class newsletter, and estimated user sentiment.

[0481] Output: Adjusted layout of the class newsletter

[0482] Step 7:

[0483] Subject: Server

[0484] The server transmits the generated class newsletter to the terminal. Specifically, the server transmits the generated class newsletter data to the terminal as an HTTP response.

[0485] Input: Adjusted class newsletter layout

[0486] Output: HTTP response sent to the device

[0487] Step 8:

[0488] Subject: Terminal

[0489] The terminal displays the class newsletter received from the server to the user. Specifically, the terminal displays the content and layout of the generated class newsletter on the screen of the terminal.

[0490] Input: HTTP response received from the server

[0491] Output: The content and layout of the class newsletter displayed to the user

[0492] (Application example 1)

[0493] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0494] Creating traditional class newsletters requires time and effort, as teachers have to do it manually. This has led to problems with inconsistent quality of content and layout. Creating the information and services provided to customers is also time-consuming, making it difficult to respond appropriately to customer sentiment.

[0495] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a means for using AI to create class newsletters, a means for automatically updating regular content such as event content, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for analyzing user emotions using an emotion engine and adjusting content and layout according to those emotions, and a means for automatically creating and adjusting information and services to be provided to customers. This reduces the burden on teachers, enables the creation of high-quality class newsletters, and enables the provision of appropriate information according to customer emotions.

[0496] A "class newsletter" is a document used by teachers in school classes to inform parents and students about events and announcements.

[0497] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to imitate human intelligence to learn and reason.

[0498] "Regular content such as events" is information about events and activities that are held regularly at schools or classes.

[0499] "Illustrations and images" are pictures or photographs that convey information visually.

[0500] "Photographs that are careful not to favor one particular person or event" are photographs that have been selected so as not to favor one particular person or event.

[0501] An "easy-to-read layout" is one in which information is organized and arranged in a way that makes it easy to understand visually.

[0502] An "emotion engine" is a technology that analyzes emotions from a user's facial expressions, tone of voice, input text, etc.

[0503] "Information and services provided to customers" refers to product information and support services provided to customers by stores and companies.

[0504] "Means for automatic creation and adjustment" refers to the system's ability to generate and appropriately adjust information and layout without human intervention.

[0505] To implement the present invention, the following system configuration and program are required.

[0506] System Configuration

[0507] 1. Hardware:

[0508] Smartphone

[0509] Smart Glasses

[0510] server

[0511] 2. Software:

[0512] Python

[0513] OpenCV

[0514] TextBlob

[0515] PIL (Python Imaging Library)

[0516] Program processing explanation

[0517] The server first receives the information entered by the user. This information includes the event schedule, details, and the message the user wants to convey. The server then automatically creates a class newsletter based on this information. Specifically, the server uses the following methods:

[0518] 1. How AI can create class newsletters:

[0519] The server uses AI to automatically create class newsletters based on information entered by teachers, reducing the burden on teachers and enabling them to create class newsletters efficiently.

[0520] 2. How to automatically update regular content such as events:

[0521] The server automatically updates information about regular events and activities, ensuring that the latest information is always reflected.

[0522] 3. Using illustrations and images that are easy to understand even with less text:

[0523] The server automatically selects illustrations and images to visually convey text information and incorporates them into the class newsletter.

[0524] 4. How to select photos with careful consideration:

[0525] The server selects photos so as not to be biased towards any particular person or event, and incorporates them into the class newsletter.

[0526] 5. Ways to create a good layout:

[0527] The server automatically creates a layout that keeps the information organized and easy to understand visually.

[0528] 6. Using an emotion engine to analyze user emotions and adjust content and layout accordingly:

[0529] The server analyzes the user's facial expressions, tone of voice, and input text to determine their emotions, and adjusts the content and layout of the newsletter accordingly. For example, if the user is feeling happy, it will use bright colors and bold fonts to emphasize positive content.

[0530] 7. Means for automatically creating and adjusting the information and services provided to customers:

[0531] The server automatically creates and adjusts the information and services provided to customers based on the information entered by store staff. It uses an emotion engine to analyze customer emotions and adjusts the content and layout of the information accordingly.

[0532] Specific examples

[0533] For example, if a customer types "What a lovely day today!", the server uses TextBlob to parse the sentiment as "positive." The server then displays information about new products and sales in bright colors and bold fonts. If a customer types "I've been feeling tired lately," the sentiment is parsed as "negative," and the server displays information about support and questions in muted colors and light fonts.

[0534] Prompt Sentence Examples

[0535] Your goal is to create a program that analyzes the sentiment of a customer based on their input text and generates the optimal message and layout based on that sentiment. The libraries used are TextBlob, PIL, and OpenCV. Use bright colors and bold fonts if the customer's sentiment is positive, and muted colors and light fonts if the sentiment is negative.

[0536] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0537] Step 1:

[0538] The user inputs information using a terminal. The input information includes the event schedule, details, and the message they want to convey. The terminal sends this information to the server. The input data is in text format, and the server receives it.

[0539] Step 2:

[0540] The server analyzes the received information and begins creating the class newsletter. First, it automatically updates regular content such as events. The server retrieves the latest event information from the database and integrates it with the input information. This ensures that the latest event information is reflected in the class newsletter.

[0541] Step 3:

[0542] The server automatically selects illustrations and images to visually convey text information. The server searches for and selects appropriate illustrations and images from an image database. The selected illustrations and images are incorporated into the content of the class newsletter.

[0543] Step 4:

[0544] The server selects photos without bias. The server selects photos from the photo database that are not biased toward a particular person or event, and incorporates them into the class newsletter. The selection criteria take into account the balance of the content and subject of the photos.

[0545] Step 5:

[0546] The server automatically creates an easy-to-read layout. The server uses a layout algorithm to generate an arrangement that organizes information and is visually easy to understand. The generated layout is used as the final form of the class newsletter.

[0547] Step 6:

[0548] The server uses an emotion engine to analyze the user's emotions. It analyzes the text entered by the user, facial expressions, and tone of voice to infer emotions. Based on the results of the emotion analysis, it adjusts the content and layout of the class newsletter. For example, bright colors and bold fonts are used for positive emotions, and muted colors and light fonts are used for negative emotions.

[0549] Step 7:

[0550] The server automatically creates and adjusts the information and services provided to customers. It generates the most suitable information for each customer based on the information entered by store staff. It uses an emotion engine to analyze the customer's emotions and adjusts the content and layout of the information accordingly. The generated information is provided to the customer via their terminal.

[0551] Step 8:

[0552] The server then sends the final generated class newsletter or customer information to the terminal, which receives it and displays it to the user or customer. The displayed information is visually arranged so that the user or customer can easily understand it.

[0553] Example 2

[0554] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0555] Creating a traditional class newsletter is a time-consuming and labor-intensive task for educators, placing a significant burden on older educators who are not particularly adept at using computers. Furthermore, the content and layout of the newsletters are uniform, making it difficult to attract parents' attention. Furthermore, it is difficult to create a class newsletter that reflects the user's feelings, which can lead to a decline in the quality of communication.

[0556] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0557] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for recognizing user emotions and adjusting the content and layout of the class newsletter in response to those emotions, and a cloud-based means for access from any device connected to the Internet. This reduces the burden on educators and enables the creation of class newsletters that attract the attention of parents. Furthermore, by creating class newsletters that reflect the user's emotions, the quality of communication can be improved.

[0558] A "class newsletter" is a document used by teachers in educational institutions to inform parents and students about class activities, events, and announcements.

[0559] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and perform functions such as learning, reasoning, recognition, and decision-making.

[0560] "Regular content such as events" refers to information about events and activities that are held regularly at schools or classes.

[0561] "Illustrations and images" are visual content such as pictures and photographs that convey information visually.

[0562] "Photo selection" is the process of selecting suitable photos based on specific criteria.

[0563] "Layout" refers to the visual arrangement and design of a document, web page, etc.

[0564] "Emotion recognition" is the process of inferring a user's emotions from their facial expressions, tone of voice, input text, etc.

[0565] "Cloud-based" refers to the use of services and data storage on remote servers provided via the Internet.

[0566] "Device" refers to an electronic device such as a computer, tablet, or smartphone.

[0567] MODE FOR CARRYING OUT THE INVENTION

[0568] This invention provides a system that allows educators to efficiently create classroom newsletters. It is designed to be easy to use, especially for older educators who are not very good at using computers. The system is cloud-based and can be accessed from any device connected to the internet.

[0569] server

[0570] The server provides a cloud-based system that receives information entered by users and creates class newsletters based on that information. Specifically, the server uses the following hardware and software:

[0571] Hardware: A server machine with a powerful processor, sufficient memory, and storage.

[0572] Software: Emotion engine, generative AI model, database management system

[0573] The server passes the information entered by the user to the emotion engine to recognize the user's emotions. The emotion engine infers emotions from the user's facial expressions, tone of voice, and input text. For example, if the user is feeling happy, the server creates a class newsletter with a positive tone, emphasizing positive content such as successful activities and the children's growth. The layout is also adjusted to create a bright and cheerful atmosphere.

[0574] Terminal

[0575] The terminal is a device through which users access the system. The terminal is connected to the Internet and can access the cloud-based system. Users use the terminal to input the necessary information and create a class newsletter. The terminal sends the user's facial expressions, tone of voice, and input text to the emotion engine. The emotion engine estimates the user's emotions based on this data and sends the results to the server. The terminal displays the content and layout of the class newsletter sent from the server so that the user can check it.

[0576] User

[0577] Users operate the system to create class newsletters. Users access the system using any device (terminal) connected to the Internet. They input the necessary information through the system's intuitive and simple operation screen. The input information is sent to the server, and the emotion engine recognizes the user's emotions. For example, if the user is feeling happy, the system will create a class newsletter with a positive tone and emphasize positive content such as successful activities and the children's growth. Conversely, if the user is feeling sad or anxious, the system will create content that takes those emotions into consideration and provide information on necessary support and measures. Users can review the content and layout of the class newsletter generated by the system and modify it as necessary.

[0578] Specific examples

[0579] For example, suppose a user wants to create this month's class newsletter. The user accesses the system using a terminal and inputs the necessary information (e.g., this month's activities and the children's progress). The emotion engine infers that the user is feeling happy based on the text, facial expression, and tone of voice they input. Based on this information, the server creates the class newsletter in a positive tone, emphasizing positive aspects such as successful activities and the children's progress. The layout is also adjusted to create a bright and cheerful atmosphere.

[0580] Prompt Sentence Examples

[0581] "I would like to create this month's class newsletter. This month's activities included a field trip and a sports day. The children had a lot of fun. Please use this as a basis for creating the class newsletter."

[0582] By inputting this prompt into a generative AI model, the system recognizes the user's emotions and creates an appropriate classroom newsletter.

[0583] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0584] Program processing flow

[0585] Step 1: User accesses the system

[0586] Users access the system using any device connected to the Internet (PC, tablet, smartphone, etc.) They open a browser, enter the system's URL, and access the login screen.

[0587] Input: System URL, Username, Password

[0588] Output: Dashboard screen after successful login

[0589] Specific operation: A user opens a browser, enters the system URL to access the login screen, enters the username and password, and clicks the login button.

[0590] Step 2: User Enters Information

[0591] Users input the necessary information through the system's intuitive and simple operation screen, such as the details of this month's activities and their children's progress, into text boxes.

[0592] Input: This month's activities and children's progress

[0593] Output: A confirmation screen showing the information entered

[0594] What happens: A user enters "We had a field trip and a sports day this month. The kids had a great time." in the "What were your activities this month?" field.

[0595] Step 3: The device sends the information to the server

[0596] The terminal sends the information entered by the user to the server, where it is prepared for processing.

[0597] Input: Information entered by the user

[0598] Output: Information sent to the server

[0599] Specific operation: When the device clicks the "Send" button, the entered information is sent to the server.

[0600] Step 4: The server recognizes emotions using the emotion engine.

[0601] The server passes the received information to the emotion engine, which then infers the user's emotion from their facial expression, tone of voice, and input text.

[0602] Input: Information entered by the user

[0603] Output: Estimated emotion (e.g., happy, sad, anxious)

[0604] Specific operation: The server passes the text "We had a field trip and a sports day. The children had a lot of fun." to the emotion engine, and the emotion engine recognizes "joy."

[0605] Step 5: The server generates the content and layout of the class newsletter.

[0606] The server generates the content and layout of the class newsletter based on the emotions recognized by the emotion engine. For example, if the user is feeling happy, the class newsletter will be created with a positive tone and a bright and cheerful layout.

[0607] Input: Estimated emotion, user-entered information

[0608] Output: Class newsletter content and layout

[0609] Specific behavior: The server generates a positive message based on "joy": "The field trip and sports day were a great success. The children had a lot of fun." and applies a bright color layout.

[0610] Step 6: The server sends the generated class newsletter to the terminal.

[0611] The server sends the content and layout of the generated class newsletter to the terminal, which then displays the received information to the user.

[0612] Input: Class newsletter content and layout

[0613] Output: Class newsletter displayed on the terminal

[0614] Specific operation: The server sends the generated class newsletter to the terminal, which displays it. The user can check the content and layout of the class newsletter on the screen.

[0615] Step 7: The user checks and edits the class newsletter.

[0616] The user checks the class newsletter displayed on the terminal and makes corrections as necessary. Once corrections are complete, the user saves or prints the final class newsletter.

[0617] Input: Generated class newsletter

[0618] Output: Modified class newsletter, saved or printed class newsletter

[0619] Specific Action: The user reviews the displayed class newsletter and is satisfied with the content: "The field trip and sports day were a great success. The children had a lot of fun." They make corrections as necessary and click the "Save" button to save the final class newsletter.

[0620] (Application example 2)

[0621] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0622] Conventional classroom newsletter creation systems are difficult to operate, especially for elderly users, and do not allow for adjustment of content or layout according to emotions, making it difficult to communicate appropriately according to the user's emotions.In addition, the generation of proposals to facilitate smooth communication with customers in physical stores is not automated, which places a heavy burden on staff and makes it difficult to improve customer satisfaction.

[0623] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0624] In this invention, the server includes means for using artificial intelligence to create class newsletters, means for automatically updating regular content such as events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize content, means for creating easy-to-read layouts, means for performing emotion recognition and adjusting content and layout according to the user's emotions, and means for generating suggestions for smooth communication with customers. This makes it easy for even elderly users to operate, and enables the creation of appropriate class newsletters according to the user's emotions and smooth communication with customers in physical stores.

[0625] A "class newsletter" is a document used by teachers at schools and educational institutions to communicate information about events and activities to parents and students.

[0626] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence, learning, reasoning, and self-correcting.

[0627] "Regular content such as events" is information about events and activities that are held regularly at schools and educational institutions.

[0628] "Illustrations and images" are pictures or photographs that convey information visually.

[0629] "Photos that are careful not to favor one person or group over another" are photos that are selected so as not to favor any particular person or group.

[0630] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[0631] "Emotion recognition" is a technology that estimates a user's emotions from facial expressions, tone of voice, input text, etc.

[0632] "Adjusting content and layout" refers to changing the content and visual layout of a document in response to the user's emotions.

[0633] "Communication with customers" refers to the act of staff exchanging information with customers and building relationships in a physical store.

[0634] "Suggestion generation" is the process of suggesting appropriate responses or actions based on specific situations or conditions.

[0635] A system for carrying out this invention has the following configuration: The server includes means for using artificial intelligence to create class newsletters, means for automatically updating regular content such as for events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize, means for creating easy-to-read layouts, means for recognizing emotions and adjusting content and layout according to the user's emotions, and means for generating suggestions for smooth communication with customers.

[0636] Hardware and software used

[0637] Hardware: Smartphone with camera, server

[0638] Software: Python, OpenCV, Keras

[0639] Data processing and calculation

[0640] The server receives video data sent from the smartphone and performs facial recognition using OpenCV. The recognized facial area is input into an emotion recognition model using Keras, and the user's emotion is estimated. Based on the estimated emotion, a generative AI model generates appropriate content and layout for the class newsletter, as well as customer service suggestions for physical stores.

[0641] Specific examples

[0642] For example, if a store staff member is holding a smartphone while interacting with a customer, the camera captures the customer's face, and the emotion recognition model recognizes the customer's emotion as "Happy." In this case, the smartphone screen will display a suggestion saying, "You seem happy. Let's introduce our new product!"

[0643] Prompt Sentence Examples

[0644] Capture your customer's facial expressions and use an emotion recognition model to infer their emotions. Based on the inferred emotions, generate suggestions such as:

[0645] Happy: Your customers seem happy. Let's introduce some new products!

[0646] Sad: You seem sad. Let me see if there's anything I can do to help you.

[0647] Other emotions: Respond to your customer's emotions accordingly.

[0648] In this way, even elderly users can easily operate the system, and it is possible to create appropriate class newsletters that reflect the user's emotions, and to communicate smoothly with customers in physical stores.

[0649] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0650] Step 1:

[0651] The terminal captures the customer's face using a camera, with the input being real-time video data and the output being the captured image data.

[0652] Step 2:

[0653] The terminal sends the captured image data to the server. The input is the image data, and the output is the data transfer to the server.

[0654] Step 3:

[0655] The server performs face recognition on the received image data using OpenCV. The input is the image data, and the output is the coordinate data of the face area.

[0656] Step 4:

[0657] The server uses the coordinate data of the face region to perform preprocessing for input into an emotion recognition model using Keras. The input is the coordinate data of the face region, and the output is the preprocessed image data.

[0658] Step 5:

[0659] The server inputs the preprocessed image data into an emotion recognition model to estimate the user's emotion. The input is the preprocessed image data, and the output is estimated emotion data.

[0660] Step 6:

[0661] The server generates appropriate suggestions using a generative AI model based on the estimated emotion data. The input is the emotion data, and the output is the suggestion content.

[0662] Step 7:

[0663] The server sends the generated proposal to the terminal. The input is the proposal, and the output is the data transfer to the terminal.

[0664] Step 8:

[0665] The device displays the received suggestions on the screen. The input is the suggestions, and the output is visual feedback to the user.

[0666] In this way, a system is realized in which the terminal and server work together to recognize customer emotions in real time and generate and display appropriate suggestions.

[0667] Example 3

[0668] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0669] Traditionally, educators have often created class newsletters manually, which is time-consuming and labor-intensive, and it has been difficult to effectively communicate content that parents will be interested in. Furthermore, many educators are not adept at using computers, making it difficult to create efficient class newsletters. Furthermore, the quality of communication can decline because it is not possible to adjust the content or layout to reflect the feelings and interests of parents.

[0670] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0671] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are not overly focused, a means for creating an easy-to-read layout, a means for recognizing a user's emotions and adjusting the content and layout of the class newsletter in response to those emotions, a means for the user to review and revise the generated class newsletter, and a means for delivering the final class newsletter to parents. This reduces the burden on educators and makes it possible to effectively convey content that parents are interested in. Furthermore, the ability to adjust the content and layout in response to the user's emotions improves the quality of communication.

[0672] A "class newsletter" is a document created by an educational institution to inform parents about their children's activities and events.

[0673] "Artificial intelligence" refers to computer systems that mimic human intelligence and can learn and reason.

[0674] "Regular content such as events" is information about events and activities that are held regularly at schools and educational institutions.

[0675] "Illustrations and images" are pictures or photographs used to convey information visually.

[0676] "Non-biased photos" are photos that are selected so as not to favor any particular child or activity.

[0677] "Layout" is a design element that refers to the structure and arrangement of a document or page.

[0678] "Recognizing a user's emotions" means estimating the user's emotions from input text, facial expressions, tone of voice, etc.

[0679] "The user checks and modifies the generated class newsletter" means that the user checks the class newsletter created by the artificial intelligence and changes the content and layout as necessary.

[0680] "Delivering the final class newsletter to parents" means sending the completed class newsletter to parents via email or a dedicated app.

[0681] The present invention is a system for making the creation of class newsletters more efficient and effectively communicating content that parents will be interested in. A specific embodiment of this system will be described below.

[0682] Hardware and software used

[0683] Hardware: Servers, devices (PCs, tablets, smartphones)

[0684] Software: emotion engines, generative AI models, image processing software (e.g., Adobe Photoshop), layout design software (e.g., Adobe InDesign)

[0685] System Overview

[0686] 1. User enters information:

[0687] The user uses the device to input the information they want to include in the class newsletter. Specifically, they input the children's activities, photos, comments, etc. For example, the user might input "photos of the children running happily at the sports day" and "how they cooperate in a relay race."

[0688] 2. The server receives the information:

[0689] The server receives the information sent by the user and stores it in a database. Specifically, it receives the text data entered by the user and the photo files uploaded by the user and stores them in the appropriate folder.

[0690] 3. The server uses the emotion engine to recognize the user's emotion:

[0691] The server activates the emotion engine and infers emotions from the text entered by the user and the uploaded photos. For example, if the user enters "The children were playing happily," the emotion engine infers that the user is feeling joy.

[0692] 4. The server uses the generative AI model to create a class newsletter:

[0693] The server inputs a prompt into the generative AI model to generate the content of the class newsletter. Specifically, the prompt uses, "Please create a class newsletter that displays large photos of the children's activities and briefly describes the details of those activities." The generative AI model generates the text of the class newsletter based on this prompt.

[0694] 5. The server adjusts the layout:

[0695] The server adjusts the layout of the class newsletter based on the results of the emotion engine. Specifically, if the user is feeling happy, the layout will have a bright and cheerful atmosphere. Using Adobe InDesign, it applies bright colors and a fun design. For example, it changes the background color to bright yellow and the font to a pop style.

[0696] 6. The server generates the class newsletter:

[0697] The server combines the generative AI model with layout design software to generate the final class newsletter. Specifically, it combines the generated text with photos uploaded by the user to create a visually appealing class newsletter. For example, it could display a large photo of a sports day, with a caption underneath that reads, "The children ran around energetically and had a great time at the sports day. Everyone worked together to achieve particularly impressive results in the relay race."

[0698] 7. User checks the class newsletter:

[0699] The user can use their device to check the generated class newsletter. Specifically, they click the preview link sent from the server and check the newsletter in their browser. They can then make corrections to the text and layout as necessary.

[0700] 8. The server distributes the class newsletter:

[0701] The server distributes the final class newsletter to parents. Specifically, it sends the newsletter via email or a dedicated app. For example, it sends the generated class newsletter as an attachment to a list of parents' email addresses.

[0702] Specific examples

[0703] Prompt Sentence Examples

[0704] "Create a class newsletter that displays large photos of the children's activities and provides brief details about the activities."

[0705] Examples of class newsletters

[0706] Photo: Display a large photo of children running at a sports day.

[0707] Description: "The children had a great time at the sports day, running around energetically. Everyone worked together to achieve great results, especially in the relay race."

[0708] In this way, an attractive class newsletter is created that reflects the user's feelings. The flow of the specific processing in the third embodiment will be described with reference to FIG.

[0709] Step 1:

[0710] The user enters the information.

[0711] The user uses the device to input the information they want to include in the class newsletter. Specifically, they input the children's activities, photos, comments, etc. For example, the user might input "photos of the children running happily at a sports day" and "how they cooperate in a relay race." The input data is sent from the device to the server as text data or image files.

[0712] Step 2:

[0713] The server receives the information.

[0714] The server receives the information sent by the user and stores it in a database. Specifically, it receives the text data entered by the user and the photo files uploaded by the user and stores them in the appropriate folder. The input data is text data and image files, and the output is the information stored in the database.

[0715] Step 3:

[0716] The server uses an emotion engine to recognize the user's emotion.

[0717] The server launches an emotion engine to estimate emotions from the text entered by the user and the uploaded photos. For example, if a user enters "The children were playing happily," the emotion engine estimates that the user is feeling happy. The input data is text data and image files, and the output is estimated emotion data.

[0718] Step 4:

[0719] The server uses the generative AI model to create a class newsletter.

[0720] The server inputs a prompt into the generative AI model to generate the content of the class newsletter. Specifically, the prompt is "Please create a class newsletter that displays large photos of the children's activities and briefly explains the details of those activities." The generative AI model generates the text of the class newsletter based on this prompt. The input data is the prompt, and the output is the generated text data.

[0721] Step 5:

[0722] The server adjusts the layout.

[0723] The server adjusts the layout of the class newsletter based on the results of the emotion engine. Specifically, if the user is feeling happy, the layout will have a bright and cheerful atmosphere. Using Adobe InDesign, it applies bright colors and a fun design. For example, it changes the background color to bright yellow and the font to a pop style. The input data is emotion data and generated text data, and the output is the adjusted layout data.

[0724] Step 6:

[0725] The server generates the class newsletter.

[0726] The server combines the generative AI model with layout design software to generate the final class newsletter. Specifically, it combines the generated text with photos uploaded by the user to create a visually appealing class newsletter. For example, it might display a large photo of a sports day, with a caption below it such as, "The children ran around energetically and had fun at the sports day. Everyone worked together to achieve particularly impressive results in the relay race." The input data is the adjusted layout data and image files, and the output is the final class newsletter data.

[0727] Step 7:

[0728] The user checks the class newsletter.

[0729] The user uses a device to check the generated class newsletter. Specifically, they click the preview link sent from the server and check the class newsletter in a browser. They can make corrections to the text and layout as needed. The input data is the final class newsletter data, and the output is the corrected class newsletter data.

[0730] Step 8:

[0731] The server distributes class newsletters.

[0732] The server distributes the final class newsletter to parents. Specifically, it sends the class newsletter via email or a dedicated app. For example, it sends the generated class newsletter as an attachment to a list of parents' email addresses. The input data is the corrected class newsletter data, and the output is the distributed class newsletter.

[0733] (Application example 3)

[0734] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0735] Conventional classroom newsletter creation systems have the problem that it is difficult to create content that parents will want to read, and that they are unable to adjust the content and layout according to the user's emotions. Furthermore, even in physical stores, product and service suggestions based on the user's emotions are not made, and an improvement in the shopping experience is required. To solve these problems, a system is needed that can recognize the user's emotions and adjust the content and layout accordingly.

[0736] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0737] In this invention, the server includes means for using AI to create class newsletters, means for automatically updating regular content such as event content, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize content, means for creating an easy-to-read layout, means for recognizing user emotions and adjusting content and layout according to those emotions, means for suggesting products and services based on the user's emotions, and means for displaying suggested content in a layout according to the user's emotions. This makes it possible to create class newsletters that parents will want to read and to suggest products and services based on the user's emotions in physical stores.

[0738] A "class newsletter" is a document used by teachers in educational institutions to inform parents about their children's activities and events.

[0739] "AI-based means" refers to a method of using artificial intelligence to automatically perform specific tasks or processes.

[0740] The "means for automatically updating regular content such as events" is a method for automatically updating information about regularly held events and activities.

[0741] "Methods of utilizing illustrations and images" are methods that use illustrations and photographs to convey information visually.

[0742] "Methods for selecting photographs that take into consideration bias" refers to a method for selecting photographs that do not favor a particular person or activity.

[0743] "Methods for creating a legible layout" are methods for designing information so that it is visually organized and arranged in an easy-to-read manner.

[0744] "Means for recognizing the user's emotions and adjusting the content and layout according to those emotions" refers to a method for inferring emotions from the user's facial expression, tone of voice, input text, etc., and changing the content and layout of information based on those emotions.

[0745] "Means for suggesting products and services based on user emotions" refers to a method for recommending appropriate products and services by taking into account the user's emotions.

[0746] The "means for displaying suggested content in a layout that corresponds to the user's emotions" is a method for displaying suggested information in a visually appealing manner that matches the user's emotions.

[0747] A system for carrying out this invention has the following configuration: The server includes means for using AI to create class newsletters, means for automatically updating regular content such as for events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize, means for creating an easy-to-read layout, means for recognizing a user's emotions and adjusting the content and layout according to those emotions, means for suggesting products and services based on the user's emotions, and means for displaying the proposed content in a layout that corresponds to the user's emotions.

[0748] Hardware and software used

[0749] Hardware:

[0750] Smartphone camera

[0751] server

[0752] software:

[0753] OpenCV

[0754] Keras

[0755] TENSORFLOW®

[0756] Data processing and calculation

[0757] The server captures video from the smartphone camera and detects faces using OpenCV. The detected facial regions are input into an emotion recognition model built with Keras to predict the user's emotions. The emotion recognition model uses TensorFlow as its backend. Based on the predicted emotions, the server suggests appropriate products and services and displays the suggestions in a layout that corresponds to the user's emotions.

[0758] Specific examples

[0759] For example, when a user launches the app through their smartphone camera, the camera captures the user's face and recognizes their emotions. If the user is smiling, the server displays "new products" and "popular products" in bright colors. On the other hand, if the user is tired, the server displays "relaxing products" and "relaxation services" in subdued colors.

[0760] Prompt Sentence Examples

[0761] An example of a prompt for a generative AI model is:

[0762] Develop an application that recognizes the user's emotions and suggests products and services accordingly. If the user is happy, suggest new or popular products. If the user is tired, suggest products and services that will help them relax. Display the suggestions in a layout that corresponds to the user's emotions.

[0763] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0764] Step 1:

[0765] The user launches the app through the smartphone camera.

[0766] Input: Smartphone camera image

[0767] Output: Captured video data

[0768] Specific behavior: The user launches the app and the smartphone camera captures the user's face.

[0769] Step 2:

[0770] The server receives the captured video data and uses OpenCV to detect faces.

[0771] Input: Captured video data

[0772] Output: Detected face area (coordinate data)

[0773] Specific operation: The server analyzes the video data and applies a face detection algorithm to identify the location of the face.

[0774] Step 3:

[0775] The server inputs the detected face regions into an emotion recognition model built with Keras.

[0776] Input: Detected face area (coordinate data)

[0777] Output: Emotion prediction result (emotion label)

[0778] Specific operation: The server extracts the facial area, performs preprocessing, and then inputs it into an emotion recognition model to predict emotions.

[0779] Step 4:

[0780] The server suggests appropriate products and services based on the emotion prediction results.

[0781] Input: Emotion prediction result (emotion label)

[0782] Output: A list of suggested products and services

[0783] Specific operation: The server refers to a database of products and services corresponding to the emotion label and generates appropriate suggestions.

[0784] Step 5:

[0785] The server displays the proposed content in a layout that corresponds to the user's emotions.

[0786] Input: List of suggested products and services, emotion prediction results (emotion labels)

[0787] Output: The layout displayed on the user's smartphone

[0788] How it works: The server adjusts the layout based on the emotion labels and displays the suggestions in a visually appealing format on the user's smartphone.

[0789] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0790] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0791] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0792] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0793] [Second embodiment]

[0794] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0795] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0796] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure.

[0797] The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0798] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0799] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0800] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0801] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0802] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0803] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0804] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0805] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0806] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0807] "Example 1"

[0808] In the system of the present invention, AI creates class newsletters on behalf of the teacher. Specifically, the teacher inputs the information necessary to create the newsletter into the system. This information includes the schedule and content of events, the message the teacher wants to convey, and so on. The system then automatically creates the newsletter based on the input information. In this process, the AI ​​performs tasks such as automatically updating regular content for events, using illustrations and images that are easy to understand even with reduced text, selecting photos that are careful not to overemphasize content, and creating an easy-to-read layout.

[0809] "Example 2"

[0810] The system of the present invention is provided in a format that can be operated even by older teachers who are not good at using PCs. Specifically, the system's operation screen has an intuitive and simple design, allowing students to create class newsletters simply by entering the necessary information. The system is also cloud-based and can be accessed from any device connected to the Internet.

[0811] "Example 3"

[0812] The system of the present invention creates class newsletters with content that parents will want to read. Specifically, based on the input information, the system emphasizes information that parents will be interested in and creates class newsletters with a visually appealing layout. For example, the system may display large photos of the children's activities and provide concise details of those activities.

[0813] The processing flow of each embodiment will be described below.

[0814] "Example 1"

[0815] Step 1: The teacher inputs the information necessary to create a class newsletter into the system, including the event schedule, content, and message to be conveyed.

[0816] Step 2: The system automatically creates a class newsletter based on the information entered. During this process, the AI ​​performs tasks such as automatically updating regular content such as events, using illustrations and images that are easy to understand even with less text, selecting photos that are careful not to overemphasize one thing, and creating an easy-to-read layout. "Example 2"

[0817] Step 1: The system's operation screen has an intuitive and simple design, allowing teachers to create class newsletters simply by entering the necessary information.

[0818] Step 2: The system is cloud-based and can be accessed from any internet-connected device.

[0819] "Example 3"

[0820] Step 1: Based on the information entered, the system creates a class newsletter in a visually appealing layout, highlighting information that parents will find interesting.

[0821] Step 2: For example, measures can be taken such as displaying large photos of the children's activities and providing brief details of those activities.

[0822] Example 1

[0823] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0824] Creating traditional class newsletters is a time-consuming and labor-intensive task for educators, placing a significant burden on older educators who are particularly unfamiliar with computers. It's also difficult to create compelling content that parents will want to read. Furthermore, it requires a wide range of tasks, including updating regular content for events, using illustrations and images that are easy to understand even with less text, carefully selecting photos that don't overwhelm others, and creating an easy-to-read layout. To solve these issues, a system that allows for the efficient and easy creation of class newsletters is needed.

[0825] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0826] In this invention, the server includes a means for the terminal to transmit information input by the user to the server, a means for generating a class newsletter using the generative AI model, and a means for transmitting the generated class newsletter to the terminal. This allows educators to easily create class newsletters and provide attractive content that parents will want to read.

[0827] A "class newsletter" is a document used by educators to inform parents and students about events and announcements.

[0828] "Artificial intelligence" refers to computer systems that mimic human intelligence and can learn and reason.

[0829] "Regular content such as events" is information about events and activities that are held regularly at schools or classes.

[0830] "Illustrations and images" are pictures or photographs that convey information visually.

[0831] "Photos that are careful not to favor one person or group over another" are photos that are selected so as not to favor any particular person or group.

[0832] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[0833] "Users" are educators who use this system to create class newsletters.

[0834] A "terminal" is a device such as a computer or smartphone that allows a user to input information and communicate with a server.

[0835] The "server" is a computer system that receives information sent by users and generates class newsletters using a generative AI model.

[0836] A "generative AI model" is an artificial intelligence algorithm that automatically generates text and content based on input information.

[0837] A "prompt sentence" is an instruction sentence input to a generative AI model.

[0838] The present invention relates to a system in which artificial intelligence is used to create class newsletters. A specific embodiment of this system will be described below.

[0839] System configuration

[0840] This system includes a terminal where the user (educator) inputs information, a server that receives and processes the input information, and a generative AI model. The terminal is a device such as a computer or smartphone, and the server is a high-performance computer system. The generative AI model used is, for example, OpenAI's GPT-4.

[0841] Program processing

[0842] The user inputs the information necessary to create a class newsletter into the terminal. This information includes the event schedule, event content, and the message to be conveyed. For example, the user might input, "The sports day is on October 15th. Let's all get ready for the sports day!"

[0843] The terminal transmits the information input by the user to the server. Specifically, the terminal transmits the input information to the server using an HTTP request.

[0844] The server generates a class newsletter using the generative AI model based on the received information. The server inputs the following prompt into the generative AI model:

[0845] Please create a class newsletter based on the information below.

[0846] Event date: October 15th

[0847] Event details: Sports day

[0848] Message to convey: "Everyone, let's get ready for the sports day!"

[0849] The content of the class newsletter should be laid out in an easy-to-read format and include appropriate illustrations and images.

[0850] The generative AI model generates the content of the class newsletter based on this prompt. For example, the following class newsletter might be generated:

[0851] Title: "About the sports day on October 15th"

[0852] Content: "Everyone, let's get ready for the sports day! The sports day will be held on October 15th. The detailed schedule is as follows..."

[0853] The server transmits the generated class newsletter to the terminal. Specifically, the server uses an HTTP response to transmit the contents of the generated class newsletter to the terminal.

[0854] The terminal displays the contents of the class newsletter received from the server to the user, who can then check the generated class newsletter on the screen of the terminal.

[0855] Specific examples

[0856] For example, if a user enters the following information:

[0857] Event date: October 15th

[0858] Event details: Sports day

[0859] Message to convey: "Everyone, let's get ready for the sports day!"

[0860] The device sends this information to a server, which uses a generative AI model to generate a class newsletter like this:

[0861] Title: "About the sports day on October 15th"

[0862] Content: "Everyone, let's get ready for the sports day! The sports day will be held on October 15th. The detailed schedule is as follows..."

[0863] The server transmits the generated class newsletter to the terminal, which displays it to the user, who can then check the generated class newsletter on the screen of the terminal.

[0864] In this way, this system allows educators to easily create class newsletters and provide attractive content that parents will want to read.

[0865] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0866] Step 1:

[0867] The user enters the information.

[0868] The user inputs the information necessary to create a class newsletter into the device. This information includes the event schedule, event content, and the message to be conveyed. For example, the user might input, "The sports day is on October 15th. Let's all get ready for the sports day!" The input information is temporarily stored in the device's memory.

[0869] Step 2:

[0870] The terminal sends the input information to the server.

[0871] The terminal sends the information entered by the user to the server. Specifically, the terminal uses an HTTP request to send the input information to the server. The input data is sent to the server in the form of the event schedule, event content, message to be conveyed, etc.

[0872] Step 3:

[0873] The server generates a class newsletter using the generative AI model.

[0874] The server generates a class newsletter using the generative AI model based on the received information. The server inputs the following prompt into the generative AI model:

[0875] Please create a class newsletter based on the information below.

[0876] Event date: October 15th

[0877] Event details: Sports day

[0878] Message to convey: "Everyone, let's get ready for the sports day!"

[0879] The content of the class newsletter should be laid out in an easy-to-read format and include appropriate illustrations and images.

[0880] The generative AI model generates the content of the class newsletter based on this prompt, and the generated content is stored in the server's memory.

[0881] Step 4:

[0882] The server transmits the generated class newsletter to the terminal.

[0883] The server sends the contents of the class newsletter generated by the generative AI model to the terminal. Specifically, the server uses an HTTP response to send the contents of the generated class newsletter to the terminal. The output data is the contents of the generated class newsletter.

[0884] Step 5:

[0885] The terminal displays the class communication to the user.

[0886] The terminal displays the contents of the class newsletter received from the server to the user. The user can check the generated class newsletter on the screen of the terminal. Specifically, the terminal performs layout processing to display the received data on the screen, and displays it in a format that is visually easy for the user to understand.

[0887] (Application example 1)

[0888] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0889] Creating traditional classroom newsletters and store event information is often done manually, which takes time and effort, and can lead to variations in the readability and ease of understanding of the information. Furthermore, these tasks are often a burden for older teachers and store staff who are not good at using computers. Furthermore, the need for specialized knowledge and skills, such as creating messages that are easy for customers to understand, selecting images, and automatically updating regular events, makes it difficult to efficiently disseminate information.

[0890] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0891] In this invention, the server includes a means for using AI to create class newsletters, a means for automatically updating regular content such as events, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for automatically creating and distributing store event and sale information, a means for generating messages that are easy for customers to understand, a means for automatically selecting images and illustrations, a means for automatically updating regular events, and a means for including an application to be installed on a smartphone. This streamlines the creation of class newsletters and store event information, enabling the dissemination of information that is easy to read and understand. Furthermore, it can be easily operated even by older teachers and store staff who are not good at using computers, reducing the burden on them.

[0892] A "class newsletter" is an information newsletter issued to parents and students on a class-by-class basis at school.

[0893] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to act in a way that mimics human intelligence.

[0894] "Regular content such as events" is information about events and activities that are held regularly at schools and stores.

[0895] "Illustrations and images" are pictures or photographs that convey information visually.

[0896] "Photographs that are careful not to favor one particular person or thing" are photographs that have been selected so as not to favor one particular person or thing.

[0897] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[0898] "Store event information" is information about sales and campaigns held at the store.

[0899] "Sale information" is information about product discounts and special offers.

[0900] A "message that is easy for customers to understand" is a message that is designed to be easy for customers to understand and to attract their interest.

[0901] "Automatic selection of images and illustrations" is the process in which AI automatically selects appropriate images and illustrations.

[0902] "Automatic update of regular events" means automatically updating information about regularly scheduled events to the latest information.

[0903] An "application installed on a smartphone" is a software program that runs on a smartphone.

[0904] The system for implementing this invention consists of three elements: a server, a terminal, and a user. The server plays a central role in automatically creating and distributing class newsletters and store event information. The terminal is a device where users input information and check the generated communications. Users provide information to create class newsletters and store event information.

[0905] The server includes the following means:

[0906] 1. AI can take over the creation of class newsletters

[0907] 2. Means of automatically updating regular content such as events

[0908] 3. Using illustrations and images that are easy to understand even with less text

[0909] 4. How to select photos without bias

[0910] 5. How to create a clear layout

[0911] 6. A means to automatically create and distribute store event and sales information

[0912] 7. A way to create a message that is easy for customers to understand

[0913] 8. A method for automatically selecting images and illustrations

[0914] 9. A way to automatically update recurring events

[0915] 10. Means including an application installed on a smartphone

[0916] The server uses OpenAI's API to leverage a generative AI model to generate prompts based on the information entered by the user. For example, if a user enters event information such as "Summer Sale, August 1st - August 10th, 20% off all items," the server generates the following prompt:

[0917] Use the information below to create a message that will be easy for your customers to understand.

[0918] Event Name: Summer Sale

[0919] Dates: August 1st to August 10th

[0920] Contents: 20% off all products

[0921] Based on this prompt, the generative AI model generates a message that is easy for the customer to understand, which is then sent to the device so that the user can view it.

[0922] A terminal is a device such as a smartphone or tablet that allows users to input information and check generated communications. A dedicated application is installed on the terminal, and users can input information through an intuitive interface.

[0923] For example, when a user opens a smartphone application and enters event information, the server automatically processes the information and generates a communication in an easy-to-read layout. The generated communication includes appropriately selected images and illustrations and a message that is easy for customers to understand.

[0924] In this way, the creation of class newsletters and store event information becomes more efficient, and it becomes possible to transmit information that is easy to read and understand. Furthermore, it is easy to use even for elderly teachers and store staff who are not good at using PCs, so the burden on them is reduced.

[0925] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0926] Step 1:

[0927] A user uses a terminal to input information about a class newsletter or a store event. The input information includes the event name, date, and content. The terminal then transmits this information to the server.

[0928] Step 2:

[0929] The server generates a prompt based on the received information. Specifically, it uses a generative AI model to analyze the input information and create a prompt that will generate a message that is easy for the customer to understand. For example, the following prompt is generated:

[0930] Use the information below to create a message that will be easy for your customers to understand.

[0931] Event Name: Summer Sale

[0932] Dates: August 1st to August 10th

[0933] Contents: 20% off all products

[0934] Step 3:

[0935] The server sends the generated prompt to the generative AI model, which generates a message that is easy for customers to understand. The generative AI model performs natural language processing based on the prompt and generates an appropriate message. For example, it generates a message like, "Our big summer sale is starting! All products are 20% off from August 1st to 10th. Don't miss out!"

[0936] Step 4:

[0937] The server creates an easy-to-read layout based on the generated message. Specifically, it uses the PIL library to automatically select images and illustrations and draw the message on the image. For example, it draws the message on a background image and selects appropriate fonts and colors.

[0938] Step 5:

[0939] The server sends the generated layout to the terminal, which displays the received layout to the user, who can then review the generated communication and make any necessary corrections.

[0940] Step 6:

[0941] After the user completes the corrections, the device sends the final communication to the server, which stores it and distributes it to a designated destination, such as emailing it to a parent or client.

[0942] In this way, the creation of class newsletters and store event information becomes more efficient, and it becomes possible to transmit information that is easy to read and understand. Furthermore, it is easy to use even for elderly teachers and store staff who are not good at using PCs, so the burden on them is reduced.

[0943] Example 2

[0944] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0945] Creating a traditional class newsletter was difficult, time-consuming, and labor-intensive, especially for older educators who were not very good at using computers. Furthermore, while the content of the newsletter needed to be appealing to parents, creating the text and adjusting the layout to achieve this was also a difficult task. Furthermore, updating regular content such as events and selecting photos that could be biased were also time-consuming tasks. A system that could solve these problems was needed.

[0946] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0947] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for operating in a cloud environment and accessible from any terminal connected to the Internet, a means for saving information entered by a user in a database and generating class newsletters using a template engine, a means for outputting the generated class newsletters in PDF or HTML format, and a means for generating text based on prompts using a generative AI model. This makes it possible for even older educators who are not good at using computers to easily create class newsletters and efficiently generate class newsletters that are appealing to parents.

[0948] A "class newsletter" is a document used by teachers in educational institutions to inform parents and students about events, learning progress, and other announcements.

[0949] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and perform functions such as learning, reasoning, and recognition.

[0950] A "cloud environment" is an infrastructure for using computer resources and services provided via the Internet.

[0951] A "terminal" is a device, such as a computer, tablet, or smartphone, that a user uses to access the system.

[0952] A "database" is a system for efficiently storing, searching, and managing data.

[0953] A "template engine" is software that generates dynamic content by embedding data in templates containing placeholders.

[0954] "PDF format" is an abbreviation for Portable Document Format, a file format for electronically storing, displaying, and printing documents.

[0955] "HTML format" is an abbreviation for HyperText Markup Language, a markup language for building web pages.

[0956] A "generative AI model" is a model that uses artificial intelligence technology to generate sentences and content based on input prompts.

[0957] A "prompt" is an instruction entered into a generative AI model to specify the content and format of the content to be generated.

[0958] This invention is a system that allows even elderly educators who are not good at using PCs to easily create class newsletters. The system runs in a cloud environment and can be accessed from any device connected to the Internet. A specific embodiment of this system is described below.

[0959] The server runs on a cloud platform (e.g., Amazon Web Services, Microsoft Azure). When a user accesses the system from a device (PC, tablet, smartphone, etc.), the server provides an intuitive and simple operation screen. This operation screen is built using web technologies such as HTML, CSS, and JavaScript.

[0960] The user enters the necessary information (e.g., the title, content, and image of the class newsletter) into the operation screen. The entered data is sent to the server and saved in a database (e.g., MySQL, PostgreSQL). The server applies a template for generating the class newsletter based on the saved data, and generates the final newsletter. The information entered by the user is embedded in the template using a template engine (e.g., Handlebars.js, EJS).

[0961] The generated class newsletter is output in PDF or HTML format, allowing users to download or print it. Libraries such as wkhtmltopdf and PDFKit are used to generate PDFs. In addition, it is possible to automatically generate the content of the class newsletter using a generative AI model (e.g., OpenAI GPT-3). When the user enters a prompt sentence, the generative AI model generates an appropriate sentence and adds it to the class newsletter.

[0962] As a concrete example, consider the case where a user wants to create a "Class Newsletter of the Month." The user enters the following information into the operation screen:

[0963] Title: "This month's class newsletter"

[0964] Contents: "This month's event information, learning progress, and messages to parents"

[0965] Image: School event photos

[0966] The server receives this information, stores it in a database, then applies a template to generate a class newsletter and outputs it in PDF format.

[0967] When using a generative AI model, the user enters a prompt like this:

[0968] "Generate this month's class newsletter. Include event information, learning progress, and parent / guardian announcements."

[0969] The generative AI model generates appropriate sentences based on this prompt and adds them to the class newsletter. For example, the following sentences might be generated:

[0970] "Information about this month's events includes the sports day, which will be held on October 15th. Regarding learning progress, the math unit has been completed and students will move on to the next unit. As a message to parents, the date for next month's parent-teacher meeting has been decided, so please check it."

[0971] In this way, users can easily create and download or print class newsletters.

[0972] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0973] Step 1:

[0974] A user accesses the system.

[0975] Users access the system's URL from a web browser using a device connected to the Internet (such as a PC, tablet, or smartphone). The server runs in a cloud environment and receives the user's access request. The input is the user's access request, and the output is the system's operation screen. The server provides the user with an intuitive and simple operation screen built using HTML, CSS, and JavaScript.

[0976] Step 2:

[0977] The user enters the information.

[0978] The user inputs the necessary information into the form displayed on the operation screen. For example, they input the title, content, and images of the class newsletter. Input is the information entered by the user, and output is the transmission of this information to the server. Specifically, the user inputs the title "This month's class newsletter," the content "This month's event information, learning progress, and messages to parents," and a photo of the school event.

[0979] Step 3:

[0980] The server receives and stores the data.

[0981] The server receives the information entered by the user and stores it in a database (e.g. MySQL, PostgreSQL). The input is the information submitted by the user, and the output is the data stored in the database. The server performs validation checks to maintain data integrity and stores the data in the correct format.

[0982] Step 4:

[0983] The server generates the class newsletter.

[0984] The server generates a class newsletter based on the saved data. It uses a template engine (e.g. Handlebars.js, EJS) to embed the information entered by the user into the template. The input is the data saved in the database, and the output is the HTML structure of the generated class newsletter. Specifically, the template contains the following structure:

[0985]

[0986] <title> {{title}}< / title>

[0987]

[0988] <h1> {{title}}< / h1>

[0989] {{Contents}}

[0990]

[0991]

[0992]

[0993] Step 5:

[0994] The server outputs the generated class newsletter.

[0995] The server outputs the generated class newsletter in PDF or HTML format. To generate PDFs, libraries such as wkhtmltopdf and PDFKit are used. The input is the HTML structure of the generated class newsletter, and the output is a PDF or HTML file. The server saves the generated file so that users can download it.

[0996] Step 6:

[0997] The user downloads or prints the class newsletter.

[0998] Users can download or print the generated class newsletter from the system's operation screen. The input is the user's download or print request, and the output is the download or print of the PDF file. Specifically, when the user clicks the download link, the PDF file is saved on the device. When the user clicks the print button, the browser's print function is called up, and the class newsletter can be printed.

[0999] Step 7:

[1000] Generate sentences using generative AI models.

[1001] When a user inputs a prompt, the server uses a generative AI model (e.g., OpenAI GPT-3) to generate an appropriate sentence. The input is the prompt entered by the user, and the output is the generated sentence. Specifically, the user inputs a prompt like this:

[1002] "Generate this month's class newsletter. Include event information, learning progress, and parent / guardian announcements."

[1003] The generative AI model generates appropriate sentences based on this prompt and adds them to the class newsletter. For example, the following sentences might be generated:

[1004] "Information about this month's events includes the sports day, which will be held on October 15th. Regarding learning progress, the math unit has been completed and students will move on to the next unit. As a message to parents, the date for next month's parent-teacher meeting has been decided, so please check it."

[1005] (Application example 2)

[1006] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1007] Creating traditional classroom and store newsletters was time-consuming and labor-intensive, placing a significant burden on older teachers and store staff who were not particularly adept at using computers. Furthermore, updating and distributing newsletter content had to be done manually, which was inefficient. Furthermore, it was difficult to create content that would appeal to customers and parents.

[1008] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a generation AI model to create class newsletters, a means for automatically updating regular content such as event content, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for a generation AI model to create store newsletters, a means for storing them in the cloud, a means for accessing them from any device connected to the Internet, and a means for distributing them to customers. This makes it possible for even older teachers and store staff who are not good at using PCs to easily create, update, and distribute class newsletters and store newsletters.

[1009] A "class newsletter" is a document used to communicate information about a school class or grade to parents and students.

[1010] A "generative AI model" is an algorithm that uses artificial intelligence to automatically generate content such as text and images.

[1011] "Regular content such as events" is information about events and campaigns that are held regularly at schools and stores.

[1012] "Utilizing illustrations and images" means using illustrations and images to complement written information and make it easier to understand visually.

[1013] "Selecting photographs with care to avoid bias" means selecting photographs with care to avoid bias towards any particular person or thing.

[1014] An "easy-to-read layout" is one in which information is organized and arranged in a way that is visually easy to understand.

[1015] "Store communications" are documents used to communicate the latest store information and campaign information to customers.

[1016] "Storing in the cloud" means storing data on a remote server via the internet.

[1017] "Any device connected to the Internet" means any device that can connect to the Internet (such as a smartphone, tablet, or PC).

[1018] "Delivery to customers" means delivering the created information to customers.

[1019] A system for implementing this invention has the function of generating classroom and store communications using a generative AI model. The system is cloud-based and can be accessed from any device connected to the Internet. A specific embodiment of the system is described below.

[1020] System configuration

[1021] The system consists of the following main components:

[1022] 1. Generative AI models: Artificial intelligence algorithms that generate text and images.

[1023] 2. Cloud storage: A remote server for storing generated communications.

[1024] 3. User Interface: An intuitive interface for users to enter information and create and edit correspondence.

[1025] 4. Distribution module: A function for distributing created communications to customers and parents.

[1026] Hardware and software used

[1027] Hardware: Internet-connected devices such as smartphones, tablets, and PCs.

[1028] Software: Python, AWS SDK (boto3), generative AI model (e.g. GPT-3).

[1029] Data processing and calculation

[1030] 1. User interface: The user enters the store name, campaign information, additional information, etc.

[1031] 2. Generative AI model: Generates text and images for class newsletters and store newsletters based on input information.

[1032] 3. Cloud storage: The generated correspondence is stored in the cloud in JSON format.

[1033] 4. Distribution module: Distributes stored communications to clients and parents.

[1034] Specific examples

[1035] For example, a store associate enters the following information:

[1036] Store name: ABC Store

[1037] Campaign Information: Summer Sale! 20% off all items

[1038] Additional Information: Limited Time Offer: July 1st to July 31st

[1039] Based on this information, the generative AI model generates the following store communication:

[1040] Store name: ABC Store

[1041] Campaign Information: Summer Sale! 20% off all items

[1042] Additional Information: Limited Time Offer: July 1st to July 31st

[1043] Created: 2023-07-01T12:00:00

[1044] The generated communications are stored in the cloud and distributed to customers as needed, making it possible for even older teachers and store staff who are not very good at using computers to easily create, update, and distribute class and store newsletters.

[1045] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1046] Step 1:

[1047] The user accesses the user interface using a terminal. The user inputs the necessary data, such as the store name, campaign information, additional information, etc. The input data is sent from the user interface to the server.

[1048] Step 2:

[1049] The server passes the received data to the generative AI model, which generates text and images for classroom and store newsletters based on the input data. Specifically, the generative AI model analyzes the prompt text and generates appropriate documents and images.

[1050] Step 3:

[1051] The communication content generated by the generative AI model is converted to JSON format by the server. This JSON data is saved in cloud storage. The server also records metadata such as the URL of the save destination and the save date and time.

[1052] Step 4:

[1053] Users can access the cloud storage using their devices to check and edit the saved communication content. If the user makes any edits, the data is sent to the server again and the updated content is saved in the cloud storage.

[1054] Step 5:

[1055] The server passes the saved communication content to the distribution module, which then distributes the communication content to the customer or guardian via email, SMS, in-app notifications, and other methods.

[1056] Step 6:

[1057] When the distribution is complete, the server records the distribution result and notifies the user, who can then check the distribution result using their terminal.

[1058] Example 3

[1059] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1060] Creating traditional class newsletters is a time-consuming and labor-intensive task for teachers and school staff, and is particularly difficult for users who are not good at using computers. It is also difficult to create a layout and design that effectively conveys content that will interest parents. This results in a decline in the quality of class newsletters and a failure to attract parents' attention.

[1061] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1062] In this invention, the server includes a means for a user to input information, a means for the server to receive information, a means for the server to input a prompt sentence to the generative AI model, a means for the generative AI model to generate content for the class newsletter, a means for the server to send the generated content to layout software, a means for the server to generate a visually appealing layout, and a means for the server to provide the final class newsletter to the user. This automates the creation of class newsletters and makes it possible to effectively communicate content that will interest parents.

[1063] "Means for users to input information" refers to an interface that allows teachers and school staff to input information they want to include in class newsletters using a device such as a computer or tablet.

[1064] The "means for the server to receive information" is a function that allows the server to receive information entered by the user and store it in a database.

[1065] "Means for the server to input prompt sentences to the generative AI model" refers to a function that allows the server to create and input instruction sentences to the generative AI model based on the information received.

[1066] "Means by which the generative AI model generates the contents of the class newsletter" refers to the function that enables the generative AI model to automatically generate the contents of the class newsletter based on the prompt text.

[1067] "Means for the server to send the generated content to the layout software" is a function that enables the server to send the content of the class newsletter obtained from the generating AI model to the layout software.

[1068] "Means for the server to generate a visually appealing layout" refers to a function that enables the server to use layout software to automatically arrange the contents of the class newsletter in a visually appealing format.

[1069] "Means for the server to provide the final class newsletter to the user" is a function that allows the server to provide the final generated class newsletter to the user, allowing the user to review and modify it.

[1070] The present invention is a system for automating the creation of class newsletters and effectively communicating content that parents will be interested in. A specific embodiment of this system will be described below.

[1071] First, the user (teachers or school staff) uses a device (PC or tablet) to input the information they want to include in the class newsletter. This information includes the children's activities, photos, event information, etc. For example, the user inputs "photos from a field trip" and "field trip details (destination, activities, participants' impressions)."

[1072] Next, the server receives the information entered by the user from the device. The received information is stored in a database. The server then creates and inputs a prompt to the generative AI model based on the received information. For example, it generates a prompt such as, "Based on the information below, please create a class newsletter that will interest parents. Please use a visually appealing layout and emphasize important information."

[1073] The generative AI model generates content for a class newsletter based on prompts received from the server. For example, it displays large photos of the children's activities and generates text that briefly describes the activities. The generated content is then sent by the server to layout software such as Adobe InDesign or Canva.

[1074] The server uses layout software to automatically generate visually appealing class newsletters. For example, it adjusts the placement of photos and the font and color of text. The final newsletter is then provided to the user by the server. The user can review the newsletter through their device and make corrections or additions as needed.

[1075] As a concrete example, suppose the user enters the following information:

[1076] Photos of children on a field trip

[1077] Field trip details (destination, activities, participants' impressions)

[1078] The server generates a class newsletter based on this information:

[1079] View larger photos of the field trip

[1080] Add a brief description: "The children had a fun day at ____ Park. They did some nature observation and learned about different plants and animals."

[1081] Example prompts to input to a generative AI model:

[1082] "Use the information below to create a class newsletter that parents will find interesting. Use a visually appealing layout that highlights important information.

[1083] Photos of children on a field trip

[1084] Details of the trip (destination, activities, participants' impressions)

[1085] In this way, the server can automatically create class newsletters that parents will want to read. This system makes it possible to efficiently create class newsletters and effectively communicate content that will attract parents' attention. The flow of the specific processing in Example 3 will be described with reference to FIG. 15.

[1086] Step 1:

[1087] The user enters the information.

[1088] Users (teachers and school staff) use devices (PCs and tablets) to input the information they want to include in the class newsletter. The information input includes details of the children's activities, photos, event information, etc. For example, a user might input "photos from a field trip" and "field trip details (destination, activities, participants' impressions)." The input data is sent from the device to the server.

[1089] Step 2:

[1090] The server receives the information.

[1091] The server receives information entered by the user from the device. The received information is stored in a database. Specifically, the server receives HTTP requests and stores the information in a database. The input data includes the children's activities, photos, event information, etc., and the output is the information stored in the database.

[1092] Step 3:

[1093] The server inputs a prompt sentence into the generative AI model.

[1094] The server creates and inputs a prompt to the generative AI model based on the received information. For example, it generates a prompt such as, "Based on the information below, please create a class newsletter that will interest parents. Please use a visually appealing layout and emphasize important information." The input data is the information stored in the database, and the output is the generated prompt.

[1095] Step 4:

[1096] A generative AI model generates the content for the class newsletter.

[1097] The generative AI model generates the content of a class newsletter based on the prompt received from the server. For example, it displays a large photo of the children's activities and generates text that briefly describes the details of those activities. The input data is the prompt, and the output is the content of the generated class newsletter.

[1098] Step 5:

[1099] The server sends the generated content to the layout software.

[1100] The server sends the content of the class newsletter obtained from the generative AI model to layout software such as Adobe InDesign or Canva. Specifically, it sends data to the layout software using an API. The input data is the content of the generated class newsletter, and the output is the data sent to the layout software.

[1101] Step 6:

[1102] The server generates a visually appealing layout.

[1103] The server uses layout software to automatically generate visually appealing class communications, for example adjusting the placement of photos, text fonts, colors, etc. The input data is the data sent to the layout software, and the output is a visually appealing layout.

[1104] Step 7:

[1105] The server provides the final class communication to the user.

[1106] The server provides the final generated class newsletter to the user, who can review it through their device and make corrections or additions as needed. The input data is a visually appealing layout, and the output is the final class newsletter provided to the user.

[1107] (Application example 3)

[1108] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1109] Creating traditional classroom newsletters and store newsletters was time-consuming and laborious, placing a significant burden on older teachers and store owners who were not particularly adept at using computers. It was also difficult to effectively highlight information that would interest parents and customers and create a visually appealing layout. This resulted in a decrease in the effectiveness of information transmission and an inability to capture the attention of recipients.

[1110] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1111] In this invention, the server includes means for using AI to create class newsletters, means for automatically updating regular content such as events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize content, means for creating easy-to-read layouts, means for automatically generating store newsletters, means for emphasizing information that customers are interested in, means for creating visually appealing layouts, and means for inserting images. This makes it possible to effectively emphasize information that parents and customers are interested in, and automatically create class newsletters and newsletters with visually appealing layouts.

[1112] A "class newsletter" is a document used to inform parents about activities, events, and announcements for a school class or grade.

[1113] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to imitate human intelligence to learn and reason.

[1114] "Regular content such as events" is information about events and activities that are held regularly at schools and stores.

[1115] "Illustrations and images" are pictures or photographs that convey information visually.

[1116] "Photo selection" is the process of selecting appropriate photos based on specific criteria.

[1117] "Layout" refers to the arrangement and design of documents and images.

[1118] A "store newsletter" is an informational document issued by a store to its customers.

[1119] "Information that interests customers" is information that customers find highly interesting and valuable.

[1120] A "visually appealing layout" is a design that looks beautiful and arranges information in an easy-to-understand manner.

[1121] An "image insertion method" is a method or technique for adding an image to a document or layout.

[1122] The system for implementing this invention operates in cooperation with a server, a terminal, and a user. The server runs a program for automating the creation of class newsletters and store newsletters. Specifically, the following hardware and software are used:

[1123] Hardware:

[1124] Server: A computer with a powerful processor and large memory capacity

[1125] Devices: Smartphones, tablets, PCs, etc.

[1126] software:

[1127] Python: A programming language used to implement programs

[1128] PIL (Python Imaging Library): A library for image processing

[1129] Generative AI model: An artificial intelligence model for natural language processing and image generation

[1130] The server automatically generates class newsletters and store newsletters based on the information entered by the user. Specifically, the process is carried out as follows:

[1131] 1. The user uses a terminal to upload event information, product information, special offer information, and related images to the server.

[1132] 2. The server uses a generative AI model to analyze the input information and highlight information that will be of interest to parents and customers.

[1133] 3. The server uses PIL to create a visually appealing layout and insert images in the appropriate locations.

[1134] 4. Finally, the server saves the generated class newsletter or newsletter as an image file and provides it to the user.

[1135] Examples:

[1136] For example, if a store owner enters information about a "summer festival" or a "new product launch" and uploads related images, the server automatically highlights this information and generates a visually appealing newsletter.

[1137] Example prompt sentence:

[1138] Enter information about your "Summer Festival" or "New Product Launch" and upload relevant images. The app will automatically highlight these details and generate a visually appealing newsletter.

[1139] In this way, the server helps users to easily create attractive class newsletters and newsletters, which improves the effectiveness of information transmission and attracts the attention of recipients.

[1140] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1141] Step 1:

[1142] A user uses a terminal to upload event information, product information, special offer information, and related images to the server.

[1143] Input: Event information, product information, bonus information, image files

[1144] Output: Input data stored on the server

[1145] Specific operation: The user opens the application on their device, enters event information, product information, and special offer information into the input form, selects an image file, and presses the upload button. The server receives this data and saves it in the database.

[1146] Step 2:

[1147] The server uses a generative AI model to analyze the input information and highlight information that will be of interest to parents and customers.

[1148] Input: Event information, product information, and special offer information stored on the server

[1149] Output: Highlighted information

[1150] How it works: The server inputs event information, product information, and special offer information into the generative AI model, which then analyzes this information to identify areas that parents and customers will be interested in. The identified information is then output in an emphasized format.

[1151] Step 3:

[1152] The server uses PIL to create a visually appealing layout and insert images in the appropriate locations.

[1153] Input: Highlighted information, image file

[1154] Output: A newsletter with a visually appealing layout

[1155] What it does: The server uses PIL to create a canvas, draws the highlighted information as text, inserts image files in the appropriate locations, and adjusts the overall layout.

[1156] Step 4:

[1157] The server saves the generated class newsletter or newsletter as an image file and provides it to the user.

[1158] Enter: a newsletter with a visually appealing layout.

[1159] Output: Generated newsletter image files

[1160] What happens: The server saves the final layout as an image file and generates a download link for the user. The user then downloads the generated newsletter from their device using this link.

[1161] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1162] "Example 1"

[1163] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system has the ability to recognize a user's emotions and adjust the content and layout of a class newsletter according to those emotions. Specifically, the emotion engine infers the user's emotions from their facial expressions, tone of voice, input text, and the like. The system then adjusts the content of the class newsletter according to those emotions. For example, if the user is feeling happy, the content of the class newsletter is created with a positive tone, emphasizing positive content such as successful activities and children's growth. Furthermore, if the user is feeling sad or anxious, the content of the class newsletter is created taking those emotions into consideration and providing information on necessary support and measures. Furthermore, the emotion engine also adjusts the layout of the class newsletter. For example, if the user is feeling happy, the layout of the class newsletter will have a bright and cheerful atmosphere, while if the user is feeling sad or anxious, the layout will have a more subdued color and design. This allows for the creation of an appropriate class newsletter according to the user's emotions, improving communication with the user.

[1164] "Example 2"

[1165] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system has the ability to recognize a user's emotions and adjust the content and layout of a class newsletter according to those emotions. Specifically, the emotion engine infers the user's emotions from their facial expressions, tone of voice, input text, and the like. The system then adjusts the content of the class newsletter according to those emotions. For example, if the user is feeling happy, the content of the class newsletter is created with a positive tone, emphasizing positive content such as successful activities and children's growth. Furthermore, if the user is feeling sad or anxious, the content of the class newsletter is created taking those emotions into consideration and providing information on necessary support and measures. Furthermore, the emotion engine also adjusts the layout of the class newsletter. For example, if the user is feeling happy, the layout of the class newsletter will have a bright and cheerful atmosphere, while if the user is feeling sad or anxious, the layout will have a more subdued color and design. This allows for the creation of an appropriate class newsletter according to the user's emotions, improving communication with the user.

[1166] "Example 3"

[1167] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system has the ability to recognize a user's emotions and adjust the content and layout of a class newsletter according to those emotions. Specifically, the emotion engine infers the user's emotions from their facial expressions, tone of voice, input text, and the like. The system then adjusts the content of the class newsletter according to those emotions. For example, if the user is feeling happy, the content of the class newsletter is created with a positive tone, emphasizing positive content such as successful activities and children's growth. Furthermore, if the user is feeling sad or anxious, the content of the class newsletter is created taking those emotions into consideration and providing information on necessary support and measures. Furthermore, the emotion engine also adjusts the layout of the class newsletter. For example, if the user is feeling happy, the layout of the class newsletter will have a bright and cheerful atmosphere, while if the user is feeling sad or anxious, the layout will have a more subdued color and design. This allows for the creation of an appropriate class newsletter according to the user's emotions, improving communication with the user.

[1168] The processing flow of each embodiment will be described below.

[1169] "Example 1"

[1170] Step 1: The user starts the system and begins creating a class newsletter.

[1171] Step 2: The system activates the emotion engine to recognize the user's emotions. Emotion recognition is based on the user's facial expressions, tone of voice, and input text.

[1172] Step 3: The emotion engine adjusts the content of the class newsletter according to the recognized emotion. For example, if the user is feeling happy, the content of the class newsletter will be created with a positive tone and will emphasize positive things such as successful activities and children's growth.

[1173] Step 4: The emotion engine also adjusts the layout of the class newsletter according to the recognized emotion. For example, if the user is feeling happy, the layout of the class newsletter will be bright and cheerful.

[1174] Step 5: The system creates a class newsletter with the adjusted content and layout and provides it to the user, thereby creating an appropriate class newsletter that reflects the user's emotions and improving communication with the user.

[1175] Example 1

[1176] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1177] Creating a traditional class newsletter is a time-consuming and labor-intensive task for educators, placing a significant burden on older educators who are not particularly adept at using computers. Furthermore, the content and layout of the newsletter are uniform, making it difficult to attract parents' attention. Furthermore, the inability to adjust the content or layout to reflect the user's feelings can lead to a decline in the quality of communication.

[1178] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1179] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing diagrams and images that are easy to understand even with reduced text, a means for selecting photos that are not overly focused, a means for creating an easy-to-read layout, a means for recognizing a user's emotions and adjusting the content and layout of the class newsletter in response to those emotions, a means for extracting important keywords and phrases from input text using natural language processing technology, a means for automatically creating class newsletters using a generative AI model, a means for estimating a user's emotions using an emotion engine, and a means for adjusting the layout of the class newsletter in response to the user's emotions. This reduces the burden on educators and enables the creation of class newsletters that attract parents' attention. Furthermore, the content and layout can be adjusted in response to the user's emotions, improving the quality of communication.

[1180] A "class newsletter" is a document used by educators to inform parents and students about events, class situations, messages, etc.

[1181] "Artificial intelligence" is a technology that enables computer systems to imitate human intelligence to learn, reason, and make decisions.

[1182] "Regular content such as events" is information about events and activities that are held regularly at schools or classes.

[1183] "Diagrams and images" refers to visual content such as illustrations and photographs that convey information visually.

[1184] "Photographs that take care not to favor any particular student or event" are photographs that are selected impartially.

[1185] An "easy-to-read layout" is an arrangement or design in which information is organized and easy to understand visually.

[1186] An "emotion engine" is a technology that estimates emotions from a user's facial expressions, tone of voice, input text, etc.

[1187] "Natural language processing technology" is a technology that enables computers to understand and analyze human language.

[1188] A "generative AI model" is an artificial intelligence model that automatically generates new content based on input data.

[1189] "Keywords and phrases" are words or parts of sentences that are particularly important in the input text.

[1190] This invention is a system in which artificial intelligence (AI) is used to create class newsletters, reducing the burden on educators and creating newsletters that attract the attention of parents. A specific embodiment of this system will be described below.

[1191] System configuration

[1192] Subject: User

[1193] The user inputs the information necessary to create a class newsletter into the terminal. This information includes the event date, content, and the message to be conveyed. For example, the user might input, "The sports day is on October 10th. I would like to convey the children's progress."

[1194] Subject: Terminal

[1195] The terminal transmits the information input by the user to the server. Specifically, the terminal transmits the input text data to the server as an HTTP request.

[1196] Subject: Server

[1197] The server analyzes the received information. Specifically, it uses natural language processing technology to extract important keywords and phrases from the input text. For example, it extracts keywords such as "sports day," "October 10th," and "growth."

[1198] Subject: Server

[1199] The server uses an emotion engine to recognize the user's emotions. The emotion engine infers emotions from the user's input text, facial expressions, tone of voice, etc. For example, if a user inputs "I want to share my children's growth," the emotion engine infers that the user is feeling happy.

[1200] Subject: Server

[1201] The server automatically creates class newsletters using a generative AI model. Specifically, the server generates appropriate text and layout based on extracted keywords and recognized emotions. For example, it creates a positive-toned newsletter that reads, "The sports day was a great success! We could see the children's growth!"

[1202] Subject: Server

[1203] The server adjusts the layout of the class newsletter according to the emotion estimated by the emotion engine. For example, if the user is feeling happy, the server applies a bright and cheerful layout, using bright colors and cheerful illustrations.

[1204] Subject: Server

[1205] The server transmits the generated class newsletter to the terminal. Specifically, the server transmits the generated class newsletter data to the terminal as an HTTP response.

[1206] Subject: Terminal

[1207] The terminal displays the class newsletter received from the server to the user. Specifically, the terminal displays the content and layout of the generated class newsletter on the screen of the terminal.

[1208] Specific examples

[1209] Example 1: Creating a positive classroom newsletter

[1210] 1. The user enters into the terminal, "The sports day is on October 10th. I would like to report on my children's growth."

[1211] 2. The terminal sends the entered information to the server.

[1212] 3. The server analyzes the information and extracts the keywords "sports day," "October 10th," and "growth."

[1213] 4. The server uses the emotion engine to recognize that the user is feeling joy.

[1214] 5. The server uses the generative AI model to create positive content such as, "The sports day was a great success! We could see the children's growth!"

[1215] 6. The server will adopt a bright and fun layout.

[1216] 7. The server sends the generated class newsletter to the terminal.

[1217] 8. The terminal displays the generated class newsletter to the user.

[1218] Example 2: Creating a class newsletter that requires support

[1219] 1. The user types into the device, "There has been some bullying in my class recently. I would like to include information about support and measures."

[1220] 2. The terminal sends the entered information to the server.

[1221] 3. The server analyzes the information and extracts the keywords "bullying," "support," and "measures."

[1222] 4. The server uses an emotion engine to recognize that the user is feeling sad or anxious.

[1223] 5. The server uses the generative AI model to create content titled "Support and countermeasures for bullying issues."

[1224] 6. The server should use a layout with a calm color scheme and design.

[1225] 7. The server sends the generated class newsletter to the terminal.

[1226] 8. The terminal displays the generated class newsletter to the user.

[1227] Prompt Sentence Examples

[1228] "The sports day was a great success. I could see the children's progress. Please create a class newsletter with a positive tone."

[1229] "There has been some bullying in your class recently. Please create a class newsletter with information about support and strategies."

[1230] In this way, an appropriate class newsletter is created according to the user's feelings, improving communication with the user.

[1231] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1232] Step 1:

[1233] Subject: User

[1234] The user inputs the information necessary to create a class newsletter into the device. This input includes the date and content of the event, the message they want to convey, etc. For example, they might input, "The sports day is on October 10th. I want to convey the children's growth."

[1235] Input: Event date, content, message

[1236] Output: The input text data

[1237] Step 2:

[1238] Subject: Terminal

[1239] The terminal transmits the information input by the user to the server. Specifically, the terminal transmits the input text data to the server as an HTTP request.

[1240] Input: Text data entered by the user

[1241] Output: HTTP request sent to the server

[1242] Step 3:

[1243] Subject: Server

[1244] The server analyzes the received information. Specifically, it uses natural language processing technology to extract important keywords and phrases from the input text. For example, it extracts keywords such as "sports day," "October 10th," and "growth."

[1245] Input: Text data received as an HTTP request

[1246] Output: Extracted keywords and phrases

[1247] Step 4:

[1248] Subject: Server

[1249] The server uses an emotion engine to recognize the user's emotions. The emotion engine infers emotions from the user's input text, facial expressions, tone of voice, etc. For example, if a user inputs "I want to share my children's growth," the emotion engine infers that the user is feeling happy.

[1250] Input: Extracted keywords and phrases, user-entered text

[1251] Output: Estimated user emotion

[1252] Step 5:

[1253] Subject: Server

[1254] The server automatically creates class newsletters using a generative AI model. Specifically, the server generates appropriate text and layout based on extracted keywords and recognized emotions. For example, it creates a positive-toned newsletter that reads, "The sports day was a great success! We could see the children's growth!"

[1255] Input: extracted keywords and phrases, estimated user sentiment

[1256] Output: The text and layout of the generated class newsletter

[1257] Step 6:

[1258] Subject: Server

[1259] The server adjusts the layout of the class newsletter according to the emotion estimated by the emotion engine. For example, if the user is feeling happy, the server applies a bright and cheerful layout, using bright colors and cheerful illustrations.

[1260] Input: The text and layout of the generated class newsletter, and estimated user sentiment.

[1261] Output: Adjusted layout of the class newsletter

[1262] Step 7:

[1263] Subject: Server

[1264] The server transmits the generated class newsletter to the terminal. Specifically, the server transmits the generated class newsletter data to the terminal as an HTTP response.

[1265] Input: Adjusted class newsletter layout

[1266] Output: HTTP response sent to the device

[1267] Step 8:

[1268] Subject: Terminal

[1269] The terminal displays the class newsletter received from the server to the user. Specifically, the terminal displays the content and layout of the generated class newsletter on the screen of the terminal.

[1270] Input: HTTP response received from the server

[1271] Output: The content and layout of the class newsletter displayed to the user

[1272] (Application example 1)

[1273] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1274] Creating traditional class newsletters requires time and effort, as teachers have to do it manually, and there are problems with the quality of the content and layout being inconsistent. Creating the information and services provided to customers is also time-consuming, and it is difficult to respond appropriately to customer sentiment.

[1275] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a means for using AI to create class newsletters, a means for automatically updating regular content such as event content, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for analyzing user emotions using an emotion engine and adjusting content and layout according to those emotions, and a means for automatically creating and adjusting information and services to be provided to customers. This reduces the burden on teachers, enables the creation of high-quality class newsletters, and enables the provision of appropriate information according to customer emotions.

[1276] A "class newsletter" is a document used by teachers in school classes to inform parents and students about events and announcements.

[1277] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to imitate human intelligence to learn and reason.

[1278] "Regular content such as events" is information about events and activities that are held regularly at schools or classes.

[1279] "Illustrations and images" are pictures or photographs that convey information visually.

[1280] "Photographs that are careful not to favor one particular person or event" are photographs that have been selected so as not to favor one particular person or event.

[1281] An "easy-to-read layout" is one in which information is organized and arranged in a way that makes it easy to understand visually.

[1282] An "emotion engine" is a technology that analyzes emotions from a user's facial expressions, tone of voice, input text, etc.

[1283] "Information and services provided to customers" refers to product information and support services provided to customers by stores and companies.

[1284] "Means for automatic creation and adjustment" refers to the system's ability to generate and appropriately adjust information and layout without human intervention.

[1285] To implement the present invention, the following system configuration and program are required.

[1286] System Configuration

[1287] 1. Hardware:

[1288] Smartphone

[1289] Smart Glasses

[1290] server

[1291] 2. Software:

[1292] Python

[1293] OpenCV

[1294] TextBlob

[1295] PIL (Python Imaging Library)

[1296] Program processing explanation

[1297] The server first receives the information entered by the user. This information includes the event schedule, details, and the message the user wants to convey. The server then automatically creates a class newsletter based on this information. Specifically, the server uses the following methods:

[1298] 1. How AI can create class newsletters:

[1299] The server uses AI to automatically create class newsletters based on information entered by teachers, reducing the burden on teachers and enabling them to create class newsletters efficiently.

[1300] 2. How to automatically update regular content such as events:

[1301] The server automatically updates information about regular events and activities, ensuring that the latest information is always reflected.

[1302] 3. Using illustrations and images that are easy to understand even with less text:

[1303] The server automatically selects illustrations and images to visually convey text information and incorporates them into the class newsletter.

[1304] 4. How to select photos with careful consideration:

[1305] The server selects photos so as not to be biased towards any particular person or event, and incorporates them into the class newsletter.

[1306] 5. Ways to create a good layout:

[1307] The server automatically creates a layout that keeps the information organized and easy to understand visually.

[1308] 6. Using an emotion engine to analyze user emotions and adjust content and layout accordingly:

[1309] The server analyzes the user's facial expressions, tone of voice, and input text to determine their emotions, and adjusts the content and layout of the newsletter accordingly. For example, if the user is feeling happy, it will use bright colors and bold fonts to emphasize positive content.

[1310] 7. Means for automatically creating and adjusting the information and services provided to customers:

[1311] The server automatically creates and adjusts the information and services provided to customers based on the information entered by store staff. It uses an emotion engine to analyze customer emotions and adjusts the content and layout of the information accordingly.

[1312] Specific examples

[1313] For example, if a customer types "What a lovely day today!", the server uses TextBlob to parse the sentiment as "positive." The server then displays information about new products and sales in bright colors and bold fonts. If a customer types "I've been feeling tired lately," the sentiment is parsed as "negative," and the server displays information about support and questions in muted colors and light fonts.

[1314] Prompt Sentence Examples

[1315] Your goal is to create a program that analyzes the sentiment of a customer based on their input text and generates the optimal message and layout based on that sentiment. The libraries used are TextBlob, PIL, and OpenCV. Use bright colors and bold fonts if the customer's sentiment is positive, and muted colors and light fonts if the sentiment is negative.

[1316] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1317] Step 1:

[1318] The user inputs information using a terminal. The input information includes the event schedule, details, and the message they want to convey. The terminal sends this information to the server. The input data is in text format, and the server receives it.

[1319] Step 2:

[1320] The server analyzes the received information and begins creating the class newsletter. First, it automatically updates regular content such as events. The server retrieves the latest event information from the database and integrates it with the input information. This ensures that the latest event information is reflected in the class newsletter.

[1321] Step 3:

[1322] The server automatically selects illustrations and images to visually convey text information. The server searches for and selects appropriate illustrations and images from an image database. The selected illustrations and images are incorporated into the content of the class newsletter.

[1323] Step 4:

[1324] The server selects photos without bias. The server selects photos from the photo database that are not biased toward a particular person or event, and incorporates them into the class newsletter. The selection criteria take into account the balance of the content and subject of the photos.

[1325] Step 5:

[1326] The server automatically creates an easy-to-read layout. The server uses a layout algorithm to generate an arrangement that organizes information and is visually easy to understand. The generated layout is used as the final form of the class newsletter.

[1327] Step 6:

[1328] The server uses an emotion engine to analyze the user's emotions. It analyzes the text entered by the user, facial expressions, and tone of voice to infer emotions. Based on the results of the emotion analysis, it adjusts the content and layout of the class newsletter. For example, bright colors and bold fonts are used for positive emotions, and muted colors and light fonts are used for negative emotions.

[1329] Step 7:

[1330] The server automatically creates and adjusts the information and services provided to customers. It generates the most suitable information for each customer based on the information entered by store staff. It uses an emotion engine to analyze the customer's emotions and adjusts the content and layout of the information accordingly. The generated information is provided to the customer via their terminal.

[1331] Step 8:

[1332] The server then sends the final generated class newsletter or customer information to the terminal, which receives it and displays it to the user or customer. The displayed information is visually arranged so that the user or customer can easily understand it.

[1333] Example 2

[1334] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1335] Creating a traditional class newsletter is a time-consuming and labor-intensive task for educators, placing a significant burden on older educators who are not particularly adept at using computers. Furthermore, the content and layout of the newsletters are uniform, making it difficult to attract parents' attention. Furthermore, it is difficult to create a class newsletter that reflects the user's feelings, which can lead to a decline in the quality of communication.

[1336] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1337] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for recognizing user emotions and adjusting the content and layout of the class newsletter in response to those emotions, and a cloud-based means for access from any device connected to the Internet. This reduces the burden on educators and enables the creation of class newsletters that attract the attention of parents. Furthermore, by creating class newsletters that reflect the user's emotions, the quality of communication can be improved.

[1338] A "class newsletter" is a document used by teachers in educational institutions to inform parents and students about class activities, events, and announcements.

[1339] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and perform functions such as learning, reasoning, recognition, and decision-making.

[1340] "Regular content such as events" refers to information about events and activities that are held regularly at schools or classes.

[1341] "Illustrations and images" are visual content such as pictures and photographs that convey information visually.

[1342] "Photo selection" is the process of selecting suitable photos based on specific criteria.

[1343] "Layout" refers to the visual arrangement and design of a document, web page, etc.

[1344] "Emotion recognition" is the process of inferring a user's emotions from their facial expressions, tone of voice, input text, etc.

[1345] "Cloud-based" refers to the use of services and data storage on remote servers provided via the Internet.

[1346] "Device" refers to an electronic device such as a computer, tablet, or smartphone.

[1347] MODE FOR CARRYING OUT THE INVENTION

[1348] This invention provides a system that allows educators to efficiently create classroom newsletters. It is designed to be easy to use, especially for older educators who are not very good at using computers. The system is cloud-based and can be accessed from any device connected to the internet.

[1349] server

[1350] The server provides a cloud-based system that receives information entered by users and creates class newsletters based on that information. Specifically, the server uses the following hardware and software:

[1351] Hardware: A server machine with a powerful processor, sufficient memory, and storage.

[1352] Software: Emotion engine, generative AI model, database management system

[1353] The server passes the information entered by the user to the emotion engine to recognize the user's emotions. The emotion engine infers emotions from the user's facial expressions, tone of voice, and input text. For example, if the user is feeling happy, the server creates a class newsletter with a positive tone, emphasizing positive content such as successful activities and the children's growth. The layout is also adjusted to create a bright and cheerful atmosphere.

[1354] Terminal

[1355] The terminal is a device through which users access the system. The terminal is connected to the Internet and can access the cloud-based system. Users use the terminal to input the necessary information and create a class newsletter. The terminal sends the user's facial expressions, tone of voice, and input text to the emotion engine. The emotion engine estimates the user's emotions based on this data and sends the results to the server. The terminal displays the content and layout of the class newsletter sent from the server so that the user can check it.

[1356] User

[1357] Users operate the system to create class newsletters. Users access the system using any device (terminal) connected to the Internet. They input the necessary information through the system's intuitive and simple operation screen. The input information is sent to the server, and the emotion engine recognizes the user's emotions. For example, if the user is feeling happy, the system will create a class newsletter with a positive tone and emphasize positive content such as successful activities and the children's growth. Conversely, if the user is feeling sad or anxious, the system will create content that takes those emotions into consideration and provide information on necessary support and measures. Users can review the content and layout of the class newsletter generated by the system and modify it as necessary.

[1358] Specific examples

[1359] For example, suppose a user wants to create this month's class newsletter. The user accesses the system using a terminal and inputs the necessary information (e.g., this month's activities and the children's progress). The emotion engine infers that the user is feeling happy based on the text, facial expression, and tone of voice they input. Based on this information, the server creates the class newsletter in a positive tone, emphasizing positive aspects such as successful activities and the children's progress. The layout is also adjusted to create a bright and cheerful atmosphere.

[1360] Prompt Sentence Examples

[1361] "I would like to create this month's class newsletter. This month's activities included a field trip and a sports day. The children had a lot of fun. Please use this as a basis for creating the class newsletter."

[1362] By inputting this prompt into a generative AI model, the system recognizes the user's emotions and creates an appropriate classroom newsletter.

[1363] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1364] Program processing flow

[1365] Step 1: The user accesses the system.

[1366] Users access the system using any device connected to the Internet (PC, tablet, smartphone, etc.) They open a browser, enter the system's URL, and access the login screen.

[1367] Input: System URL, Username, Password

[1368] Output: Dashboard screen after successful login

[1369] Specific operation: A user opens a browser, enters the system URL to access the login screen, enters the username and password, and clicks the login button.

[1370] Step 2: The user enters information.

[1371] Users input the necessary information through the system's intuitive and simple operation screen, such as the details of this month's activities and their children's progress, into text boxes.

[1372] Input: This month's activities and children's progress

[1373] Output: A confirmation screen showing the information entered

[1374] What happens: A user enters "We had a field trip and a sports day this month. The kids had a great time." in the "What were your activities this month?" field.

[1375] Step 3: The device sends the information to the server.

[1376] The terminal sends the information entered by the user to the server, where it is prepared for processing.

[1377] Input: Information entered by the user

[1378] Output: Information sent to the server

[1379] Specific operation: When the device clicks the "Send" button, the entered information is sent to the server.

[1380] Step 4: The server recognizes emotions using the emotion engine.

[1381] The server passes the received information to the emotion engine, which then infers the user's emotion from their facial expression, tone of voice, and input text.

[1382] Input: Information entered by the user

[1383] Output: Estimated emotion (e.g., happy, sad, anxious)

[1384] Specific operation: The server passes the text "We had a field trip and a sports day. The children had a lot of fun." to the emotion engine, and the emotion engine recognizes "joy."

[1385] Step 5: The server generates the content and layout of the class newsletter.

[1386] The server generates the content and layout of the class newsletter based on the emotions recognized by the emotion engine. For example, if the user is feeling happy, the class newsletter will be created with a positive tone and a bright and cheerful layout.

[1387] Input: Estimated emotion, user-entered information

[1388] Output: Class newsletter content and layout

[1389] Specific behavior: The server generates a positive message based on "joy": "The field trip and sports day were a great success. The children had a lot of fun." and applies a bright color layout.

[1390] Step 6: The server sends the generated class newsletter to the terminal.

[1391] The server sends the content and layout of the generated class newsletter to the terminal, which then displays the received information to the user.

[1392] Input: Class newsletter content and layout

[1393] Output: Class newsletter displayed on the terminal

[1394] Specific operation: The server sends the generated class newsletter to the terminal, which displays it. The user can check the content and layout of the class newsletter on the screen.

[1395] Step 7: The user checks and edits the class newsletter.

[1396] The user checks the class newsletter displayed on the terminal and makes corrections as necessary. Once corrections are complete, the user saves or prints the final class newsletter.

[1397] Input: Generated class newsletter

[1398] Output: Modified class newsletter, saved or printed class newsletter

[1399] Specific Action: The user reviews the displayed class newsletter and is satisfied with the content: "The field trip and sports day were a great success. The children had a lot of fun." They make corrections as necessary and click the "Save" button to save the final class newsletter.

[1400] (Application example 2)

[1401] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1402] Conventional classroom newsletter creation systems are difficult to operate, especially for elderly users, and do not allow for adjustment of content or layout according to emotions, making it difficult to communicate appropriately according to the user's emotions.In addition, the generation of proposals to facilitate smooth communication with customers in physical stores is not automated, which places a heavy burden on staff and makes it difficult to improve customer satisfaction.

[1403] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1404] In this invention, the server includes means for using artificial intelligence to create class newsletters, means for automatically updating regular content such as events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize content, means for creating easy-to-read layouts, means for performing emotion recognition and adjusting content and layout according to the user's emotions, and means for generating suggestions for smooth communication with customers. This makes it easy for even elderly users to operate, and enables the creation of appropriate class newsletters according to the user's emotions and smooth communication with customers in physical stores.

[1405] A "class newsletter" is a document used by teachers at schools and educational institutions to communicate information about events and activities to parents and students.

[1406] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence, learning, reasoning, and self-correcting.

[1407] "Regular content such as events" is information about events and activities that are held regularly at schools and educational institutions.

[1408] "Illustrations and images" are pictures or photographs that convey information visually.

[1409] "Photos that are careful not to favor one person or group over another" are photos that are selected so as not to favor any particular person or group.

[1410] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[1411] "Emotion recognition" is a technology that estimates a user's emotions from facial expressions, tone of voice, input text, etc.

[1412] "Adjusting content and layout" refers to changing the content and visual layout of a document in response to the user's emotions.

[1413] "Communication with customers" refers to the act of staff exchanging information with customers and building relationships in a physical store.

[1414] "Suggestion generation" is the process of suggesting appropriate responses or actions based on specific situations or conditions.

[1415] A system for carrying out this invention has the following configuration: The server includes means for using artificial intelligence to create class newsletters, means for automatically updating regular content such as for events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize, means for creating easy-to-read layouts, means for recognizing emotions and adjusting content and layout according to the user's emotions, and means for generating suggestions for smooth communication with customers.

[1416] Hardware and software used

[1417] Hardware: Smartphone with camera, server

[1418] Software: Python, OpenCV, Keras

[1419] Data processing and calculation

[1420] The server receives video data sent from the smartphone and performs facial recognition using OpenCV. The recognized facial area is input into an emotion recognition model using Keras, and the user's emotion is estimated. Based on the estimated emotion, a generative AI model generates appropriate content and layout for the class newsletter, as well as customer service suggestions for physical stores.

[1421] Specific examples

[1422] For example, if a store staff member is holding a smartphone while interacting with a customer, the camera captures the customer's face, and the emotion recognition model recognizes the customer's emotion as "Happy." In this case, the smartphone screen will display a suggestion saying, "You seem happy. Let's introduce our new product!"

[1423] Prompt Sentence Examples

[1424] Capture your customer's facial expressions and use an emotion recognition model to infer their emotions. Based on the inferred emotions, generate suggestions such as:

[1425] Happy: Your customers seem happy. Let's introduce some new products!

[1426] Sad: You seem sad. Let me see if there's anything I can do to help you.

[1427] Other emotions: Respond to your customer's emotions accordingly.

[1428] In this way, even elderly users can easily operate the system, and it is possible to create appropriate class newsletters that reflect the user's emotions, and to communicate smoothly with customers in physical stores.

[1429] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1430] Step 1:

[1431] The terminal captures the customer's face using a camera, with the input being real-time video data and the output being the captured image data.

[1432] Step 2:

[1433] The terminal sends the captured image data to the server. The input is the image data, and the output is the data transfer to the server.

[1434] Step 3:

[1435] The server performs face recognition on the received image data using OpenCV. The input is the image data, and the output is the coordinate data of the face area.

[1436] Step 4:

[1437] The server uses the coordinate data of the face region to perform preprocessing for input into an emotion recognition model using Keras. The input is the coordinate data of the face region, and the output is the preprocessed image data.

[1438] Step 5:

[1439] The server inputs the preprocessed image data into an emotion recognition model to estimate the user's emotion. The input is the preprocessed image data, and the output is estimated emotion data.

[1440] Step 6:

[1441] The server generates appropriate suggestions using a generative AI model based on the estimated emotion data. The input is the emotion data, and the output is the suggestion content.

[1442] Step 7:

[1443] The server sends the generated proposal to the terminal. The input is the proposal, and the output is the data transfer to the terminal.

[1444] Step 8:

[1445] The device displays the received suggestions on the screen. The input is the suggestions, and the output is visual feedback to the user.

[1446] In this way, a system is realized in which the terminal and server work together to recognize customer emotions in real time and generate and display appropriate suggestions.

[1447] Example 3

[1448] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1449] Traditionally, educators have often created class newsletters manually, which is time-consuming and labor-intensive, and it has been difficult to effectively communicate content that parents will be interested in. Furthermore, many educators are not adept at using computers, making it difficult to create efficient class newsletters. Furthermore, the quality of communication can decline because it is not possible to adjust the content or layout to reflect the feelings and interests of parents.

[1450] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1451] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are not overly focused, a means for creating an easy-to-read layout, a means for recognizing a user's emotions and adjusting the content and layout of the class newsletter in response to those emotions, a means for the user to review and revise the generated class newsletter, and a means for delivering the final class newsletter to parents. This reduces the burden on educators and makes it possible to effectively convey content that parents are interested in. Furthermore, the ability to adjust the content and layout in response to the user's emotions improves the quality of communication.

[1452] A "class newsletter" is a document created by an educational institution to inform parents about their children's activities and events.

[1453] "Artificial intelligence" refers to computer systems that mimic human intelligence and can learn and reason.

[1454] "Regular content such as events" is information about events and activities that are held regularly at schools and educational institutions.

[1455] "Illustrations and images" are pictures or photographs used to convey information visually.

[1456] "Non-biased photos" are photos that are selected so as not to favor any particular child or activity.

[1457] "Layout" is a design element that refers to the structure and arrangement of a document or page.

[1458] "Recognizing a user's emotions" means estimating the user's emotions from input text, facial expressions, tone of voice, etc.

[1459] "The user checks and modifies the generated class newsletter" means that the user checks the class newsletter created by the artificial intelligence and changes the content and layout as necessary.

[1460] "Delivering the final class newsletter to parents" means sending the completed class newsletter to parents via email or a dedicated app.

[1461] The present invention is a system for making the creation of class newsletters more efficient and effectively communicating content that parents will be interested in. A specific embodiment of this system will be described below.

[1462] Hardware and software used

[1463] Hardware: Servers, devices (PCs, tablets, smartphones)

[1464] Software: emotion engines, generative AI models, image processing software (e.g., Adobe Photoshop), layout design software (e.g., Adobe InDesign)

[1465] System Overview

[1466] 1. User enters information:

[1467] The user uses the device to input the information they want to include in the class newsletter. Specifically, they input the children's activities, photos, comments, etc. For example, the user might input "photos of the children running happily at the sports day" and "how they cooperate in a relay race."

[1468] 2. The server receives the information:

[1469] The server receives the information sent by the user and stores it in a database. Specifically, it receives the text data entered by the user and the photo files uploaded by the user and stores them in the appropriate folder.

[1470] 3. The server uses the emotion engine to recognize the user's emotion:

[1471] The server activates the emotion engine and infers emotions from the text entered by the user and the uploaded photos. For example, if the user enters "The children were playing happily," the emotion engine infers that the user is feeling joy.

[1472] 4. The server uses the generative AI model to create a class newsletter:

[1473] The server inputs a prompt into the generative AI model to generate the content of the class newsletter. Specifically, the prompt uses, "Please create a class newsletter that displays large photos of the children's activities and briefly describes the details of those activities." The generative AI model generates the text of the class newsletter based on this prompt.

[1474] 5. The server adjusts the layout:

[1475] The server adjusts the layout of the class newsletter based on the results of the emotion engine. Specifically, if the user is feeling happy, the layout will have a bright and cheerful atmosphere. Using Adobe InDesign, it applies bright colors and a fun design. For example, it changes the background color to bright yellow and the font to a pop style.

[1476] 6. The server generates the class newsletter:

[1477] The server combines the generative AI model with layout design software to generate the final class newsletter. Specifically, it combines the generated text with photos uploaded by the user to create a visually appealing class newsletter. For example, it could display a large photo of a sports day, with a caption underneath that reads, "The children ran around energetically and had a great time at the sports day. Everyone worked together to achieve particularly impressive results in the relay race."

[1478] 7. User checks the class newsletter:

[1479] The user can use their device to check the generated class newsletter. Specifically, they click the preview link sent from the server and check the newsletter in their browser. They can then make corrections to the text and layout as necessary.

[1480] 8. The server distributes the class newsletter:

[1481] The server distributes the final class newsletter to parents. Specifically, it sends the newsletter via email or a dedicated app. For example, it sends the generated class newsletter as an attachment to a list of parents' email addresses.

[1482] Specific examples

[1483] Prompt Sentence Examples

[1484] "Create a class newsletter that displays large photos of the children's activities and provides brief details about the activities."

[1485] Examples of class newsletters

[1486] Photo: Display a large photo of children running at a sports day.

[1487] Description: "The children had a great time at the sports day, running around energetically. Everyone worked together to achieve great results, especially in the relay race."

[1488] In this way, an attractive class newsletter is created that reflects the user's feelings. The flow of the specific processing in the third embodiment will be described with reference to FIG.

[1489] Step 1:

[1490] The user enters the information.

[1491] The user uses the device to input the information they want to include in the class newsletter. Specifically, they input the children's activities, photos, comments, etc. For example, the user might input "photos of the children running happily at a sports day" and "how they cooperate in a relay race." The input data is sent from the device to the server as text data or image files.

[1492] Step 2:

[1493] The server receives the information.

[1494] The server receives the information sent by the user and stores it in a database. Specifically, it receives the text data entered by the user and the photo files uploaded by the user and stores them in the appropriate folder. The input data is text data and image files, and the output is the information stored in the database.

[1495] Step 3:

[1496] The server uses an emotion engine to recognize the user's emotion.

[1497] The server launches an emotion engine to estimate emotions from the text entered by the user and the uploaded photos. For example, if a user enters "The children were playing happily," the emotion engine estimates that the user is feeling happy. The input data is text data and image files, and the output is estimated emotion data.

[1498] Step 4:

[1499] The server uses the generative AI model to create a class newsletter.

[1500] The server inputs a prompt into the generative AI model to generate the content of the class newsletter. Specifically, the prompt is "Please create a class newsletter that displays large photos of the children's activities and briefly explains the details of those activities." The generative AI model generates the text of the class newsletter based on this prompt. The input data is the prompt, and the output is the generated text data.

[1501] Step 5:

[1502] The server adjusts the layout.

[1503] The server adjusts the layout of the class newsletter based on the results of the emotion engine. Specifically, if the user is feeling happy, the layout will have a bright and cheerful atmosphere. Using Adobe InDesign, it applies bright colors and a fun design. For example, it changes the background color to bright yellow and the font to a pop style. The input data is emotion data and generated text data, and the output is the adjusted layout data.

[1504] Step 6:

[1505] The server generates the class newsletter.

[1506] The server combines the generative AI model with layout design software to generate the final class newsletter. Specifically, it combines the generated text with photos uploaded by the user to create a visually appealing class newsletter. For example, it might display a large photo of a sports day, with a caption below it such as, "The children ran around energetically and had fun at the sports day. Everyone worked together to achieve particularly impressive results in the relay race." The input data is the adjusted layout data and image files, and the output is the final class newsletter data.

[1507] Step 7:

[1508] The user checks the class newsletter.

[1509] The user uses a device to check the generated class newsletter. Specifically, they click the preview link sent from the server and check the class newsletter in a browser. They can make corrections to the text and layout as needed. The input data is the final class newsletter data, and the output is the corrected class newsletter data.

[1510] Step 8:

[1511] The server distributes class newsletters.

[1512] The server distributes the final class newsletter to parents. Specifically, it sends the class newsletter via email or a dedicated app. For example, it sends the generated class newsletter as an attachment to a list of parents' email addresses. The input data is the corrected class newsletter data, and the output is the distributed class newsletter.

[1513] (Application example 3)

[1514] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1515] Conventional classroom newsletter creation systems have the problem that it is difficult to create content that parents will want to read, and that they are unable to adjust the content and layout according to the user's emotions. Furthermore, even in physical stores, product and service suggestions based on the user's emotions are not made, and an improvement in the shopping experience is required. To solve these problems, a system is needed that can recognize the user's emotions and adjust the content and layout accordingly.

[1516] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1517] In this invention, the server includes means for using AI to create class newsletters, means for automatically updating regular content such as event content, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize content, means for creating an easy-to-read layout, means for recognizing user emotions and adjusting content and layout according to those emotions, means for suggesting products and services based on the user's emotions, and means for displaying suggested content in a layout according to the user's emotions. This makes it possible to create class newsletters that parents will want to read and to suggest products and services based on the user's emotions in physical stores.

[1518] A "class newsletter" is a document used by teachers in educational institutions to inform parents about their children's activities and events.

[1519] "AI-based means" refers to a method of using artificial intelligence to automatically perform specific tasks or processes.

[1520] The "means for automatically updating regular content such as events" is a method for automatically updating information about regularly held events and activities.

[1521] "Methods of utilizing illustrations and images" are methods that use illustrations and photographs to convey information visually.

[1522] "Methods for selecting photographs that take into consideration bias" refers to a method for selecting photographs that do not favor a particular person or activity.

[1523] "Methods for creating a legible layout" are methods for designing information so that it is visually organized and arranged in an easy-to-read manner.

[1524] "Means for recognizing the user's emotions and adjusting the content and layout according to those emotions" refers to a method for inferring emotions from the user's facial expression, tone of voice, input text, etc., and changing the content and layout of information based on those emotions.

[1525] "Means for suggesting products and services based on user emotions" refers to a method for recommending appropriate products and services by taking into account the user's emotions.

[1526] The "means for displaying suggested content in a layout that corresponds to the user's emotions" is a method for displaying suggested information in a visually appealing manner that matches the user's emotions.

[1527] A system for carrying out this invention has the following configuration: The server includes means for using AI to create class newsletters, means for automatically updating regular content such as for events, means for utilizing illustrations and images that are easy to understand even with reduced text, means for selecting photos that are careful not to overemphasize, means for creating an easy-to-read layout, means for recognizing a user's emotions and adjusting the content and layout according to those emotions, means for suggesting products and services based on the user's emotions, and means for displaying the proposed content in a layout that corresponds to the user's emotions.

[1528] Hardware and software used

[1529] Hardware:

[1530] Smartphone camera

[1531] server

[1532] software:

[1533] OpenCV

[1534] Keras

[1535] TensorFlow

[1536] Data processing and calculation

[1537] The server captures video from the smartphone camera and detects faces using OpenCV. The detected facial regions are input into an emotion recognition model built with Keras to predict the user's emotions. The emotion recognition model uses TensorFlow as its backend. Based on the predicted emotions, the server suggests appropriate products and services and displays the suggestions in a layout that corresponds to the user's emotions.

[1538] Specific examples

[1539] For example, when a user launches the app through their smartphone camera, the camera captures the user's face and recognizes their emotions. If the user is smiling, the server displays "new products" and "popular products" in bright colors. On the other hand, if the user is tired, the server displays "relaxing products" and "relaxation services" in subdued colors.

[1540] Prompt Sentence Examples

[1541] An example of a prompt for a generative AI model is:

[1542] Develop an application that recognizes the user's emotions and suggests products and services accordingly. If the user is happy, suggest new or popular products. If the user is tired, suggest products and services that will help them relax. Display the suggestions in a layout that corresponds to the user's emotions.

[1543] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1544] Step 1:

[1545] The user launches the app through the smartphone camera.

[1546] Input: Smartphone camera image

[1547] Output: Captured video data

[1548] Specific behavior: The user launches the app and the smartphone camera captures the user's face.

[1549] Step 2:

[1550] The server receives the captured video data and uses OpenCV to detect faces.

[1551] Input: Captured video data

[1552] Output: Detected face area (coordinate data)

[1553] Specific operation: The server analyzes the video data and applies a face detection algorithm to identify the location of the face.

[1554] Step 3:

[1555] The server inputs the detected face regions into an emotion recognition model built with Keras.

[1556] Input: Detected face area (coordinate data)

[1557] Output: Emotion prediction result (emotion label)

[1558] Specific operation: The server extracts the facial area, performs preprocessing, and then inputs it into an emotion recognition model to predict emotions.

[1559] Step 4:

[1560] The server suggests appropriate products and services based on the emotion prediction results.

[1561] Input: Emotion prediction result (emotion label)

[1562] Output: A list of suggested products and services

[1563] Specific operation: The server refers to a database of products and services corresponding to the emotion label and generates appropriate suggestions.

[1564] Step 5:

[1565] The server displays the proposed content in a layout that corresponds to the user's emotions.

[1566] Input: List of suggested products and services, emotion prediction results (emotion labels)

[1567] Output: The layout displayed on the user's smartphone

[1568] How it works: The server adjusts the layout based on the emotion labels and displays the suggestions in a visually appealing format on the user's smartphone.

[1569] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1570] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1571] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1572] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1573] [Third embodiment]

[1574] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1575] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1576] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1577] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1578] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1579] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1580] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1581] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1582] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1583] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1584] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1585] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1586] "Example 1"

[1587] In the system of the present invention, AI creates class newsletters on behalf of the teacher. Specifically, the teacher inputs the information necessary to create the newsletter into the system. This information includes the schedule and content of events, the message the teacher wants to convey, and so on. The system then automatically creates the newsletter based on the input information. In this process, the AI ​​performs tasks such as automatically updating regular content for events, using illustrations and images that are easy to understand even with reduced text, selecting photos that are careful not to overemphasize content, and creating an easy-to-read layout.

[1588] "Example 2"

[1589] The system of the present invention is provided in a format that can be operated even by older teachers who are not good at using PCs. Specifically, the system's operation screen has an intuitive and simple design, allowing students to create class newsletters simply by entering the necessary information. The system is also cloud-based and can be accessed from any device connected to the Internet.

[1590] "Example 3"

[1591] The system of the present invention creates class newsletters with content that parents will want to read. Specifically, based on the input information, the system emphasizes information that parents will be interested in and creates class newsletters with a visually appealing layout. For example, the system may display large photos of the children's activities and provide concise details of those activities.

[1592] The processing flow of each embodiment will be described below.

[1593] "Example 1"

[1594] Step 1: The teacher inputs the information necessary to create a class newsletter into the system, including the event schedule, content, and message to be conveyed.

[1595] Step 2: The system automatically creates a class newsletter based on the information entered. During this process, the AI ​​automatically updates regular content such as events, uses illustrations and images to make the newsletter easier to understand even with less text, selects photos carefully to avoid bias, and creates an easy-to-read layout.

[1596] "Example 2"

[1597] Step 1: The system's operation screen has an intuitive and simple design, allowing teachers to create class newsletters simply by entering the necessary information.

[1598] Step 2: The system is cloud-based and can be accessed from any internet-connected device.

[1599] "Example 3"

[1600] Step 1: Based on the information entered, the system creates a class newsletter in a visually appealing layout, highlighting information that parents will find interesting.

[1601] Step 2: For example, measures can be taken such as displaying large photos of the children's activities and providing brief details of those activities.

[1602] Example 1

[1603] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1604] Creating traditional class newsletters is a time-consuming and labor-intensive task for educators, placing a significant burden on older educators who are particularly unfamiliar with computers. It's also difficult to create compelling content that parents will want to read. Furthermore, it requires a wide range of tasks, including updating regular content for events, using illustrations and images that are easy to understand even with less text, carefully selecting photos that don't overwhelm others, and creating an easy-to-read layout. To solve these issues, a system that allows for the efficient and easy creation of class newsletters is needed.

[1605] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1606] In this invention, the server includes a means for the terminal to transmit information input by the user to the server, a means for generating a class newsletter using the generative AI model, and a means for transmitting the generated class newsletter to the terminal. This allows educators to easily create class newsletters and provide attractive content that parents will want to read.

[1607] A "class newsletter" is a document used by educators to inform parents and students about events and announcements.

[1608] "Artificial intelligence" refers to computer systems that mimic human intelligence and can learn and reason.

[1609] "Regular content such as events" is information about events and activities that are held regularly at schools or classes.

[1610] "Illustrations and images" are pictures or photographs that convey information visually.

[1611] "Photos that are careful not to favor one person or group over another" are photos that are selected so as not to favor any particular person or group.

[1612] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[1613] "Users" are educators who use this system to create class newsletters.

[1614] A "terminal" is a device such as a computer or smartphone that allows a user to input information and communicate with a server.

[1615] The "server" is a computer system that receives information sent by users and generates class newsletters using a generative AI model.

[1616] A "generative AI model" is an artificial intelligence algorithm that automatically generates text and content based on input information.

[1617] A "prompt sentence" is an instruction sentence input to a generative AI model.

[1618] The present invention relates to a system in which artificial intelligence is used to create class newsletters. A specific embodiment of this system will be described below.

[1619] System configuration

[1620] This system includes a terminal where the user (educator) inputs information, a server that receives and processes the input information, and a generative AI model. The terminal is a device such as a computer or smartphone, and the server is a high-performance computer system. The generative AI model used is, for example, OpenAI's GPT-4.

[1621] Program processing

[1622] The user inputs the information necessary to create a class newsletter into the terminal. This information includes the event schedule, event content, and the message to be conveyed. For example, the user might input, "The sports day is on October 15th. Let's all get ready for the sports day!"

[1623] The terminal transmits the information input by the user to the server. Specifically, the terminal transmits the input information to the server using an HTTP request.

[1624] The server generates a class newsletter using the generative AI model based on the received information. The server inputs the following prompt into the generative AI model:

[1625] Please create a class newsletter based on the information below.

[1626] Event date: October 15th

[1627] Event details: Sports day

[1628] Message to convey: "Everyone, let's get ready for the sports day!"

[1629] The content of the class newsletter should be laid out in an easy-to-read format and include appropriate illustrations and images.

[1630] The generative AI model generates the content of the class newsletter based on this prompt. For example, the following class newsletter might be generated:

[1631] Title: "About the sports day on October 15th"

[1632] Content: "Everyone, let's get ready for the sports day! The sports day will be held on October 15th. The detailed schedule is as follows..."

[1633] The server transmits the generated class newsletter to the terminal. Specifically, the server uses an HTTP response to transmit the contents of the generated class newsletter to the terminal.

[1634] The terminal displays the contents of the class newsletter received from the server to the user, who can then check the generated class newsletter on the screen of the terminal.

[1635] Specific examples

[1636] For example, if a user enters the following information:

[1637] Event date: October 15th

[1638] Event details: Sports day

[1639] Message to convey: "Everyone, let's get ready for the sports day!"

[1640] The device sends this information to a server, which uses a generative AI model to generate a class newsletter like this:

[1641] Title: "About the sports day on October 15th"

[1642] Content: "Everyone, let's get ready for the sports day! The sports day will be held on October 15th. The detailed schedule is as follows..."

[1643] The server transmits the generated class newsletter to the terminal, which displays it to the user, who can then check the generated class newsletter on the screen of the terminal.

[1644] In this way, this system allows educators to easily create class newsletters and provide attractive content that parents will want to read.

[1645] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1646] Step 1:

[1647] The user enters the information.

[1648] The user inputs the information necessary to create a class newsletter into the device. This information includes the event schedule, event content, and the message to be conveyed. For example, the user might input, "The sports day is on October 15th. Let's all get ready for the sports day!" The input information is temporarily stored in the device's memory.

[1649] Step 2:

[1650] The terminal sends the input information to the server.

[1651] The terminal sends the information entered by the user to the server. Specifically, the terminal uses an HTTP request to send the input information to the server. The input data is sent to the server in the form of the event schedule, event content, message to be conveyed, etc.

[1652] Step 3:

[1653] The server generates class newsletters using the generative AI model.

[1654] The server generates a class newsletter using the generative AI model based on the received information. The server inputs the following prompt into the generative AI model:

[1655] Please create a class newsletter based on the information below.

[1656] Event date: October 15th

[1657] Event details: Sports day

[1658] Message to convey: "Everyone, let's get ready for the sports day!"

[1659] The content of the class newsletter should be laid out in an easy-to-read format and include appropriate illustrations and images.

[1660] The generative AI model generates the content of the class newsletter based on this prompt, and the generated content is stored in the server's memory.

[1661] Step 4:

[1662] The server transmits the generated class newsletter to the terminal.

[1663] The server sends the contents of the class newsletter generated by the generative AI model to the terminal. Specifically, the server uses an HTTP response to send the contents of the generated class newsletter to the terminal. The output data is the contents of the generated class newsletter.

[1664] Step 5:

[1665] The terminal displays the class communication to the user.

[1666] The terminal displays the contents of the class newsletter received from the server to the user. The user can check the generated class newsletter on the screen of the terminal. Specifically, the terminal performs layout processing to display the received data on the screen, and displays it in a format that is visually easy for the user to understand.

[1667] (Application example 1)

[1668] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1669] Creating traditional classroom newsletters and store event information is often done manually, which takes time and effort, and can lead to variations in the readability and ease of understanding of the information. Furthermore, these tasks are often a burden for older teachers and store staff who are not good at using computers. Furthermore, the need for specialized knowledge and skills, such as creating messages that are easy for customers to understand, selecting images, and automatically updating regular events, makes it difficult to efficiently disseminate information.

[1670] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1671] In this invention, the server includes a means for using AI to create class newsletters, a means for automatically updating regular content such as events, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for automatically creating and distributing store event and sale information, a means for generating messages that are easy for customers to understand, a means for automatically selecting images and illustrations, a means for automatically updating regular events, and a means for including an application to be installed on a smartphone. This streamlines the creation of class newsletters and store event information, enabling the dissemination of information that is easy to read and understand. Furthermore, it can be easily operated even by older teachers and store staff who are not good at using computers, reducing the burden on them.

[1672] A "class newsletter" is an information newsletter issued to parents and students on a class-by-class basis at school.

[1673] "AI" is an abbreviation for artificial intelligence, a technology that allows computers to act in a way that mimics human intelligence.

[1674] "Regular content such as events" is information about events and activities that are held regularly at schools and stores.

[1675] "Illustrations and images" are pictures or photographs that convey information visually.

[1676] "Photographs that are careful not to favor one particular person or thing" are photographs that have been selected so as not to favor one particular person or thing.

[1677] An "easy-to-read layout" is one in which information is organized and arranged in a way that is easy to understand visually.

[1678] "Store event information" is information about sales and campaigns held at the store.

[1679] "Sale information" is information about product discounts and special offers.

[1680] A "message that is easy for customers to understand" is a message that is designed to be easy for customers to understand and to attract their interest.

[1681] "Automatic selection of images and illustrations" is the process in which AI automatically selects appropriate images and illustrations.

[1682] "Automatic update of regular events" means automatically updating information about regularly scheduled events to the latest information.

[1683] An "application installed on a smartphone" is a software program that runs on a smartphone.

[1684] The system for implementing this invention consists of three elements: a server, a terminal, and a user. The server plays a central role in automatically creating and distributing class newsletters and store event information. The terminal is a device where users input information and check the generated communications. Users provide information to create class newsletters and store event information.

[1685] The server includes the following means:

[1686] 1. AI can take over the creation of class newsletters

[1687] 2. Means of automatically updating regular content such as events

[1688] 3. Using illustrations and images that are easy to understand even with less text

[1689] 4. How to select photos without bias

[1690] 5. How to create a clear layout

[1691] 6. A means to automatically create and distribute store event and sales information

[1692] 7. A way to create a message that is easy for customers to understand

[1693] 8. A method for automatically selecting images and illustrations

[1694] 9. A way to automatically update recurring events

[1695] 10. Means including an application installed on a smartphone

[1696] The server uses OpenAI's API to leverage a generative AI model to generate prompts based on the information entered by the user. For example, if a user enters event information such as "Summer Sale, August 1st - August 10th, 20% off all items," the server generates the following prompt:

[1697] Use the information below to create a message that will be easy for your customers to understand.

[1698] Event Name: Summer Sale

[1699] Dates: August 1st to August 10th

[1700] Contents: 20% off all products

[1701] Based on this prompt, the generative AI model generates a message that is easy for the customer to understand, which is then sent to the device so that the user can view it.

[1702] A terminal is a device such as a smartphone or tablet that allows users to input information and check generated communications. A dedicated application is installed on the terminal, and users can input information through an intuitive interface.

[1703] For example, when a user opens a smartphone application and enters event information, the server automatically processes the information and generates a communication in an easy-to-read layout. The generated communication includes appropriately selected images and illustrations and a message that is easy for customers to understand.

[1704] In this way, the creation of class newsletters and store event information becomes more efficient, and it becomes possible to transmit information that is easy to read and understand. Furthermore, it is easy to use even for elderly teachers and store staff who are not good at using PCs, so the burden on them is reduced.

[1705] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1706] Step 1:

[1707] A user uses a terminal to input information about a class newsletter or a store event. The input information includes the event name, date, and content. The terminal then transmits this information to the server.

[1708] Step 2:

[1709] The server generates a prompt based on the received information. Specifically, it uses a generative AI model to analyze the input information and create a prompt that will generate a message that is easy for the customer to understand. For example, the following prompt is generated:

[1710] Use the information below to create a message that will be easy for your customers to understand.

[1711] Event Name: Summer Sale

[1712] Dates: August 1st to August 10th

[1713] Contents: 20% off all products

[1714] Step 3:

[1715] The server sends the generated prompt to the generative AI model, which generates a message that is easy for customers to understand. The generative AI model performs natural language processing based on the prompt and generates an appropriate message. For example, it generates a message like, "Our big summer sale is starting! All products are 20% off from August 1st to 10th. Don't miss out!"

[1716] Step 4:

[1717] The server creates an easy-to-read layout based on the generated message. Specifically, it uses the PIL library to automatically select images and illustrations and draw the message on the image. For example, it draws the message on a background image and selects appropriate fonts and colors.

[1718] Step 5:

[1719] The server sends the generated layout to the terminal, which displays the received layout to the user, who can then review the generated communication and make any necessary corrections.

[1720] Step 6:

[1721] After the user completes the corrections, the device sends the final communication to the server, which stores it and distributes it to a designated destination, such as emailing it to a parent or client.

[1722] In this way, the creation of class newsletters and store event information becomes more efficient, and it becomes possible to transmit information that is easy to read and understand. Furthermore, it is easy to use even for elderly teachers and store staff who are not good at using PCs, so the burden on them is reduced.

[1723] Example 2

[1724] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1725] Creating a traditional class newsletter was difficult, time-consuming, and labor-intensive, especially for older educators who were not very good at using computers. Furthermore, while the content of the newsletter needed to be appealing to parents, creating the text and adjusting the layout to achieve this was also a difficult task. Furthermore, updating regular content such as events and selecting photos that could be biased were also time-consuming tasks. A system that could solve these problems was needed.

[1726] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1727] In this invention, the server includes a means for using artificial intelligence to create class newsletters, a means for automatically updating regular content such as event content, a means for utilizing illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for operating in a cloud environment and accessible from any terminal connected to the Internet, a means for saving information entered by a user in a database and generating class newsletters using a template engine, a means for outputting the generated class newsletters in PDF or HTML format, and a means for generating text based on prompts using a generative AI model. This makes it possible for even older educators who are not good at using computers to easily create class newsletters and efficiently generate class newsletters that are appealing to parents.

[1728] A "class newsletter" is a document used by teachers in educational institutions to inform parents and students about events, learning progress, and other announcements.

[1729] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and perform functions such as learning, reasoning, and recognition.

[1730] A "cloud environment" is an infrastructure for using computer resources and services provided via the Internet.

[1731] A "terminal" is a device, such as a computer, tablet, or smartphone, that a user uses to access the system.

[1732] A "database" is a system for efficiently storing, searching, and managing data.

[1733] A "template engine" is software that generates dynamic content by embedding data in templates containing placeholders.

[1734] "PDF format" is an abbreviation for Portable Document Format, a file format for electronically storing, displaying, and printing documents.

[1735] "HTML format" is an abbreviation for HyperText Markup Language, a markup language for building web pages.

[1736] A "generative AI model" is a model that uses artificial intelligence technology to generate sentences and content based on input prompts.

[1737] A "prompt" is an instruction entered into a generative AI model to specify the content and format of the content to be generated.

[1738] This invention is a system that allows even elderly educators who are not good at using PCs to easily create class newsletters. The system runs in a cloud environment and can be accessed from any device connected to the Internet. A specific embodiment of this system is described below.

[1739] The server runs on a cloud platform (e.g., Amazon Web Services, Microsoft Azure). When a user accesses the system from a device (PC, tablet, smartphone, etc.), the server provides an intuitive and simple operation screen. This operation screen is built using web technologies such as HTML, CSS, and JavaScript.

[1740] The user enters the necessary information (e.g., the title, content, and image of the class newsletter) into the operation screen. The entered data is sent to the server and saved in a database (e.g., MySQL, PostgreSQL). The server applies a template for generating the class newsletter based on the saved data, and generates the final newsletter. The information entered by the user is embedded in the template using a template engine (e.g., Handlebars.js, EJS).

[1741] The generated class newsletter is output in PDF or HTML format, allowing users to download or print it. Libraries such as wkhtmltopdf and PDFKit are used to generate PDFs. In addition, it is possible to automatically generate the content of the class newsletter using a generative AI model (e.g., OpenAI GPT-3). When the user enters a prompt sentence, the generative AI model generates an appropriate sentence and adds it to the class newsletter.

[1742] As a concrete example, consider the case where a user wants to create a "Class Newsletter of the Month." The user enters the following information into the operation screen:

[1743] Title: "This month's class newsletter"

[1744] Contents: "This month's event information, learning progress, and messages to parents"

[1745] Image: School event photos

[1746] The server receives this information, stores it in a database, then applies a template to generate a class newsletter and outputs it in PDF format.

[1747] When using a generative AI model, the user enters a prompt like this:

[1748] "Generate this month's class newsletter. Include event information, learning progress, and parent / guardian announcements."

[1749] The generative AI model generates appropriate sentences based on this prompt and adds them to the class newsletter. For example, the following sentences might be generated:

[1750] "Information about this month's events includes the sports day, which will be held on October 15th. Regarding learning progress, the math unit has been completed and students will move on to the next unit. As a message to parents, the date for next month's parent-teacher meeting has been decided, so please check it."

[1751] In this way, users can easily create and download or print class newsletters.

[1752] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1753] Step 1:

[1754] A user accesses the system.

[1755] Users access the system's URL from a web browser using a device connected to the Internet (such as a PC, tablet, or smartphone). The server runs in a cloud environment and receives the user's access request. The input is the user's access request, and the output is the system's operation screen. The server provides the user with an intuitive and simple operation screen built using HTML, CSS, and JavaScript.

[1756] Step 2:

[1757] The user enters the information.

[1758] The user inputs the necessary information into the form displayed on the operation screen. For example, they input the title, content, and images of the class newsletter. Input is the information entered by the user, and output is the transmission of this information to the server. Specifically, the user inputs the title "This month's class newsletter," the content "This month's event information, learning progress, and messages to parents," and a photo of the school event.

[1759] Step 3:

[1760] The server receives and stores the data.

[1761] The server receives the information entered by the user and stores it in a database (e.g. MySQL, PostgreSQL). The input is the information submitted by the user, and the output is the data stored in the database. The server performs validation checks to maintain data integrity and stores the data in the correct format.

[1762] Step 4:

[1763] The server generates the class newsletter.

[1764] The server generates a class newsletter based on the saved data. It uses a template engine (e.g. Handlebars.js, EJS) to embed the information entered by the user into the template. The input is the data saved in the database, and the output is the HTML structure of the generated class newsletter. Specifically, the template contains the following structure:

[1765]

[1766] <title> {{title}}< / title>

[1767]

[1768] <h1> {{title}}< / h1>

[1769] {{Contents}}

[1770]

[1771]

[1772]

[1773] Step 5:

[1774] The server outputs the generated class newsletter.

[1775] The server outputs the generated class newsletter in PDF or HTML format. To generate PDFs, libraries such as wkhtmltopdf and PDFKit are used. The input is the HTML structure of the generated class newsletter, and the output is a PDF or HTML file. The server saves the generated file so that users can download it.

[1776] Step 6:

[1777] The user downloads or prints the class newsletter.

[1778] Users can download or print the generated class newsletter from the system's operation screen. The input is the user's download or print request, and the output is the download or print of the PDF file. Specifically, when the user clicks the download link, the PDF file is saved on the device. When the user clicks the print button, the browser's print function is called up, and the class newsletter can be printed.

[1779] Step 7:

[1780] Generate sentences using generative AI models.

[1781] When a user inputs a prompt, the server uses a generative AI model (e.g., OpenAI GPT-3) to generate an appropriate sentence. The input is the prompt entered by the user, and the output is the generated sentence. Specifically, the user inputs a prompt like this:

[1782] "Generate this month's class newsletter. Include event information, learning progress, and parent / guardian announcements."

[1783] The generative AI model generates appropriate sentences based on this prompt and adds them to the class newsletter. For example, the following sentences might be generated:

[1784] "Information about this month's events includes the sports day, which will be held on October 15th. Regarding learning progress, the math unit has been completed and students will move on to the next unit. As a message to parents, the date for next month's parent-teacher meeting has been decided, so please check it."

[1785] (Application example 2)

[1786] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1787] Creating traditional classroom and store newsletters was time-consuming and laborious, placing a significant burden on older teachers and store staff who were not particularly adept at using computers. Furthermore, updating and distributing newsletter content had to be done manually, which was inefficient. Furthermore, it was difficult to create content that would appeal to customers and parents.

[1788] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a generation AI model to create class newsletters, a means for automatically updating regular content such as event content, a means for using illustrations and images that are easy to understand even with reduced text, a means for selecting photos that are careful not to overemphasize content, a means for creating an easy-to-read layout, a means for a generation AI model to create store newsletters, a means for storing them in the cloud, a means for accessing them from any device connected to the Internet, and a means for distributing them to customers. This makes it possible for even older teachers and store staff who are not good at using PCs to easily create, update, and distribute class newsletters and store newsletters.

[1789] A "class newsletter" is a document used to communicate information about a school class or grade to parents and students.

[1790] A "generative AI model" is an algorithm that uses artificial intelligence to automatically generate content such as text and images.

[1791] "Regular content such as events" is information about events and campaigns that are held regularly at schools and stores.

[1792] "Utilizing illustrations and images" means using illustrations and images to complement written information and make it easier to understand visually.

[1793] "Selecting photographs with care to avoid bias" means selecting photographs with care to avoid bias towards any particular person or thing.

[1794] An "easy-to-read layout" is one in which information is organized and arranged in a way that is visually easy to understand.

[1795] "Store communications" are documents used to communicate the latest store information and campaign information to customers.

[1796] "Storing in the cloud" means storing data on a remote server via the internet.

[1797] "Any device connected to the Internet" means any device that can connect to the Internet (such as a smartphone, tablet, or PC).

[1798] "Delivery to customers" means delivering the created information to customers.

[1799] A system for implementing this invention has the function of generating classroom and store communications using a generative AI model. The system is cloud-based and can be accessed from any device connected to the Internet. A specific embodiment of the system is described below.

[1800] System configuration

[1801] The system consists of the following main components:

[1802] 1. Generative AI models: Artificial intelligence algorithms that generate text and images.

[1803] 2. Cloud storage: A remote server for storing generated communications.

[1804] 3. User Interface: An intuitive interface for users to enter information and create and edit correspondence.

[1805] 4. Distribution module: A function for distributing created communications to customers and parents.

[1806] Hardware and software used

[1807] Hardware: Internet-connected devices such as smartphones, tablets, and PCs.

[1808] Software: Python, AWS SDK (boto3), generative AI model (e.g. GPT-3).

[1809] Data processing and calculation

[1810] 1. User interface: The user enters the store name, campaign information, additional information, etc.

[1811] 2. Generative AI model: Generates text and images for class newsletters and store newsletters based on input information.

[1812] 3. Cloud storage: The generated correspondence is stored in the cloud in JSON format.

[1813] 4. Distribution module: Distributes stored communications to clients and parents.

[1814] Specific examples

[1815] For example, a store associate enters the following informatio...

Claims

1. An input means for inputting the schedule, contents of the event, and contents of the message to be included in a class newsletter, which is a document for educators to inform parents and students of events and other announcements; a means for generating a prompt sentence for instructing the creation of contents of the class newsletter based on the information input by the input means; A means for creating the contents of a class newsletter using the generated prompt sentences and the generation AI model, in which illustrations and images are used to make the content easier to understand visually, photos are arranged with care to avoid being biased toward specific people or things, and organized information is arranged in a layout that is easy to understand visually; A means for outputting the contents of the created class newsletter; A system including:

2. The method further includes a means for estimating, using an emotion engine, the emotional state of a user who has inputted information to be included in the class newsletter; the creation means adjusts the layout of the class newsletter to be created in accordance with the emotional state estimated by the emotion engine; The system of claim 1 .

3. the creation means creates a class newsletter by embedding the information input by the input means into a template using a template engine. The system of claim 1 .

Images