system
A system using a generative AI model generates tailored slide outlines for rural relocation, addressing the challenge of family persuasion and offering continuous support.
Patent Information
- Application Number
- JP2024123987
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-30
- Publication Date
- 2026-02-12
AI Technical Summary
Individuals considering relocation to rural areas face difficulties in effectively explaining and convincing their families due to varying concerns, and traditional methods of information gathering are time-consuming and lack persuasive power.
A system that allows users to input concerns and family structure information, which is analyzed by a generative AI model to generate tailored slide outlines, automatically creating PDF slides and connecting with local government support.
Enables users to create specific and persuasive slides to alleviate family concerns, while providing continuous support from local governments.
Smart Images

Figure 2026022470000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Currently, many people considering moving to rural areas find it difficult to explain and convince their families of their decision. Furthermore, because each prospective relocator has different concerns, it is difficult to respond to them individually, and local governments are called upon to provide efficient support. Traditional methods of gathering information and creating explanatory materials are time-consuming and labor-intensive, and often lack persuasive power. Against this backdrop, there is a need for methods that make it easier for those considering moving to convince their families simply and effectively. [Means for solving the problem]
[0005] The present invention provides a system that includes a means for a user to input information about their concerns, family structure, and the person being persuaded; a means for the terminal to transmit the input information to a server; a means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; a means for the server to automatically generate slide content and convert it to PDF format; and a means for the server to transmit the completed PDF file to the user's terminal. This system allows users to easily create specific and effective slides to persuade their families. The system also includes a means for the server to link with the local government's official account and provide support information to users, enabling continuous support for those wishing to relocate. Furthermore, the generative AI model generates outlines based on fine-tuned data, automatically creating optimal slides tailored to individual needs. This efficiently resolves the concerns shared by prospective relocates and their families, enabling them to smoothly receive support from local governments.
[0006] "User" refers to an individual who uses this system to consider moving to a rural area.
[0007] "Terminal" refers to a device such as a smartphone, tablet, or PC that a user uses to input and manage information.
[0008] "Server" refers to the central processing unit that receives and analyzes information sent by users and creates and serves slides using generative AI models.
[0009] "Concerns" refer to issues that users are worried about when moving, such as the medical environment, availability of jobs, and educational environment.
[0010] "Family structure" refers to information about the structure of the user's family members, such as the number of spouses and children.
[0011] "Persuasion target" refers to a family member to whom the user needs to explain or persuade about relocating.
[0012] "Generative AI model" refers to an artificial intelligence model that creates optimal slide outlines based on the data it receives.
[0013] An "outline" refers to the framework that shows the basic structure, chapter divisions, and main items of the slides to be generated.
[0014] "Slides" refer to visual materials used to present specific information and solutions to users' concerns, family structures, and target audiences.
[0015] "PDF format" is an abbreviation for Portable Document Format and refers to a standard file format for electronically distributing and displaying documents.
[0016] "Official local government account" refers to an online account operated by a local government for official communication and information provision.
[0017] "Continuing support" refers to assistance and information activities provided to migrants by local governments and other institutions over the long term.
[0018] "Fine-tuning" refers to the process of adjusting data and updating models to optimize them for a specific purpose. [Brief explanation of the drawings]
[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0021] First, the terms used in the following description will be explained.
[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0027] [First embodiment]
[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0040] MODE FOR CARRYING OUT THE INVENTION
[0041] The present invention relates to a system for generating slides to help people considering relocating to Japan persuade their families. Specific embodiments of this system will be described below.
[0042] User Input and Data Submission
[0043] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0044] Server data analysis and slide outline generation
[0045] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[0046] Automatic generation of slides on the server and PDF conversion
[0047] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[0048] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[0049] Sending PDF files and collaborating with local governments
[0050] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0051] Specific examples
[0052] Enter and submit information
[0053] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0054] Data analysis and outline generation
[0055] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0056] Auto-generate slides and convert to PDF
[0057] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0058] PDF transmission and collaboration with local governments
[0059] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0060] In this way, the system of the present invention helps users to resolve concerns when planning to move to rural areas and plays a role in efficiently supporting persuading their families to move.
[0061] The processing flow will be explained below.
[0062] Step 1:
[0063] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[0064] Step 2:
[0065] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[0066] Step 3:
[0067] The terminal sends the input information to the server. Specifically, the terminal sends the user's input data to the server in the form of a POST request.
[0068] Step 4:
[0069] The server receives the user's input data. Specifically, the server receives the request at the API endpoint and saves it in the database.
[0070] Step 5:
[0071] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), and persuasion target (e.g., spouse) to each variable and analyzes them.
[0072] Step 6:
[0073] The server calls the generative AI model, inputs the user's data, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, and the person being persuaded into the generative AI model, and outputs the outline.
[0074] Step 7:
[0075] The server automatically generates the slide content. Specifically, the server generates titles, text, and visual elements such as images and graphs for each slide based on the generated outline.
[0076] Step 8:
[0077] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[0078] Step 9:
[0079] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[0080] Step 10:
[0081] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[0082] Step 11:
[0083] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[0084] Example 1
[0085] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0086] In modern society, an increasing number of people are considering moving to rural areas. However, when planning a move, it is difficult to effectively explain and persuade their families about concerns such as the medical environment, educational environment, and availability of jobs. In particular, it is necessary to provide appropriate information while taking into consideration the family structure and the person being persuaded. It is also important to provide support information from local governments in a timely manner.
[0087] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0088] In this invention, the server includes: a means for the user to input information about their concerns, family structure, and persuasion target; a means for the terminal to transmit the input information to the server; a means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; a means for the server to automatically generate slide content and convert it to PDF format; a means for the server to transmit the completed PDF file to the user's terminal; a means for the generative AI model to generate an automatic response script for the information input by the user; and a means for the server to make recommendations based on the slide content. This allows users to explain specific information about relocation to their families in an easy-to-understand manner, helping to alleviate their concerns about moving to rural areas. The server also links with official local government accounts to provide users with appropriate support information, effectively supporting their lives after relocation.
[0089] "User" refers to a person considering immigration who uses this system.
[0090] "Concerns" are matters that the user is anxious or worried about when moving to a rural area, and include, for example, the medical environment and the educational environment.
[0091] "Family structure" refers to specific family structure information such as the number of family members and their relationships.
[0092] The "person to be persuaded" refers to the person to whom the user wants to explain and convince about moving to the countryside.
[0093] "Terminal" refers to a device used by a user, such as a smartphone or PC, that allows information input and communication.
[0094] "Server" refers to a computer system that receives information sent from a terminal, analyzes it, and generates content.
[0095] A "generative AI model" refers to an artificial intelligence model that learns from past data and examples and generates optimal slide outlines based on the user's specific needs.
[0096] An "outline" refers to a general outline or framework that shows the structure of a slide.
[0097] "Slide content" refers to the specific slide content that is automatically generated based on the outline.
[0098] "PDF format" refers to a standard file format that can be easily viewed on many devices.
[0099] An "automatic response script" refers to an automatic response sentence generated by a generative AI model in response to user input information.
[0100] "Recommendation" refers to making suggestions or recommendations to users.
[0101] An "official local government account" is an official account provided by a local government that provides users with support information, event information, and the like.
[0102] The present invention relates to a system for generating slides to help those considering relocating to persuade their families. This system generates optimal slides based on information entered by the user and provides them in PDF format, making it easier to alleviate concerns about relocating and efficiently supporting persuasion of families. Specific embodiments of this system are described below.
[0103] User Input and Data Submission
[0104] Users log in to the system using a device such as a smartphone or PC and enter information about their concerns, family structure, and the person they are trying to persuade. Specific concerns include the medical environment, educational environment, and whether or not they have a job. Once they have completed entering the information, the user presses the send button, and the device sends this information to the server. This transmission is performed using an HTTP request.
[0105] Server data analysis and slide outline generation
[0106] The server receives the information sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs. For example, if concerns about the educational environment are input, the generative AI model will generate an outline of local school information, educational level, and types of extracurricular activities.
[0107] Automatic slide generation and PDF conversion on the server
[0108] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slide content is complete, the server converts the slides into PDF format using slide creation software such as PowerPoint or Keynote. PDF is a standard file format that can be easily viewed on many devices.
[0109] Sending PDF files and collaborating with local governments
[0110] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family members, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0111] Specific examples
[0112] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0113] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0114] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0115] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0116] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0117] Processing flow
[0118] Step 1:
[0119] A user logs in to an application using a device such as a smartphone or PC.
[0120] Input: User authentication information (ID, password)
[0121] How it works: The user enters their ID and password into the app's login screen and presses the authentication button.
[0122] Output: Authentication is successful and the user is taken to the dashboard screen.
[0123] Step 2:
[0124] The user enters information about their concern, their family, and the person they want to persuade.
[0125] Input: Concerns, family structure, data of the person being persuaded (e.g., concerns about educational environment, spouse and two children, spouse)
[0126] How it works: The user fills out a form in the app with their concerns (e.g., "I'm worried about my educational environment"), their family situation (e.g., "Spouse and two children"), and the person they're trying to persuade (e.g., "Spouse").
[0127] Output: The input data is stored in temporary memory on the device.
[0128] Step 3:
[0129] The terminal transmits the input information to the server.
[0130] Input: Data entered by the user
[0131] Action: The user presses the submit button. The device sends this input information to the server via an HTTP request.
[0132] Output: The server receives the input information.
[0133] Step 4:
[0134] The server stores the received information in a database.
[0135] Input: User information received from the device
[0136] How it works: The server records the data in a database.
[0137] Output: User information stored in the database
[0138] Step 5:
[0139] The server inputs the data into a generative AI model to generate an optimal slide outline.
[0140] Input: User information stored in the database
[0141] How it works: The server analyzes the stored data and inputs it as prompts to the generative AI model. For example, it passes information such as "The user is concerned about the educational environment," "They have a spouse and two children," and "The person they are trying to persuade is their spouse."
[0142] Output: The generative AI model returns an outline, including information about local schools, educational levels, and types of extracurricular activities.
[0143] Step 6:
[0144] The server automatically generates specific slide content based on the outline.
[0145] Input: Outline obtained from a generative AI model
[0146] How it works: The server uses a slide generator to create specific slides based on the outline, including details such as "local school introduction," "academic achievements," and "extracurricular activity options."
[0147] Output: Generated slide content
[0148] Step 7:
[0149] The server converts the slides into PDF format.
[0150] Input: Generated slide content
[0151] What it does: The server converts the slides to PDF format using a PDF conversion library (e.g. PDFKit, ReportLab).
[0152] Output: PDF file
[0153] Step 8:
[0154] The server sends the completed PDF file to the user's device.
[0155] Input: PDF file
[0156] How it works: The server sends a PDF file to the user's device, and the user is provided with a link to download the PDF through the app.
[0157] Output: A PDF file that users can download to their device.
[0158] Step 9:
[0159] The user downloads the PDF file and shows it to a family member.
[0160] Input: PDF file sent from the server
[0161] Action: The user downloads the PDF file on their device, views it, and shows it to their family members to explain it to them.
[0162] Output: Be able to give specific and effective explanations to families.
[0163] Step 10:
[0164] The server connects with the local government's official account to provide support information to users.
[0165] Input: Support information from the local government's official account
[0166] Operation: The server sends support messages and event information to users via the LINE mini-app.
[0167] Output: Relevant support information and event announcements provided to users
[0168] Through this series of steps, users can persuade their families with concrete information and effectively alleviate their concerns about moving to rural areas.
[0169] (Application example 1)
[0170] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0171] Currently, brick-and-mortar stores lack effective methods for efficiently proposing optimal products and services to customers. In particular, it is difficult to quickly provide slides that meet the needs and desires of individual customers, and in many cases, staff explanations tend to be vague. This can lead to a decline in customer satisfaction.
[0172] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0173] In this invention, the server includes a means for inputting customer information and generating optimal proposal slides, and a means for displaying the generated slides on a terminal, thereby enabling staff to quickly and accurately propose products and services that meet the customer's needs.
[0174] "Concerns" are the fears or questions users have about a particular situation or condition.
[0175] "Family structure" refers to information that indicates the number and relationships of members in a particular household.
[0176] The "target of persuasion" is the person to whom you give an explanation in order to get them to accept your proposal or opinion.
[0177] A "terminal" is an electronic device that allows a user to input information and perform operations.
[0178] A "server" is a computing device under the control of a third party that receives, analyzes, and transmits data.
[0179] A "generative AI model" is a model that has been trained using artificial intelligence to perform a specific task.
[0180] "Slides" are visual presentation materials used to make proposals or explanations.
[0181] An "outline" is a simplified outline of the main themes or content of a slide or document.
[0182] "PDF" stands for Portable Document Format, a standard file format for electronically storing and sharing documents and images.
[0183] "Customer Information" refers to information such as personal information and purchase preferences associated with a particular customer.
[0184] A "proposal slide" is a visual document created to present the best product or service to a specific customer.
[0185] "Displaying on a terminal" means visually presenting information or data on the screen of an electronic device.
[0186] "Municipality" means a local government or agency that governs a local community.
[0187] An "official account" is an official online account provided by a company or organization.
[0188] "Supporting Information" means supporting information to improve a particular service or process.
[0189] "Fine-tuning" is a technique for further improving the performance of an existing AI model by adding new data.
[0190] The present invention relates to a system for generating optimal proposal slides for customers and supporting service provision in physical stores. Specific embodiments of this system will be described below.
[0191] First, the user (store staff) accesses the application using a device such as a smartphone or smart glasses. The user enters basic customer information and needs (e.g., "smartphone camera performance") into the application. Once this information is entered, the device sends it to the server.
[0192] The server analyzes the received customer information and inputs it into a generative AI model, which is trained using machine learning frameworks such as TensorFlow and PyTorch and fine-tuned to adapt to specific tasks. The model learns from past data and examples and generates a slide outline that best suits the customer's needs.
[0193] Based on the generated outline, the server automatically generates specific slide content, including, for example, product feature comparisons, user reviews, pricing information, etc. The generated slides are converted into PDF format and sent to the user's device.
[0194] Through the above process, staff can quickly and accurately recommend products to customers, which improves customer satisfaction and streamlines store operations.
[0195] As a specific example, let's consider a case where a customer wants a smartphone with a high-performance camera. The user logs in to the smartphone application and enters the following information:
[0196] I want a smartphone with a high-performance camera
[0197] This information is sent to a server, where it is analyzed and an outline is created by a generative AI model. The server then generates a slide deck containing a list of smartphones with high camera performance, their features, user reviews, and price comparisons. The slide deck is then converted into a PDF and sent to the user's device. Staff can then view the PDF on their device and give a presentation to customers.
[0198] This series of steps will enable more effective service provision in physical stores and enable product proposals that meet customer expectations.
[0199] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0200] Step 1:
[0201] The user logs in to the device and enters customer information and needs. The input items include the customer's basic information and the characteristics of the desired product or service (e.g., "a smartphone with a high-performance camera"). After entering the information, the user presses the send button, which sends this information from the device to the server. The input data is sent to the server in JSON format or similar.
[0202] Step 2:
[0203] The server analyzes the customer information received from the terminal. The server first stores the received data in a database, then analyzes the data to extract the necessary information. Based on the analyzed data, the server inputs the prompt text into the generative AI model. The analysis results include specific elements related to the customer's needs (e.g., product features, price range, etc.).
[0204] Step 3:
[0205] The server uses a generative AI model to generate a slide outline that best suits the customer's needs. The generative AI model contains fine-tuned data based on past data and examples. Each item in the outline is suggested based on a prompt entered into the model (e.g., "I want a smartphone with a good camera"). The outline includes a list of suggested products, their features, reviews, etc.
[0206] Step 4:
[0207] The server automatically generates specific slide content based on the generated outline. The slide content is created in detail based on the customer information and the outline. For example, a slide about a smartphone with a high-performance camera would include product features, ratings, price comparisons, user reviews, and more.
[0208] Step 5:
[0209] The server converts the generated slides to PDF format. The generated slide content is saved as a PDF file, making it easy to view and share. PDF conversion is performed using Python's FPDF library, among others.
[0210] Step 6:
[0211] The server sends the completed PDF file to the user's device, where store staff can display the received PDF file and give a presentation to the customer. This enables specific and effective proposals to be made to customers.
[0212] In this way, a system is realized in which the server automatically generates slides based on information entered by the user, enabling specific and individualized suggestions.
[0213] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0214] MODE FOR CARRYING OUT THE INVENTION
[0215] The present invention combines a new system for creating slides for users to persuade their families with an emotion engine. Specific embodiments of this system will be described below.
[0216] User Input and Data Submission
[0217] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0218] Server data analysis and slide outline generation
[0219] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[0220] Using the Emotion Engine
[0221] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the server will fine-tune the slide content according to that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will help improve the content in future generation processes.
[0222] Auto-generate slides and convert to PDF
[0223] Based on the outlines generated by the generative AI model and emotion engine, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[0224] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[0225] Sending PDF files and collaborating with local governments
[0226] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0227] Specific examples
[0228] Enter and submit information
[0229] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0230] Data analysis and outline generation
[0231] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0232] Using the Emotion Engine
[0233] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[0234] Auto-generate slides and convert to PDF
[0235] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0236] PDF transmission and collaboration with local governments
[0237] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0238] The system of the present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also improves persuasive power by making the content generated through emotion recognition more personalized.
[0239] The processing flow will be explained below.
[0240] Step 1:
[0241] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[0242] Step 2:
[0243] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[0244] Step 3:
[0245] The emotion engine analyzes the user's input data and reactions to recognize the user's emotional state. Specifically, the emotion engine detects emotions such as "anxiety," "relief," and "excitement" from the input text, facial expressions, and voice.
[0246] Step 4:
[0247] The device sends the input information and emotion recognition results to the server. Specifically, the device sends the user's input data and emotion recognition results to the server in POST request format.
[0248] Step 5:
[0249] The server receives the user's input data and emotion recognition results and stores them in a database. Specifically, the server receives a request at an API endpoint and integrates and stores both sets of data in the database.
[0250] Step 6:
[0251] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), persuasion target (e.g., spouse), and emotional state to each variable and analyzes them.
[0252] Step 7:
[0253] The server calls the generative AI model, inputs the user's data and emotion recognition results, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, persuasion target, and emotional state into the generative AI model, and outputs the outline.
[0254] Step 8:
[0255] The server automatically generates slide content. Specifically, it generates titles, text, images, graphs, and other visual elements for each slide based on the generated outline. It also adjusts some of the content based on emotion recognition results.
[0256] Step 9:
[0257] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[0258] Step 10:
[0259] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[0260] Step 11:
[0261] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[0262] Step 12:
[0263] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[0264] Example 2
[0265] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0266] In modern society, many users planning to move to rural areas need to provide sufficient and specific information to persuade their families. However, if the information is insufficient or does not take into account the user's emotions, persuasion can be difficult. Furthermore, if the information is not provided effectively, it will not alleviate the family's anxiety or resistance. To address these issues, the present invention provides a system that generates optimal slides based on the user's input information and emotional state, providing specific information and emotional reassurance.
[0267] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0268] In this invention, the server includes: means for a user to input information about their concerns, family structure, and persuasion target; means for a terminal to transmit the input information to the server; means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; means for the server to analyze the user's emotional state using an emotion engine and optimize the slide content based on the data; means for the server to automatically generate slide content and convert it into PDF format; and means for the server to transmit the completed PDF file to the user's terminal. This enables the user to provide specific and emotion-sensitive information to effectively persuade their family.
[0269] A "user" is a person who uses the system to input information about concerns, family structure, and the person being persuaded, and generates slides to persuade the family.
[0270] A "terminal" is a device that a user uses to input information and communicate with a server, and specifically includes a smartphone or PC.
[0271] A "server" is a central computer system that receives information sent from the terminals and performs major processes such as analysis and slide creation.
[0272] An "emotion engine" is software that analyzes the user's emotional state from their input data and reactions, and optimizes the content of their slides based on that data.
[0273] A "generative AI model" is an artificial intelligence model that learns from past data and examples and is used to generate optimal slide outlines based on the user's specific needs.
[0274] "Slides" are presentation-style materials that show specific information and solutions that users can use to persuade their families.
[0275] An "outline" refers to the outline or rough structure of a slide created based on data analyzed by a generative AI model.
[0276] "PDF" is a standard format for converting generated slide content into a widely viewable format.
[0277] An "official local government account" is an official means of communication that distributes support information and event information provided by local government agencies online.
[0278] MODE FOR CARRYING OUT THE INVENTION
[0279] The present invention is a system for generating slides for users to persuade their families, and combines an emotion engine and a generative AI model to provide more effective and individually optimized slides. Specific embodiments of the system are described below.
[0280] User Input and Data Submission
[0281] The user logs in to a device such as a smartphone or PC and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0282] Server data analysis and slide outline generation
[0283] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs.
[0284] Using the Emotion Engine
[0285] The server uses an emotion engine to analyze the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the content of the slide will be fine-tuned accordingly. The results of this emotion analysis are also fed back to the generative AI model, helping to improve the content in subsequent generation processes.
[0286] Auto-generate slides and convert to PDF
[0287] The server automatically generates specific slide content based on the outline generated by the generative AI model and emotion engine. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slides are complete, the server converts them into PDF format. PDF is a standard file format that can be easily viewed on many devices and is user-friendly.
[0288] Sending PDF files and collaborating with local governments
[0289] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0290] Specific examples
[0291] 1. Entering and submitting information
[0292] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0293] 2. Data analysis and outline generation
[0294] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0295] 3. Use of Emotion Engine
[0296] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[0297] 4. Automatic slide generation and PDF conversion
[0298] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0299] 5. PDF transmission and collaboration with local governments
[0300] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0301] Prompt Sentence Examples
[0302] "I'm concerned about the local educational environment in order to convince my family. I need a specific slide deck for my spouse and two children that includes information about local schools, educational levels, and extracurricular activity options."
[0303] The present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also makes the content generated through emotion recognition more personalized and more persuasive.
[0304] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0305] System program processing flow
[0306] Step 1:
[0307] A user logs in to a terminal.
[0308] Specifically, a user enters an email address and password to log in to the app. The input data is the user's authentication information, and the output is the login status after successful authentication.
[0309] Step 2:
[0310] The user enters information about their concern, their family, and the person they want to persuade.
[0311] The user enters information such as "I'm worried about my educational environment," "I have a spouse and two children," and "My spouse" into a form within the app. The input is the user's interests and family information, and the output is a state where all the input information is complete.
[0312] Step 3:
[0313] The user presses the send button.
[0314] When the user presses the send button, the terminal sends the input data to the server. The input data is the information entered by the user, and the output is the completion of data transfer to the server.
[0315] Step 4:
[0316] The server receives the data and stores it in a database.
[0317] The server receives data sent from the terminal and stores it in a database. The input is the user data sent from the terminal, and the output is the data stored in the database.
[0318] Step 5:
[0319] The server inputs the data into a generative AI model.
[0320] The server inputs the data stored in the database into the generative AI model. Specifically, the concern "I'm worried about my educational environment" is passed to the generative AI model as a prompt. The input is the user data stored in the database, and the output is the prompt to the generative AI model.
[0321] Step 6:
[0322] A generative AI model generates slide outlines.
[0323] The generative AI model generates an optimal slide outline based on the prompt data. The outline includes information about local schools, educational levels, and types of extracurricular activities. The input is the prompt data, and the output is the generated outline.
[0324] Step 7:
[0325] The server invokes the emotion engine to analyze the user's emotional state.
[0326] The server invokes the emotion engine and analyzes the emotional state from the user's input data and reactions. The input is the user's text data, facial expressions, and voice data, and the output is the analyzed emotional state.
[0327] Step 8:
[0328] The server feeds the results of the emotion analysis back into the generative AI model to optimize the content.
[0329] The server receives feedback from the emotion engine and adjusts the slide outline content. The input is the emotion analysis result, and the output is a fine-tuned slide outline.
[0330] Step 9:
[0331] The server generates the specific slide content.
[0332] The server generates specific slide content based on the outline obtained from the generative AI model and emotion engine. For example, it creates slides such as "Local School Introduction," "Academic Achievements," and "Extracurricular Activity Options." The input is the adjusted outline, and the output is specific slide content.
[0333] Step 10:
[0334] The server converts the slides into PDF format.
[0335] The server converts the generated slides into PDF format, where the input is the slide content and the output is a PDF file.
[0336] Step 11:
[0337] The server sends the PDF file to the user's device.
[0338] The server sends the PDF file to the user's terminal. The input is the PDF file, and the output is the PDF file sent to the user's terminal.
[0339] Step 12:
[0340] The server connects with the local government's official account to provide support information to users.
[0341] The server connects with the local government's official account and provides support and event information to users through the LINE Mini App. The input is the connection information sent via the LINE API, and the output is the support message or event information sent to the user.
[0342] (Application example 2)
[0343] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0344] With conventional ad generation systems, it was difficult to quickly and effectively create ad slides that accurately reflected the emotions of target consumers. Furthermore, it required advertisers to manually adjust the ads and distribute them in PDF format, which required a great deal of time and effort, preventing the effectiveness of the ads from being maximized.
[0345] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information about a target consumer demographic and an advertising object; a means for a terminal to send the input information to the server; a means for the server to analyze the received information and generate an outline of an optimal advertising slide using a generative AI model; a means for the server to optimize the advertising slide based on the input information and the emotion analysis results and convert the automatically generated slide into PDF format; and a means for the server to send the completed PDF file to the advertiser's terminal and further distribute the advertisement to a distribution platform. This enables advertisers to quickly generate effective advertisements that appeal to the emotions of their target consumer demographic and distribute them in PDF format.
[0346] "Target demographic" refers to a specific group of consumers targeted by an advertisement.
[0347] "Advertising subject matter" refers to the goods or services that the advertiser aims to promote or sell through advertising.
[0348] "Device" refers to an electronic device, such as a computer, smartphone, or tablet, that a user or advertiser uses to enter or receive information.
[0349] "Server" refers to the central management system that analyzes the received information and generates the slide outline using a generative AI model.
[0350] "Generative AI model" refers to an artificial intelligence model that generates optimal slide outlines based on received information.
[0351] "Emotion analysis results" refers to the data obtained as a result of analyzing the emotional state of users or target consumer groups.
[0352] An "advertising slide" is a visual presentation created for advertising purposes, consisting of multiple pages containing text and images.
[0353] "PDF format" is an abbreviation for Portable Document Format and refers to a widely used electronic document format.
[0354] "Advertiser" refers to an individual or corporation that creates and distributes advertisements for the purpose of advertising and promoting its own products or services.
[0355] "Delivery Platform" refers to an online service or advertising network that delivers generated advertisements to consumers via the Internet.
[0356] "Emotion engine" refers to technology that identifies a user's emotional state from input information and optimizes advertising content.
[0357] The present invention relates to an advertising generation system, and in particular to a system that can automatically generate and distribute effective advertising slides based on user-entered information on target consumer demographics and advertising subjects. This system includes a server, a terminal, a generative AI model, an emotion engine, a PDF generation function, and linkage with a distribution platform.
[0358] 1. Program Generation
[0359] The user accesses the system using a device (smartphone or PC). The user enters information about the target consumer demographic and advertising subject matter and presses the send button. The device then sends this information to the server.
[0360] 2. Server Processing
[0361] The server analyzes the received information and stores it in a database. It then uses a generative AI model to generate the optimal ad slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide the most effective outline for a specific target consumer demographic.
[0362] 3. Utilizing the Emotion Engine
[0363] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the content of the ad slides based on that data. For example, if the user feels "anxious" about the target consumer demographic, the server will fine-tune the content of the ad slides based on that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will be used to improve the content in subsequent generation processes.
[0364] 4. Automatic generation of advertising slides and PDF conversion
[0365] Based on the outline generated by the generative AI model and emotion engine, the server automatically generates specific ad slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. Once the ad slide content is complete, the server converts the slides into PDF format. PDF is a standard file format that can be easily viewed on many devices, making it user-friendly.
[0366] 5. Sending and delivering advertising slides
[0367] The server sends the completed PDF file to the advertiser's device. The server then connects with a distribution platform (such as an Internet advertising network) to deliver the advertisement to the target consumer demographic. This process allows advertisers to quickly create effective advertisements and deliver them to consumers.
[0368] 6. Hardware and Software Used
[0369] This system uses cloud servers such as AWS, Google Cloud, and Azure. It uses GPT-4 as the generative AI model and Azure Cognitive Services' Sentiment Analysis API for sentiment analysis. It uses MySQL and PostgreSQL as the database and React Native for the front-end application. It also uses pdfkit and ReportLab for PDF generation.
[0370] Examples of concrete examples and prompts
[0371] As a concrete example, consider the case where an advertiser is promoting a new product, an energy-efficient refrigerator. The advertiser enters the following information into the app: "Target consumer demographic: 30-45 years old, family-owning, urban dwelling," "Product information: energy-efficient refrigerator," and "Concerns: electricity bills, environmental impact," and then presses the submit button. The server analyzes this data and generates an optimal slide outline using a generative AI model. The emotion engine detects "anxiety" and adds specific data on how to reduce electricity bills and content that provides reassurance to the slide.
[0372] Target consumer demographic: 30-45 years old, family-oriented, urban dwellers
[0373] Product Information: Energy-Saving Refrigerator
[0374] Concerns: Electricity costs, environmental impact
[0375] Emotion: Anxiety (rising electricity bill)
[0376] Produced slide:
[0377] 1. Data supporting energy conservation
[0378] 2. Reducing environmental impact
[0379] 3. User satisfaction
[0380] As described above, this system allows advertisers to quickly create effective advertisements and deliver them to target consumer groups.
[0381] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0382] Step 1:
[0383] Users access the system using a device (smartphone or PC) and enter information about the target consumer demographic and advertising object. Specifically, they enter the target age group, family structure, place of residence, and detailed information about the advertising object (e.g., energy-saving refrigerator). The entered data is temporarily stored on the device.
[0384] Step 2:
[0385] When the user completes the input and presses the submit button, the terminal sends the input information to the server. The input data is packaged in JSON format and sent to the server via a secure communication protocol (e.g., HTTPS). The server stores the received data in a database. The input here is the user's input data, and the output is the data sent to the server.
[0386] Step 3:
[0387] The server analyzes the information stored in the database and inputs it as prompts to the generative AI model. The analysis includes information on the target consumer demographic and advertising subject matter entered by the user. The generative AI model (e.g., GPT-4) generates an optimal advertising slide outline based on the input prompts. The input in this step is the user's input data, and the output is the generated slide outline.
[0388] Step 4:
[0389] The server uses an emotion engine to analyze the user's emotional state from input data (text, facial expressions, voice, etc.). The emotion engine (e.g., Azure Cognitive Services' Emotion Analysis API) recognizes the emotions (e.g., anxiety, excitement) the user has toward the target consumer demographic. The emotion analysis results are fed back to the generative AI model to help optimize the outline. The input in this step is the user's emotional data, and the output is the emotion analysis results.
[0390] Step 5:
[0391] Based on the slide outline generated and optimized by the generative AI model and emotion engine, the server automatically generates specific advertising slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. The generated slides are converted to PDF format using a Python script. The input here is the optimized slide outline, and the output is the slides in PDF format.
[0392] Step 6:
[0393] The server sends the completed PDF file to the advertiser's device. Specifically, it uses a messaging service such as Firebase Cloud Messaging (FCM) to send the PDF file to the advertiser's device as a push notification. The server then connects with a distribution platform (e.g., Google Ads, Facebook Ads) to distribute the generated advertisement to the target consumer demographic. The input in this step is the slides in PDF format, and the output is the transmission of the PDF to the advertiser's device and the distribution of the advertisement to the target consumer demographic.
[0394] As described above, this system is capable of quickly generating effective advertising slides based on information entered by the user and delivering them to target consumer groups.
[0395] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0396] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0397] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0398] [Second embodiment]
[0399] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0400] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0401] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0402] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0403] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0404] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0405] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0406] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0407] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0408] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0409] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0410] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0411] MODE FOR CARRYING OUT THE INVENTION
[0412] The present invention relates to a system for generating slides to help people considering relocating to Japan persuade their families. Specific embodiments of this system will be described below.
[0413] User Input and Data Submission
[0414] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0415] Server data analysis and slide outline generation
[0416] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[0417] Automatic generation of slides on the server and PDF conversion
[0418] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[0419] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[0420] Sending PDF files and collaborating with local governments
[0421] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0422] Specific examples
[0423] Enter and submit information
[0424] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0425] Data analysis and outline generation
[0426] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0427] Auto-generate slides and convert to PDF
[0428] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0429] PDF transmission and collaboration with local governments
[0430] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0431] In this way, the system of the present invention helps users to resolve concerns when planning to move to rural areas and plays a role in efficiently supporting persuading their families to move.
[0432] The processing flow will be explained below.
[0433] Step 1:
[0434] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[0435] Step 2:
[0436] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[0437] Step 3:
[0438] The terminal sends the input information to the server. Specifically, the terminal sends the user's input data to the server in the form of a POST request.
[0439] Step 4:
[0440] The server receives the user's input data. Specifically, the server receives the request at the API endpoint and saves it in the database.
[0441] Step 5:
[0442] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), and persuasion target (e.g., spouse) to each variable and analyzes them.
[0443] Step 6:
[0444] The server calls the generative AI model, inputs the user's data, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, and the person being persuaded into the generative AI model, and outputs the outline.
[0445] Step 7:
[0446] The server automatically generates the slide content. Specifically, the server generates titles, text, and visual elements such as images and graphs for each slide based on the generated outline.
[0447] Step 8:
[0448] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[0449] Step 9:
[0450] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[0451] Step 10:
[0452] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[0453] Step 11:
[0454] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[0455] Example 1
[0456] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0457] In modern society, an increasing number of people are considering moving to rural areas. However, when planning a move, it is difficult to effectively explain and persuade their families about concerns such as the medical environment, educational environment, and availability of jobs. In particular, it is necessary to provide appropriate information while taking into consideration the family structure and the person being persuaded. It is also important to provide support information from local governments in a timely manner.
[0458] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0459] In this invention, the server includes: a means for the user to input information about their concerns, family structure, and persuasion target; a means for the terminal to transmit the input information to the server; a means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; a means for the server to automatically generate slide content and convert it to PDF format; a means for the server to transmit the completed PDF file to the user's terminal; a means for the generative AI model to generate an automatic response script for the information input by the user; and a means for the server to make recommendations based on the slide content. This allows users to explain specific information about relocation to their families in an easy-to-understand manner, helping to alleviate their concerns about moving to rural areas. The server also links with official local government accounts to provide users with appropriate support information, effectively supporting their lives after relocation.
[0460] "User" refers to a person considering immigration who uses this system.
[0461] "Concerns" are matters that the user is anxious or worried about when moving to a rural area, and include, for example, the medical environment and the educational environment.
[0462] "Family structure" refers to specific family structure information such as the number of family members and their relationships.
[0463] The "person to be persuaded" refers to the person to whom the user wants to explain and convince about moving to the countryside.
[0464] "Terminal" refers to a device used by a user, such as a smartphone or PC, that allows information input and communication.
[0465] "Server" refers to a computer system that receives information sent from a terminal, analyzes it, and generates content.
[0466] A "generative AI model" refers to an artificial intelligence model that learns from past data and examples and generates optimal slide outlines based on the user's specific needs.
[0467] An "outline" refers to a general outline or framework that shows the structure of a slide.
[0468] "Slide content" refers to the specific slide content that is automatically generated based on the outline.
[0469] "PDF format" refers to a standard file format that can be easily viewed on many devices.
[0470] An "automatic response script" refers to an automatic response sentence generated by a generative AI model in response to user input information.
[0471] "Recommendation" refers to making suggestions or recommendations to users.
[0472] An "official local government account" is an official account provided by a local government that provides users with support information, event information, and the like.
[0473] The present invention relates to a system for generating slides to help those considering relocating to persuade their families. This system generates optimal slides based on information entered by the user and provides them in PDF format, making it easier to alleviate concerns about relocating and efficiently supporting persuasion of families. Specific embodiments of this system are described below.
[0474] User Input and Data Submission
[0475] Users log in to the system using a device such as a smartphone or PC and enter information about their concerns, family structure, and the person they are trying to persuade. Specific concerns include the medical environment, educational environment, and whether or not they have a job. Once they have completed entering the information, the user presses the send button, and the device sends this information to the server. This transmission is performed using an HTTP request.
[0476] Server data analysis and slide outline generation
[0477] The server receives the information sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs. For example, if concerns about the educational environment are input, the generative AI model will generate an outline of local school information, educational level, and types of extracurricular activities.
[0478] Automatic slide generation and PDF conversion on the server
[0479] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slide content is complete, the server converts the slides into PDF format using slide creation software such as PowerPoint or Keynote. PDF is a standard file format that can be easily viewed on many devices.
[0480] Sending PDF files and collaborating with local governments
[0481] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family members, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0482] Specific examples
[0483] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0484] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0485] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0486] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0487] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0488] Processing flow
[0489] Step 1:
[0490] A user logs in to an application using a device such as a smartphone or PC.
[0491] Input: User authentication information (ID, password)
[0492] How it works: The user enters their ID and password into the app's login screen and presses the authentication button.
[0493] Output: Authentication is successful and the user is taken to the dashboard screen.
[0494] Step 2:
[0495] The user enters information about their concern, their family, and the person they want to persuade.
[0496] Input: Concerns, family structure, data of the person being persuaded (e.g., concerns about educational environment, spouse and two children, spouse)
[0497] How it works: The user fills out a form in the app with their concerns (e.g., "I'm worried about my educational environment"), their family situation (e.g., "Spouse and two children"), and the person they're trying to persuade (e.g., "Spouse").
[0498] Output: The input data is stored in temporary memory on the device.
[0499] Step 3:
[0500] The terminal transmits the input information to the server.
[0501] Input: Data entered by the user
[0502] Action: The user presses the submit button. The device sends this input information to the server via an HTTP request.
[0503] Output: The server receives the input information.
[0504] Step 4:
[0505] The server stores the received information in a database.
[0506] Input: User information received from the device
[0507] How it works: The server records the data in a database.
[0508] Output: User information stored in the database
[0509] Step 5:
[0510] The server inputs the data into a generative AI model to generate an optimal slide outline.
[0511] Input: User information stored in the database
[0512] How it works: The server analyzes the stored data and inputs it as prompts to the generative AI model. For example, it passes information such as "The user is concerned about the educational environment," "They have a spouse and two children," and "The person they are trying to persuade is their spouse."
[0513] Output: The generative AI model returns an outline, including information about local schools, educational levels, and types of extracurricular activities.
[0514] Step 6:
[0515] The server automatically generates specific slide content based on the outline.
[0516] Input: Outline obtained from a generative AI model
[0517] How it works: The server uses a slide generator to create specific slides based on the outline, including details such as "local school introduction," "academic achievements," and "extracurricular activity options."
[0518] Output: Generated slide content
[0519] Step 7:
[0520] The server converts the slides into PDF format.
[0521] Input: Generated slide content
[0522] What it does: The server converts the slides to PDF format using a PDF conversion library (e.g. PDFKit, ReportLab).
[0523] Output: PDF file
[0524] Step 8:
[0525] The server sends the completed PDF file to the user's device.
[0526] Input: PDF file
[0527] How it works: The server sends a PDF file to the user's device, and the user is provided with a link to download the PDF through the app.
[0528] Output: A PDF file that users can download to their device.
[0529] Step 9:
[0530] The user downloads the PDF file and shows it to a family member.
[0531] Input: PDF file sent from the server
[0532] Action: The user downloads the PDF file on their device, views it, and shows it to their family members to explain it to them.
[0533] Output: Be able to give specific and effective explanations to families.
[0534] Step 10:
[0535] The server connects with the local government's official account to provide support information to users.
[0536] Input: Support information from the local government's official account
[0537] Operation: The server sends support messages and event information to users via the LINE mini-app.
[0538] Output: Relevant support information and event announcements provided to users
[0539] Through this series of steps, users can persuade their families with concrete information and effectively alleviate their concerns about moving to rural areas.
[0540] (Application example 1)
[0541] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0542] Currently, brick-and-mortar stores lack effective methods for efficiently proposing optimal products and services to customers. In particular, it is difficult to quickly provide slides that meet the needs and desires of individual customers, and in many cases, staff explanations tend to be vague. This can lead to a decline in customer satisfaction.
[0543] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0544] In this invention, the server includes a means for inputting customer information and generating optimal proposal slides, and a means for displaying the generated slides on a terminal, thereby enabling staff to quickly and accurately propose products and services that meet the customer's needs.
[0545] "Concerns" are the fears or questions users have about a particular situation or condition.
[0546] "Family structure" refers to information that indicates the number and relationships of members in a particular household.
[0547] The "target of persuasion" is the person to whom you give an explanation in order to get them to accept your proposal or opinion.
[0548] A "terminal" is an electronic device that allows a user to input information and perform operations.
[0549] A "server" is a computing device under the control of a third party that receives, analyzes, and transmits data.
[0550] A "generative AI model" is a model that has been trained using artificial intelligence to perform a specific task.
[0551] "Slides" are visual presentation materials used to make proposals or explanations.
[0552] An "outline" is a simplified outline of the main themes or content of a slide or document.
[0553] "PDF" stands for Portable Document Format, a standard file format for electronically storing and sharing documents and images.
[0554] "Customer Information" refers to information such as personal information and purchase preferences associated with a particular customer.
[0555] A "proposal slide" is a visual document created to present the best product or service to a specific customer.
[0556] "Displaying on a terminal" means visually presenting information or data on the screen of an electronic device.
[0557] "Municipality" means a local government or agency that governs a local community.
[0558] An "official account" is an official online account provided by a company or organization.
[0559] "Supporting Information" means supporting information to improve a particular service or process.
[0560] "Fine-tuning" is a technique for further improving the performance of an existing AI model by adding new data.
[0561] The present invention relates to a system for generating optimal proposal slides for customers and supporting service provision in physical stores. Specific embodiments of this system will be described below.
[0562] First, the user (store staff) accesses the application using a device such as a smartphone or smart glasses. The user enters basic customer information and needs (e.g., "smartphone camera performance") into the application. Once this information is entered, the device sends it to the server.
[0563] The server analyzes the received customer information and inputs it into a generative AI model, which is trained using machine learning frameworks such as TensorFlow and PyTorch and fine-tuned to adapt to specific tasks. The model learns from past data and examples and generates a slide outline that best suits the customer's needs.
[0564] Based on the generated outline, the server automatically generates specific slide content, including, for example, product feature comparisons, user reviews, pricing information, etc. The generated slides are converted into PDF format and sent to the user's device.
[0565] Through the above process, staff can quickly and accurately recommend products to customers, which improves customer satisfaction and streamlines store operations.
[0566] As a specific example, let's consider a case where a customer wants a smartphone with a high-performance camera. The user logs in to the smartphone application and enters the following information:
[0567] I want a smartphone with a high-performance camera
[0568] This information is sent to a server, where it is analyzed and an outline is created by a generative AI model. The server then generates a slide deck containing a list of smartphones with high camera performance, their features, user reviews, and price comparisons. The slide deck is then converted into a PDF and sent to the user's device. Staff can then view the PDF on their device and give a presentation to customers.
[0569] This series of steps will enable more effective service provision in physical stores and enable product proposals that meet customer expectations.
[0570] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0571] Step 1:
[0572] The user logs in to the device and enters customer information and needs. The input items include the customer's basic information and the characteristics of the desired product or service (e.g., "a smartphone with a high-performance camera"). After entering the information, the user presses the send button, which sends this information from the device to the server. The input data is sent to the server in JSON format or similar.
[0573] Step 2:
[0574] The server analyzes the customer information received from the terminal. The server first stores the received data in a database, then analyzes the data to extract the necessary information. Based on the analyzed data, the server inputs the prompt text into the generative AI model. The analysis results include specific elements related to the customer's needs (e.g., product features, price range, etc.).
[0575] Step 3:
[0576] The server uses a generative AI model to generate a slide outline that best suits the customer's needs. The generative AI model contains fine-tuned data based on past data and examples. Each item in the outline is suggested based on a prompt entered into the model (e.g., "I want a smartphone with a good camera"). The outline includes a list of suggested products, their features, reviews, etc.
[0577] Step 4:
[0578] The server automatically generates specific slide content based on the generated outline. The slide content is created in detail based on the customer information and the outline. For example, a slide about a smartphone with a high-performance camera would include product features, ratings, price comparisons, user reviews, and more.
[0579] Step 5:
[0580] The server converts the generated slides to PDF format. The generated slide content is saved as a PDF file, making it easy to view and share. PDF conversion is performed using Python's FPDF library, among others.
[0581] Step 6:
[0582] The server sends the completed PDF file to the user's device, where store staff can display the received PDF file and give a presentation to the customer. This enables specific and effective proposals to be made to customers.
[0583] In this way, a system is realized in which the server automatically generates slides based on information entered by the user, enabling specific and individualized suggestions.
[0584] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0585] MODE FOR CARRYING OUT THE INVENTION
[0586] The present invention combines a new system for creating slides for users to persuade their families with an emotion engine. Specific embodiments of this system will be described below.
[0587] User Input and Data Submission
[0588] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0589] Server data analysis and slide outline generation
[0590] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[0591] Using the Emotion Engine
[0592] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the server will fine-tune the slide content according to that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will help improve the content in future generation processes.
[0593] Auto-generate slides and convert to PDF
[0594] Based on the outlines generated by the generative AI model and emotion engine, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[0595] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[0596] Sending PDF files and collaborating with local governments
[0597] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0598] Specific examples
[0599] Enter and submit information
[0600] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0601] Data analysis and outline generation
[0602] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0603] Using the Emotion Engine
[0604] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[0605] Auto-generate slides and convert to PDF
[0606] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0607] PDF transmission and collaboration with local governments
[0608] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0609] The system of the present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also improves persuasive power by making the content generated through emotion recognition more personalized.
[0610] The processing flow will be explained below.
[0611] Step 1:
[0612] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[0613] Step 2:
[0614] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[0615] Step 3:
[0616] The emotion engine analyzes the user's input data and reactions to recognize the user's emotional state. Specifically, the emotion engine detects emotions such as "anxiety," "relief," and "excitement" from the input text, facial expressions, and voice.
[0617] Step 4:
[0618] The device sends the input information and emotion recognition results to the server. Specifically, the device sends the user's input data and emotion recognition results to the server in POST request format.
[0619] Step 5:
[0620] The server receives the user's input data and emotion recognition results and stores them in a database. Specifically, the server receives a request at an API endpoint and integrates and stores both sets of data in the database.
[0621] Step 6:
[0622] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), persuasion target (e.g., spouse), and emotional state to each variable and analyzes them.
[0623] Step 7:
[0624] The server calls the generative AI model, inputs the user's data and emotion recognition results, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, persuasion target, and emotional state into the generative AI model, and outputs the outline.
[0625] Step 8:
[0626] The server automatically generates slide content. Specifically, it generates titles, text, images, graphs, and other visual elements for each slide based on the generated outline. It also adjusts some of the content based on emotion recognition results.
[0627] Step 9:
[0628] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[0629] Step 10:
[0630] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[0631] Step 11:
[0632] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[0633] Step 12:
[0634] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[0635] Example 2
[0636] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0637] In modern society, many users planning to move to rural areas need to provide sufficient and specific information to persuade their families. However, if the information is insufficient or does not take into account the user's emotions, persuasion can be difficult. Furthermore, if the information is not provided effectively, it will not alleviate the family's anxiety or resistance. To address these issues, the present invention provides a system that generates optimal slides based on the user's input information and emotional state, providing specific information and emotional reassurance.
[0638] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0639] In this invention, the server includes: means for a user to input information about their concerns, family structure, and persuasion target; means for a terminal to transmit the input information to the server; means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; means for the server to analyze the user's emotional state using an emotion engine and optimize the slide content based on the data; means for the server to automatically generate slide content and convert it into PDF format; and means for the server to transmit the completed PDF file to the user's terminal. This enables the user to provide specific and emotion-sensitive information to effectively persuade their family.
[0640] A "user" is a person who uses the system to input information about concerns, family structure, and the person being persuaded, and generates slides to persuade the family.
[0641] A "terminal" is a device that a user uses to input information and communicate with a server, and specifically includes a smartphone or PC.
[0642] A "server" is a central computer system that receives information sent from the terminals and performs major processes such as analysis and slide creation.
[0643] An "emotion engine" is software that analyzes the user's emotional state from their input data and reactions, and optimizes the content of their slides based on that data.
[0644] A "generative AI model" is an artificial intelligence model that learns from past data and examples and is used to generate optimal slide outlines based on the user's specific needs.
[0645] "Slides" are presentation-style materials that show specific information and solutions that users can use to persuade their families.
[0646] An "outline" refers to the outline or rough structure of a slide created based on data analyzed by a generative AI model.
[0647] "PDF" is a standard format for converting generated slide content into a widely viewable format.
[0648] An "official local government account" is an official means of communication that distributes support information and event information provided by local government agencies online.
[0649] MODE FOR CARRYING OUT THE INVENTION
[0650] The present invention is a system for generating slides for users to persuade their families, and combines an emotion engine and a generative AI model to provide more effective and individually optimized slides. Specific embodiments of the system are described below.
[0651] User Input and Data Submission
[0652] The user logs in to a device such as a smartphone or PC and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0653] Server data analysis and slide outline generation
[0654] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs.
[0655] Using the Emotion Engine
[0656] The server uses an emotion engine to analyze the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the content of the slide will be fine-tuned accordingly. The results of this emotion analysis are also fed back to the generative AI model, helping to improve the content in subsequent generation processes.
[0657] Auto-generate slides and convert to PDF
[0658] The server automatically generates specific slide content based on the outline generated by the generative AI model and emotion engine. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slides are complete, the server converts them into PDF format. PDF is a standard file format that can be easily viewed on many devices and is user-friendly.
[0659] Sending PDF files and collaborating with local governments
[0660] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0661] Specific examples
[0662] 1. Entering and submitting information
[0663] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0664] 2. Data analysis and outline generation
[0665] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0666] 3. Use of Emotion Engine
[0667] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[0668] 4. Automatic slide generation and PDF conversion
[0669] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0670] 5. PDF transmission and collaboration with local governments
[0671] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0672] Prompt Sentence Examples
[0673] "I'm concerned about the local educational environment in order to convince my family. I need a specific slide deck for my spouse and two children that includes information about local schools, educational levels, and extracurricular activity options."
[0674] The present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also makes the content generated through emotion recognition more personalized and more persuasive.
[0675] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0676] System program processing flow
[0677] Step 1:
[0678] A user logs in to a terminal.
[0679] Specifically, a user enters an email address and password to log in to the app. The input data is the user's authentication information, and the output is the login status after successful authentication.
[0680] Step 2:
[0681] The user enters information about their concern, their family, and the person they want to persuade.
[0682] The user enters information such as "I'm worried about my educational environment," "I have a spouse and two children," and "My spouse" into a form within the app. The input is the user's interests and family information, and the output is a state where all the input information is complete.
[0683] Step 3:
[0684] The user presses the send button.
[0685] When the user presses the send button, the terminal sends the input data to the server. The input data is the information entered by the user, and the output is the completion of data transfer to the server.
[0686] Step 4:
[0687] The server receives the data and stores it in a database.
[0688] The server receives data sent from the terminal and stores it in a database. The input is the user data sent from the terminal, and the output is the data stored in the database.
[0689] Step 5:
[0690] The server inputs the data into a generative AI model.
[0691] The server inputs the data stored in the database into the generative AI model. Specifically, the concern "I'm worried about my educational environment" is passed to the generative AI model as a prompt. The input is the user data stored in the database, and the output is the prompt to the generative AI model.
[0692] Step 6:
[0693] A generative AI model generates slide outlines.
[0694] The generative AI model generates an optimal slide outline based on the prompt data. The outline includes information about local schools, educational levels, and types of extracurricular activities. The input is the prompt data, and the output is the generated outline.
[0695] Step 7:
[0696] The server invokes the emotion engine to analyze the user's emotional state.
[0697] The server invokes the emotion engine and analyzes the emotional state from the user's input data and reactions. The input is the user's text data, facial expressions, and voice data, and the output is the analyzed emotional state.
[0698] Step 8:
[0699] The server feeds the results of the emotion analysis back into the generative AI model to optimize the content.
[0700] The server receives feedback from the emotion engine and adjusts the slide outline content. The input is the emotion analysis result, and the output is a fine-tuned slide outline.
[0701] Step 9:
[0702] The server generates the specific slide content.
[0703] The server generates specific slide content based on the outline obtained from the generative AI model and emotion engine. For example, it creates slides such as "Local School Introduction," "Academic Achievements," and "Extracurricular Activity Options." The input is the adjusted outline, and the output is specific slide content.
[0704] Step 10:
[0705] The server converts the slides into PDF format.
[0706] The server converts the generated slides into PDF format, where the input is the slide content and the output is a PDF file.
[0707] Step 11:
[0708] The server sends the PDF file to the user's device.
[0709] The server sends the PDF file to the user's terminal. The input is the PDF file, and the output is the PDF file sent to the user's terminal.
[0710] Step 12:
[0711] The server connects with the local government's official account to provide support information to users.
[0712] The server connects with the local government's official account and provides support and event information to users through the LINE Mini App. The input is the connection information sent via the LINE API, and the output is the support message or event information sent to the user.
[0713] (Application example 2)
[0714] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0715] With conventional ad generation systems, it was difficult to quickly and effectively create ad slides that accurately reflected the emotions of target consumers. Furthermore, it required advertisers to manually adjust the ads and distribute them in PDF format, which required a great deal of time and effort, preventing the effectiveness of the ads from being maximized.
[0716] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information about a target consumer demographic and an advertising object; a means for a terminal to send the input information to the server; a means for the server to analyze the received information and generate an outline of an optimal advertising slide using a generative AI model; a means for the server to optimize the advertising slide based on the input information and the emotion analysis results and convert the automatically generated slide into PDF format; and a means for the server to send the completed PDF file to the advertiser's terminal and further distribute the advertisement to a distribution platform. This enables advertisers to quickly generate effective advertisements that appeal to the emotions of their target consumer demographic and distribute them in PDF format.
[0717] "Target demographic" refers to a specific group of consumers targeted by an advertisement.
[0718] "Advertising subject matter" refers to the goods or services that the advertiser aims to promote or sell through advertising.
[0719] "Device" refers to an electronic device, such as a computer, smartphone, or tablet, that a user or advertiser uses to enter or receive information.
[0720] "Server" refers to the central management system that analyzes the received information and generates the slide outline using a generative AI model.
[0721] "Generative AI model" refers to an artificial intelligence model that generates optimal slide outlines based on received information.
[0722] "Emotion analysis results" refers to the data obtained as a result of analyzing the emotional state of users or target consumer groups.
[0723] An "advertising slide" is a visual presentation created for advertising purposes, consisting of multiple pages containing text and images.
[0724] "PDF format" is an abbreviation for Portable Document Format and refers to a widely used electronic document format.
[0725] "Advertiser" refers to an individual or corporation that creates and distributes advertisements for the purpose of advertising and promoting its own products or services.
[0726] "Delivery Platform" refers to an online service or advertising network that delivers generated advertisements to consumers via the Internet.
[0727] "Emotion engine" refers to technology that identifies a user's emotional state from input information and optimizes advertising content.
[0728] The present invention relates to an advertising generation system, and in particular to a system that can automatically generate and distribute effective advertising slides based on user-entered information on target consumer demographics and advertising subjects. This system includes a server, a terminal, a generative AI model, an emotion engine, a PDF generation function, and linkage with a distribution platform.
[0729] 1. Program Generation
[0730] The user accesses the system using a device (smartphone or PC). The user enters information about the target consumer demographic and advertising subject matter and presses the send button. The device then sends this information to the server.
[0731] 2. Server Processing
[0732] The server analyzes the received information and stores it in a database. It then uses a generative AI model to generate the optimal ad slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide the most effective outline for a specific target consumer demographic.
[0733] 3. Utilizing the Emotion Engine
[0734] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the content of the ad slides based on that data. For example, if the user feels "anxious" about the target consumer demographic, the server will fine-tune the content of the ad slides based on that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will be used to improve the content in subsequent generation processes.
[0735] 4. Automatic generation of advertising slides and PDF conversion
[0736] Based on the outline generated by the generative AI model and emotion engine, the server automatically generates specific ad slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. Once the ad slide content is complete, the server converts the slides into PDF format. PDF is a standard file format that can be easily viewed on many devices, making it user-friendly.
[0737] 5. Sending and delivering advertising slides
[0738] The server sends the completed PDF file to the advertiser's device. The server then connects with a distribution platform (such as an Internet advertising network) to deliver the advertisement to the target consumer demographic. This process allows advertisers to quickly create effective advertisements and deliver them to consumers.
[0739] 6. Hardware and Software Used
[0740] This system uses cloud servers such as AWS, Google Cloud, and Azure. It uses GPT-4 as the generative AI model and Azure Cognitive Services' Sentiment Analysis API for sentiment analysis. It uses MySQL and PostgreSQL as the database and React Native for the front-end application. It also uses pdfkit and ReportLab for PDF generation.
[0741] Examples of concrete examples and prompts
[0742] As a concrete example, consider the case where an advertiser is promoting a new product, an energy-efficient refrigerator. The advertiser enters the following information into the app: "Target consumer demographic: 30-45 years old, family-owning, urban dwelling," "Product information: energy-efficient refrigerator," and "Concerns: electricity bills, environmental impact," and then presses the submit button. The server analyzes this data and generates an optimal slide outline using a generative AI model. The emotion engine detects "anxiety" and adds specific data on how to reduce electricity bills and content that provides reassurance to the slide.
[0743] Target consumer demographic: 30-45 years old, family-oriented, urban dwellers
[0744] Product Information: Energy-Saving Refrigerator
[0745] Concerns: Electricity costs, environmental impact
[0746] Emotion: Anxiety (rising electricity bill)
[0747] Produced slide:
[0748] 1. Data supporting energy conservation
[0749] 2. Reducing environmental impact
[0750] 3. User satisfaction
[0751] As described above, this system allows advertisers to quickly create effective advertisements and deliver them to target consumer groups.
[0752] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0753] Step 1:
[0754] Users access the system using a device (smartphone or PC) and enter information about the target consumer demographic and advertising object. Specifically, they enter the target age group, family structure, place of residence, and detailed information about the advertising object (e.g., energy-saving refrigerator). The entered data is temporarily stored on the device.
[0755] Step 2:
[0756] When the user completes the input and presses the submit button, the terminal sends the input information to the server. The input data is packaged in JSON format and sent to the server via a secure communication protocol (e.g., HTTPS). The server stores the received data in a database. The input here is the user's input data, and the output is the data sent to the server.
[0757] Step 3:
[0758] The server analyzes the information stored in the database and inputs it as prompts to the generative AI model. The analysis includes information on the target consumer demographic and advertising subject matter entered by the user. The generative AI model (e.g., GPT-4) generates an optimal advertising slide outline based on the input prompts. The input in this step is the user's input data, and the output is the generated slide outline.
[0759] Step 4:
[0760] The server uses an emotion engine to analyze the user's emotional state from input data (text, facial expressions, voice, etc.). The emotion engine (e.g., Azure Cognitive Services' Emotion Analysis API) recognizes the emotions (e.g., anxiety, excitement) the user has toward the target consumer demographic. The emotion analysis results are fed back to the generative AI model to help optimize the outline. The input in this step is the user's emotional data, and the output is the emotion analysis results.
[0761] Step 5:
[0762] Based on the slide outline generated and optimized by the generative AI model and emotion engine, the server automatically generates specific advertising slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. The generated slides are converted to PDF format using a Python script. The input here is the optimized slide outline, and the output is the slides in PDF format.
[0763] Step 6:
[0764] The server sends the completed PDF file to the advertiser's device. Specifically, it uses a messaging service such as Firebase Cloud Messaging (FCM) to send the PDF file to the advertiser's device as a push notification. The server then connects with a distribution platform (e.g., Google Ads, Facebook Ads) to distribute the generated advertisement to the target consumer demographic. The input in this step is the slides in PDF format, and the output is the transmission of the PDF to the advertiser's device and the distribution of the advertisement to the target consumer demographic.
[0765] As described above, this system is capable of quickly generating effective advertising slides based on information entered by the user and delivering them to target consumer groups.
[0766] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0767] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0768] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0769] [Third embodiment]
[0770] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0771] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0772] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0773] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0774] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0775] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0776] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0777] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0778] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0779] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0780] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0781] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0782] MODE FOR CARRYING OUT THE INVENTION
[0783] The present invention relates to a system for generating slides to help people considering relocating to Japan persuade their families. Specific embodiments of this system will be described below.
[0784] User Input and Data Submission
[0785] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0786] Server data analysis and slide outline generation
[0787] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[0788] Automatic generation of slides on the server and PDF conversion
[0789] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[0790] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[0791] Sending PDF files and collaborating with local governments
[0792] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0793] Specific examples
[0794] Enter and submit information
[0795] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0796] Data analysis and outline generation
[0797] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0798] Auto-generate slides and convert to PDF
[0799] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0800] PDF transmission and collaboration with local governments
[0801] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0802] In this way, the system of the present invention helps users to resolve concerns when planning to move to rural areas and plays a role in efficiently supporting persuading their families to move.
[0803] The processing flow will be explained below.
[0804] Step 1:
[0805] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[0806] Step 2:
[0807] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[0808] Step 3:
[0809] The terminal sends the input information to the server. Specifically, the terminal sends the user's input data to the server in the form of a POST request.
[0810] Step 4:
[0811] The server receives the user's input data. Specifically, the server receives the request at the API endpoint and saves it in the database.
[0812] Step 5:
[0813] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), and persuasion target (e.g., spouse) to each variable and analyzes them.
[0814] Step 6:
[0815] The server calls the generative AI model, inputs the user's data, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, and the person being persuaded into the generative AI model, and outputs the outline.
[0816] Step 7:
[0817] The server automatically generates the slide content. Specifically, the server generates titles, text, and visual elements such as images and graphs for each slide based on the generated outline.
[0818] Step 8:
[0819] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[0820] Step 9:
[0821] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[0822] Step 10:
[0823] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[0824] Step 11:
[0825] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[0826] Example 1
[0827] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0828] In modern society, an increasing number of people are considering moving to rural areas. However, when planning a move, it is difficult to effectively explain and persuade their families about concerns such as the medical environment, educational environment, and availability of jobs. In particular, it is necessary to provide appropriate information while taking into consideration the family structure and the person being persuaded. It is also important to provide support information from local governments in a timely manner.
[0829] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0830] In this invention, the server includes: a means for the user to input information about their concerns, family structure, and persuasion target; a means for the terminal to transmit the input information to the server; a means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; a means for the server to automatically generate slide content and convert it to PDF format; a means for the server to transmit the completed PDF file to the user's terminal; a means for the generative AI model to generate an automatic response script for the information input by the user; and a means for the server to make recommendations based on the slide content. This allows users to explain specific information about relocation to their families in an easy-to-understand manner, helping to alleviate their concerns about moving to rural areas. The server also links with official local government accounts to provide users with appropriate support information, effectively supporting their lives after relocation.
[0831] "User" refers to a person considering immigration who uses this system.
[0832] "Concerns" are matters that the user is anxious or worried about when moving to a rural area, and include, for example, the medical environment and the educational environment.
[0833] "Family structure" refers to specific family structure information such as the number of family members and their relationships.
[0834] The "person to be persuaded" refers to the person to whom the user wants to explain and convince about moving to the countryside.
[0835] "Terminal" refers to a device used by a user, such as a smartphone or PC, that allows information input and communication.
[0836] "Server" refers to a computer system that receives information sent from a terminal, analyzes it, and generates content.
[0837] A "generative AI model" refers to an artificial intelligence model that learns from past data and examples and generates optimal slide outlines based on the user's specific needs.
[0838] An "outline" refers to a general outline or framework that shows the structure of a slide.
[0839] "Slide content" refers to the specific slide content that is automatically generated based on the outline.
[0840] "PDF format" refers to a standard file format that can be easily viewed on many devices.
[0841] An "automatic response script" refers to an automatic response sentence generated by a generative AI model in response to user input information.
[0842] "Recommendation" refers to making suggestions or recommendations to users.
[0843] An "official local government account" is an official account provided by a local government that provides users with support information, event information, and the like.
[0844] The present invention relates to a system for generating slides to help those considering relocating to persuade their families. This system generates optimal slides based on information entered by the user and provides them in PDF format, making it easier to alleviate concerns about relocating and efficiently supporting persuasion of families. Specific embodiments of this system are described below.
[0845] User Input and Data Submission
[0846] Users log in to the system using a device such as a smartphone or PC and enter information about their concerns, family structure, and the person they are trying to persuade. Specific concerns include the medical environment, educational environment, and whether or not they have a job. Once they have completed entering the information, the user presses the send button, and the device sends this information to the server. This transmission is performed using an HTTP request.
[0847] Server data analysis and slide outline generation
[0848] The server receives the information sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs. For example, if concerns about the educational environment are input, the generative AI model will generate an outline of local school information, educational level, and types of extracurricular activities.
[0849] Automatic slide generation and PDF conversion on the server
[0850] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slide content is complete, the server converts the slides into PDF format using slide creation software such as PowerPoint or Keynote. PDF is a standard file format that can be easily viewed on many devices.
[0851] Sending PDF files and collaborating with local governments
[0852] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family members, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0853] Specific examples
[0854] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0855] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0856] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0857] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0858] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0859] Processing flow
[0860] Step 1:
[0861] A user logs in to an application using a device such as a smartphone or PC.
[0862] Input: User authentication information (ID, password)
[0863] How it works: The user enters their ID and password into the app's login screen and presses the authentication button.
[0864] Output: Authentication is successful and the user is taken to the dashboard screen.
[0865] Step 2:
[0866] The user enters information about their concern, their family, and the person they want to persuade.
[0867] Input: Concerns, family structure, data of the person being persuaded (e.g., concerns about educational environment, spouse and two children, spouse)
[0868] How it works: The user fills out a form in the app with their concerns (e.g., "I'm worried about my educational environment"), their family situation (e.g., "Spouse and two children"), and the person they're trying to persuade (e.g., "Spouse").
[0869] Output: The input data is stored in temporary memory on the device.
[0870] Step 3:
[0871] The terminal transmits the input information to the server.
[0872] Input: Data entered by the user
[0873] Action: The user presses the submit button. The device sends this input information to the server via an HTTP request.
[0874] Output: The server receives the input information.
[0875] Step 4:
[0876] The server stores the received information in a database.
[0877] Input: User information received from the device
[0878] How it works: The server records the data in a database.
[0879] Output: User information stored in the database
[0880] Step 5:
[0881] The server inputs the data into a generative AI model to generate an optimal slide outline.
[0882] Input: User information stored in the database
[0883] How it works: The server analyzes the stored data and inputs it as prompts to the generative AI model. For example, it passes information such as "The user is concerned about the educational environment," "They have a spouse and two children," and "The person they are trying to persuade is their spouse."
[0884] Output: The generative AI model returns an outline, including information about local schools, educational levels, and types of extracurricular activities.
[0885] Step 6:
[0886] The server automatically generates specific slide content based on the outline.
[0887] Input: Outline obtained from a generative AI model
[0888] How it works: The server uses a slide generator to create specific slides based on the outline, including details such as "local school introduction," "academic achievements," and "extracurricular activity options."
[0889] Output: Generated slide content
[0890] Step 7:
[0891] The server converts the slides into PDF format.
[0892] Input: Generated slide content
[0893] What it does: The server converts the slides to PDF format using a PDF conversion library (e.g. PDFKit, ReportLab).
[0894] Output: PDF file
[0895] Step 8:
[0896] The server sends the completed PDF file to the user's device.
[0897] Input: PDF file
[0898] How it works: The server sends a PDF file to the user's device, and the user is provided with a link to download the PDF through the app.
[0899] Output: A PDF file that users can download to their device.
[0900] Step 9:
[0901] The user downloads the PDF file and shows it to a family member.
[0902] Input: PDF file sent from the server
[0903] Action: The user downloads the PDF file on their device, views it, and shows it to their family members to explain it to them.
[0904] Output: Be able to give specific and effective explanations to families.
[0905] Step 10:
[0906] The server connects with the local government's official account to provide support information to users.
[0907] Input: Support information from the local government's official account
[0908] Operation: The server sends support messages and event information to users via the LINE mini-app.
[0909] Output: Relevant support information and event announcements provided to users
[0910] Through this series of steps, users can persuade their families with concrete information and effectively alleviate their concerns about moving to rural areas.
[0911] (Application example 1)
[0912] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0913] Currently, brick-and-mortar stores lack effective methods for efficiently proposing optimal products and services to customers. In particular, it is difficult to quickly provide slides that meet the needs and desires of individual customers, and in many cases, staff explanations tend to be vague. This can lead to a decline in customer satisfaction.
[0914] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0915] In this invention, the server includes a means for inputting customer information and generating optimal proposal slides, and a means for displaying the generated slides on a terminal, thereby enabling staff to quickly and accurately propose products and services that meet the customer's needs.
[0916] "Concerns" are the fears or questions users have about a particular situation or condition.
[0917] "Family structure" refers to information that indicates the number and relationships of members in a particular household.
[0918] The "target of persuasion" is the person to whom you give an explanation in order to get them to accept your proposal or opinion.
[0919] A "terminal" is an electronic device that allows a user to input information and perform operations.
[0920] A "server" is a computing device under the control of a third party that receives, analyzes, and transmits data.
[0921] A "generative AI model" is a model that has been trained using artificial intelligence to perform a specific task.
[0922] "Slides" are visual presentation materials used to make proposals or explanations.
[0923] An "outline" is a simplified outline of the main themes or content of a slide or document.
[0924] "PDF" stands for Portable Document Format, a standard file format for electronically storing and sharing documents and images.
[0925] "Customer Information" refers to information such as personal information and purchase preferences associated with a particular customer.
[0926] A "proposal slide" is a visual document created to present the best product or service to a specific customer.
[0927] "Displaying on a terminal" means visually presenting information or data on the screen of an electronic device.
[0928] "Municipality" means a local government or agency that governs a local community.
[0929] An "official account" is an official online account provided by a company or organization.
[0930] "Supporting Information" means supporting information to improve a particular service or process.
[0931] "Fine-tuning" is a technique for further improving the performance of an existing AI model by adding new data.
[0932] The present invention relates to a system for generating optimal proposal slides for customers and supporting service provision in physical stores. Specific embodiments of this system will be described below.
[0933] First, the user (store staff) accesses the application using a device such as a smartphone or smart glasses. The user enters basic customer information and needs (e.g., "smartphone camera performance") into the application. Once this information is entered, the device sends it to the server.
[0934] The server analyzes the received customer information and inputs it into a generative AI model, which is trained using machine learning frameworks such as TensorFlow and PyTorch and fine-tuned to adapt to specific tasks. The model learns from past data and examples and generates a slide outline that best suits the customer's needs.
[0935] Based on the generated outline, the server automatically generates specific slide content, including, for example, product feature comparisons, user reviews, pricing information, etc. The generated slides are converted into PDF format and sent to the user's device.
[0936] Through the above process, staff can quickly and accurately recommend products to customers, which improves customer satisfaction and streamlines store operations.
[0937] As a specific example, let's consider a case where a customer wants a smartphone with a high-performance camera. The user logs in to the smartphone application and enters the following information:
[0938] I want a smartphone with a high-performance camera
[0939] This information is sent to a server, where it is analyzed and an outline is created by a generative AI model. The server then generates a slide deck containing a list of smartphones with high camera performance, their features, user reviews, and price comparisons. The slide deck is then converted into a PDF and sent to the user's device. Staff can then view the PDF on their device and give a presentation to customers.
[0940] This series of steps will enable more effective service provision in physical stores and enable product proposals that meet customer expectations.
[0941] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0942] Step 1:
[0943] The user logs in to the device and enters customer information and needs. The input items include the customer's basic information and the characteristics of the desired product or service (e.g., "a smartphone with a high-performance camera"). After entering the information, the user presses the send button, which sends this information from the device to the server. The input data is sent to the server in JSON format or similar.
[0944] Step 2:
[0945] The server analyzes the customer information received from the terminal. The server first stores the received data in a database, then analyzes the data to extract the necessary information. Based on the analyzed data, the server inputs the prompt text into the generative AI model. The analysis results include specific elements related to the customer's needs (e.g., product features, price range, etc.).
[0946] Step 3:
[0947] The server uses a generative AI model to generate a slide outline that best suits the customer's needs. The generative AI model contains fine-tuned data based on past data and examples. Each item in the outline is suggested based on a prompt entered into the model (e.g., "I want a smartphone with a good camera"). The outline includes a list of suggested products, their features, reviews, etc.
[0948] Step 4:
[0949] The server automatically generates specific slide content based on the generated outline. The slide content is created in detail based on the customer information and the outline. For example, a slide about a smartphone with a high-performance camera would include product features, ratings, price comparisons, user reviews, and more.
[0950] Step 5:
[0951] The server converts the generated slides to PDF format. The generated slide content is saved as a PDF file, making it easy to view and share. PDF conversion is performed using Python's FPDF library, among others.
[0952] Step 6:
[0953] The server sends the completed PDF file to the user's device, where store staff can display the received PDF file and give a presentation to the customer. This enables specific and effective proposals to be made to customers.
[0954] In this way, a system is realized in which the server automatically generates slides based on information entered by the user, enabling specific and individualized suggestions.
[0955] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0956] MODE FOR CARRYING OUT THE INVENTION
[0957] The present invention combines a new system for creating slides for users to persuade their families with an emotion engine. Specific embodiments of this system will be described below.
[0958] User Input and Data Submission
[0959] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[0960] Server data analysis and slide outline generation
[0961] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[0962] Using the Emotion Engine
[0963] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the server will fine-tune the slide content according to that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will help improve the content in future generation processes.
[0964] Auto-generate slides and convert to PDF
[0965] Based on the outlines generated by the generative AI model and emotion engine, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[0966] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[0967] Sending PDF files and collaborating with local governments
[0968] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[0969] Specific examples
[0970] Enter and submit information
[0971] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[0972] Data analysis and outline generation
[0973] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[0974] Using the Emotion Engine
[0975] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[0976] Auto-generate slides and convert to PDF
[0977] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[0978] PDF transmission and collaboration with local governments
[0979] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[0980] The system of the present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also improves persuasive power by making the content generated through emotion recognition more personalized.
[0981] The processing flow will be explained below.
[0982] Step 1:
[0983] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[0984] Step 2:
[0985] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[0986] Step 3:
[0987] The emotion engine analyzes the user's input data and reactions to recognize the user's emotional state. Specifically, the emotion engine detects emotions such as "anxiety," "relief," and "excitement" from the input text, facial expressions, and voice.
[0988] Step 4:
[0989] The device sends the input information and emotion recognition results to the server. Specifically, the device sends the user's input data and emotion recognition results to the server in POST request format.
[0990] Step 5:
[0991] The server receives the user's input data and emotion recognition results and stores them in a database. Specifically, the server receives a request at an API endpoint and integrates and stores both sets of data in the database.
[0992] Step 6:
[0993] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), persuasion target (e.g., spouse), and emotional state to each variable and analyzes them.
[0994] Step 7:
[0995] The server calls the generative AI model, inputs the user's data and emotion recognition results, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, persuasion target, and emotional state into the generative AI model, and outputs the outline.
[0996] Step 8:
[0997] The server automatically generates slide content. Specifically, it generates titles, text, images, graphs, and other visual elements for each slide based on the generated outline. It also adjusts some of the content based on emotion recognition results.
[0998] Step 9:
[0999] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[1000] Step 10:
[1001] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[1002] Step 11:
[1003] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[1004] Step 12:
[1005] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[1006] Example 2
[1007] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1008] In modern society, many users planning to move to rural areas need to provide sufficient and specific information to persuade their families. However, if the information is insufficient or does not take into account the user's emotions, persuasion can be difficult. Furthermore, if the information is not provided effectively, it will not alleviate the family's anxiety or resistance. To address these issues, the present invention provides a system that generates optimal slides based on the user's input information and emotional state, providing specific information and emotional reassurance.
[1009] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1010] In this invention, the server includes: means for a user to input information about their concerns, family structure, and persuasion target; means for a terminal to transmit the input information to the server; means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; means for the server to analyze the user's emotional state using an emotion engine and optimize the slide content based on the data; means for the server to automatically generate slide content and convert it into PDF format; and means for the server to transmit the completed PDF file to the user's terminal. This enables the user to provide specific and emotion-sensitive information to effectively persuade their family.
[1011] A "user" is a person who uses the system to input information about concerns, family structure, and the person being persuaded, and generates slides to persuade the family.
[1012] A "terminal" is a device that a user uses to input information and communicate with a server, and specifically includes a smartphone or PC.
[1013] A "server" is a central computer system that receives information sent from the terminals and performs major processes such as analysis and slide creation.
[1014] An "emotion engine" is software that analyzes the user's emotional state from their input data and reactions, and optimizes the content of their slides based on that data.
[1015] A "generative AI model" is an artificial intelligence model that learns from past data and examples and is used to generate optimal slide outlines based on the user's specific needs.
[1016] "Slides" are presentation-style materials that show specific information and solutions that users can use to persuade their families.
[1017] An "outline" refers to the outline or rough structure of a slide created based on data analyzed by a generative AI model.
[1018] "PDF" is a standard format for converting generated slide content into a widely viewable format.
[1019] An "official local government account" is an official means of communication that distributes support information and event information provided by local government agencies online.
[1020] MODE FOR CARRYING OUT THE INVENTION
[1021] The present invention is a system for generating slides for users to persuade their families, and combines an emotion engine and a generative AI model to provide more effective and individually optimized slides. Specific embodiments of the system are described below.
[1022] User Input and Data Submission
[1023] The user logs in to a device such as a smartphone or PC and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[1024] Server data analysis and slide outline generation
[1025] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs.
[1026] Using the Emotion Engine
[1027] The server uses an emotion engine to analyze the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the content of the slide will be fine-tuned accordingly. The results of this emotion analysis are also fed back to the generative AI model, helping to improve the content in subsequent generation processes.
[1028] Auto-generate slides and convert to PDF
[1029] The server automatically generates specific slide content based on the outline generated by the generative AI model and emotion engine. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slides are complete, the server converts them into PDF format. PDF is a standard file format that can be easily viewed on many devices and is user-friendly.
[1030] Sending PDF files and collaborating with local governments
[1031] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[1032] Specific examples
[1033] 1. Entering and submitting information
[1034] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[1035] 2. Data analysis and outline generation
[1036] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[1037] 3. Use of Emotion Engine
[1038] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[1039] 4. Automatic slide generation and PDF conversion
[1040] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[1041] 5. PDF transmission and collaboration with local governments
[1042] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[1043] Prompt Sentence Examples
[1044] "I'm concerned about the local educational environment in order to convince my family. I need a specific slide deck for my spouse and two children that includes information about local schools, educational levels, and extracurricular activity options."
[1045] The present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also makes the content generated through emotion recognition more personalized and more persuasive.
[1046] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1047] System program processing flow
[1048] Step 1:
[1049] A user logs in to a terminal.
[1050] Specifically, a user enters an email address and password to log in to the app. The input data is the user's authentication information, and the output is the login status after successful authentication.
[1051] Step 2:
[1052] The user enters information about their concern, their family, and the person they want to persuade.
[1053] The user enters information such as "I'm worried about my educational environment," "I have a spouse and two children," and "My spouse" into a form within the app. The input is the user's interests and family information, and the output is a state where all the input information is complete.
[1054] Step 3:
[1055] The user presses the send button.
[1056] When the user presses the send button, the terminal sends the input data to the server. The input data is the information entered by the user, and the output is the completion of data transfer to the server.
[1057] Step 4:
[1058] The server receives the data and stores it in a database.
[1059] The server receives data sent from the terminal and stores it in a database. The input is the user data sent from the terminal, and the output is the data stored in the database.
[1060] Step 5:
[1061] The server inputs the data into a generative AI model.
[1062] The server inputs the data stored in the database into the generative AI model. Specifically, the concern "I'm worried about my educational environment" is passed to the generative AI model as a prompt. The input is the user data stored in the database, and the output is the prompt to the generative AI model.
[1063] Step 6:
[1064] A generative AI model generates slide outlines.
[1065] The generative AI model generates an optimal slide outline based on the prompt data. The outline includes information about local schools, educational levels, and types of extracurricular activities. The input is the prompt data, and the output is the generated outline.
[1066] Step 7:
[1067] The server invokes the emotion engine to analyze the user's emotional state.
[1068] The server invokes the emotion engine and analyzes the emotional state from the user's input data and reactions. The input is the user's text data, facial expressions, and voice data, and the output is the analyzed emotional state.
[1069] Step 8:
[1070] The server feeds the results of the emotion analysis back into the generative AI model to optimize the content.
[1071] The server receives feedback from the emotion engine and adjusts the slide outline content. The input is the emotion analysis result, and the output is a fine-tuned slide outline.
[1072] Step 9:
[1073] The server generates the specific slide content.
[1074] The server generates specific slide content based on the outline obtained from the generative AI model and emotion engine. For example, it creates slides such as "Local School Introduction," "Academic Achievements," and "Extracurricular Activity Options." The input is the adjusted outline, and the output is specific slide content.
[1075] Step 10:
[1076] The server converts the slides into PDF format.
[1077] The server converts the generated slides into PDF format, where the input is the slide content and the output is a PDF file.
[1078] Step 11:
[1079] The server sends the PDF file to the user's device.
[1080] The server sends the PDF file to the user's terminal. The input is the PDF file, and the output is the PDF file sent to the user's terminal.
[1081] Step 12:
[1082] The server connects with the local government's official account to provide support information to users.
[1083] The server connects with the local government's official account and provides support and event information to users through the LINE Mini App. The input is the connection information sent via the LINE API, and the output is the support message or event information sent to the user.
[1084] (Application example 2)
[1085] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1086] With conventional ad generation systems, it was difficult to quickly and effectively create ad slides that accurately reflected the emotions of target consumers. Furthermore, it required advertisers to manually adjust the ads and distribute them in PDF format, which required a great deal of time and effort, preventing the effectiveness of the ads from being maximized.
[1087] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information about a target consumer demographic and an advertising object; a means for a terminal to send the input information to the server; a means for the server to analyze the received information and generate an outline of an optimal advertising slide using a generative AI model; a means for the server to optimize the advertising slide based on the input information and the emotion analysis results and convert the automatically generated slide into PDF format; and a means for the server to send the completed PDF file to the advertiser's terminal and further distribute the advertisement to a distribution platform. This enables advertisers to quickly generate effective advertisements that appeal to the emotions of their target consumer demographic and distribute them in PDF format.
[1088] "Target demographic" refers to a specific group of consumers targeted by an advertisement.
[1089] "Advertising subject matter" refers to the goods or services that the advertiser aims to promote or sell through advertising.
[1090] "Device" refers to an electronic device, such as a computer, smartphone, or tablet, that a user or advertiser uses to enter or receive information.
[1091] "Server" refers to the central management system that analyzes the received information and generates the slide outline using a generative AI model.
[1092] "Generative AI model" refers to an artificial intelligence model that generates optimal slide outlines based on received information.
[1093] "Emotion analysis results" refers to the data obtained as a result of analyzing the emotional state of users or target consumer groups.
[1094] An "advertising slide" is a visual presentation created for advertising purposes, consisting of multiple pages containing text and images.
[1095] "PDF format" is an abbreviation for Portable Document Format and refers to a widely used electronic document format.
[1096] "Advertiser" refers to an individual or corporation that creates and distributes advertisements for the purpose of advertising and promoting its own products or services.
[1097] "Delivery Platform" refers to an online service or advertising network that delivers generated advertisements to consumers via the Internet.
[1098] "Emotion engine" refers to technology that identifies a user's emotional state from input information and optimizes advertising content.
[1099] The present invention relates to an advertising generation system, and in particular to a system that can automatically generate and distribute effective advertising slides based on user-entered information on target consumer demographics and advertising subjects. This system includes a server, a terminal, a generative AI model, an emotion engine, a PDF generation function, and linkage with a distribution platform.
[1100] 1. Program Generation
[1101] The user accesses the system using a device (smartphone or PC). The user enters information about the target consumer demographic and advertising subject matter and presses the send button. The device then sends this information to the server.
[1102] 2. Server Processing
[1103] The server analyzes the received information and stores it in a database. It then uses a generative AI model to generate the optimal ad slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide the most effective outline for a specific target consumer demographic.
[1104] 3. Utilizing the Emotion Engine
[1105] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the content of the ad slides based on that data. For example, if the user feels "anxious" about the target consumer demographic, the server will fine-tune the content of the ad slides based on that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will be used to improve the content in subsequent generation processes.
[1106] 4. Automatic generation of advertising slides and PDF conversion
[1107] Based on the outline generated by the generative AI model and emotion engine, the server automatically generates specific ad slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. Once the ad slide content is complete, the server converts the slides into PDF format. PDF is a standard file format that can be easily viewed on many devices, making it user-friendly.
[1108] 5. Sending and delivering advertising slides
[1109] The server sends the completed PDF file to the advertiser's device. The server then connects with a distribution platform (such as an Internet advertising network) to deliver the advertisement to the target consumer demographic. This process allows advertisers to quickly create effective advertisements and deliver them to consumers.
[1110] 6. Hardware and Software Used
[1111] This system uses cloud servers such as AWS, Google Cloud, and Azure. It uses GPT-4 as the generative AI model and Azure Cognitive Services' Sentiment Analysis API for sentiment analysis. It uses MySQL and PostgreSQL as the database and React Native for the front-end application. It also uses pdfkit and ReportLab for PDF generation.
[1112] Examples of concrete examples and prompts
[1113] As a concrete example, consider the case where an advertiser is promoting a new product, an energy-efficient refrigerator. The advertiser enters the following information into the app: "Target consumer demographic: 30-45 years old, family-owning, urban dwelling," "Product information: energy-efficient refrigerator," and "Concerns: electricity bills, environmental impact," and then presses the submit button. The server analyzes this data and generates an optimal slide outline using a generative AI model. The emotion engine detects "anxiety" and adds specific data on how to reduce electricity bills and content that provides reassurance to the slide.
[1114] Target consumer demographic: 30-45 years old, family-oriented, urban dwellers
[1115] Product Information: Energy-Saving Refrigerator
[1116] Concerns: Electricity costs, environmental impact
[1117] Emotion: Anxiety (rising electricity bill)
[1118] Produced slide:
[1119] 1. Data supporting energy conservation
[1120] 2. Reducing environmental impact
[1121] 3. User satisfaction
[1122] As described above, this system allows advertisers to quickly create effective advertisements and deliver them to target consumer groups.
[1123] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1124] Step 1:
[1125] Users access the system using a device (smartphone or PC) and enter information about the target consumer demographic and advertising object. Specifically, they enter the target age group, family structure, place of residence, and detailed information about the advertising object (e.g., energy-saving refrigerator). The entered data is temporarily stored on the device.
[1126] Step 2:
[1127] When the user completes the input and presses the submit button, the terminal sends the input information to the server. The input data is packaged in JSON format and sent to the server via a secure communication protocol (e.g., HTTPS). The server stores the received data in a database. The input here is the user's input data, and the output is the data sent to the server.
[1128] Step 3:
[1129] The server analyzes the information stored in the database and inputs it as prompts to the generative AI model. The analysis includes information on the target consumer demographic and advertising subject matter entered by the user. The generative AI model (e.g., GPT-4) generates an optimal advertising slide outline based on the input prompts. The input in this step is the user's input data, and the output is the generated slide outline.
[1130] Step 4:
[1131] The server uses an emotion engine to analyze the user's emotional state from input data (text, facial expressions, voice, etc.). The emotion engine (e.g., Azure Cognitive Services' Emotion Analysis API) recognizes the emotions (e.g., anxiety, excitement) the user has toward the target consumer demographic. The emotion analysis results are fed back to the generative AI model to help optimize the outline. The input in this step is the user's emotional data, and the output is the emotion analysis results.
[1132] Step 5:
[1133] Based on the slide outline generated and optimized by the generative AI model and emotion engine, the server automatically generates specific advertising slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. The generated slides are converted to PDF format using a Python script. The input here is the optimized slide outline, and the output is the slides in PDF format.
[1134] Step 6:
[1135] The server sends the completed PDF file to the advertiser's device. Specifically, it uses a messaging service such as Firebase Cloud Messaging (FCM) to send the PDF file to the advertiser's device as a push notification. The server then connects with a distribution platform (e.g., Google Ads, Facebook Ads) to distribute the generated advertisement to the target consumer demographic. The input in this step is the slides in PDF format, and the output is the transmission of the PDF to the advertiser's device and the distribution of the advertisement to the target consumer demographic.
[1136] As described above, this system is capable of quickly generating effective advertising slides based on information entered by the user and delivering them to target consumer groups.
[1137] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1138] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1139] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1140] [Fourth embodiment]
[1141] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1142] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1143] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1144] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1145] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1146] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1147] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1148] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1149] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1150] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1151] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1152] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1153] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1154] MODE FOR CARRYING OUT THE INVENTION
[1155] The present invention relates to a system for generating slides to help people considering relocating to Japan persuade their families. Specific embodiments of this system will be described below.
[1156] User Input and Data Submission
[1157] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[1158] Server data analysis and slide outline generation
[1159] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[1160] Automatic generation of slides on the server and PDF conversion
[1161] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[1162] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[1163] Sending PDF files and collaborating with local governments
[1164] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[1165] Specific examples
[1166] Enter and submit information
[1167] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[1168] Data analysis and outline generation
[1169] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[1170] Auto-generate slides and convert to PDF
[1171] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[1172] PDF transmission and collaboration with local governments
[1173] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[1174] In this way, the system of the present invention helps users to resolve concerns when planning to move to rural areas and plays a role in efficiently supporting persuading their families to move.
[1175] The processing flow will be explained below.
[1176] Step 1:
[1177] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[1178] Step 2:
[1179] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[1180] Step 3:
[1181] The terminal sends the input information to the server. Specifically, the terminal sends the user's input data to the server in the form of a POST request.
[1182] Step 4:
[1183] The server receives the user's input data. Specifically, the server receives the request at the API endpoint and saves it in the database.
[1184] Step 5:
[1185] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), and persuasion target (e.g., spouse) to each variable and analyzes them.
[1186] Step 6:
[1187] The server calls the generative AI model, inputs the user's data, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, and the person being persuaded into the generative AI model, and outputs the outline.
[1188] Step 7:
[1189] The server automatically generates the slide content. Specifically, the server generates titles, text, and visual elements such as images and graphs for each slide based on the generated outline.
[1190] Step 8:
[1191] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[1192] Step 9:
[1193] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[1194] Step 10:
[1195] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[1196] Step 11:
[1197] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[1198] Example 1
[1199] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1200] In modern society, an increasing number of people are considering moving to rural areas. However, when planning a move, it is difficult to effectively explain and persuade their families about concerns such as the medical environment, educational environment, and availability of jobs. In particular, it is necessary to provide appropriate information while taking into consideration the family structure and the person being persuaded. It is also important to provide support information from local governments in a timely manner.
[1201] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1202] In this invention, the server includes: a means for the user to input information about their concerns, family structure, and persuasion target; a means for the terminal to transmit the input information to the server; a means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; a means for the server to automatically generate slide content and convert it to PDF format; a means for the server to transmit the completed PDF file to the user's terminal; a means for the generative AI model to generate an automatic response script for the information input by the user; and a means for the server to make recommendations based on the slide content. This allows users to explain specific information about relocation to their families in an easy-to-understand manner, helping to alleviate their concerns about moving to rural areas. The server also links with official local government accounts to provide users with appropriate support information, effectively supporting their lives after relocation.
[1203] "User" refers to a person considering immigration who uses this system.
[1204] "Concerns" are matters that the user is anxious or worried about when moving to a rural area, and include, for example, the medical environment and the educational environment.
[1205] "Family structure" refers to specific family structure information such as the number of family members and their relationships.
[1206] The "person to be persuaded" refers to the person to whom the user wants to explain and convince about moving to the countryside.
[1207] "Terminal" refers to a device used by a user, such as a smartphone or PC, that allows information input and communication.
[1208] "Server" refers to a computer system that receives information sent from a terminal, analyzes it, and generates content.
[1209] A "generative AI model" refers to an artificial intelligence model that learns from past data and examples and generates optimal slide outlines based on the user's specific needs.
[1210] An "outline" refers to a general outline or framework that shows the structure of a slide.
[1211] "Slide content" refers to the specific slide content that is automatically generated based on the outline.
[1212] "PDF format" refers to a standard file format that can be easily viewed on many devices.
[1213] An "automatic response script" refers to an automatic response sentence generated by a generative AI model in response to user input information.
[1214] "Recommendation" refers to making suggestions or recommendations to users.
[1215] An "official local government account" is an official account provided by a local government that provides users with support information, event information, and the like.
[1216] The present invention relates to a system for generating slides to help those considering relocating to persuade their families. This system generates optimal slides based on information entered by the user and provides them in PDF format, making it easier to alleviate concerns about relocating and efficiently supporting persuasion of families. Specific embodiments of this system are described below.
[1217] User Input and Data Submission
[1218] Users log in to the system using a device such as a smartphone or PC and enter information about their concerns, family structure, and the person they are trying to persuade. Specific concerns include the medical environment, educational environment, and whether or not they have a job. Once they have completed entering the information, the user presses the send button, and the device sends this information to the server. This transmission is performed using an HTTP request.
[1219] Server data analysis and slide outline generation
[1220] The server receives the information sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs. For example, if concerns about the educational environment are input, the generative AI model will generate an outline of local school information, educational level, and types of extracurricular activities.
[1221] Automatic slide generation and PDF conversion on the server
[1222] Based on the outline generated by the generative AI model, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slide content is complete, the server converts the slides into PDF format using slide creation software such as PowerPoint or Keynote. PDF is a standard file format that can be easily viewed on many devices.
[1223] Sending PDF files and collaborating with local governments
[1224] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family members, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[1225] Specific examples
[1226] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[1227] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a trained generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[1228] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[1229] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[1230] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1231] Processing flow
[1232] Step 1:
[1233] A user logs in to an application using a device such as a smartphone or PC.
[1234] Input: User authentication information (ID, password)
[1235] How it works: The user enters their ID and password into the app's login screen and presses the authentication button.
[1236] Output: Authentication is successful and the user is taken to the dashboard screen.
[1237] Step 2:
[1238] The user enters information about their concern, their family, and the person they want to persuade.
[1239] Input: Concerns, family structure, data of the person being persuaded (e.g., concerns about educational environment, spouse and two children, spouse)
[1240] How it works: The user fills out a form in the app with their concerns (e.g., "I'm worried about my educational environment"), their family situation (e.g., "Spouse and two children"), and the person they're trying to persuade (e.g., "Spouse").
[1241] Output: The input data is stored in temporary memory on the device.
[1242] Step 3:
[1243] The terminal transmits the input information to the server.
[1244] Input: Data entered by the user
[1245] Action: The user presses the submit button. The device sends this input information to the server via an HTTP request.
[1246] Output: The server receives the input information.
[1247] Step 4:
[1248] The server stores the received information in a database.
[1249] Input: User information received from the device
[1250] How it works: The server records the data in a database.
[1251] Output: User information stored in the database
[1252] Step 5:
[1253] The server inputs the data into a generative AI model to generate an optimal slide outline.
[1254] Input: User information stored in the database
[1255] How it works: The server analyzes the stored data and inputs it as prompts to the generative AI model. For example, it passes information such as "The user is concerned about the educational environment," "They have a spouse and two children," and "The person they are trying to persuade is their spouse."
[1256] Output: The generative AI model returns an outline, including information about local schools, educational levels, and types of extracurricular activities.
[1257] Step 6:
[1258] The server automatically generates specific slide content based on the outline.
[1259] Input: Outline obtained from a generative AI model
[1260] How it works: The server uses a slide generator to create specific slides based on the outline, including details such as "local school introduction," "academic achievements," and "extracurricular activity options."
[1261] Output: Generated slide content
[1262] Step 7:
[1263] The server converts the slides into PDF format.
[1264] Input: Generated slide content
[1265] What it does: The server converts the slides to PDF format using a PDF conversion library (e.g. PDFKit, ReportLab).
[1266] Output: PDF file
[1267] Step 8:
[1268] The server sends the completed PDF file to the user's device.
[1269] Input: PDF file
[1270] How it works: The server sends a PDF file to the user's device, and the user is provided with a link to download the PDF through the app.
[1271] Output: A PDF file that users can download to their device.
[1272] Step 9:
[1273] The user downloads the PDF file and shows it to a family member.
[1274] Input: PDF file sent from the server
[1275] Action: The user downloads the PDF file on their device, views it, and shows it to their family members to explain it to them.
[1276] Output: Be able to give specific and effective explanations to families.
[1277] Step 10:
[1278] The server connects with the local government's official account to provide support information to users.
[1279] Input: Support information from the local government's official account
[1280] Operation: The server sends support messages and event information to users via the LINE mini-app.
[1281] Output: Relevant support information and event announcements provided to users
[1282] Through this series of steps, users can persuade their families with concrete information and effectively alleviate their concerns about moving to rural areas.
[1283] (Application example 1)
[1284] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1285] Currently, brick-and-mortar stores lack effective methods for efficiently proposing optimal products and services to customers. In particular, it is difficult to quickly provide slides that meet the needs and desires of individual customers, and in many cases, staff explanations tend to be vague. This can lead to a decline in customer satisfaction.
[1286] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1287] In this invention, the server includes a means for inputting customer information and generating optimal proposal slides, and a means for displaying the generated slides on a terminal, thereby enabling staff to quickly and accurately propose products and services that meet the customer's needs.
[1288] "Concerns" are the fears or questions users have about a particular situation or condition.
[1289] "Family structure" refers to information that indicates the number and relationships of members in a particular household.
[1290] The "target of persuasion" is the person to whom you give an explanation in order to get them to accept your proposal or opinion.
[1291] A "terminal" is an electronic device that allows a user to input information and perform operations.
[1292] A "server" is a computing device under the control of a third party that receives, analyzes, and transmits data.
[1293] A "generative AI model" is a model that has been trained using artificial intelligence to perform a specific task.
[1294] "Slides" are visual presentation materials used to make proposals or explanations.
[1295] An "outline" is a simplified outline of the main themes or content of a slide or document.
[1296] "PDF" stands for Portable Document Format, a standard file format for electronically storing and sharing documents and images.
[1297] "Customer Information" refers to information such as personal information and purchase preferences associated with a particular customer.
[1298] A "proposal slide" is a visual document created to present the best product or service to a specific customer.
[1299] "Displaying on a terminal" means visually presenting information or data on the screen of an electronic device.
[1300] "Municipality" means a local government or agency that governs a local community.
[1301] An "official account" is an official online account provided by a company or organization.
[1302] "Supporting Information" means supporting information to improve a particular service or process.
[1303] "Fine-tuning" is a technique for further improving the performance of an existing AI model by adding new data.
[1304] The present invention relates to a system for generating optimal proposal slides for customers and supporting service provision in physical stores. Specific embodiments of this system will be described below.
[1305] First, the user (store staff) accesses the application using a device such as a smartphone or smart glasses. The user enters basic customer information and needs (e.g., "smartphone camera performance") into the application. Once this information is entered, the device sends it to the server.
[1306] The server analyzes the received customer information and inputs it into a generative AI model, which is trained using machine learning frameworks such as TensorFlow and PyTorch and fine-tuned to adapt to specific tasks. The model learns from past data and examples and generates a slide outline that best suits the customer's needs.
[1307] Based on the generated outline, the server automatically generates specific slide content, including, for example, product feature comparisons, user reviews, pricing information, etc. The generated slides are converted into PDF format and sent to the user's device.
[1308] Through the above process, staff can quickly and accurately recommend products to customers, which improves customer satisfaction and streamlines store operations.
[1309] As a specific example, let's consider a case where a customer wants a smartphone with a high-performance camera. The user logs in to the smartphone application and enters the following information:
[1310] I want a smartphone with a high-performance camera
[1311] This information is sent to a server, where it is analyzed and an outline is created by a generative AI model. The server then generates a slide deck containing a list of smartphones with high camera performance, their features, user reviews, and price comparisons. The slide deck is then converted into a PDF and sent to the user's device. Staff can then view the PDF on their device and give a presentation to customers.
[1312] This series of steps will enable more effective service provision in physical stores and enable product proposals that meet customer expectations.
[1313] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1314] Step 1:
[1315] The user logs in to the device and enters customer information and needs. The input items include the customer's basic information and the characteristics of the desired product or service (e.g., "a smartphone with a high-performance camera"). After entering the information, the user presses the send button, which sends this information from the device to the server. The input data is sent to the server in JSON format or similar.
[1316] Step 2:
[1317] The server analyzes the customer information received from the terminal. The server first stores the received data in a database, then analyzes the data to extract the necessary information. Based on the analyzed data, the server inputs the prompt text into the generative AI model. The analysis results include specific elements related to the customer's needs (e.g., product features, price range, etc.).
[1318] Step 3:
[1319] The server uses a generative AI model to generate a slide outline that best suits the customer's needs. The generative AI model contains fine-tuned data based on past data and examples. Each item in the outline is suggested based on a prompt entered into the model (e.g., "I want a smartphone with a good camera"). The outline includes a list of suggested products, their features, reviews, etc.
[1320] Step 4:
[1321] The server automatically generates specific slide content based on the generated outline. The slide content is created in detail based on the customer information and the outline. For example, a slide about a smartphone with a high-performance camera would include product features, ratings, price comparisons, user reviews, and more.
[1322] Step 5:
[1323] The server converts the generated slides to PDF format. The generated slide content is saved as a PDF file, making it easy to view and share. PDF conversion is performed using Python's FPDF library, among others.
[1324] Step 6:
[1325] The server sends the completed PDF file to the user's device, where store staff can display the received PDF file and give a presentation to the customer. This enables specific and effective proposals to be made to customers.
[1326] In this way, a system is realized in which the server automatically generates slides based on information entered by the user, enabling specific and individualized suggestions.
[1327] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1328] MODE FOR CARRYING OUT THE INVENTION
[1329] The present invention combines a new system for creating slides for users to persuade their families with an emotion engine. Specific embodiments of this system will be described below.
[1330] User Input and Data Submission
[1331] The user logs in to a device (smartphone or PC) and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include, for example, the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[1332] Server data analysis and slide outline generation
[1333] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide outlines that meet each user's specific needs.
[1334] Using the Emotion Engine
[1335] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the server will fine-tune the slide content according to that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will help improve the content in future generation processes.
[1336] Auto-generate slides and convert to PDF
[1337] Based on the outlines generated by the generative AI model and emotion engine, the server automatically generates specific slide content. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will include information about local medical facilities, how to access them, and user reviews in the slides.
[1338] Once the slide content is complete, the server converts the slides into PDF format, a standard file format that can be easily viewed on many devices and is user-friendly.
[1339] Sending PDF files and collaborating with local governments
[1340] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[1341] Specific examples
[1342] Enter and submit information
[1343] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[1344] Data analysis and outline generation
[1345] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[1346] Using the Emotion Engine
[1347] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[1348] Auto-generate slides and convert to PDF
[1349] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[1350] PDF transmission and collaboration with local governments
[1351] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[1352] The system of the present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also improves persuasive power by making the content generated through emotion recognition more personalized.
[1353] The processing flow will be explained below.
[1354] Step 1:
[1355] The user logs in to a device (smartphone or PC). Specifically, the user enters their ID and password into an online form or the app's login screen to authenticate.
[1356] Step 2:
[1357] The user enters information about their concerns, family structure, and the person to be persuaded. Specifically, the user fills in the form with concerns such as "presence of medical facilities" and "educational environment," family structure such as "spouse and two children," and the person to be persuaded such as "spouse," and then presses the submit button.
[1358] Step 3:
[1359] The emotion engine analyzes the user's input data and reactions to recognize the user's emotional state. Specifically, the emotion engine detects emotions such as "anxiety," "relief," and "excitement" from the input text, facial expressions, and voice.
[1360] Step 4:
[1361] The device sends the input information and emotion recognition results to the server. Specifically, the device sends the user's input data and emotion recognition results to the server in POST request format.
[1362] Step 5:
[1363] The server receives the user's input data and emotion recognition results and stores them in a database. Specifically, the server receives a request at an API endpoint and integrates and stores both sets of data in the database.
[1364] Step 6:
[1365] The server analyzes the received data and extracts appropriate parameters. Specifically, the server assigns concerns (e.g., educational environment), family structure (e.g., spouse, two children), persuasion target (e.g., spouse), and emotional state to each variable and analyzes them.
[1366] Step 7:
[1367] The server calls the generative AI model, inputs the user's data and emotion recognition results, and generates an optimal slide outline. Specifically, the server inputs data on concerns, family structure, persuasion target, and emotional state into the generative AI model, and outputs the outline.
[1368] Step 8:
[1369] The server automatically generates slide content. Specifically, it generates titles, text, images, graphs, and other visual elements for each slide based on the generated outline. It also adjusts some of the content based on emotion recognition results.
[1370] Step 9:
[1371] The server converts the completed slides into PDF format. Specifically, the server exports the slide contents as a PDF file using a PDF generation library.
[1372] Step 10:
[1373] The server sends the completed PDF file to the user's device. Specifically, the server either attaches the PDF to the user's email address and sends it, or creates a PDF download link in the user's account.
[1374] Step 11:
[1375] The server will connect to the local government's official account and notify the user. Specifically, the server will use the LINE Bot API to send a message to the user instructing them how to obtain the UID.
[1376] Step 12:
[1377] The user obtains a UID and receives ongoing support from the local government. Specifically, the user enters the UID using the LINE Mini App and receives additional support information and event announcements from the local government.
[1378] Example 2
[1379] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1380] In modern society, many users planning to move to rural areas need to provide sufficient and specific information to persuade their families. However, if the information is insufficient or does not take into account the user's emotions, persuasion can be difficult. Furthermore, if the information is not provided effectively, it will not alleviate the family's anxiety or resistance. To address these issues, the present invention provides a system that generates optimal slides based on the user's input information and emotional state, providing specific information and emotional reassurance.
[1381] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1382] In this invention, the server includes: means for a user to input information about their concerns, family structure, and persuasion target; means for a terminal to transmit the input information to the server; means for the server to analyze the received information and generate an optimal slide outline using a generative AI model; means for the server to analyze the user's emotional state using an emotion engine and optimize the slide content based on the data; means for the server to automatically generate slide content and convert it into PDF format; and means for the server to transmit the completed PDF file to the user's terminal. This enables the user to provide specific and emotion-sensitive information to effectively persuade their family.
[1383] A "user" is a person who uses the system to input information about concerns, family structure, and the person being persuaded, and generates slides to persuade the family.
[1384] A "terminal" is a device that a user uses to input information and communicate with a server, and specifically includes a smartphone or PC.
[1385] A "server" is a central computer system that receives information sent from the terminals and performs major processes such as analysis and slide creation.
[1386] An "emotion engine" is software that analyzes the user's emotional state from their input data and reactions, and optimizes the content of their slides based on that data.
[1387] A "generative AI model" is an artificial intelligence model that learns from past data and examples and is used to generate optimal slide outlines based on the user's specific needs.
[1388] "Slides" are presentation-style materials that show specific information and solutions that users can use to persuade their families.
[1389] An "outline" refers to the outline or rough structure of a slide created based on data analyzed by a generative AI model.
[1390] "PDF" is a standard format for converting generated slide content into a widely viewable format.
[1391] An "official local government account" is an official means of communication that distributes support information and event information provided by local government agencies online.
[1392] MODE FOR CARRYING OUT THE INVENTION
[1393] The present invention is a system for generating slides for users to persuade their families, and combines an emotion engine and a generative AI model to provide more effective and individually optimized slides. Specific embodiments of the system are described below.
[1394] User Input and Data Submission
[1395] The user logs in to a device such as a smartphone or PC and enters information about their concerns, family structure, and the person they are trying to persuade. Concerns include the medical environment, educational environment, and whether or not the person has a job. Once the information is complete, the user presses the send button, and the device sends this information to the server.
[1396] Server data analysis and slide outline generation
[1397] The server receives the data sent from the device and stores it in a database. The server then analyzes the received data and inputs it into a generative AI model to generate an optimal slide outline. This generative AI model learns from past data and examples and is fine-tuned to provide outlines that meet each user's specific needs.
[1398] Using the Emotion Engine
[1399] The server uses an emotion engine to analyze the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the slide content based on that data. For example, if the user is in a specific emotional state such as "anxiety" or "excitement," the content of the slide will be fine-tuned accordingly. The results of this emotion analysis are also fed back to the generative AI model, helping to improve the content in subsequent generation processes.
[1400] Auto-generate slides and convert to PDF
[1401] The server automatically generates specific slide content based on the outline generated by the generative AI model and emotion engine. The slides include solutions to the user's concerns and specific information. For example, if a user inputs concerns about the medical environment, the server will incorporate information about local medical facilities, how to access them, and user reviews into the slides. Once the slides are complete, the server converts them into PDF format. PDF is a standard file format that can be easily viewed on many devices and is user-friendly.
[1402] Sending PDF files and collaborating with local governments
[1403] The server sends the completed PDF file to the user's device. The user can download this PDF and show it to their family, allowing them to provide specific and effective explanations. Furthermore, the server connects with the local government's official account to provide users with ongoing support information. For example, support messages and event information can be sent to users via the LINE mini-app.
[1404] Specific examples
[1405] 1. Entering and submitting information
[1406] User A logs in to the app on their smartphone. They enter "I'm worried about the educational environment" as their concern, "Spouse and two children" as their family composition, and "Spouse" as the person they want to persuade. After completing the entry, they press the send button, and the device sends this information to the server.
[1407] 2. Data analysis and outline generation
[1408] The server receives user A's input data and stores it in a database. The server analyzes this data and inputs it into a generative AI model. The generative AI model generates an outline of the educational environment, including specific items such as local school information, educational level, and types of extracurricular activities.
[1409] 3. Use of Emotion Engine
[1410] The emotion engine detects the emotion of anxiety from the text and reactions entered by User A. The server receives feedback from the emotion engine and adds content to the slides about the educational environment to create a sense of security. As a result, the information becomes more specific and persuasive.
[1411] 4. Automatic slide generation and PDF conversion
[1412] The server automatically generates specific slides related to the educational environment based on the generated outline. For example, slides containing items such as "Introduction to local schools," "Academic achievements," and "Extracurricular activity options" are created. The created slides are converted to PDF format and sent to User A's device.
[1413] 5. PDF transmission and collaboration with local governments
[1414] User A receives the PDF on their smartphone and shows it to their spouse to explain the situation. The server also connects with the local government's official account and provides User A with information about local support and events via LINE. Through this series of processes, User A can effectively persuade their spouse and alleviate their concerns about moving to a rural area.
[1415] Prompt Sentence Examples
[1416] "I'm concerned about the local educational environment in order to convince my family. I need a specific slide deck for my spouse and two children that includes information about local schools, educational levels, and extracurricular activity options."
[1417] The present invention not only helps users to resolve concerns when planning to move to rural areas and efficiently supports persuading family members, but also makes the content generated through emotion recognition more personalized and more persuasive.
[1418] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1419] System program processing flow
[1420] Step 1:
[1421] A user logs in to a terminal.
[1422] Specifically, a user enters an email address and password to log in to the app. The input data is the user's authentication information, and the output is the login status after successful authentication.
[1423] Step 2:
[1424] The user enters information about their concern, their family, and the person they want to persuade.
[1425] The user enters information such as "I'm worried about my educational environment," "I have a spouse and two children," and "My spouse" into a form within the app. The input is the user's interests and family information, and the output is a state where all the input information is complete.
[1426] Step 3:
[1427] The user presses the send button.
[1428] When the user presses the send button, the terminal sends the input data to the server. The input data is the information entered by the user, and the output is the completion of data transfer to the server.
[1429] Step 4:
[1430] The server receives the data and stores it in a database.
[1431] The server receives data sent from the terminal and stores it in a database. The input is the user data sent from the terminal, and the output is the data stored in the database.
[1432] Step 5:
[1433] The server inputs the data into a generative AI model.
[1434] The server inputs the data stored in the database into the generative AI model. Specifically, the concern "I'm worried about my educational environment" is passed to the generative AI model as a prompt. The input is the user data stored in the database, and the output is the prompt to the generative AI model.
[1435] Step 6:
[1436] A generative AI model generates slide outlines.
[1437] The generative AI model generates an optimal slide outline based on the prompt data. The outline includes information about local schools, educational levels, and types of extracurricular activities. The input is the prompt data, and the output is the generated outline.
[1438] Step 7:
[1439] The server invokes the emotion engine to analyze the user's emotional state.
[1440] The server invokes the emotion engine and analyzes the emotional state from the user's input data and reactions. The input is the user's text data, facial expressions, and voice data, and the output is the analyzed emotional state.
[1441] Step 8:
[1442] The server feeds the results of the emotion analysis back into the generative AI model to optimize the content.
[1443] The server receives feedback from the emotion engine and adjusts the slide outline content. The input is the emotion analysis result, and the output is a fine-tuned slide outline.
[1444] Step 9:
[1445] The server generates the specific slide content.
[1446] The server generates specific slide content based on the outline obtained from the generative AI model and emotion engine. For example, it creates slides such as "Local School Introduction," "Academic Achievements," and "Extracurricular Activity Options." The input is the adjusted outline, and the output is specific slide content.
[1447] Step 10:
[1448] The server converts the slides into PDF format.
[1449] The server converts the generated slides into PDF format, where the input is the slide content and the output is a PDF file.
[1450] Step 11:
[1451] The server sends the PDF file to the user's device.
[1452] The server sends the PDF file to the user's terminal. The input is the PDF file, and the output is the PDF file sent to the user's terminal.
[1453] Step 12:
[1454] The server connects with the local government's official account to provide support information to users.
[1455] The server connects with the local government's official account and provides support and event information to users through the LINE Mini App. The input is the connection information sent via the LINE API, and the output is the support message or event information sent to the user.
[1456] (Application example 2)
[1457] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1458] With conventional ad generation systems, it was difficult to quickly and effectively create ad slides that accurately reflected the emotions of target consumers. Furthermore, it required advertisers to manually adjust the ads and distribute them in PDF format, which required a great deal of time and effort, preventing the effectiveness of the ads from being maximized.
[1459] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input information about a target consumer demographic and an advertising object; a means for a terminal to send the input information to the server; a means for the server to analyze the received information and generate an outline of an optimal advertising slide using a generative AI model; a means for the server to optimize the advertising slide based on the input information and the emotion analysis results and convert the automatically generated slide into PDF format; and a means for the server to send the completed PDF file to the advertiser's terminal and further distribute the advertisement to a distribution platform. This enables advertisers to quickly generate effective advertisements that appeal to the emotions of their target consumer demographic and distribute them in PDF format.
[1460] "Target demographic" refers to a specific group of consumers targeted by an advertisement.
[1461] "Advertising subject matter" refers to the goods or services that the advertiser aims to promote or sell through advertising.
[1462] "Device" refers to an electronic device, such as a computer, smartphone, or tablet, that a user or advertiser uses to enter or receive information.
[1463] "Server" refers to the central management system that analyzes the received information and generates the slide outline using a generative AI model.
[1464] "Generative AI model" refers to an artificial intelligence model that generates optimal slide outlines based on received information.
[1465] "Emotion analysis results" refers to the data obtained as a result of analyzing the emotional state of users or target consumer groups.
[1466] An "advertising slide" is a visual presentation created for advertising purposes, consisting of multiple pages containing text and images.
[1467] "PDF format" is an abbreviation for Portable Document Format and refers to a widely used electronic document format.
[1468] "Advertiser" refers to an individual or corporation that creates and distributes advertisements for the purpose of advertising and promoting its own products or services.
[1469] "Delivery Platform" refers to an online service or advertising network that delivers generated advertisements to consumers via the Internet.
[1470] "Emotion engine" refers to technology that identifies a user's emotional state from input information and optimizes advertising content.
[1471] The present invention relates to an advertising generation system, and in particular to a system that can automatically generate and distribute effective advertising slides based on user-entered information on target consumer demographics and advertising subjects. This system includes a server, a terminal, a generative AI model, an emotion engine, a PDF generation function, and linkage with a distribution platform.
[1472] 1. Program Generation
[1473] The user accesses the system using a device (smartphone or PC). The user enters information about the target consumer demographic and advertising subject matter and presses the send button. The device then sends this information to the server.
[1474] 2. Server Processing
[1475] The server analyzes the received information and stores it in a database. It then uses a generative AI model to generate the optimal ad slide outline. This generative AI model is fine-tuned by learning from past data and examples, so it can provide the most effective outline for a specific target consumer demographic.
[1476] 3. Utilizing the Emotion Engine
[1477] Furthermore, an emotion engine analyzes the user's input data and reactions. This emotion engine recognizes the user's emotional state from the text data, facial expressions, and voice input, and optimizes the content of the ad slides based on that data. For example, if the user feels "anxious" about the target consumer demographic, the server will fine-tune the content of the ad slides based on that emotional state. The results of this emotion analysis are also fed back to the generative AI model, which will be used to improve the content in subsequent generation processes.
[1478] 4. Automatic generation of advertising slides and PDF conversion
[1479] Based on the outline generated by the generative AI model and emotion engine, the server automatically generates specific ad slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. Once the ad slide content is complete, the server converts the slides into PDF format. PDF is a standard file format that can be easily viewed on many devices, making it user-friendly.
[1480] 5. Sending and delivering advertising slides
[1481] The server sends the completed PDF file to the advertiser's device. The server then connects with a distribution platform (such as an Internet advertising network) to deliver the advertisement to the target consumer demographic. This process allows advertisers to quickly create effective advertisements and deliver them to consumers.
[1482] 6. Hardware and Software Used
[1483] This system uses cloud servers such as AWS, Google Cloud, and Azure. It uses GPT-4 as the generative AI model and Azure Cognitive Services' Sentiment Analysis API for sentiment analysis. It uses MySQL and PostgreSQL as the database and React Native for the front-end application. It also uses pdfkit and ReportLab for PDF generation.
[1484] Examples of concrete examples and prompts
[1485] As a concrete example, consider the case where an advertiser is promoting a new product, an energy-efficient refrigerator. The advertiser enters the following information into the app: "Target consumer demographic: 30-45 years old, family-owning, urban dwelling," "Product information: energy-efficient refrigerator," and "Concerns: electricity bills, environmental impact," and then presses the submit button. The server analyzes this data and generates an optimal slide outline using a generative AI model. The emotion engine detects "anxiety" and adds specific data on how to reduce electricity bills and content that provides reassurance to the slide.
[1486] Target consumer demographic: 30-45 years old, family-oriented, urban dwellers
[1487] Product Information: Energy-Saving Refrigerator
[1488] Concerns: Electricity costs, environmental impact
[1489] Emotion: Anxiety (rising electricity bill)
[1490] Produced slide:
[1491] 1. Data supporting energy conservation
[1492] 2. Reducing environmental impact
[1493] 3. User satisfaction
[1494] As described above, this system allows advertisers to quickly create effective advertisements and deliver them to target consumer groups.
[1495] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1496] Step 1:
[1497] Users access the system using a device (smartphone or PC) and enter information about the target consumer demographic and advertising object. Specifically, they enter the target age group, family structure, place of residence, and detailed information about the advertising object (e.g., energy-saving refrigerator). The entered data is temporarily stored on the device.
[1498] Step 2:
[1499] When the user completes the input and presses the submit button, the terminal sends the input information to the server. The input data is packaged in JSON format and sent to the server via a secure communication protocol (e.g., HTTPS). The server stores the received data in a database. The input here is the user's input data, and the output is the data sent to the server.
[1500] Step 3:
[1501] The server analyzes the information stored in the database and inputs it as prompts to the generative AI model. The analysis includes information on the target consumer demographic and advertising subject matter entered by the user. The generative AI model (e.g., GPT-4) generates an optimal advertising slide outline based on the input prompts. The input in this step is the user's input data, and the output is the generated slide outline.
[1502] Step 4:
[1503] The server uses an emotion engine to analyze the user's emotional state from input data (text, facial expressions, voice, etc.). The emotion engine (e.g., Azure Cognitive Services' Emotion Analysis API) recognizes the emotions (e.g., anxiety, excitement) the user has toward the target consumer demographic. The emotion analysis results are fed back to the generative AI model to help optimize the outline. The input in this step is the user's emotional data, and the output is the emotion analysis results.
[1504] Step 5:
[1505] Based on the slide outline generated and optimized by the generative AI model and emotion engine, the server automatically generates specific advertising slide content. The slides contain messages and images appropriate for the target consumer demographic entered by the user. The generated slides are converted to PDF format using a Python script. The input here is the optimized slide outline, and the output is the slides in PDF format.
[1506] Step 6:
[1507] The server sends the completed PDF file to the advertiser's device. Specifically, it uses a messaging service such as Firebase Cloud Messaging (FCM) to send the PDF file to the advertiser's device as a push notification. The server then connects with a distribution platform (e.g., Google Ads, Facebook Ads) to distribute the generated advertisement to the target consumer demographic. The input in this step is the slides in PDF format, and the output is the transmission of the PDF to the advertiser's device and the distribution of the advertisement to the target consumer demographic.
[1508] As described above, this system is capable of quickly generating effective advertising slides based on information entered by the user and delivering them to target consumer groups.
[1509] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1510] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1511] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1512] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1513] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1514] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1515] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1516] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1517] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1518] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1519] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1520] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1521] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1522] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1523] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1524] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1525] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1526] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1527] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1528] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1529] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1530] The following is further disclosed regarding the above embodiment.
[1531] (Claim 1)
[1532] a means for the user to input information about their concerns, family members, and the person they are trying to persuade;
[1533] A means for transmitting input information from the terminal to a server;
[1534] A means for analyzing the received information by the server and generating an optimal slide outline using a generative AI model;
[1535] A server automatically generates slide content and converts it into PDF format.
[1536] A means for the server to send the completed PDF file to the user's terminal;
[1537] A system including:
[1538] (Claim 2)
[1539] The system according to claim 1, further comprising means for the server to link with the official account of the local government and provide support information to the user.
[1540] (Claim 3)
[1541] The system of claim 1, wherein the generative AI model generates an outline based on fine-tuned data.
[1542] "Example 1"
[1543] (Claim 1)
[1544] a means for the user to input information about their concerns, family members, and the person they are trying to persuade;
[1545] A means for transmitting input information from the terminal to a server;
[1546] A means for analyzing the received information by the server and generating an optimal slide outline using a generative AI model;
[1547] A server automatically generates slide content and converts it into PDF format.
[1548] A means for the server to send the completed PDF file to the user's terminal;
[1549] A means for the generative AI model to generate an automatic response script in response to information input by a user;
[1550] a means for the server to make recommendations based on the content of the slides;
[1551] A system including:
[1552] (Claim 2)
[1553] The system according to claim 1, further comprising means for the server to link with an official account of a local government and provide support information to the user.
[1554] (Claim 3)
[1555] The system of claim 1, wherein the generative AI model generates an outline based on fine-tuned data.
[1556] "Application Example 1"
[1557] (Claim 1)
[1558] a means for the user to input information about their concerns, family members, and the person they are trying to persuade;
[1559] A means for transmitting input information from the terminal to a server;
[1560] A means for analyzing the received information by the server and generating an optimal slide outline using a generative AI model;
[1561] A server automatically generates slide content and converts it into PDF format.
[1562] A means for the server to send the completed PDF file to the user's terminal;
[1563] A means to input customer information and generate the optimal proposal slides;
[1564] a means for displaying the generated slides on a terminal;
[1565] A system including:
[1566] (Claim 2)
[1567] The system according to claim 1, further comprising means for the server to link with the official account of the local government and provide support information to the user.
[1568] (Claim 3)
[1569] The system of claim 1, wherein the generative AI model generates an outline based on fine-tuned data.
[1570] "Example 2: Combining Emotion Engines"
[1571] (Claim 1)
[1572] a means for the user to input information about their concerns, family members, and the person they are trying to persuade;
[1573] A means for transmitting input information from the terminal to a server;
[1574] A means for analyzing the received information by the server and generating an optimal slide outline using a generative AI model;
[1575] The server uses an emotion engine to analyze the user's emotional state and optimizes the content of the slides based on that data.
[1576] A server automatically generates slide content and converts it into PDF format.
[1577] A means for the server to send the completed PDF file to the user's terminal;
[1578] A system including:
[1579] (Claim 2)
[1580] The system according to claim 1, further comprising means for the server to link with an official account of a local government and provide support information to the user.
[1581] (Claim 3)
[1582] The system of claim 1, wherein the generative AI model generates an outline based on fine-tuned data.
[1583] "Application example 2 when combining emotion engines"
[1584] (Claim 1)
[1585] a means for a user to input target consumer demographic and advertising subject information;
[1586] A means for transmitting input information from the terminal to a server;
[1587] A means for analyzing the received information by the server and generating an optimal outline of the advertising slide using a generative AI model;
[1588] The server optimizes the advertising slides based on the input information and the results of sentiment analysis, and converts the automatically generated slides into PDF format.
[1589] The server sends the completed PDF file to the advertiser's terminal and then distributes the advertisement to the distribution platform.
[1590] A system including:
[1591] (Claim 2)
[1592] 10. The system of claim 1, wherein the server further comprises means for cooperating with the communication platform to provide support information to the user.
[1593] (Claim 3)
[1594] The system of claim 1, wherein the generative AI model generates an outline based on fine-tuned data and prompt sentences. [Explanation of symbols]
[1595] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. a means for the user to input information about their concerns, family members, and the person they are trying to persuade; A means for transmitting input information from the terminal to a server; A means for analyzing the received information by the server and generating an optimal slide outline using a generative AI model; A server automatically generates slide content and converts it into PDF format. A means for the server to send the completed PDF file to the user's terminal; A system including:
2. The system according to claim 1, further comprising means for the server to link with an official account of a local government and provide support information to the user.
3. The system of claim 1, wherein the generative AI model generates outlines based on fine-tuned data.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A