System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving a message input at the time of remittance of a user using a message function of an online remittance service; means for analyzing the message and extracting a keyword and emotion of the message; means for selecting an optimal layout and design on the basis of the keyword and emotion; means for automatically generating a writing on the basis of the layout and design; means for providing the generated writing to the user in a digital format; and means for printing and delivering the writing in a digital format on actual color paper.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In Japan, the culture of sending messages of thanksgiving is deeply rooted at graduations and other celebrations. However, there are limited ways to achieve this online, and even in today's world where online payments are widespread, there is currently no system that can integrate messages of thanksgiving with gifts. Furthermore, with conventional methods, the process of creating messages of thanksgiving is time-consuming, and it is difficult to collect messages from multiple people. The objective of this invention is to solve these problems and provide a system that can easily generate and provide messages of thanksgiving when transferring money online. [Means for solving the problem]

[0005] The present invention provides a means for receiving messages entered by users when sending money using the message function of an online money transfer service, and a means for analyzing the messages and extracting keywords and emotions. It also provides a means for selecting an optimal layout and design based on the results of these analyses, and a means for automatically generating a message book based on the selected layout and design. Furthermore, it provides a means for providing the generated message book to the user in digital form, and also includes a means for printing and delivering the digital message book on actual colored paper, making it possible to easily send a message book online. This significantly reduces the effort required for creating a message book as in the past, improving user convenience.

[0006] "Online remittance service" refers to any service that allows money to be transferred via the Internet.

[0007] "Message function" refers to a function that allows a user to input a text message and have it delivered to a destination.

[0008] "User" refers to an individual user of this system.

[0009] An "analysis module" refers to the part of the software that analyzes input information and extracts important keywords and emotions.

[0010] "Keywords" refer to words or phrases that are particularly important within the message you enter.

[0011] "Emotion" refers to information contained in a message that indicates positive, negative, or other emotions.

[0012] "Layout" refers to the arrangement of information and design elements.

[0013] "Design" refers to visual decoration and aesthetic elements.

[0014] A "message book" is a document, either on a piece of paper or digitally, that collects messages from multiple people.

[0015] "Generative AI model" refers to an artificial intelligence model used to generate optimal designs and layouts based on data.

[0016] "Digital format" refers to a format that is electronically displayable.

[0017] "Actual colored paper" refers to a physically existing colored paper.

[0018] "Printing" refers to the process of transferring digital data to a physical medium.

[0019] "Delivery" refers to the process of bringing a physical product to a specified address.

[0020] "Natural language processing technology" refers to technology for understanding, interpreting, and generating human language. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0022] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0023] First, the terms used in the following description will be explained.

[0024] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0025] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0026] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0027] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0029] [First embodiment]

[0030] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0031] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0034] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0037] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0041] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0042] This invention relates to a system that analyzes messages entered by users when sending money using the message function of an online remittance service and automatically generates a message book. This system significantly reduces the effort required to create a message book while maintaining the convenience of remittance, making it possible to easily convey congratulatory messages online.

[0043] System Configuration and Functions

[0044] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0045] 1. Receiving and parsing messages

[0046] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and passes it to an analysis module. The analysis module uses natural language processing technology to extract keywords and sentiment from the message. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[0047] 2. Layout and design selection

[0048] The server uses an AI model to select the optimal layout and design based on the analyzed keywords and emotion data. For example, a colorful design or a design including an illustration of balloons would be selected to match the keyword "birthday." If the emotion is positive, bright colors would be selected.

[0049] 3. Generate a message board

[0050] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the generated message board is saved in digital format.

[0051] 4. Digital offerings and print options

[0052] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[0053] Specific examples

[0054] Example 1: Generating a graduation message

[0055] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0056] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[0057] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0058] 4. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[0059] Example 2: Generating a birthday message

[0060] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0061] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[0062] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0063] 4. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[0064] The present invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude.

[0065] The processing flow will be explained below.

[0066] Step 1:

[0067] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[0068] Step 2:

[0069] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[0070] Step 3:

[0071] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[0072] Step 4:

[0073] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the good work," keywords such as "graduation," "congratulations," and "keep up the good work" are extracted and the message is determined to have a positive sentiment.

[0074] Step 5:

[0075] The server passes the extracted keywords and sentiment data to an AI model, which then selects the optimal layout and design, such as a design with bright colors and an illustration of a graduation cap, to match the theme of a "graduation gift."

[0076] Step 6:

[0077] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[0078] Step 7:

[0079] The server sends the generated digital image of the message board to the user's terminal, where it is displayed in a format that the user can view.

[0080] Step 8:

[0081] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[0082] Step 9:

[0083] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[0084] Step 10:

[0085] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[0086] Step 11:

[0087] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[0088] In this way, the system is designed to ensure a smooth process from the user's message input to the final delivery of the message book.

[0089] Example 1

[0090] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0091] When using online remittance services, users must manually create message boards to display their messages effectively and attractively. However, this is a time-consuming task, especially when combining multiple messages into a single message board. Furthermore, when creating a message board that incorporates messages from other users, it can be difficult to maintain a consistent layout and design. Therefore, a method to automatically solve this problem is needed.

[0092] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0093] In this invention, the server includes means for receiving a message entered by a user when remitting money using the message function of the online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, and means for printing the digital message collection on actual material and delivering it. This allows users to easily express their congratulations or feelings of gratitude in a message collection, and significantly improves work efficiency compared to manual processing.

[0094] "Online money transfer service" means an electronic service for sending and receiving money over the Internet.

[0095] The "message function" is a function that allows a user to input text information and send it to other users.

[0096] "User" means an individual or organization that uses the system or service.

[0097] A "server" is a computer system that processes and stores data on a computer network.

[0098] "Parsing" is the act of automatically processing the content of an input message to extract and understand its information.

[0099] "Keywords" are words or phrases that have special significance within a message.

[0100] "Emotion" refers to the emotional elements expressed in a message, such as joy, sadness, surprise, etc.

[0101] "Layout" refers to the position and structure for arranging each message and design element within the message board.

[0102] "Design" refers to planning the design and layout that will create the overall appearance of the message board.

[0103] A "message book" is a document or image that compiles multiple messages into a single design or layout.

[0104] "Digital format" means a format that can be stored and displayed electronically, such as PNG, PDF, JPEG, etc.

[0105] "Materials" are the physical items, such as the actual paper or card, that are printed on.

[0106] "Printing" is the act of transferring a digital message onto a physical material.

[0107] "Delivery" refers to the act of delivering the printed message book to the specified address.

[0108] This invention relates to a system that uses the message function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. This system significantly reduces the time and effort required to create a message collection while maintaining the convenience of remittance, allowing people to easily convey their congratulations online.

[0109] System Configuration and Functions

[0110] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0111] Specific hardware and software configurations

[0112] The server hardware used was a standard web server, running server software such as the Ubuntu OS and Apache Tomcat, and a Python environment.

[0113] The analysis module uses natural language processing techniques to extract keywords and sentiment from messages using Python libraries such as NLTK and SpaCy, and then uses generative AI models (TensorFlow and PyTorch) to select layout and design based on the extracted data.

[0114] They also use graphics generation libraries such as Adobe Creative Cloud API to select designs, and libraries such as Pillow and SVG to save the final message board in digital format.

[0115] Specific examples

[0116] Example 1: Generating a graduation message

[0117] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0118] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[0119] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0120] 4. A digital message board is provided to the user, who then selects the option to print it on physical material after reviewing it.

[0121] Example 2: Generating a birthday message

[0122] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0123] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[0124] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0125] 4. A digital message board is provided to the user, who then selects the option to print it on actual material after reviewing it.

[0126] This invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude. The generated message book is saved in digital format, making it easy to share and save on multiple devices. It also works with external printing and delivery services, making it easy to distribute physical message books.

[0127] Prompt Sentence Examples

[0128] "The user types, 'Congratulations on your graduation! I wish you success in your new stage,' and sends the money."

[0129] "Happy birthday! Wishing you a wonderful year."

[0130] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0131] Step 1:

[0132] The user enters a congratulatory message into the message input field of the online money transfer service and sends money. For example, the user might enter "Happy birthday! I hope you have a wonderful year." The device then sends this message data to the server.

[0133] Input: The message entered by the user

[0134] Output: Message data sent to the server

[0135] Step 2:

[0136] The server receives messages sent by users, temporarily stores them in a database, and then passes the message data to the analysis module.

[0137] Input: Message data sent by the user

[0138] Output: Message data passed to the analysis module

[0139] Step 3:

[0140] The analysis module analyzes the message using natural language processing techniques. Specifically, it uses a Python NLP library (e.g., NLTK or SpaCy) to extract keywords and sentiment from the message. The extracted keywords and sentiment are returned to the server.

[0141] Input: Message data

[0142] Data processing: Extract keywords and sentiment using natural language processing

[0143] Output: Keywords and sentiment data

[0144] Step 4:

[0145] The server uses the keywords and sentiment data received from the analysis module to select the optimal layout and design using a generative AI model. To do this, it uses a machine learning framework (e.g., TensorFlow or PyTorch). The selected layout and design information is then passed on to the next step.

[0146] Input: Keywords and sentiment data

[0147] Data Computation: Layout and design selection with generative AI models

[0148] Output: Layout and design information

[0149] Step 5:

[0150] The server automatically generates the message board by placing the user's message based on the selected layout and design, using a graphics generation library (e.g., Pillow or SVG), and saves the generated message board in a digital format (e.g., PNG or PDF).

[0151] Input: Layout and design information, user messages

[0152] Data processing: Automatic generation of messages

[0153] Output: Digital message board

[0154] Step 6:

[0155] The server provides the generated message board in digital format to the user's terminal, where the user can preview the message board using the terminal's web browser and download it as needed.

[0156] Input: Digital message board

[0157] Output: Providing a digital message to the user's device

[0158] Step 7:

[0159] Users can view the digital message book and select the print option, after which the server will connect to the API of an external printing and delivery service to print the message book and arrange for it to be delivered to the specified address.

[0160] Input: User's print option selection

[0161] Data calculation: printing and delivery arrangements

[0162] Output: Instructions for printing and delivery services

[0163] (Application example 1)

[0164] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0165] Conventional online message book creation systems require users to input messages individually and manually select a design based on them, which is time-consuming and laborious. Furthermore, there is no automated message book generation system that works with remittance services, making it difficult to integrate remittances and message book creation. Furthermore, there is no means to efficiently generate message book designs using generative AI models. This makes it difficult for users to easily and quickly convey their feelings of gratitude and congratulations.

[0166] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0167] In this invention, the server includes means for receiving a message entered by a user when sending money using the message function of the online money transfer service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for generating a design for a message book using a generative AI model with a specific prompt sentence, means for automatically generating a message book based on the layout and design, means for providing the generated message book to the user in digital form, means for printing and delivering the digital message book on actual colored paper, and means for linking with an external printing and delivery service for physically storing the generated message book. This automates the process of creating a message book, making it possible to efficiently convey gratitude and congratulations at the same time as sending money.

[0168] An "online remittance service" is a service that allows sending and receiving money via the Internet.

[0169] "Message function" means a function that allows users to input and send text messages when transferring money.

[0170] "User" refers to any individual or legal entity that uses the Online Money Transfer Service.

[0171] A "message" is text information that a user enters when sending money.

[0172] "Means for receiving" is a function that allows the server to receive the message entered when the user remits money.

[0173] "Means of analysis" refers to the function of analyzing the content of a message and extracting keywords and emotions from it.

[0174] "Keywords" are specific words or phrases contained in a message that summarize the content of the message.

[0175] "Emotion" refers to the user's feelings and emotions that can be read from the message.

[0176] "Layout" refers to the design of the message board and the arrangement of its components.

[0177] "Design" refers to the visual style or theme of the message board.

[0178] A "message book" refers to the integration of multiple messages into a single document or design.

[0179] "Means for automatic generation" refers to a function that automatically creates a message board based on the analysis results.

[0180] "Digital format" means a format stored as electronic data.

[0181] The "means of providing" is a function that allows users to view and use the generated message board.

[0182] "Means for printing and delivering" refers to the function of printing the digital message board onto a physical medium and delivering it to a designated location.

[0183] A "prompt" is an instruction entered into a generative AI model to generate a design.

[0184] A "generative AI model" is a trained algorithm that uses artificial intelligence to perform a specific task.

[0185] "External printing and delivery service for physical storage" is a service that works in cooperation with an external printing and delivery company to print the generated message book and ship it to a specified address.

[0186] This invention relates to a method and system for automatically generating a message board based on the message entered by a user when sending money using an online money transfer service. The system mainly consists of a server, a user terminal, and an external system that cooperates with external printing and delivery services as needed.

[0187] System configuration and program processing

[0188] Server configuration and operation:

[0189] 1. Message receiving method:

[0190] The server receives a message entered by the user when transferring money using the message function of the online money transfer service.

[0191] The server passes this message to the analysis module.

[0192] 2. Message analysis methods:

[0193] The server uses natural language processing techniques (e.g., spaCy) to extract keywords and sentiment from the message.

[0194] For example, if a user inputs "Happy birthday! Have a wonderful year," the server extracts keywords such as "birthday," "congratulations," and "wonderful year."

[0195] 3. Layout and design selection methods:

[0196] Based on the extracted keywords and sentiment data, the server uses a generative AI model (e.g., OpenAI GPT model) to select the optimal layout and design.

[0197] Use prompts to instruct the AI ​​model and generate designs.

[0198] Example: "Happy birthday! Wishing you a wonderful year ahead."

[0199] 4. Automatic message generation method:

[0200] The server automatically generates a message book by arranging the user's message based on the selected layout and design.

[0201] The generated message board is saved in digital format.

[0202] 5. Digital Delivery Methods:

[0203] The server provides the generated message board in digital form to the user's terminal, where the user can view it.

[0204] 6. Printing and Delivery Methods:

[0205] If desired, the user can select a print and delivery option to physically store the actual message book, in which case the server will coordinate with an external print and delivery service to arrange for the message book to be printed and delivered.

[0206] Hardware and software used

[0207] Natural Language Processing: spaCy (depending on version, uses 'ja_core_news_sm' model)

[0208] Generative AI model: OpenAI GPT model

[0209] Image generation: Python Imaging Library (PIL)

[0210] API requests: the requests library

[0211] Examples of specific examples and prompts

[0212] Example 1: Generating a birthday message

[0213] The user enters a message such as "Happy birthday! I hope you have a wonderful year" and sends money.

[0214] The server receives the message and extracts the keywords "birthday," "congratulations," and "wonderful year."

[0215] Use prompts to instruct the AI ​​model to choose the right layout and design for your birthday celebration.

[0216] The prompt phrase "Happy birthday! I hope you have a wonderful year" is input into the generative AI model, and related designs are generated as a message book.

[0217] In this way, the present invention allows users to easily create a special message book when sending money, and efficiently convey feelings of gratitude or congratulations.

[0218] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0219] Step 1:

[0220] The user uses the message function of the online money transfer service to enter a message.

[0221] Input: A message that the user enters when sending money (e.g., "Happy Birthday! Wishing you a wonderful year!").

[0222] Output: The input message is sent to the server.

[0223] Step 2:

[0224] The server receives a message from the user using the message receiving means.

[0225] Input: The message entered by the user.

[0226] Output: The message data that is passed to the message parsing module.

[0227] Step 3:

[0228] The server uses a message analysis means to analyze the received message and extract keywords and emotions.

[0229] Input: Received message data.

[0230] Data processing: Analyze messages using natural language processing techniques (e.g., spaCy).

[0231] Specifically, the system analyzes the structure of the sentence and extracts keywords (e.g., "Birthday," "Congratulations," "Have a wonderful year") and emotions.

[0232] Output: Extracted keywords and sentiment data.

[0233] Step 4:

[0234] The server uses a generative AI model to generate prompts to select the optimal layout and design based on the keywords and emotions.

[0235] Input: Extracted keywords and sentiment data.

[0236] Data calculation: Generate prompt sentences using keywords and sentiment data (e.g., "Happy birthday! Wishing you a wonderful year").

[0237] Specifically, keywords and emotional information are combined to create appropriate instructions.

[0238] Output: The generated prompt statement.

[0239] Step 5:

[0240] The server uses a generative AI model to generate designs based on prompts and select the optimal layout.

[0241] Input: The generated prompt statement.

[0242] Data computation: Input the prompt statement into an AI model (e.g., OpenAI GPT model) to generate a design.

[0243] Specifically, the AI ​​analyzes the prompt text and outputs relevant design elements.

[0244] Output: Selected layout and design data.

[0245] Step 6:

[0246] The server automatically generates a message book based on the layout and design, arranging the user's message.

[0247] Input: Layout and design data, user messages.

[0248] Data processing: Place messages in a layout template and generate a message board using an image generation library (e.g., PIL).

[0249] Specifically, you specify the position and font of the message and arrange it to match the design.

[0250] Output: The generated digital image of the message board.

[0251] Step 7:

[0252] The server provides the digital message board to the user's terminal.

[0253] Input: The generated digital message.

[0254] Output: The digital message data is sent to the user's device for review.

[0255] Step 8:

[0256] The user can check the generated message book and, if necessary, select the option to print it on actual colored paper and have it delivered.

[0257] Input: Digital message data.

[0258] Output: Request data for printing and delivery.

[0259] Step 9:

[0260] The server uses the printing and delivery means to link with an external printing and delivery service, prints the message book, and delivers it to the specified address.

[0261] Input: Printing and delivery request data, digital message data.

[0262] Data processing: Sends data to the API of an external printing and delivery service to arrange printing and delivery.

[0263] Specifically, the message board image file is sent to an external service, and information such as the delivery address is also included in the request.

[0264] Output: The message is delivered to the address specified by the user.

[0265] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0266] This invention relates to a system that uses the messaging function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide a more personalized message collection. This system allows users to easily send message collections online, significantly reducing the effort required to create a message collection.

[0267] System Configuration and Functions

[0268] This system consists of a server, user terminals, and external systems that link with the print delivery service as needed. The server manages message reception, analysis, emotion recognition, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0269] 1. Receiving and parsing messages

[0270] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and stores it in a database. The server's analysis module analyzes the stored message and extracts keywords and emotions. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[0271] 2. Emotion Recognition by Emotion Engine

[0272] The server uses an emotion engine to analyze the emotion of messages entered by users in real time. The emotion engine classifies messages based on multiple emotion categories, such as positive, negative, and neutral, and extracts emotion data. For example, "Happy Birthday" is recognized as a positive emotion.

[0273] 3. Layout and design selection

[0274] The server selects the optimal layout and design based on the extracted keywords and emotion data. Based on the emotion engine data, it automatically selects design elements (such as color tones and illustrations) that accurately reflect the emotion. For example, for a message containing the keyword "birthday," a colorful design that conveys positive emotions and a design that includes illustrations of balloons will be selected.

[0275] 4. Generate a message board

[0276] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[0277] 5. Digital offerings and print options

[0278] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[0279] Specific examples

[0280] Example 1: Generating a graduation message

[0281] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0282] 2. The server receives the message, and the analysis module extracts keywords such as "graduation," "congratulations," and "achievement."

[0283] 3. The emotion engine classifies the message as having a positive emotion.

[0284] 4. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0285] 5. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[0286] Example 2: Generating a birthday message

[0287] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0288] 2. The server receives the message and the analysis module extracts keywords such as "Birthday," "Happy Birthday," and "Happy New Year."

[0289] 3. The emotion engine classifies the message as having a positive emotion.

[0290] 4. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0291] 5. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[0292] This invention makes it easy to create online message boards, allowing users to easily convey their congratulations and gratitude. The introduction of an emotion engine allows for message boards that are more personalized in design and respond to emotions.

[0293] The processing flow will be explained below.

[0294] Step 1:

[0295] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[0296] Step 2:

[0297] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[0298] Step 3:

[0299] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[0300] Step 4:

[0301] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the great work," keywords such as "graduation," "congratulations," and "good luck" are extracted.

[0302] Step 5:

[0303] The server passes the extracted keywords and emotion data to the emotion engine, which analyzes the emotion of the message in real time. The emotion engine classifies the message into emotion categories such as positive, negative, and neutral, and generates appropriate emotion data. For example, the emotion is determined to be positive.

[0304] Step 6:

[0305] The server uses an AI model to select the optimal layout and design based on emotion data and keywords. For example, for a "birthday" message, it selects a colorful and vibrant design to evoke positive emotions.

[0306] Step 7:

[0307] The server arranges the user's message based on the selected layout and design, automatically generating a message board, which is then saved in digital format.

[0308] Step 8:

[0309] The server sends a digital image of the generated message board to the user's terminal, where the user can check the displayed message board.

[0310] Step 9:

[0311] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[0312] Step 10:

[0313] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[0314] Step 11:

[0315] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[0316] Step 12:

[0317] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[0318] In this way, the entire process from the user's message input to the final delivery of the message is designed to run smoothly. The introduction of the emotion engine allows for personalized design that reflects the emotional data of the message, providing users with a more refined service.

[0319] Example 2

[0320] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0321] Previous online trading services did not offer a way for users to easily create and send messages based on a specific theme. Creating messages manually also required a lot of time and effort, and it was difficult to select a design that accurately reflected the sentiments. This made it difficult for users to effectively convey their congratulations and gratitude.

[0322] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0323] In this invention, the server includes means for receiving messages entered by users at the time of transactions using the communication function of the online transaction service, means for analyzing the messages and extracting words and emotions from the messages, and means for selecting an optimal layout and design based on the words and emotions. This allows users to easily and automatically generate a message board based on a specific theme and provide it in a design that suits the emotions.

[0324] "Online trading service" refers to a service that allows users to conduct transactions via the Internet.

[0325] "Communication function" refers to the function that enables the system to send and receive data from users.

[0326] "Message" refers to the content of the message entered by the user during a transaction.

[0327] "Means for receiving" refers to the method and function by which the server receives messages sent by users.

[0328] "Means for analyzing" refers to the methods and functions by which the server extracts and analyzes the content of messages received.

[0329] "Words" refer to specific words extracted from the parsed message.

[0330] "Sentiment" refers to the emotional nuance or meaning of the analyzed message.

[0331] "Means for selecting optimal layout and design" refers to a method and function for selecting the most appropriate layout and visual design for the message board based on the extracted words and emotions.

[0332] "Means for automatic generation" refers to the method and function by which the system automatically creates a message board based on the selected layout and design.

[0333] "Digital format" refers to the format of information that is represented and handled as electronic data.

[0334] "Physical printing and delivery means" refers to the method and function of printing the digital message board onto physical paper and delivering it to a designated location.

[0335] This invention relates to a system that analyzes messages sent by users and automatically generates a collection of messages in an online transaction service. This system is mainly composed of a server, a user terminal, and an external system that cooperates with a print delivery service as needed.

[0336] The server receives messages entered by users when making transactions and stores them in a database. The server's analysis module then analyzes the stored messages and extracts important words and emotions. For example, from the message "Happy Birthday! Wishing you a wonderful year," the words "Birthday," "Congratulations," and "Wonderful Year" are extracted.

[0337] The server then uses an emotion engine to analyze the sentiment of the message in real time. The emotion engine categorizes the message into categories such as positive, negative, and neutral, and extracts emotional data. For example, "Happy Birthday" is recognized as a positive sentiment.

[0338] The server then selects the optimal layout and design based on the extracted words and emotion data. Based on the emotion engine's data, design elements (e.g., color tones and illustrations) that accurately reflect the emotion are automatically selected. For example, a message containing the word "birthday" might be matched with a colorful design and illustrations of balloons.

[0339] The server automatically generates a message book by arranging the user's message based on the selected layout and design. This message book is temporarily saved in digital format. The generated message book is provided in digital format to the user's device, where the user can view it. If necessary, the user can also select the option to print it on physical paper and have it mailed. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[0340] As a concrete example, consider the case where a user types and sends a message saying, "Congratulations on your graduation! Wishing you success in your new stage." The server receives this message, and the analysis module extracts words such as "graduation," "congratulations," and "success." The emotion engine classifies the message as having a positive emotion, and the server selects a layout and design appropriate for a "graduation celebration." A message book is generated and provided to the user in digital format. After reviewing this digital message book, the user can select the print option, and the physical message book will be printed and delivered.

[0341] Prompt Sentence Examples

[0342] When a user types and submits a graduation message, explain how the system parses it and generates a message of congratulations.

[0343] When a user types and submits a birthday message, explain how the system parses it and generates a message.

[0344] This invention allows users to easily create a message board online and send messages with designs that reflect their emotions. This system significantly simplifies the traditional, time-consuming process of creating a message board, making it possible to send messages of gratitude or congratulations more quickly and efficiently.

[0345] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0346] Step 1:

[0347] A user enters a message into the message input field of an online transaction service and presses the send button. The entered message is input data, and the server receives this message and stores it in a database. For example, a user enters and sends the message "Happy birthday! I hope you have a wonderful year." Based on this input, the server receives the message data and obtains the message stored in the database as its output.

[0348] Step 2:

[0349] The server's analysis module retrieves the saved message and performs analysis processing. The input data is the saved message, and the output is the words and emotions extracted from the message. Specifically, from the message "Happy birthday! I hope you have a wonderful year," the words "birthday," "congratulations," and "wonderful year" are extracted. This data processing results in a word list being output.

[0350] Step 3:

[0351] The server uses an emotion engine to perform emotion analysis of the message. The input data are the extracted words and the original message, and the output is emotion data of the message. The emotion engine classifies "Happy birthday! I hope you have a wonderful year" as a positive emotion and outputs positive emotion data.

[0352] Step 4:

[0353] The server selects the optimal layout and design based on the extracted words and emotion data. The input data is a word list and emotion data, and the output is the optimal layout and design information. For example, based on the word "birthday" and positive emotion, a colorful layout and design including an illustration of balloons is selected.

[0354] Step 5:

[0355] The server automatically generates a message book by arranging the user's message based on the selected layout and design. The input data is the layout and design information and the message, and the generated digital message book is obtained as output. The server arranges the message and generates the message book using a colorful layout and balloon illustration.

[0356] Step 6:

[0357] The server provides the generated message board in digital form to the user's terminal. The input data is the generated digital message board, and the message board displayed on the user's terminal is obtained as output. The user can check this digital message board.

[0358] Step 7:

[0359] If necessary, the user selects the option to print and mail the message book. The input data is the user's print request and delivery information, and the output is a physical message book that is printed and delivered. The server works with an external printing and delivery service to deliver the message book to the specified address.

[0360] In this way, users can easily and automatically generate a message board based on a specific theme online and provide it in a design that reflects their emotions.

[0361] (Application example 2)

[0362] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0363] Analyzing messages sent through online remittance services and creating personalized message cards is a time-consuming and tedious process using conventional methods. Furthermore, there are limited ways to easily create and print message cards in brick-and-mortar stores, making it less convenient for users. Furthermore, it is difficult to select a design and layout that accurately reflects the sentiment of the message, making it difficult to provide message cards that meet individual needs.

[0364] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving a message entered by a user when transferring money using the message function of an online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, means for inputting a message using a smart device at a physical store and generating the message collection, and means for checking the generated message collection using a head-mounted display and printing it on an actual medium. This makes it possible to easily generate personalized message collections at online remittance services and physical stores and to check and print them immediately.

[0365] "Online Money Transfer Service" means an electronic service for transferring funds over the Internet.

[0366] The "message function" is a function that allows users to input a message by text or voice when transferring money online and send that message.

[0367] "Message entered by user when transferring funds" refers to words or sentences entered by a user using the message function of the online remittance service when transferring funds.

[0368] The "means for receiving a message" refers to a method or device by which the server receives and stores a message entered by a user.

[0369] The "means for analyzing a message and extracting keywords and emotions from the message" is a method or device for analyzing an input message using natural language processing techniques and isolating important keywords and emotions.

[0370] The "means for selecting the optimum layout and design" is a method or device for selecting the layout and design suitable for a message board based on the extracted keywords and emotions.

[0371] The "means for automatically generating a message board" is a method or device for automatically creating a message board by arranging a user's message based on a selected layout and design.

[0372] The "means for providing the generated message board to the user in a digital format" refers to a method or device for providing the generated message board to the user in an electronic data format.

[0373] A "brick and mortar store" is a physical store that sells goods and services.

[0374] "Smart device" is a general term for electronic devices that have internet connectivity and advanced computing capabilities.

[0375] A "head-mounted display" is a display device that is worn on the user's head and is a device that projects information into the user's field of vision.

[0376] "Means for checking the generated message board and printing it on an actual medium" refers to a method or device that allows a user to visually check the created digital message board and then print it on an actual medium such as paper.

[0377] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate the natural language that humans use on a daily basis.

[0378] An "emotion engine" is software or algorithms that recognize and classify emotions from input text or speech.

[0379] The present invention relates to a system for generating personalized messages by inputting messages from users in online remittance services and brick-and-mortar stores, analyzing the messages, and recognizing emotions.

[0380] System configuration

[0381] The system mainly consists of the following components:

[0382] 1. Server

[0383] 2. User Device

[0384] 3. Head-Mounted Display (HMD)

[0385] 4. Smart Devices

[0386] 5. Printing machine

[0387] What the program does

[0388] Message input and analysis

[0389] When a user uses an online money transfer service, they input a message. The message is received and stored by the server. In this process, the server converts the voice message into text using the Google Cloud Speech-to-Text API and analyzes the message using an NLP library (e.g., spaCy).

[0390] emotion recognition

[0391] The server uses a custom model with TensorFlow to analyze text messages and classify them into emotion categories such as positive, negative, and neutral, and also uses the Emotion Recognition API as an emotion engine.

[0392] Layout and design selection

[0393] Based on the keywords and emotion data, an optimal layout and design is selected, using a generative AI model to generate a design that best suits the user's emotion.

[0394] Automatic generation of message cards

[0395] Based on the selected layout and design, the server automatically generates the message board. During this process, each element is arranged digitally. The generated message board is temporarily stored as digital data on the server.

[0396] Provide and confirm with users

[0397] The generated message board is provided to the user in digital form, and the user can visually check the generated message board using a head-mounted display (e.g., Microsoft HoloLens).

[0398] Printing and Shipping

[0399] After the user confirms, the message can be printed on a physical medium. The server works with a printer to print the message and provide it to the user. Delivery services are also available if necessary.

[0400] Specific examples

[0401] Generate a graduation message

[0402] The user types and sends the message, "Congratulations on your graduation! I wish you success in your new stage." The server receives and analyzes the message. Based on the keywords and emotions extracted from the message, the server selects the optimal layout and design and generates a message board. This message board is visually presented to the user via the HMD, and after confirmation, it is printed on actual media by a printer.

[0403] Generate birthday greetings

[0404] The user types "Happy Birthday! Have a wonderful year!" and sends it. The server receives the message and analyzes it in the same way. Because the emotion engine recognizes it as a positive emotion, the server selects a colorful design and generates a message card. This message card is also presented visually on the HMD, and the user can print it out after checking it.

[0405] As described above, the system of the present invention makes it possible to easily create personalized message cards online and in physical stores, and to instantly check and print them.

[0406] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0407] Step 1:

[0408] A user wears a head-mounted display (HMD) and inputs a message to generate a message board.

[0409] Specifically, the user inputs a text or voice message on the interface of the online remittance service, which is then sent to the server via the HMD.

[0410] Input: User's message (text or voice)

[0411] Output: Message data sent to the server

[0412] Step 2:

[0413] The server receives the message, transcribes it, and parses it.

[0414] Specifically, the server converts the voice message into text using the Google Cloud Speech-to-Text API, and then uses an NLP library (e.g., spaCy) to extract keywords and sentiment from the message. This process identifies the keywords and sentiment of the message.

[0415] Input: Message data sent to the server

[0416] Output: Translated message, extracted keywords and sentiment data

[0417] Step 3:

[0418] The server selects the optimal layout and design based on the extracted keywords and emotion data.

[0419] Specifically, a generative AI model is used to automatically generate a design and layout for a message card that best suits the emotional data. A prompt sentence is input into the generative AI model to obtain appropriate design elements.

[0420] Input: Translated message, extracted keywords and sentiment data

[0421] Output: Selected layout and design data

[0422] Step 4:

[0423] The server automatically generates a message card based on the selected layout and design.

[0424] Specifically, a message card template is created based on the design elements obtained in the preprocessing, and the message is then appropriately arranged to generate the final digital message card. This generated message card is temporarily saved as digital data.

[0425] Input: Selected layout and design data

[0426] Output: Automatically generated digital data of messages

[0427] Step 5:

[0428] The server provides the generated digital data of the message board to the user, who visually checks it through a head-mounted display.

[0429] Specifically, the digital data of the generated message board is sent to the HMD, where the user can visually check it, confirming the content and design of the message board and making any necessary corrections.

[0430] Input: Automatically generated digital data of messages

[0431] Output: A digital message displayed in the user's field of view

[0432] Step 6:

[0433] The user makes a final confirmation, and the server prints and delivers the message book on the actual medium.

[0434] Specifically, the user performs a final check through the HMD, and after confirming that there are no corrections required, the server sends the data to the printer to print the message book. The printed message book is provided to the user and can be delivered as needed.

[0435] Input: Verified digital message data

[0436] Output: The actual printed message

[0437] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0438] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0439] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0440] [Second embodiment]

[0441] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0442] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0443] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0444] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0445] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0446] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0447] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0448] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0449] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0450] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0451] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0452] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0453] This invention relates to a system that analyzes messages entered by users when sending money using the message function of an online remittance service and automatically generates a message book. This system significantly reduces the effort required to create a message book while maintaining the convenience of remittance, making it possible to easily convey congratulatory messages online.

[0454] System Configuration and Functions

[0455] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0456] 1. Receiving and parsing messages

[0457] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and passes it to an analysis module. The analysis module uses natural language processing technology to extract keywords and sentiment from the message. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[0458] 2. Layout and design selection

[0459] The server uses an AI model to select the optimal layout and design based on the analyzed keywords and emotion data. For example, a colorful design or a design including an illustration of balloons would be selected to match the keyword "birthday." If the emotion is positive, bright colors would be selected.

[0460] 3. Generate a message board

[0461] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the generated message board is saved in digital format.

[0462] 4. Digital offerings and print options

[0463] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[0464] Specific examples

[0465] Example 1: Generating a graduation message

[0466] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0467] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[0468] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0469] 4. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[0470] Example 2: Generating a birthday message

[0471] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0472] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[0473] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0474] 4. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[0475] The present invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude.

[0476] The processing flow will be explained below.

[0477] Step 1:

[0478] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[0479] Step 2:

[0480] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[0481] Step 3:

[0482] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[0483] Step 4:

[0484] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the good work," keywords such as "graduation," "congratulations," and "keep up the good work" are extracted and the message is determined to have a positive sentiment.

[0485] Step 5:

[0486] The server passes the extracted keywords and sentiment data to an AI model, which then selects the optimal layout and design, such as a design with bright colors and an illustration of a graduation cap, to match the theme of a "graduation gift."

[0487] Step 6:

[0488] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[0489] Step 7:

[0490] The server sends the generated digital image of the message board to the user's terminal, where it is displayed in a format that the user can view.

[0491] Step 8:

[0492] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[0493] Step 9:

[0494] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[0495] Step 10:

[0496] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[0497] Step 11:

[0498] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[0499] In this way, the system is designed to ensure a smooth process from the user's message input to the final delivery of the message book.

[0500] Example 1

[0501] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0502] When using online remittance services, users must manually create message boards to display their messages effectively and attractively. However, this is a time-consuming task, especially when combining multiple messages into a single message board. Furthermore, when creating a message board that incorporates messages from other users, it can be difficult to maintain a consistent layout and design. Therefore, a method to automatically solve this problem is needed.

[0503] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0504] In this invention, the server includes means for receiving a message entered by a user when remitting money using the message function of the online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, and means for printing the digital message collection on actual material and delivering it. This allows users to easily express their congratulations or feelings of gratitude in a message collection, and significantly improves work efficiency compared to manual processing.

[0505] "Online money transfer service" means an electronic service for sending and receiving money over the Internet.

[0506] The "message function" is a function that allows a user to input text information and send it to other users.

[0507] "User" means an individual or organization that uses the system or service.

[0508] A "server" is a computer system that processes and stores data on a computer network.

[0509] "Parsing" is the act of automatically processing the content of an input message to extract and understand its information.

[0510] "Keywords" are words or phrases that have special significance within a message.

[0511] "Emotion" refers to the emotional elements expressed in a message, such as joy, sadness, surprise, etc.

[0512] "Layout" refers to the position and structure for arranging each message and design element within the message board.

[0513] "Design" refers to planning the design and layout that will create the overall appearance of the message board.

[0514] A "message book" is a document or image that compiles multiple messages into a single design or layout.

[0515] "Digital format" means a format that can be stored and displayed electronically, such as PNG, PDF, JPEG, etc.

[0516] "Materials" are the physical items, such as the actual paper or card, that are printed on.

[0517] "Printing" is the act of transferring a digital message onto a physical material.

[0518] "Delivery" refers to the act of delivering the printed message book to the specified address.

[0519] This invention relates to a system that uses the message function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. This system significantly reduces the time and effort required to create a message collection while maintaining the convenience of remittance, allowing people to easily convey their congratulations online.

[0520] System Configuration and Functions

[0521] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0522] Specific hardware and software configurations

[0523] The server hardware used was a standard web server, running server software such as the Ubuntu OS and Apache Tomcat, and a Python environment.

[0524] The analysis module uses natural language processing techniques to extract keywords and sentiment from messages using Python libraries such as NLTK and SpaCy, and then uses generative AI models (TensorFlow and PyTorch) to select layout and design based on the extracted data.

[0525] They also use graphics generation libraries such as Adobe Creative Cloud API to select designs, and libraries such as Pillow and SVG to save the final message board in digital format.

[0526] Specific examples

[0527] Example 1: Generating a graduation message

[0528] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0529] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[0530] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0531] 4. A digital message board is provided to the user, who then selects the option to print it on physical material after reviewing it.

[0532] Example 2: Generating a birthday message

[0533] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0534] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[0535] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0536] 4. A digital message board is provided to the user, who then selects the option to print it on actual material after reviewing it.

[0537] This invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude. The generated message book is saved in digital format, making it easy to share and save on multiple devices. It also works with external printing and delivery services, making it easy to distribute physical message books.

[0538] Prompt Sentence Examples

[0539] "The user types, 'Congratulations on your graduation! I wish you success in your new stage,' and sends the money."

[0540] "Happy birthday! Wishing you a wonderful year."

[0541] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0542] Step 1:

[0543] The user enters a congratulatory message into the message input field of the online money transfer service and sends money. For example, the user might enter "Happy birthday! I hope you have a wonderful year." The device then sends this message data to the server.

[0544] Input: The message entered by the user

[0545] Output: Message data sent to the server

[0546] Step 2:

[0547] The server receives messages sent by users, temporarily stores them in a database, and then passes the message data to the analysis module.

[0548] Input: Message data sent by the user

[0549] Output: Message data passed to the analysis module

[0550] Step 3:

[0551] The analysis module analyzes the message using natural language processing techniques. Specifically, it uses a Python NLP library (e.g., NLTK or SpaCy) to extract keywords and sentiment from the message. The extracted keywords and sentiment are returned to the server.

[0552] Input: Message data

[0553] Data processing: Extract keywords and sentiment using natural language processing

[0554] Output: Keywords and sentiment data

[0555] Step 4:

[0556] The server uses the keywords and sentiment data received from the analysis module to select the optimal layout and design using a generative AI model. To do this, it uses a machine learning framework (e.g., TensorFlow or PyTorch). The selected layout and design information is then passed on to the next step.

[0557] Input: Keywords and sentiment data

[0558] Data Computation: Layout and design selection with generative AI models

[0559] Output: Layout and design information

[0560] Step 5:

[0561] The server automatically generates the message board by placing the user's message based on the selected layout and design, using a graphics generation library (e.g., Pillow or SVG), and saves the generated message board in a digital format (e.g., PNG or PDF).

[0562] Input: Layout and design information, user messages

[0563] Data processing: Automatic generation of messages

[0564] Output: Digital message board

[0565] Step 6:

[0566] The server provides the generated message board in digital format to the user's terminal, where the user can preview the message board using the terminal's web browser and download it as needed.

[0567] Input: Digital message board

[0568] Output: Providing a digital message to the user's device

[0569] Step 7:

[0570] Users can view the digital message book and select the print option, after which the server will connect to the API of an external printing and delivery service to print the message book and arrange for it to be delivered to the specified address.

[0571] Input: User's print option selection

[0572] Data calculation: printing and delivery arrangements

[0573] Output: Instructions for printing and delivery services

[0574] (Application example 1)

[0575] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0576] Conventional online message book creation systems require users to input messages individually and manually select a design based on them, which is time-consuming and laborious. Furthermore, there is no automated message book generation system that works with remittance services, making it difficult to integrate remittances and message book creation. Furthermore, there is no means to efficiently generate message book designs using generative AI models. This makes it difficult for users to easily and quickly convey their feelings of gratitude and congratulations.

[0577] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0578] In this invention, the server includes means for receiving a message entered by a user when sending money using the message function of the online money transfer service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for generating a design for a message book using a generative AI model with a specific prompt sentence, means for automatically generating a message book based on the layout and design, means for providing the generated message book to the user in digital form, means for printing and delivering the digital message book on actual colored paper, and means for linking with an external printing and delivery service for physically storing the generated message book. This automates the process of creating a message book, making it possible to efficiently convey gratitude and congratulations at the same time as sending money.

[0579] An "online remittance service" is a service that allows sending and receiving money via the Internet.

[0580] "Message function" means a function that allows users to input and send text messages when transferring money.

[0581] "User" refers to any individual or legal entity that uses the Online Money Transfer Service.

[0582] A "message" is text information that a user enters when sending money.

[0583] "Means for receiving" is a function that allows the server to receive the message entered when the user remits money.

[0584] "Means of analysis" refers to the function of analyzing the content of a message and extracting keywords and emotions from it.

[0585] "Keywords" are specific words or phrases contained in a message that summarize the content of the message.

[0586] "Emotion" refers to the user's feelings and emotions that can be read from the message.

[0587] "Layout" refers to the design of the message board and the arrangement of its components.

[0588] "Design" refers to the visual style or theme of the message board.

[0589] A "message book" refers to the integration of multiple messages into a single document or design.

[0590] "Means for automatic generation" refers to a function that automatically creates a message board based on the analysis results.

[0591] "Digital format" means a format stored as electronic data.

[0592] The "means of providing" is a function that allows users to view and use the generated message board.

[0593] "Means for printing and delivering" refers to the function of printing the digital message board onto a physical medium and delivering it to a designated location.

[0594] A "prompt" is an instruction entered into a generative AI model to generate a design.

[0595] A "generative AI model" is a trained algorithm that uses artificial intelligence to perform a specific task.

[0596] "External printing and delivery service for physical storage" is a service that works in cooperation with an external printing and delivery company to print the generated message book and ship it to a specified address.

[0597] This invention relates to a method and system for automatically generating a message board based on the message entered by a user when sending money using an online money transfer service. The system mainly consists of a server, a user terminal, and an external system that cooperates with external printing and delivery services as needed.

[0598] System configuration and program processing

[0599] Server configuration and operation:

[0600] 1. Message receiving method:

[0601] The server receives a message entered by the user when transferring money using the message function of the online money transfer service.

[0602] The server passes this message to the analysis module.

[0603] 2. Message analysis methods:

[0604] The server uses natural language processing techniques (e.g., spaCy) to extract keywords and sentiment from the message.

[0605] For example, if a user inputs "Happy birthday! Have a wonderful year," the server extracts keywords such as "birthday," "congratulations," and "wonderful year."

[0606] 3. Layout and design selection methods:

[0607] Based on the extracted keywords and sentiment data, the server uses a generative AI model (e.g., OpenAI GPT model) to select the optimal layout and design.

[0608] Use prompts to instruct the AI ​​model and generate designs.

[0609] Example: "Happy birthday! Wishing you a wonderful year ahead."

[0610] 4. Automatic message generation method:

[0611] The server automatically generates a message book by arranging the user's message based on the selected layout and design.

[0612] The generated message board is saved in digital format.

[0613] 5. Digital Delivery Methods:

[0614] The server provides the generated message board in digital form to the user's terminal, where the user can view it.

[0615] 6. Printing and Delivery Methods:

[0616] If desired, the user can select a print and delivery option to physically store the actual message book, in which case the server will coordinate with an external print and delivery service to arrange for the message book to be printed and delivered.

[0617] Hardware and software used

[0618] Natural Language Processing: spaCy (depending on version, uses 'ja_core_news_sm' model)

[0619] Generative AI model: OpenAI GPT model

[0620] Image generation: Python Imaging Library (PIL)

[0621] API requests: the requests library

[0622] Examples of specific examples and prompts

[0623] Example 1: Generating a birthday message

[0624] The user enters a message such as "Happy birthday! I hope you have a wonderful year" and sends money.

[0625] The server receives the message and extracts the keywords "birthday," "congratulations," and "wonderful year."

[0626] Use prompts to instruct the AI ​​model to choose the right layout and design for your birthday celebration.

[0627] The prompt phrase "Happy birthday! I hope you have a wonderful year" is input into the generative AI model, and related designs are generated as a message book.

[0628] In this way, the present invention allows users to easily create a special message book when sending money, and efficiently convey feelings of gratitude or congratulations.

[0629] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0630] Step 1:

[0631] The user uses the message function of the online money transfer service to enter a message.

[0632] Input: A message that the user enters when sending money (e.g., "Happy Birthday! Wishing you a wonderful year!").

[0633] Output: The input message is sent to the server.

[0634] Step 2:

[0635] The server receives a message from the user using the message receiving means.

[0636] Input: The message entered by the user.

[0637] Output: The message data that is passed to the message parsing module.

[0638] Step 3:

[0639] The server uses a message analysis means to analyze the received message and extract keywords and emotions.

[0640] Input: Received message data.

[0641] Data processing: Analyze messages using natural language processing techniques (e.g., spaCy).

[0642] Specifically, the system analyzes the structure of the sentence and extracts keywords (e.g., "Birthday," "Congratulations," "Have a wonderful year") and emotions.

[0643] Output: Extracted keywords and sentiment data.

[0644] Step 4:

[0645] The server uses a generative AI model to generate prompts to select the optimal layout and design based on the keywords and emotions.

[0646] Input: Extracted keywords and sentiment data.

[0647] Data calculation: Generate prompt sentences using keywords and sentiment data (e.g., "Happy birthday! Wishing you a wonderful year").

[0648] Specifically, keywords and emotional information are combined to create appropriate instructions.

[0649] Output: The generated prompt statement.

[0650] Step 5:

[0651] The server uses a generative AI model to generate designs based on prompts and select the optimal layout.

[0652] Input: The generated prompt statement.

[0653] Data computation: Input the prompt statement into an AI model (e.g., OpenAI GPT model) to generate a design.

[0654] Specifically, the AI ​​analyzes the prompt text and outputs relevant design elements.

[0655] Output: Selected layout and design data.

[0656] Step 6:

[0657] The server automatically generates a message book based on the layout and design, arranging the user's message.

[0658] Input: Layout and design data, user messages.

[0659] Data processing: Place messages in a layout template and generate a message board using an image generation library (e.g., PIL).

[0660] Specifically, you specify the position and font of the message and arrange it to match the design.

[0661] Output: The generated digital image of the message board.

[0662] Step 7:

[0663] The server provides the digital message board to the user's terminal.

[0664] Input: The generated digital message.

[0665] Output: The digital message data is sent to the user's device for review.

[0666] Step 8:

[0667] The user can check the generated message book and, if necessary, select the option to print it on actual colored paper and have it delivered.

[0668] Input: Digital message data.

[0669] Output: Request data for printing and delivery.

[0670] Step 9:

[0671] The server uses the printing and delivery means to link with an external printing and delivery service, prints the message book, and delivers it to the specified address.

[0672] Input: Printing and delivery request data, digital message data.

[0673] Data processing: Sends data to the API of an external printing and delivery service to arrange printing and delivery.

[0674] Specifically, the message board image file is sent to an external service, and information such as the delivery address is also included in the request.

[0675] Output: The message is delivered to the address specified by the user.

[0676] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0677] This invention relates to a system that uses the messaging function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide a more personalized message collection. This system allows users to easily send message collections online, significantly reducing the effort required to create a message collection.

[0678] System Configuration and Functions

[0679] This system consists of a server, user terminals, and external systems that link with the print delivery service as needed. The server manages message reception, analysis, emotion recognition, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0680] 1. Receiving and parsing messages

[0681] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and stores it in a database. The server's analysis module analyzes the stored message and extracts keywords and emotions. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[0682] 2. Emotion Recognition by Emotion Engine

[0683] The server uses an emotion engine to analyze the emotion of messages entered by users in real time. The emotion engine classifies messages based on multiple emotion categories, such as positive, negative, and neutral, and extracts emotion data. For example, "Happy Birthday" is recognized as a positive emotion.

[0684] 3. Layout and design selection

[0685] The server selects the optimal layout and design based on the extracted keywords and emotion data. Based on the emotion engine data, it automatically selects design elements (such as color tones and illustrations) that accurately reflect the emotion. For example, for a message containing the keyword "birthday," a colorful design that conveys positive emotions and a design that includes illustrations of balloons will be selected.

[0686] 4. Generate a message board

[0687] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[0688] 5. Digital offerings and print options

[0689] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[0690] Specific examples

[0691] Example 1: Generating a graduation message

[0692] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0693] 2. The server receives the message, and the analysis module extracts keywords such as "graduation," "congratulations," and "achievement."

[0694] 3. The emotion engine classifies the message as having a positive emotion.

[0695] 4. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0696] 5. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[0697] Example 2: Generating a birthday message

[0698] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0699] 2. The server receives the message and the analysis module extracts keywords such as "Birthday," "Happy Birthday," and "Happy New Year."

[0700] 3. The emotion engine classifies the message as having a positive emotion.

[0701] 4. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0702] 5. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[0703] This invention makes it easy to create online message boards, allowing users to easily convey their congratulations and gratitude. The introduction of an emotion engine allows for message boards that are more personalized in design and respond to emotions.

[0704] The processing flow will be explained below.

[0705] Step 1:

[0706] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[0707] Step 2:

[0708] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[0709] Step 3:

[0710] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[0711] Step 4:

[0712] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the great work," keywords such as "graduation," "congratulations," and "good luck" are extracted.

[0713] Step 5:

[0714] The server passes the extracted keywords and emotion data to the emotion engine, which analyzes the emotion of the message in real time. The emotion engine classifies the message into emotion categories such as positive, negative, and neutral, and generates appropriate emotion data. For example, the emotion is determined to be positive.

[0715] Step 6:

[0716] The server uses an AI model to select the optimal layout and design based on emotion data and keywords. For example, for a "birthday" message, it selects a colorful and vibrant design to evoke positive emotions.

[0717] Step 7:

[0718] The server arranges the user's message based on the selected layout and design, automatically generating a message board, which is then saved in digital format.

[0719] Step 8:

[0720] The server sends a digital image of the generated message board to the user's terminal, where the user can check the displayed message board.

[0721] Step 9:

[0722] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[0723] Step 10:

[0724] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[0725] Step 11:

[0726] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[0727] Step 12:

[0728] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[0729] In this way, the entire process from the user's message input to the final delivery of the message is designed to run smoothly. The introduction of the emotion engine allows for personalized design that reflects the emotional data of the message, providing users with a more refined service.

[0730] Example 2

[0731] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0732] Previous online trading services did not offer a way for users to easily create and send messages based on a specific theme. Creating messages manually also required a lot of time and effort, and it was difficult to select a design that accurately reflected the sentiments. This made it difficult for users to effectively convey their congratulations and gratitude.

[0733] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0734] In this invention, the server includes means for receiving messages entered by users at the time of transactions using the communication function of the online transaction service, means for analyzing the messages and extracting words and emotions from the messages, and means for selecting an optimal layout and design based on the words and emotions. This allows users to easily and automatically generate a message board based on a specific theme and provide it in a design that suits the emotions.

[0735] "Online trading service" refers to a service that allows users to conduct transactions via the Internet.

[0736] "Communication function" refers to the function that enables the system to send and receive data from users.

[0737] "Message" refers to the content of the message entered by the user during a transaction.

[0738] "Means for receiving" refers to the method and function by which the server receives messages sent by users.

[0739] "Means for analyzing" refers to the methods and functions by which the server extracts and analyzes the content of messages received.

[0740] "Words" refer to specific words extracted from the parsed message.

[0741] "Sentiment" refers to the emotional nuance or meaning of the analyzed message.

[0742] "Means for selecting optimal layout and design" refers to a method and function for selecting the most appropriate layout and visual design for the message board based on the extracted words and emotions.

[0743] "Means for automatic generation" refers to the method and function by which the system automatically creates a message board based on the selected layout and design.

[0744] "Digital format" refers to the format of information that is represented and handled as electronic data.

[0745] "Physical printing and delivery means" refers to the method and function of printing the digital message board onto physical paper and delivering it to a designated location.

[0746] This invention relates to a system that analyzes messages sent by users and automatically generates a collection of messages in an online transaction service. This system is mainly composed of a server, a user terminal, and an external system that cooperates with a print delivery service as needed.

[0747] The server receives messages entered by users when making transactions and stores them in a database. The server's analysis module then analyzes the stored messages and extracts important words and emotions. For example, from the message "Happy Birthday! Wishing you a wonderful year," the words "Birthday," "Congratulations," and "Wonderful Year" are extracted.

[0748] The server then uses an emotion engine to analyze the sentiment of the message in real time. The emotion engine categorizes the message into categories such as positive, negative, and neutral, and extracts emotional data. For example, "Happy Birthday" is recognized as a positive sentiment.

[0749] The server then selects the optimal layout and design based on the extracted words and emotion data. Based on the emotion engine's data, design elements (e.g., color tones and illustrations) that accurately reflect the emotion are automatically selected. For example, a message containing the word "birthday" might be matched with a colorful design and illustrations of balloons.

[0750] The server automatically generates a message book by arranging the user's message based on the selected layout and design. This message book is temporarily saved in digital format. The generated message book is provided in digital format to the user's device, where the user can view it. If necessary, the user can also select the option to print it on physical paper and have it mailed. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[0751] As a concrete example, consider the case where a user types and sends a message saying, "Congratulations on your graduation! Wishing you success in your new stage." The server receives this message, and the analysis module extracts words such as "graduation," "congratulations," and "success." The emotion engine classifies the message as having a positive emotion, and the server selects a layout and design appropriate for a "graduation celebration." A message book is generated and provided to the user in digital format. After reviewing this digital message book, the user can select the print option, and the physical message book will be printed and delivered.

[0752] Prompt Sentence Examples

[0753] When a user types and submits a graduation message, explain how the system parses it and generates a message of congratulations.

[0754] When a user types and submits a birthday message, explain how the system parses it and generates a message.

[0755] This invention allows users to easily create a message board online and send messages with designs that reflect their emotions. This system significantly simplifies the traditional, time-consuming process of creating a message board, making it possible to send messages of gratitude or congratulations more quickly and efficiently.

[0756] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0757] Step 1:

[0758] A user enters a message into the message input field of an online transaction service and presses the send button. The entered message is input data, and the server receives this message and stores it in a database. For example, a user enters and sends the message "Happy birthday! I hope you have a wonderful year." Based on this input, the server receives the message data and obtains the message stored in the database as its output.

[0759] Step 2:

[0760] The server's analysis module retrieves the saved message and performs analysis processing. The input data is the saved message, and the output is the words and emotions extracted from the message. Specifically, from the message "Happy birthday! I hope you have a wonderful year," the words "birthday," "congratulations," and "wonderful year" are extracted. This data processing results in a word list being output.

[0761] Step 3:

[0762] The server uses an emotion engine to perform emotion analysis of the message. The input data are the extracted words and the original message, and the output is emotion data of the message. The emotion engine classifies "Happy birthday! I hope you have a wonderful year" as a positive emotion and outputs positive emotion data.

[0763] Step 4:

[0764] The server selects the optimal layout and design based on the extracted words and emotion data. The input data is a word list and emotion data, and the output is the optimal layout and design information. For example, based on the word "birthday" and positive emotion, a colorful layout and design including an illustration of balloons is selected.

[0765] Step 5:

[0766] The server automatically generates a message book by arranging the user's message based on the selected layout and design. The input data is the layout and design information and the message, and the generated digital message book is obtained as output. The server arranges the message and generates the message book using a colorful layout and balloon illustration.

[0767] Step 6:

[0768] The server provides the generated message board in digital form to the user's terminal. The input data is the generated digital message board, and the message board displayed on the user's terminal is obtained as output. The user can check this digital message board.

[0769] Step 7:

[0770] If necessary, the user selects the option to print and mail the message book. The input data is the user's print request and delivery information, and the output is a physical message book that is printed and delivered. The server works with an external printing and delivery service to deliver the message book to the specified address.

[0771] In this way, users can easily and automatically generate a message board based on a specific theme online and provide it in a design that reflects their emotions.

[0772] (Application example 2)

[0773] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0774] Analyzing messages sent through online remittance services and creating personalized message cards is a time-consuming and tedious process using conventional methods. Furthermore, there are limited ways to easily create and print message cards in brick-and-mortar stores, making it less convenient for users. Furthermore, it is difficult to select a design and layout that accurately reflects the sentiment of the message, making it difficult to provide message cards that meet individual needs.

[0775] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving a message entered by a user when transferring money using the message function of an online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, means for inputting a message using a smart device at a physical store and generating the message collection, and means for checking the generated message collection using a head-mounted display and printing it on an actual medium. This makes it possible to easily generate personalized message collections at online remittance services and physical stores and to check and print them immediately.

[0776] "Online Money Transfer Service" means an electronic service for transferring funds over the Internet.

[0777] The "message function" is a function that allows users to input a message by text or voice when transferring money online and send that message.

[0778] "Message entered by user when transferring funds" refers to words or sentences entered by a user using the message function of the online remittance service when transferring funds.

[0779] The "means for receiving a message" refers to a method or device by which the server receives and stores a message entered by a user.

[0780] The "means for analyzing a message and extracting keywords and emotions from the message" is a method or device for analyzing an input message using natural language processing techniques and isolating important keywords and emotions.

[0781] The "means for selecting the optimum layout and design" is a method or device for selecting the layout and design suitable for a message board based on the extracted keywords and emotions.

[0782] The "means for automatically generating a message board" is a method or device for automatically creating a message board by arranging a user's message based on a selected layout and design.

[0783] The "means for providing the generated message board to the user in a digital format" refers to a method or device for providing the generated message board to the user in an electronic data format.

[0784] A "brick and mortar store" is a physical store that sells goods and services.

[0785] "Smart device" is a general term for electronic devices that have internet connectivity and advanced computing capabilities.

[0786] A "head-mounted display" is a display device that is worn on the user's head and is a device that projects information into the user's field of vision.

[0787] "Means for checking the generated message board and printing it on an actual medium" refers to a method or device that allows a user to visually check the created digital message board and then print it on an actual medium such as paper.

[0788] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate the natural language that humans use on a daily basis.

[0789] An "emotion engine" is software or algorithms that recognize and classify emotions from input text or speech.

[0790] The present invention relates to a system for generating personalized messages by inputting messages from users in online remittance services and brick-and-mortar stores, analyzing the messages, and recognizing emotions.

[0791] System configuration

[0792] The system mainly consists of the following components:

[0793] 1. Server

[0794] 2. User Device

[0795] 3. Head-Mounted Display (HMD)

[0796] 4. Smart Devices

[0797] 5. Printing machine

[0798] What the program does

[0799] Message input and analysis

[0800] When a user uses an online money transfer service, they input a message. The message is received and stored by the server. In this process, the server converts the voice message into text using the Google Cloud Speech-to-Text API and analyzes the message using an NLP library (e.g., spaCy).

[0801] emotion recognition

[0802] The server uses a custom model with TensorFlow to analyze text messages and classify them into emotion categories such as positive, negative, and neutral, and also uses the Emotion Recognition API as an emotion engine.

[0803] Layout and design selection

[0804] Based on the keywords and emotion data, an optimal layout and design is selected, using a generative AI model to generate a design that best suits the user's emotion.

[0805] Automatic generation of message cards

[0806] Based on the selected layout and design, the server automatically generates the message board. During this process, each element is arranged digitally. The generated message board is temporarily stored as digital data on the server.

[0807] Provide and confirm with users

[0808] The generated message board is provided to the user in digital form, and the user can visually check the generated message board using a head-mounted display (e.g., Microsoft HoloLens).

[0809] Printing and Shipping

[0810] After the user confirms, the message can be printed on a physical medium. The server works with a printer to print the message and provide it to the user. Delivery services are also available if necessary.

[0811] Specific examples

[0812] Generate a graduation message

[0813] The user types and sends the message, "Congratulations on your graduation! I wish you success in your new stage." The server receives and analyzes the message. Based on the keywords and emotions extracted from the message, the server selects the optimal layout and design and generates a message board. This message board is visually presented to the user via the HMD, and after confirmation, it is printed on actual media by a printer.

[0814] Generate birthday greetings

[0815] The user types "Happy Birthday! Have a wonderful year!" and sends it. The server receives the message and analyzes it in the same way. Because the emotion engine recognizes it as a positive emotion, the server selects a colorful design and generates a message card. This message card is also presented visually on the HMD, and the user can print it out after checking it.

[0816] As described above, the system of the present invention makes it possible to easily create personalized message cards online and in physical stores, and to instantly check and print them.

[0817] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0818] Step 1:

[0819] A user wears a head-mounted display (HMD) and inputs a message to generate a message board.

[0820] Specifically, the user inputs a text or voice message on the interface of the online remittance service, which is then sent to the server via the HMD.

[0821] Input: User's message (text or voice)

[0822] Output: Message data sent to the server

[0823] Step 2:

[0824] The server receives the message, transcribes it, and parses it.

[0825] Specifically, the server converts the voice message into text using the Google Cloud Speech-to-Text API, and then uses an NLP library (e.g., spaCy) to extract keywords and sentiment from the message. This process identifies the keywords and sentiment of the message.

[0826] Input: Message data sent to the server

[0827] Output: Translated message, extracted keywords and sentiment data

[0828] Step 3:

[0829] The server selects the optimal layout and design based on the extracted keywords and emotion data.

[0830] Specifically, a generative AI model is used to automatically generate a design and layout for a message card that best suits the emotional data. A prompt sentence is input into the generative AI model to obtain appropriate design elements.

[0831] Input: Translated message, extracted keywords and sentiment data

[0832] Output: Selected layout and design data

[0833] Step 4:

[0834] The server automatically generates a message card based on the selected layout and design.

[0835] Specifically, a message card template is created based on the design elements obtained in the preprocessing, and the message is then appropriately arranged to generate the final digital message card. This generated message card is temporarily saved as digital data.

[0836] Input: Selected layout and design data

[0837] Output: Automatically generated digital data of messages

[0838] Step 5:

[0839] The server provides the generated digital data of the message board to the user, who visually checks it through a head-mounted display.

[0840] Specifically, the digital data of the generated message board is sent to the HMD, where the user can visually check it, confirming the content and design of the message board and making any necessary corrections.

[0841] Input: Automatically generated digital data of messages

[0842] Output: A digital message displayed in the user's field of view

[0843] Step 6:

[0844] The user makes a final confirmation, and the server prints and delivers the message book on the actual medium.

[0845] Specifically, the user performs a final check through the HMD, and after confirming that there are no corrections required, the server sends the data to the printer to print the message book. The printed message book is provided to the user and can be delivered as needed.

[0846] Input: Verified digital message data

[0847] Output: The actual printed message

[0848] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0849] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0850] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0851] [Third embodiment]

[0852] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0853] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0854] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0855] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0856] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0857] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0858] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0859] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0860] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0861] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0862] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0863] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0864] This invention relates to a system that analyzes messages entered by users when sending money using the message function of an online remittance service and automatically generates a message book. This system significantly reduces the effort required to create a message book while maintaining the convenience of remittance, making it possible to easily convey congratulatory messages online.

[0865] System Configuration and Functions

[0866] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0867] 1. Receiving and parsing messages

[0868] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and passes it to an analysis module. The analysis module uses natural language processing technology to extract keywords and sentiment from the message. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[0869] 2. Layout and design selection

[0870] The server uses an AI model to select the optimal layout and design based on the analyzed keywords and emotion data. For example, a colorful design or a design including an illustration of balloons would be selected to match the keyword "birthday." If the emotion is positive, bright colors would be selected.

[0871] 3. Generate a message board

[0872] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the generated message board is saved in digital format.

[0873] 4. Digital offerings and print options

[0874] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[0875] Specific examples

[0876] Example 1: Generating a graduation message

[0877] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0878] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[0879] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0880] 4. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[0881] Example 2: Generating a birthday message

[0882] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0883] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[0884] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0885] 4. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[0886] The present invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude.

[0887] The processing flow will be explained below.

[0888] Step 1:

[0889] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[0890] Step 2:

[0891] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[0892] Step 3:

[0893] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[0894] Step 4:

[0895] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the good work," keywords such as "graduation," "congratulations," and "keep up the good work" are extracted and the message is determined to have a positive sentiment.

[0896] Step 5:

[0897] The server passes the extracted keywords and sentiment data to an AI model, which then selects the optimal layout and design, such as a design with bright colors and an illustration of a graduation cap, to match the theme of a "graduation gift."

[0898] Step 6:

[0899] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[0900] Step 7:

[0901] The server sends the generated digital image of the message board to the user's terminal, where it is displayed in a format that the user can view.

[0902] Step 8:

[0903] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[0904] Step 9:

[0905] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[0906] Step 10:

[0907] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[0908] Step 11:

[0909] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[0910] In this way, the system is designed to ensure a smooth process from the user's message input to the final delivery of the message book.

[0911] Example 1

[0912] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0913] When using online remittance services, users must manually create message boards to display their messages effectively and attractively. However, this is a time-consuming task, especially when combining multiple messages into a single message board. Furthermore, when creating a message board that incorporates messages from other users, it can be difficult to maintain a consistent layout and design. Therefore, a method to automatically solve this problem is needed.

[0914] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0915] In this invention, the server includes means for receiving a message entered by a user when remitting money using the message function of the online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, and means for printing the digital message collection on actual material and delivering it. This allows users to easily express their congratulations or feelings of gratitude in a message collection, and significantly improves work efficiency compared to manual processing.

[0916] "Online money transfer service" means an electronic service for sending and receiving money over the Internet.

[0917] The "message function" is a function that allows a user to input text information and send it to other users.

[0918] "User" means an individual or organization that uses the system or service.

[0919] A "server" is a computer system that processes and stores data on a computer network.

[0920] "Parsing" is the act of automatically processing the content of an input message to extract and understand its information.

[0921] "Keywords" are words or phrases that have special significance within a message.

[0922] "Emotion" refers to the emotional elements expressed in a message, such as joy, sadness, surprise, etc.

[0923] "Layout" refers to the position and structure for arranging each message and design element within the message board.

[0924] "Design" refers to planning the design and layout that will create the overall appearance of the message board.

[0925] A "message book" is a document or image that compiles multiple messages into a single design or layout.

[0926] "Digital format" means a format that can be stored and displayed electronically, such as PNG, PDF, JPEG, etc.

[0927] "Materials" are the physical items, such as the actual paper or card, that are printed on.

[0928] "Printing" is the act of transferring a digital message onto a physical material.

[0929] "Delivery" refers to the act of delivering the printed message book to the specified address.

[0930] This invention relates to a system that uses the message function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. This system significantly reduces the time and effort required to create a message collection while maintaining the convenience of remittance, allowing people to easily convey their congratulations online.

[0931] System Configuration and Functions

[0932] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[0933] Specific hardware and software configurations

[0934] The server hardware used was a standard web server, running server software such as the Ubuntu OS and Apache Tomcat, and a Python environment.

[0935] The analysis module uses natural language processing techniques to extract keywords and sentiment from messages using Python libraries such as NLTK and SpaCy, and then uses generative AI models (TensorFlow and PyTorch) to select layout and design based on the extracted data.

[0936] They also use graphics generation libraries such as Adobe Creative Cloud API to select designs, and libraries such as Pillow and SVG to save the final message board in digital format.

[0937] Specific examples

[0938] Example 1: Generating a graduation message

[0939] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[0940] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[0941] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[0942] 4. A digital message board is provided to the user, who then selects the option to print it on physical material after reviewing it.

[0943] Example 2: Generating a birthday message

[0944] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[0945] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[0946] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[0947] 4. A digital message board is provided to the user, who then selects the option to print it on actual material after reviewing it.

[0948] This invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude. The generated message book is saved in digital format, making it easy to share and save on multiple devices. It also works with external printing and delivery services, making it easy to distribute physical message books.

[0949] Prompt Sentence Examples

[0950] "The user types, 'Congratulations on your graduation! I wish you success in your new stage,' and sends the money."

[0951] "Happy birthday! Wishing you a wonderful year."

[0952] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0953] Step 1:

[0954] The user enters a congratulatory message into the message input field of the online money transfer service and sends money. For example, the user might enter "Happy birthday! I hope you have a wonderful year." The device then sends this message data to the server.

[0955] Input: The message entered by the user

[0956] Output: Message data sent to the server

[0957] Step 2:

[0958] The server receives messages sent by users, temporarily stores them in a database, and then passes the message data to the analysis module.

[0959] Input: Message data sent by the user

[0960] Output: Message data passed to the analysis module

[0961] Step 3:

[0962] The analysis module analyzes the message using natural language processing techniques. Specifically, it uses a Python NLP library (e.g., NLTK or SpaCy) to extract keywords and sentiment from the message. The extracted keywords and sentiment are returned to the server.

[0963] Input: Message data

[0964] Data processing: Extract keywords and sentiment using natural language processing

[0965] Output: Keywords and sentiment data

[0966] Step 4:

[0967] The server uses the keywords and sentiment data received from the analysis module to select the optimal layout and design using a generative AI model. To do this, it uses a machine learning framework (e.g., TensorFlow or PyTorch). The selected layout and design information is then passed on to the next step.

[0968] Input: Keywords and sentiment data

[0969] Data Computation: Layout and design selection with generative AI models

[0970] Output: Layout and design information

[0971] Step 5:

[0972] The server automatically generates the message board by placing the user's message based on the selected layout and design, using a graphics generation library (e.g., Pillow or SVG), and saves the generated message board in a digital format (e.g., PNG or PDF).

[0973] Input: Layout and design information, user messages

[0974] Data processing: Automatic generation of messages

[0975] Output: Digital message board

[0976] Step 6:

[0977] The server provides the generated message board in digital format to the user's terminal, where the user can preview the message board using the terminal's web browser and download it as needed.

[0978] Input: Digital message board

[0979] Output: Providing a digital message to the user's device

[0980] Step 7:

[0981] Users can view the digital message book and select the print option, after which the server will connect to the API of an external printing and delivery service to print the message book and arrange for it to be delivered to the specified address.

[0982] Input: User's print option selection

[0983] Data calculation: printing and delivery arrangements

[0984] Output: Instructions for printing and delivery services

[0985] (Application example 1)

[0986] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0987] Conventional online message book creation systems require users to input messages individually and manually select a design based on them, which is time-consuming and laborious. Furthermore, there is no automated message book generation system that works with remittance services, making it difficult to integrate remittances and message book creation. Furthermore, there is no means to efficiently generate message book designs using generative AI models. This makes it difficult for users to easily and quickly convey their feelings of gratitude and congratulations.

[0988] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0989] In this invention, the server includes means for receiving a message entered by a user when sending money using the message function of the online money transfer service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for generating a design for a message book using a generative AI model with a specific prompt sentence, means for automatically generating a message book based on the layout and design, means for providing the generated message book to the user in digital form, means for printing and delivering the digital message book on actual colored paper, and means for linking with an external printing and delivery service for physically storing the generated message book. This automates the process of creating a message book, making it possible to efficiently convey gratitude and congratulations at the same time as sending money.

[0990] An "online remittance service" is a service that allows sending and receiving money via the Internet.

[0991] "Message function" means a function that allows users to input and send text messages when transferring money.

[0992] "User" refers to any individual or legal entity that uses the Online Money Transfer Service.

[0993] A "message" is text information that a user enters when sending money.

[0994] "Means for receiving" is a function that allows the server to receive the message entered when the user remits money.

[0995] "Means of analysis" refers to the function of analyzing the content of a message and extracting keywords and emotions from it.

[0996] "Keywords" are specific words or phrases contained in a message that summarize the content of the message.

[0997] "Emotion" refers to the user's feelings and emotions that can be read from the message.

[0998] "Layout" refers to the design of the message board and the arrangement of its components.

[0999] "Design" refers to the visual style or theme of the message board.

[1000] A "message book" refers to the integration of multiple messages into a single document or design.

[1001] "Means for automatic generation" refers to a function that automatically creates a message board based on the analysis results.

[1002] "Digital format" means a format stored as electronic data.

[1003] The "means of providing" is a function that allows users to view and use the generated message board.

[1004] "Means for printing and delivering" refers to the function of printing the digital message board onto a physical medium and delivering it to a designated location.

[1005] A "prompt" is an instruction entered into a generative AI model to generate a design.

[1006] A "generative AI model" is a trained algorithm that uses artificial intelligence to perform a specific task.

[1007] "External printing and delivery service for physical storage" is a service that works in cooperation with an external printing and delivery company to print the generated message book and ship it to a specified address.

[1008] This invention relates to a method and system for automatically generating a message board based on the message entered by a user when sending money using an online money transfer service. The system mainly consists of a server, a user terminal, and an external system that cooperates with external printing and delivery services as needed.

[1009] System configuration and program processing

[1010] Server configuration and operation:

[1011] 1. Message receiving method:

[1012] The server receives a message entered by the user when transferring money using the message function of the online money transfer service.

[1013] The server passes this message to the analysis module.

[1014] 2. Message analysis methods:

[1015] The server uses natural language processing techniques (e.g., spaCy) to extract keywords and sentiment from the message.

[1016] For example, if a user inputs "Happy birthday! Have a wonderful year," the server extracts keywords such as "birthday," "congratulations," and "wonderful year."

[1017] 3. Layout and design selection methods:

[1018] Based on the extracted keywords and sentiment data, the server uses a generative AI model (e.g., OpenAI GPT model) to select the optimal layout and design.

[1019] Use prompts to instruct the AI ​​model and generate designs.

[1020] Example: "Happy birthday! Wishing you a wonderful year ahead."

[1021] 4. Automatic message generation method:

[1022] The server automatically generates a message book by arranging the user's message based on the selected layout and design.

[1023] The generated message board is saved in digital format.

[1024] 5. Digital Delivery Methods:

[1025] The server provides the generated message board in digital form to the user's terminal, where the user can view it.

[1026] 6. Printing and Delivery Methods:

[1027] If desired, the user can select a print and delivery option to physically store the actual message book, in which case the server will coordinate with an external print and delivery service to arrange for the message book to be printed and delivered.

[1028] Hardware and software used

[1029] Natural Language Processing: spaCy (depending on version, uses 'ja_core_news_sm' model)

[1030] Generative AI model: OpenAI GPT model

[1031] Image generation: Python Imaging Library (PIL)

[1032] API requests: the requests library

[1033] Examples of specific examples and prompts

[1034] Example 1: Generating a birthday message

[1035] The user enters a message such as "Happy birthday! I hope you have a wonderful year" and sends money.

[1036] The server receives the message and extracts the keywords "birthday," "congratulations," and "wonderful year."

[1037] Use prompts to instruct the AI ​​model to choose the right layout and design for your birthday celebration.

[1038] The prompt phrase "Happy birthday! I hope you have a wonderful year" is input into the generative AI model, and related designs are generated as a message book.

[1039] In this way, the present invention allows users to easily create a special message book when sending money, and efficiently convey feelings of gratitude or congratulations.

[1040] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1041] Step 1:

[1042] The user uses the message function of the online money transfer service to enter a message.

[1043] Input: A message that the user enters when sending money (e.g., "Happy Birthday! Wishing you a wonderful year!").

[1044] Output: The input message is sent to the server.

[1045] Step 2:

[1046] The server receives a message from the user using the message receiving means.

[1047] Input: The message entered by the user.

[1048] Output: The message data that is passed to the message parsing module.

[1049] Step 3:

[1050] The server uses a message analysis means to analyze the received message and extract keywords and emotions.

[1051] Input: Received message data.

[1052] Data processing: Analyze messages using natural language processing techniques (e.g., spaCy).

[1053] Specifically, the system analyzes the structure of the sentence and extracts keywords (e.g., "Birthday," "Congratulations," "Have a wonderful year") and emotions.

[1054] Output: Extracted keywords and sentiment data.

[1055] Step 4:

[1056] The server uses a generative AI model to generate prompts to select the optimal layout and design based on the keywords and emotions.

[1057] Input: Extracted keywords and sentiment data.

[1058] Data calculation: Generate prompt sentences using keywords and sentiment data (e.g., "Happy birthday! Wishing you a wonderful year").

[1059] Specifically, keywords and emotional information are combined to create appropriate instructions.

[1060] Output: The generated prompt statement.

[1061] Step 5:

[1062] The server uses a generative AI model to generate designs based on prompts and select the optimal layout.

[1063] Input: The generated prompt statement.

[1064] Data computation: Input the prompt statement into an AI model (e.g., OpenAI GPT model) to generate a design.

[1065] Specifically, the AI ​​analyzes the prompt text and outputs relevant design elements.

[1066] Output: Selected layout and design data.

[1067] Step 6:

[1068] The server automatically generates a message book based on the layout and design, arranging the user's message.

[1069] Input: Layout and design data, user messages.

[1070] Data processing: Place messages in a layout template and generate a message board using an image generation library (e.g., PIL).

[1071] Specifically, you specify the position and font of the message and arrange it to match the design.

[1072] Output: The generated digital image of the message board.

[1073] Step 7:

[1074] The server provides the digital message board to the user's terminal.

[1075] Input: The generated digital message.

[1076] Output: The digital message data is sent to the user's device for review.

[1077] Step 8:

[1078] The user can check the generated message book and, if necessary, select the option to print it on actual colored paper and have it delivered.

[1079] Input: Digital message data.

[1080] Output: Request data for printing and delivery.

[1081] Step 9:

[1082] The server uses the printing and delivery means to link with an external printing and delivery service, prints the message book, and delivers it to the specified address.

[1083] Input: Printing and delivery request data, digital message data.

[1084] Data processing: Sends data to the API of an external printing and delivery service to arrange printing and delivery.

[1085] Specifically, the message board image file is sent to an external service, and information such as the delivery address is also included in the request.

[1086] Output: The message is delivered to the address specified by the user.

[1087] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1088] This invention relates to a system that uses the messaging function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide a more personalized message collection. This system allows users to easily send message collections online, significantly reducing the effort required to create a message collection.

[1089] System Configuration and Functions

[1090] This system consists of a server, user terminals, and external systems that link with the print delivery service as needed. The server manages message reception, analysis, emotion recognition, layout and design selection, message collection generation, digital provision, printing, and delivery.

[1091] 1. Receiving and parsing messages

[1092] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and stores it in a database. The server's analysis module analyzes the stored message and extracts keywords and emotions. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[1093] 2. Emotion Recognition by Emotion Engine

[1094] The server uses an emotion engine to analyze the emotion of messages entered by users in real time. The emotion engine classifies messages based on multiple emotion categories, such as positive, negative, and neutral, and extracts emotion data. For example, "Happy Birthday" is recognized as a positive emotion.

[1095] 3. Layout and design selection

[1096] The server selects the optimal layout and design based on the extracted keywords and emotion data. Based on the emotion engine data, it automatically selects design elements (such as color tones and illustrations) that accurately reflect the emotion. For example, for a message containing the keyword "birthday," a colorful design that conveys positive emotions and a design that includes illustrations of balloons will be selected.

[1097] 4. Generate a message board

[1098] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[1099] 5. Digital offerings and print options

[1100] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[1101] Specific examples

[1102] Example 1: Generating a graduation message

[1103] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[1104] 2. The server receives the message, and the analysis module extracts keywords such as "graduation," "congratulations," and "achievement."

[1105] 3. The emotion engine classifies the message as having a positive emotion.

[1106] 4. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[1107] 5. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[1108] Example 2: Generating a birthday message

[1109] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[1110] 2. The server receives the message and the analysis module extracts keywords such as "Birthday," "Happy Birthday," and "Happy New Year."

[1111] 3. The emotion engine classifies the message as having a positive emotion.

[1112] 4. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[1113] 5. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[1114] This invention makes it easy to create online message boards, allowing users to easily convey their congratulations and gratitude. The introduction of an emotion engine allows for message boards that are more personalized in design and respond to emotions.

[1115] The processing flow will be explained below.

[1116] Step 1:

[1117] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[1118] Step 2:

[1119] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[1120] Step 3:

[1121] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[1122] Step 4:

[1123] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the great work," keywords such as "graduation," "congratulations," and "good luck" are extracted.

[1124] Step 5:

[1125] The server passes the extracted keywords and emotion data to the emotion engine, which analyzes the emotion of the message in real time. The emotion engine classifies the message into emotion categories such as positive, negative, and neutral, and generates appropriate emotion data. For example, the emotion is determined to be positive.

[1126] Step 6:

[1127] The server uses an AI model to select the optimal layout and design based on emotion data and keywords. For example, for a "birthday" message, it selects a colorful and vibrant design to evoke positive emotions.

[1128] Step 7:

[1129] The server arranges the user's message based on the selected layout and design, automatically generating a message board, which is then saved in digital format.

[1130] Step 8:

[1131] The server sends a digital image of the generated message board to the user's terminal, where the user can check the displayed message board.

[1132] Step 9:

[1133] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[1134] Step 10:

[1135] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[1136] Step 11:

[1137] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[1138] Step 12:

[1139] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[1140] In this way, the entire process from the user's message input to the final delivery of the message is designed to run smoothly. The introduction of the emotion engine allows for personalized design that reflects the emotional data of the message, providing users with a more refined service.

[1141] Example 2

[1142] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1143] Previous online trading services did not offer a way for users to easily create and send messages based on a specific theme. Creating messages manually also required a lot of time and effort, and it was difficult to select a design that accurately reflected the sentiments. This made it difficult for users to effectively convey their congratulations and gratitude.

[1144] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1145] In this invention, the server includes means for receiving messages entered by users at the time of transactions using the communication function of the online transaction service, means for analyzing the messages and extracting words and emotions from the messages, and means for selecting an optimal layout and design based on the words and emotions. This allows users to easily and automatically generate a message board based on a specific theme and provide it in a design that suits the emotions.

[1146] "Online trading service" refers to a service that allows users to conduct transactions via the Internet.

[1147] "Communication function" refers to the function that enables the system to send and receive data from users.

[1148] "Message" refers to the content of the message entered by the user during a transaction.

[1149] "Means for receiving" refers to the method and function by which the server receives messages sent by users.

[1150] "Means for analyzing" refers to the methods and functions by which the server extracts and analyzes the content of messages received.

[1151] "Words" refer to specific words extracted from the parsed message.

[1152] "Sentiment" refers to the emotional nuance or meaning of the analyzed message.

[1153] "Means for selecting optimal layout and design" refers to a method and function for selecting the most appropriate layout and visual design for the message board based on the extracted words and emotions.

[1154] "Means for automatic generation" refers to the method and function by which the system automatically creates a message board based on the selected layout and design.

[1155] "Digital format" refers to the format of information that is represented and handled as electronic data.

[1156] "Physical printing and delivery means" refers to the method and function of printing the digital message board onto physical paper and delivering it to a designated location.

[1157] This invention relates to a system that analyzes messages sent by users and automatically generates a collection of messages in an online transaction service. This system is mainly composed of a server, a user terminal, and an external system that cooperates with a print delivery service as needed.

[1158] The server receives messages entered by users when making transactions and stores them in a database. The server's analysis module then analyzes the stored messages and extracts important words and emotions. For example, from the message "Happy Birthday! Wishing you a wonderful year," the words "Birthday," "Congratulations," and "Wonderful Year" are extracted.

[1159] The server then uses an emotion engine to analyze the sentiment of the message in real time. The emotion engine categorizes the message into categories such as positive, negative, and neutral, and extracts emotional data. For example, "Happy Birthday" is recognized as a positive sentiment.

[1160] The server then selects the optimal layout and design based on the extracted words and emotion data. Based on the emotion engine's data, design elements (e.g., color tones and illustrations) that accurately reflect the emotion are automatically selected. For example, a message containing the word "birthday" might be matched with a colorful design and illustrations of balloons.

[1161] The server automatically generates a message book by arranging the user's message based on the selected layout and design. This message book is temporarily saved in digital format. The generated message book is provided in digital format to the user's device, where the user can view it. If necessary, the user can also select the option to print it on physical paper and have it mailed. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[1162] As a concrete example, consider the case where a user types and sends a message saying, "Congratulations on your graduation! Wishing you success in your new stage." The server receives this message, and the analysis module extracts words such as "graduation," "congratulations," and "success." The emotion engine classifies the message as having a positive emotion, and the server selects a layout and design appropriate for a "graduation celebration." A message book is generated and provided to the user in digital format. After reviewing this digital message book, the user can select the print option, and the physical message book will be printed and delivered.

[1163] Prompt Sentence Examples

[1164] When a user types and submits a graduation message, explain how the system parses it and generates a message of congratulations.

[1165] When a user types and submits a birthday message, explain how the system parses it and generates a message.

[1166] This invention allows users to easily create a message board online and send messages with designs that reflect their emotions. This system significantly simplifies the traditional, time-consuming process of creating a message board, making it possible to send messages of gratitude or congratulations more quickly and efficiently.

[1167] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1168] Step 1:

[1169] A user enters a message into the message input field of an online transaction service and presses the send button. The entered message is input data, and the server receives this message and stores it in a database. For example, a user enters and sends the message "Happy birthday! I hope you have a wonderful year." Based on this input, the server receives the message data and obtains the message stored in the database as its output.

[1170] Step 2:

[1171] The server's analysis module retrieves the saved message and performs analysis processing. The input data is the saved message, and the output is the words and emotions extracted from the message. Specifically, from the message "Happy birthday! I hope you have a wonderful year," the words "birthday," "congratulations," and "wonderful year" are extracted. This data processing results in a word list being output.

[1172] Step 3:

[1173] The server uses an emotion engine to perform emotion analysis of the message. The input data are the extracted words and the original message, and the output is emotion data of the message. The emotion engine classifies "Happy birthday! I hope you have a wonderful year" as a positive emotion and outputs positive emotion data.

[1174] Step 4:

[1175] The server selects the optimal layout and design based on the extracted words and emotion data. The input data is a word list and emotion data, and the output is the optimal layout and design information. For example, based on the word "birthday" and positive emotion, a colorful layout and design including an illustration of balloons is selected.

[1176] Step 5:

[1177] The server automatically generates a message book by arranging the user's message based on the selected layout and design. The input data is the layout and design information and the message, and the generated digital message book is obtained as output. The server arranges the message and generates the message book using a colorful layout and balloon illustration.

[1178] Step 6:

[1179] The server provides the generated message board in digital form to the user's terminal. The input data is the generated digital message board, and the message board displayed on the user's terminal is obtained as output. The user can check this digital message board.

[1180] Step 7:

[1181] If necessary, the user selects the option to print and mail the message book. The input data is the user's print request and delivery information, and the output is a physical message book that is printed and delivered. The server works with an external printing and delivery service to deliver the message book to the specified address.

[1182] In this way, users can easily and automatically generate a message board based on a specific theme online and provide it in a design that reflects their emotions.

[1183] (Application example 2)

[1184] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1185] Analyzing messages sent through online remittance services and creating personalized message cards is a time-consuming and tedious process using conventional methods. Furthermore, there are limited ways to easily create and print message cards in brick-and-mortar stores, making it less convenient for users. Furthermore, it is difficult to select a design and layout that accurately reflects the sentiment of the message, making it difficult to provide message cards that meet individual needs.

[1186] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving a message entered by a user when transferring money using the message function of an online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, means for inputting a message using a smart device at a physical store and generating the message collection, and means for checking the generated message collection using a head-mounted display and printing it on an actual medium. This makes it possible to easily generate personalized message collections at online remittance services and physical stores and to check and print them immediately.

[1187] "Online Money Transfer Service" means an electronic service for transferring funds over the Internet.

[1188] The "message function" is a function that allows users to input a message by text or voice when transferring money online and send that message.

[1189] "Message entered by user when transferring funds" refers to words or sentences entered by a user using the message function of the online remittance service when transferring funds.

[1190] The "means for receiving a message" refers to a method or device by which the server receives and stores a message entered by a user.

[1191] The "means for analyzing a message and extracting keywords and emotions from the message" is a method or device for analyzing an input message using natural language processing techniques and isolating important keywords and emotions.

[1192] The "means for selecting the optimum layout and design" is a method or device for selecting the layout and design suitable for a message board based on the extracted keywords and emotions.

[1193] The "means for automatically generating a message board" is a method or device for automatically creating a message board by arranging a user's message based on a selected layout and design.

[1194] The "means for providing the generated message board to the user in a digital format" refers to a method or device for providing the generated message board to the user in an electronic data format.

[1195] A "brick and mortar store" is a physical store that sells goods and services.

[1196] "Smart device" is a general term for electronic devices that have internet connectivity and advanced computing capabilities.

[1197] A "head-mounted display" is a display device that is worn on the user's head and is a device that projects information into the user's field of vision.

[1198] "Means for checking the generated message board and printing it on an actual medium" refers to a method or device that allows a user to visually check the created digital message board and then print it on an actual medium such as paper.

[1199] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate the natural language that humans use on a daily basis.

[1200] An "emotion engine" is software or algorithms that recognize and classify emotions from input text or speech.

[1201] The present invention relates to a system for generating personalized messages by inputting messages from users in online remittance services and brick-and-mortar stores, analyzing the messages, and recognizing emotions.

[1202] System configuration

[1203] The system mainly consists of the following components:

[1204] 1. Server

[1205] 2. User Device

[1206] 3. Head-Mounted Display (HMD)

[1207] 4. Smart Devices

[1208] 5. Printing machine

[1209] What the program does

[1210] Message input and analysis

[1211] When a user uses an online money transfer service, they input a message. The message is received and stored by the server. In this process, the server converts the voice message into text using the Google Cloud Speech-to-Text API and analyzes the message using an NLP library (e.g., spaCy).

[1212] emotion recognition

[1213] The server uses a custom model with TensorFlow to analyze text messages and classify them into emotion categories such as positive, negative, and neutral, and also uses the Emotion Recognition API as an emotion engine.

[1214] Layout and design selection

[1215] Based on the keywords and emotion data, an optimal layout and design is selected, using a generative AI model to generate a design that best suits the user's emotion.

[1216] Automatic generation of message cards

[1217] Based on the selected layout and design, the server automatically generates the message board. During this process, each element is arranged digitally. The generated message board is temporarily stored as digital data on the server.

[1218] Provide and confirm with users

[1219] The generated message board is provided to the user in digital form, and the user can visually check the generated message board using a head-mounted display (e.g., Microsoft HoloLens).

[1220] Printing and Shipping

[1221] After the user confirms, the message can be printed on a physical medium. The server works with a printer to print the message and provide it to the user. Delivery services are also available if necessary.

[1222] Specific examples

[1223] Generate a graduation message

[1224] The user types and sends the message, "Congratulations on your graduation! I wish you success in your new stage." The server receives and analyzes the message. Based on the keywords and emotions extracted from the message, the server selects the optimal layout and design and generates a message board. This message board is visually presented to the user via the HMD, and after confirmation, it is printed on actual media by a printer.

[1225] Generate birthday greetings

[1226] The user types "Happy Birthday! Have a wonderful year!" and sends it. The server receives the message and analyzes it in the same way. Because the emotion engine recognizes it as a positive emotion, the server selects a colorful design and generates a message card. This message card is also presented visually on the HMD, and the user can print it out after checking it.

[1227] As described above, the system of the present invention makes it possible to easily create personalized message cards online and in physical stores, and to instantly check and print them.

[1228] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1229] Step 1:

[1230] A user wears a head-mounted display (HMD) and inputs a message to generate a message board.

[1231] Specifically, the user inputs a text or voice message on the interface of the online remittance service, which is then sent to the server via the HMD.

[1232] Input: User's message (text or voice)

[1233] Output: Message data sent to the server

[1234] Step 2:

[1235] The server receives the message, transcribes it, and parses it.

[1236] Specifically, the server converts the voice message into text using the Google Cloud Speech-to-Text API, and then uses an NLP library (e.g., spaCy) to extract keywords and sentiment from the message. This process identifies the keywords and sentiment of the message.

[1237] Input: Message data sent to the server

[1238] Output: Translated message, extracted keywords and sentiment data

[1239] Step 3:

[1240] The server selects the optimal layout and design based on the extracted keywords and emotion data.

[1241] Specifically, a generative AI model is used to automatically generate a design and layout for a message card that best suits the emotional data. A prompt sentence is input into the generative AI model to obtain appropriate design elements.

[1242] Input: Translated message, extracted keywords and sentiment data

[1243] Output: Selected layout and design data

[1244] Step 4:

[1245] The server automatically generates a message card based on the selected layout and design.

[1246] Specifically, a message card template is created based on the design elements obtained in the preprocessing, and the message is then appropriately arranged to generate the final digital message card. This generated message card is temporarily saved as digital data.

[1247] Input: Selected layout and design data

[1248] Output: Automatically generated digital data of messages

[1249] Step 5:

[1250] The server provides the generated digital data of the message board to the user, who visually checks it through a head-mounted display.

[1251] Specifically, the digital data of the generated message board is sent to the HMD, where the user can visually check it, confirming the content and design of the message board and making any necessary corrections.

[1252] Input: Automatically generated digital data of messages

[1253] Output: A digital message displayed in the user's field of view

[1254] Step 6:

[1255] The user makes a final confirmation, and the server prints and delivers the message book on the actual medium.

[1256] Specifically, the user performs a final check through the HMD, and after confirming that there are no corrections required, the server sends the data to the printer to print the message book. The printed message book is provided to the user and can be delivered as needed.

[1257] Input: Verified digital message data

[1258] Output: The actual printed message

[1259] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1260] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1261] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1262] [Fourth embodiment]

[1263] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1264] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1265] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1266] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1267] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1268] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1269] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1270] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1271] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1272] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1273] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1274] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1275] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1276] This invention relates to a system that analyzes messages entered by users when sending money using the message function of an online remittance service and automatically generates a message book. This system significantly reduces the effort required to create a message book while maintaining the convenience of remittance, making it possible to easily convey congratulatory messages online.

[1277] System Configuration and Functions

[1278] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[1279] 1. Receiving and parsing messages

[1280] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and passes it to an analysis module. The analysis module uses natural language processing technology to extract keywords and sentiment from the message. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[1281] 2. Layout and design selection

[1282] The server uses an AI model to select the optimal layout and design based on the analyzed keywords and emotion data. For example, a colorful design or a design including an illustration of balloons would be selected to match the keyword "birthday." If the emotion is positive, bright colors would be selected.

[1283] 3. Generate a message board

[1284] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the generated message board is saved in digital format.

[1285] 4. Digital offerings and print options

[1286] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[1287] Specific examples

[1288] Example 1: Generating a graduation message

[1289] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[1290] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[1291] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[1292] 4. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[1293] Example 2: Generating a birthday message

[1294] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[1295] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[1296] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[1297] 4. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[1298] The present invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude.

[1299] The processing flow will be explained below.

[1300] Step 1:

[1301] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[1302] Step 2:

[1303] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[1304] Step 3:

[1305] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[1306] Step 4:

[1307] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the good work," keywords such as "graduation," "congratulations," and "keep up the good work" are extracted and the message is determined to have a positive sentiment.

[1308] Step 5:

[1309] The server passes the extracted keywords and sentiment data to an AI model, which then selects the optimal layout and design, such as a design with bright colors and an illustration of a graduation cap, to match the theme of a "graduation gift."

[1310] Step 6:

[1311] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[1312] Step 7:

[1313] The server sends the generated digital image of the message board to the user's terminal, where it is displayed in a format that the user can view.

[1314] Step 8:

[1315] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[1316] Step 9:

[1317] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[1318] Step 10:

[1319] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[1320] Step 11:

[1321] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[1322] In this way, the system is designed to ensure a smooth process from the user's message input to the final delivery of the message book.

[1323] Example 1

[1324] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1325] When using online remittance services, users must manually create message boards to display their messages effectively and attractively. However, this is a time-consuming task, especially when combining multiple messages into a single message board. Furthermore, when creating a message board that incorporates messages from other users, it can be difficult to maintain a consistent layout and design. Therefore, a method to automatically solve this problem is needed.

[1326] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1327] In this invention, the server includes means for receiving a message entered by a user when remitting money using the message function of the online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, and means for printing the digital message collection on actual material and delivering it. This allows users to easily express their congratulations or feelings of gratitude in a message collection, and significantly improves work efficiency compared to manual processing.

[1328] "Online money transfer service" means an electronic service for sending and receiving money over the Internet.

[1329] The "message function" is a function that allows a user to input text information and send it to other users.

[1330] "User" means an individual or organization that uses the system or service.

[1331] A "server" is a computer system that processes and stores data on a computer network.

[1332] "Parsing" is the act of automatically processing the content of an input message to extract and understand its information.

[1333] "Keywords" are words or phrases that have special significance within a message.

[1334] "Emotion" refers to the emotional elements expressed in a message, such as joy, sadness, surprise, etc.

[1335] "Layout" refers to the position and structure for arranging each message and design element within the message board.

[1336] "Design" refers to planning the design and layout that will create the overall appearance of the message board.

[1337] A "message book" is a document or image that compiles multiple messages into a single design or layout.

[1338] "Digital format" means a format that can be stored and displayed electronically, such as PNG, PDF, JPEG, etc.

[1339] "Materials" are the physical items, such as the actual paper or card, that are printed on.

[1340] "Printing" is the act of transferring a digital message onto a physical material.

[1341] "Delivery" refers to the act of delivering the printed message book to the specified address.

[1342] This invention relates to a system that uses the message function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. This system significantly reduces the time and effort required to create a message collection while maintaining the convenience of remittance, allowing people to easily convey their congratulations online.

[1343] System Configuration and Functions

[1344] This system consists of a server, user terminals, and external systems that link with print delivery services as needed. The server manages message reception, analysis, layout and design selection, message collection generation, digital provision, printing, and delivery.

[1345] Specific hardware and software configurations

[1346] The server hardware used was a standard web server, running server software such as the Ubuntu OS and Apache Tomcat, and a Python environment.

[1347] The analysis module uses natural language processing techniques to extract keywords and sentiment from messages using Python libraries such as NLTK and SpaCy, and then uses generative AI models (TensorFlow and PyTorch) to select layout and design based on the extracted data.

[1348] They also use graphics generation libraries such as Adobe Creative Cloud API to select designs, and libraries such as Pillow and SVG to save the final message board in digital format.

[1349] Specific examples

[1350] Example 1: Generating a graduation message

[1351] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[1352] 2. The server receives the message and extracts the keywords "graduation," "congratulations," and "achievement."

[1353] 3. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[1354] 4. A digital message board is provided to the user, who then selects the option to print it on physical material after reviewing it.

[1355] Example 2: Generating a birthday message

[1356] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[1357] 2. The server receives the message and extracts the keywords "Birthday," "Happy Birthday," and "Happy New Year."

[1358] 3. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[1359] 4. A digital message board is provided to the user, who then selects the option to print it on actual material after reviewing it.

[1360] This invention makes it easy to create a message book online, allowing users to easily convey their congratulations and gratitude. The generated message book is saved in digital format, making it easy to share and save on multiple devices. It also works with external printing and delivery services, making it easy to distribute physical message books.

[1361] Prompt Sentence Examples

[1362] "The user types, 'Congratulations on your graduation! I wish you success in your new stage,' and sends the money."

[1363] "Happy birthday! Wishing you a wonderful year."

[1364] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1365] Step 1:

[1366] The user enters a congratulatory message into the message input field of the online money transfer service and sends money. For example, the user might enter "Happy birthday! I hope you have a wonderful year." The device then sends this message data to the server.

[1367] Input: The message entered by the user

[1368] Output: Message data sent to the server

[1369] Step 2:

[1370] The server receives messages sent by users, temporarily stores them in a database, and then passes the message data to the analysis module.

[1371] Input: Message data sent by the user

[1372] Output: Message data passed to the analysis module

[1373] Step 3:

[1374] The analysis module analyzes the message using natural language processing techniques. Specifically, it uses a Python NLP library (e.g., NLTK or SpaCy) to extract keywords and sentiment from the message. The extracted keywords and sentiment are returned to the server.

[1375] Input: Message data

[1376] Data processing: Extract keywords and sentiment using natural language processing

[1377] Output: Keywords and sentiment data

[1378] Step 4:

[1379] The server uses the keywords and sentiment data received from the analysis module to select the optimal layout and design using a generative AI model. To do this, it uses a machine learning framework (e.g., TensorFlow or PyTorch). The selected layout and design information is then passed on to the next step.

[1380] Input: Keywords and sentiment data

[1381] Data Computation: Layout and design selection with generative AI models

[1382] Output: Layout and design information

[1383] Step 5:

[1384] The server automatically generates the message board by placing the user's message based on the selected layout and design, using a graphics generation library (e.g., Pillow or SVG), and saves the generated message board in a digital format (e.g., PNG or PDF).

[1385] Input: Layout and design information, user messages

[1386] Data processing: Automatic generation of messages

[1387] Output: Digital message board

[1388] Step 6:

[1389] The server provides the generated message board in digital format to the user's terminal, where the user can preview the message board using the terminal's web browser and download it as needed.

[1390] Input: Digital message board

[1391] Output: Providing a digital message to the user's device

[1392] Step 7:

[1393] Users can view the digital message book and select the print option, after which the server will connect to the API of an external printing and delivery service to print the message book and arrange for it to be delivered to the specified address.

[1394] Input: User's print option selection

[1395] Data calculation: printing and delivery arrangements

[1396] Output: Instructions for printing and delivery services

[1397] (Application example 1)

[1398] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1399] Conventional online message book creation systems require users to input messages individually and manually select a design based on them, which is time-consuming and laborious. Furthermore, there is no automated message book generation system that works with remittance services, making it difficult to integrate remittances and message book creation. Furthermore, there is no means to efficiently generate message book designs using generative AI models. This makes it difficult for users to easily and quickly convey their feelings of gratitude and congratulations.

[1400] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1401] In this invention, the server includes means for receiving a message entered by a user when sending money using the message function of the online money transfer service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for generating a design for a message book using a generative AI model with a specific prompt sentence, means for automatically generating a message book based on the layout and design, means for providing the generated message book to the user in digital form, means for printing and delivering the digital message book on actual colored paper, and means for linking with an external printing and delivery service for physically storing the generated message book. This automates the process of creating a message book, making it possible to efficiently convey gratitude and congratulations at the same time as sending money.

[1402] An "online remittance service" is a service that allows sending and receiving money via the Internet.

[1403] "Message function" means a function that allows users to input and send text messages when transferring money.

[1404] "User" refers to any individual or legal entity that uses the Online Money Transfer Service.

[1405] A "message" is text information that a user enters when sending money.

[1406] "Means for receiving" is a function that allows the server to receive the message entered when the user remits money.

[1407] "Means of analysis" refers to the function of analyzing the content of a message and extracting keywords and emotions from it.

[1408] "Keywords" are specific words or phrases contained in a message that summarize the content of the message.

[1409] "Emotion" refers to the user's feelings and emotions that can be read from the message.

[1410] "Layout" refers to the design of the message board and the arrangement of its components.

[1411] "Design" refers to the visual style or theme of the message board.

[1412] A "message book" refers to the integration of multiple messages into a single document or design.

[1413] "Means for automatic generation" refers to a function that automatically creates a message board based on the analysis results.

[1414] "Digital format" means a format stored as electronic data.

[1415] The "means of providing" is a function that allows users to view and use the generated message board.

[1416] "Means for printing and delivering" refers to the function of printing the digital message board onto a physical medium and delivering it to a designated location.

[1417] A "prompt" is an instruction entered into a generative AI model to generate a design.

[1418] A "generative AI model" is a trained algorithm that uses artificial intelligence to perform a specific task.

[1419] "External printing and delivery service for physical storage" is a service that works in cooperation with an external printing and delivery company to print the generated message book and ship it to a specified address.

[1420] This invention relates to a method and system for automatically generating a message board based on the message entered by a user when sending money using an online money transfer service. The system mainly consists of a server, a user terminal, and an external system that cooperates with external printing and delivery services as needed.

[1421] System configuration and program processing

[1422] Server configuration and operation:

[1423] 1. Message receiving method:

[1424] The server receives a message entered by the user when transferring money using the message function of the online money transfer service.

[1425] The server passes this message to the analysis module.

[1426] 2. Message analysis methods:

[1427] The server uses natural language processing techniques (e.g., spaCy) to extract keywords and sentiment from the message.

[1428] For example, if a user inputs "Happy birthday! Have a wonderful year," the server extracts keywords such as "birthday," "congratulations," and "wonderful year."

[1429] 3. Layout and design selection methods:

[1430] Based on the extracted keywords and sentiment data, the server uses a generative AI model (e.g., OpenAI GPT model) to select the optimal layout and design.

[1431] Use prompts to instruct the AI ​​model and generate designs.

[1432] Example: "Happy birthday! Wishing you a wonderful year ahead."

[1433] 4. Automatic message generation method:

[1434] The server automatically generates a message book by arranging the user's message based on the selected layout and design.

[1435] The generated message board is saved in digital format.

[1436] 5. Digital Delivery Methods:

[1437] The server provides the generated message board in digital form to the user's terminal, where the user can view it.

[1438] 6. Printing and Delivery Methods:

[1439] If desired, the user can select a print and delivery option to physically store the actual message book, in which case the server will coordinate with an external print and delivery service to arrange for the message book to be printed and delivered.

[1440] Hardware and software used

[1441] Natural Language Processing: spaCy (depending on version, uses 'ja_core_news_sm' model)

[1442] Generative AI model: OpenAI GPT model

[1443] Image generation: Python Imaging Library (PIL)

[1444] API requests: the requests library

[1445] Examples of specific examples and prompts

[1446] Example 1: Generating a birthday message

[1447] The user enters a message such as "Happy birthday! I hope you have a wonderful year" and sends money.

[1448] The server receives the message and extracts the keywords "birthday," "congratulations," and "wonderful year."

[1449] Use prompts to instruct the AI ​​model to choose the right layout and design for your birthday celebration.

[1450] The prompt phrase "Happy birthday! I hope you have a wonderful year" is input into the generative AI model, and related designs are generated as a message book.

[1451] In this way, the present invention allows users to easily create a special message book when sending money, and efficiently convey feelings of gratitude or congratulations.

[1452] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1453] Step 1:

[1454] The user uses the message function of the online money transfer service to enter a message.

[1455] Input: A message that the user enters when sending money (e.g., "Happy Birthday! Wishing you a wonderful year!").

[1456] Output: The input message is sent to the server.

[1457] Step 2:

[1458] The server receives a message from the user using the message receiving means.

[1459] Input: The message entered by the user.

[1460] Output: The message data that is passed to the message parsing module.

[1461] Step 3:

[1462] The server uses a message analysis means to analyze the received message and extract keywords and emotions.

[1463] Input: Received message data.

[1464] Data processing: Analyze messages using natural language processing techniques (e.g., spaCy).

[1465] Specifically, the system analyzes the structure of the sentence and extracts keywords (e.g., "Birthday," "Congratulations," "Have a wonderful year") and emotions.

[1466] Output: Extracted keywords and sentiment data.

[1467] Step 4:

[1468] The server uses a generative AI model to generate prompts to select the optimal layout and design based on the keywords and emotions.

[1469] Input: Extracted keywords and sentiment data.

[1470] Data calculation: Generate prompt sentences using keywords and sentiment data (e.g., "Happy birthday! Wishing you a wonderful year").

[1471] Specifically, keywords and emotional information are combined to create appropriate instructions.

[1472] Output: The generated prompt statement.

[1473] Step 5:

[1474] The server uses a generative AI model to generate designs based on prompts and select the optimal layout.

[1475] Input: The generated prompt statement.

[1476] Data computation: Input the prompt statement into an AI model (e.g., OpenAI GPT model) to generate a design.

[1477] Specifically, the AI ​​analyzes the prompt text and outputs relevant design elements.

[1478] Output: Selected layout and design data.

[1479] Step 6:

[1480] The server automatically generates a message book based on the layout and design, arranging the user's message.

[1481] Input: Layout and design data, user messages.

[1482] Data processing: Place messages in a layout template and generate a message board using an image generation library (e.g., PIL).

[1483] Specifically, you specify the position and font of the message and arrange it to match the design.

[1484] Output: The generated digital image of the message board.

[1485] Step 7:

[1486] The server provides the digital message board to the user's terminal.

[1487] Input: The generated digital message.

[1488] Output: The digital message data is sent to the user's device for review.

[1489] Step 8:

[1490] The user can check the generated message book and, if necessary, select the option to print it on actual colored paper and have it delivered.

[1491] Input: Digital message data.

[1492] Output: Request data for printing and delivery.

[1493] Step 9:

[1494] The server uses the printing and delivery means to link with an external printing and delivery service, prints the message book, and delivers it to the specified address.

[1495] Input: Printing and delivery request data, digital message data.

[1496] Data processing: Sends data to the API of an external printing and delivery service to arrange printing and delivery.

[1497] Specifically, the message board image file is sent to an external service, and information such as the delivery address is also included in the request.

[1498] Output: The message is delivered to the address specified by the user.

[1499] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1500] This invention relates to a system that uses the messaging function of an online remittance service to analyze messages entered by users when sending money and automatically generates a message collection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide a more personalized message collection. This system allows users to easily send message collections online, significantly reducing the effort required to create a message collection.

[1501] System Configuration and Functions

[1502] This system consists of a server, user terminals, and external systems that link with the print delivery service as needed. The server manages message reception, analysis, emotion recognition, layout and design selection, message collection generation, digital provision, printing, and delivery.

[1503] 1. Receiving and parsing messages

[1504] When a user enters a congratulatory message into the message input field of an online money transfer service and sends it, the server receives the message and stores it in a database. The server's analysis module analyzes the stored message and extracts keywords and emotions. For example, from the message "Happy birthday! I hope you have a wonderful year," keywords such as "birthday," "congratulations," and "wonderful year" are extracted.

[1505] 2. Emotion Recognition by Emotion Engine

[1506] The server uses an emotion engine to analyze the emotion of messages entered by users in real time. The emotion engine classifies messages based on multiple emotion categories, such as positive, negative, and neutral, and extracts emotion data. For example, "Happy Birthday" is recognized as a positive emotion.

[1507] 3. Layout and design selection

[1508] The server selects the optimal layout and design based on the extracted keywords and emotion data. Based on the emotion engine data, it automatically selects design elements (such as color tones and illustrations) that accurately reflect the emotion. For example, for a message containing the keyword "birthday," a colorful design that conveys positive emotions and a design that includes illustrations of balloons will be selected.

[1509] 4. Generate a message board

[1510] The server automatically generates a message board based on the selected layout and design, arranging the user's message, and the message board is temporarily saved in digital format.

[1511] 5. Digital offerings and print options

[1512] The server provides the generated message book in digital format to the user's device, where the user can view it. If desired, the user can select the option to print it on actual colored paper and mail it. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[1513] Specific examples

[1514] Example 1: Generating a graduation message

[1515] 1. The user writes, "Congratulations on your graduation! I wish you success in your new stage," and transfers money.

[1516] 2. The server receives the message, and the analysis module extracts keywords such as "graduation," "congratulations," and "achievement."

[1517] 3. The emotion engine classifies the message as having a positive emotion.

[1518] 4. The server selects a layout and design suitable for a "graduation gift" and generates a message book.

[1519] 5. A digital message board is provided to the user, who can then review it and select the option to print it on actual colored paper.

[1520] Example 2: Generating a birthday message

[1521] 1. The user types "Happy birthday! I hope you have a wonderful year" and sends money.

[1522] 2. The server receives the message and the analysis module extracts keywords such as "Birthday," "Happy Birthday," and "Happy New Year."

[1523] 3. The emotion engine classifies the message as having a positive emotion.

[1524] 4. The server selects a design suitable for a "birthday celebration" that includes a colorful layout and an illustration of balloons, and generates a message book.

[1525] 5. A digital message board is provided to the user, who can then select the option to print it on actual colored paper after reviewing it.

[1526] This invention makes it easy to create online message boards, allowing users to easily convey their congratulations and gratitude. The introduction of an emotion engine allows for message boards that are more personalized in design and respond to emotions.

[1527] The processing flow will be explained below.

[1528] Step 1:

[1529] The user enters a congratulatory message in the message input field of the online money transfer service, specifies the amount to be transferred and the recipient, and presses the "Send" button.

[1530] Step 2:

[1531] The server receives the sent message and stores it in a database. The server manages the message by linking it to the remittance information.

[1532] Step 3:

[1533] The server passes the stored message to the analysis module, where the text data of the message is input to the analysis module.

[1534] Step 4:

[1535] The server's analysis module uses natural language processing technology to extract keywords and emotions from messages. For example, from the message "Congratulations on your graduation! Keep up the great work," keywords such as "graduation," "congratulations," and "good luck" are extracted.

[1536] Step 5:

[1537] The server passes the extracted keywords and emotion data to the emotion engine, which analyzes the emotion of the message in real time. The emotion engine classifies the message into emotion categories such as positive, negative, and neutral, and generates appropriate emotion data. For example, the emotion is determined to be positive.

[1538] Step 6:

[1539] The server uses an AI model to select the optimal layout and design based on emotion data and keywords. For example, for a "birthday" message, it selects a colorful and vibrant design to evoke positive emotions.

[1540] Step 7:

[1541] The server arranges the user's message based on the selected layout and design, automatically generating a message board, which is then saved in digital format.

[1542] Step 8:

[1543] The server sends a digital image of the generated message board to the user's terminal, where the user can check the displayed message board.

[1544] Step 9:

[1545] The user can check the digital message board and select the option to print it on actual colored paper if necessary. When selecting this option, an additional payment procedure is performed.

[1546] Step 10:

[1547] The server connects to an external system that provides printing and delivery services, and starts the process of printing the message on actual colored paper. The print data is sent to the external system.

[1548] Step 11:

[1549] The server tracks the progress of the delivery and notifies the user of the delivery status, for example by sending a confirmation email to the user after the item has been shipped.

[1550] Step 12:

[1551] Once the message book is delivered to the user, the server sends a feedback request to the user to collect evaluations of the service and suggestions for improvement.

[1552] In this way, the entire process from the user's message input to the final delivery of the message is designed to run smoothly. The introduction of the emotion engine allows for personalized design that reflects the emotional data of the message, providing users with a more refined service.

[1553] Example 2

[1554] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1555] Previous online trading services did not offer a way for users to easily create and send messages based on a specific theme. Creating messages manually also required a lot of time and effort, and it was difficult to select a design that accurately reflected the sentiments. This made it difficult for users to effectively convey their congratulations and gratitude.

[1556] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1557] In this invention, the server includes means for receiving messages entered by users at the time of transactions using the communication function of the online transaction service, means for analyzing the messages and extracting words and emotions from the messages, and means for selecting an optimal layout and design based on the words and emotions. This allows users to easily and automatically generate a message board based on a specific theme and provide it in a design that suits the emotions.

[1558] "Online trading service" refers to a service that allows users to conduct transactions via the Internet.

[1559] "Communication function" refers to the function that enables the system to send and receive data from users.

[1560] "Message" refers to the content of the message entered by the user during a transaction.

[1561] "Means for receiving" refers to the method and function by which the server receives messages sent by users.

[1562] "Means for analyzing" refers to the methods and functions by which the server extracts and analyzes the content of messages received.

[1563] "Words" refer to specific words extracted from the parsed message.

[1564] "Sentiment" refers to the emotional nuance or meaning of the analyzed message.

[1565] "Means for selecting optimal layout and design" refers to a method and function for selecting the most appropriate layout and visual design for the message board based on the extracted words and emotions.

[1566] "Means for automatic generation" refers to the method and function by which the system automatically creates a message board based on the selected layout and design.

[1567] "Digital format" refers to the format of information that is represented and handled as electronic data.

[1568] "Physical printing and delivery means" refers to the method and function of printing the digital message board onto physical paper and delivering it to a designated location.

[1569] This invention relates to a system that analyzes messages sent by users and automatically generates a collection of messages in an online transaction service. This system is mainly composed of a server, a user terminal, and an external system that cooperates with a print delivery service as needed.

[1570] The server receives messages entered by users when making transactions and stores them in a database. The server's analysis module then analyzes the stored messages and extracts important words and emotions. For example, from the message "Happy Birthday! Wishing you a wonderful year," the words "Birthday," "Congratulations," and "Wonderful Year" are extracted.

[1571] The server then uses an emotion engine to analyze the sentiment of the message in real time. The emotion engine categorizes the message into categories such as positive, negative, and neutral, and extracts emotional data. For example, "Happy Birthday" is recognized as a positive sentiment.

[1572] The server then selects the optimal layout and design based on the extracted words and emotion data. Based on the emotion engine's data, design elements (e.g., color tones and illustrations) that accurately reflect the emotion are automatically selected. For example, a message containing the word "birthday" might be matched with a colorful design and illustrations of balloons.

[1573] The server automatically generates a message book by arranging the user's message based on the selected layout and design. This message book is temporarily saved in digital format. The generated message book is provided in digital format to the user's device, where the user can view it. If necessary, the user can also select the option to print it on physical paper and have it mailed. In response to this request, the server connects with an external printing and delivery service to print the message book and deliver it to the specified address.

[1574] As a concrete example, consider the case where a user types and sends a message saying, "Congratulations on your graduation! Wishing you success in your new stage." The server receives this message, and the analysis module extracts words such as "graduation," "congratulations," and "success." The emotion engine classifies the message as having a positive emotion, and the server selects a layout and design appropriate for a "graduation celebration." A message book is generated and provided to the user in digital format. After reviewing this digital message book, the user can select the print option, and the physical message book will be printed and delivered.

[1575] Prompt Sentence Examples

[1576] When a user types and submits a graduation message, explain how the system parses it and generates a message of congratulations.

[1577] When a user types and submits a birthday message, explain how the system parses it and generates a message.

[1578] This invention allows users to easily create a message board online and send messages with designs that reflect their emotions. This system significantly simplifies the traditional, time-consuming process of creating a message board, making it possible to send messages of gratitude or congratulations more quickly and efficiently.

[1579] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1580] Step 1:

[1581] A user enters a message into the message input field of an online transaction service and presses the send button. The entered message is input data, and the server receives this message and stores it in a database. For example, a user enters and sends the message "Happy birthday! I hope you have a wonderful year." Based on this input, the server receives the message data and obtains the message stored in the database as its output.

[1582] Step 2:

[1583] The server's analysis module retrieves the saved message and performs analysis processing. The input data is the saved message, and the output is the words and emotions extracted from the message. Specifically, from the message "Happy birthday! I hope you have a wonderful year," the words "birthday," "congratulations," and "wonderful year" are extracted. This data processing results in a word list being output.

[1584] Step 3:

[1585] The server uses an emotion engine to perform emotion analysis of the message. The input data are the extracted words and the original message, and the output is emotion data of the message. The emotion engine classifies "Happy birthday! I hope you have a wonderful year" as a positive emotion and outputs positive emotion data.

[1586] Step 4:

[1587] The server selects the optimal layout and design based on the extracted words and emotion data. The input data is a word list and emotion data, and the output is the optimal layout and design information. For example, based on the word "birthday" and positive emotion, a colorful layout and design including an illustration of balloons is selected.

[1588] Step 5:

[1589] The server automatically generates a message book by arranging the user's message based on the selected layout and design. The input data is the layout and design information and the message, and the generated digital message book is obtained as output. The server arranges the message and generates the message book using a colorful layout and balloon illustration.

[1590] Step 6:

[1591] The server provides the generated message board in digital form to the user's terminal. The input data is the generated digital message board, and the message board displayed on the user's terminal is obtained as output. The user can check this digital message board.

[1592] Step 7:

[1593] If necessary, the user selects the option to print and mail the message book. The input data is the user's print request and delivery information, and the output is a physical message book that is printed and delivered. The server works with an external printing and delivery service to deliver the message book to the specified address.

[1594] In this way, users can easily and automatically generate a message board based on a specific theme online and provide it in a design that reflects their emotions.

[1595] (Application example 2)

[1596] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1597] Analyzing messages sent through online remittance services and creating personalized message cards is a time-consuming and tedious process using conventional methods. Furthermore, there are limited ways to easily create and print message cards in brick-and-mortar stores, making it less convenient for users. Furthermore, it is difficult to select a design and layout that accurately reflects the sentiment of the message, making it difficult to provide message cards that meet individual needs.

[1598] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving a message entered by a user when transferring money using the message function of an online remittance service, means for analyzing the message and extracting keywords and emotions from the message, means for selecting an optimal layout and design based on the keywords and emotions, means for automatically generating a message collection based on the layout and design, means for providing the generated message collection to the user in digital form, means for inputting a message using a smart device at a physical store and generating the message collection, and means for checking the generated message collection using a head-mounted display and printing it on an actual medium. This makes it possible to easily generate personalized message collections at online remittance services and physical stores and to check and print them immediately.

[1599] "Online Money Transfer Service" means an electronic service for transferring funds over the Internet.

[1600] The "message function" is a function that allows users to input a message by text or voice when transferring money online and send that message.

[1601] "Message entered by user when transferring funds" refers to words or sentences entered by a user using the message function of the online remittance service when transferring funds.

[1602] The "means for receiving a message" refers to a method or device by which the server receives and stores a message entered by a user.

[1603] The "means for analyzing a message and extracting keywords and emotions from the message" is a method or device for analyzing an input message using natural language processing techniques and isolating important keywords and emotions.

[1604] The "means for selecting the optimum layout and design" is a method or device for selecting the layout and design suitable for a message board based on the extracted keywords and emotions.

[1605] The "means for automatically generating a message board" is a method or device for automatically creating a message board by arranging a user's message based on a selected layout and design.

[1606] The "means for providing the generated message board to the user in a digital format" refers to a method or device for providing the generated message board to the user in an electronic data format.

[1607] A "brick and mortar store" is a physical store that sells goods and services.

[1608] "Smart device" is a general term for electronic devices that have internet connectivity and advanced computing capabilities.

[1609] A "head-mounted display" is a display device that is worn on the user's head and is a device that projects information into the user's field of vision.

[1610] "Means for checking the generated message board and printing it on an actual medium" refers to a method or device that allows a user to visually check the created digital message board and then print it on an actual medium such as paper.

[1611] "Natural language processing technology" is a technology that enables computers to understand, analyze, and generate the natural language that humans use on a daily basis.

[1612] An "emotion engine" is software or algorithms that recognize and classify emotions from input text or speech.

[1613] The present invention relates to a system for generating personalized messages by inputting messages from users in online remittance services and brick-and-mortar stores, analyzing the messages, and recognizing emotions.

[1614] System configuration

[1615] The system mainly consists of the following components:

[1616] 1. Server

[1617] 2. User Device

[1618] 3. Head-Mounted Display (HMD)

[1619] 4. Smart Devices

[1620] 5. Printing machine

[1621] What the program does

[1622] Message input and analysis

[1623] When a user uses an online money transfer service, they input a message. The message is received and stored by the server. In this process, the server converts the voice message into text using the Google Cloud Speech-to-Text API and analyzes the message using an NLP library (e.g., spaCy).

[1624] emotion recognition

[1625] The server uses a custom model with TensorFlow to analyze text messages and classify them into emotion categories such as positive, negative, and neutral, and also uses the Emotion Recognition API as an emotion engine.

[1626] Layout and design selection

[1627] Based on the keywords and emotion data, an optimal layout and design is selected, using a generative AI model to generate a design that best suits the user's emotion.

[1628] Automatic generation of message cards

[1629] Based on the selected layout and design, the server automatically generates the message board. During this process, each element is arranged digitally. The generated message board is temporarily stored as digital data on the server.

[1630] Provide and confirm with users

[1631] The generated message board is provided to the user in digital form, and the user can visually check the generated message board using a head-mounted display (e.g., Microsoft HoloLens).

[1632] Printing and Shipping

[1633] After the user confirms, the message can be printed on a physical medium. The server works with a printer to print the message and provide it to the user. Delivery services are also available if necessary.

[1634] Specific examples

[1635] Generate a graduation message

[1636] The user types and sends the message, "Congratulations on your graduation! I wish you success in your new stage." The server receives and analyzes the message. Based on the keywords and emotions extracted from the message, the server selects the optimal layout and design and generates a message board. This message board is visually presented to the user via the HMD, and after confirmation, it is printed on actual media by a printer.

[1637] Generate birthday greetings

[1638] The user types "Happy Birthday! Have a wonderful year!" and sends it. The server receives the message and analyzes it in the same way. Because the emotion engine recognizes it as a positive emotion, the server selects a colorful design and generates a message card. This message card is also presented visually on the HMD, and the user can print it out after checking it.

[1639] As described above, the system of the present invention makes it possible to easily create personalized message cards online and in physical stores, and to instantly check and print them.

[1640] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1641] Step 1:

[1642] A user wears a head-mounted display (HMD) and inputs a message to generate a message board.

[1643] Specifically, the user inputs a text or voice message on the interface of the online remittance service, which is then sent to the server via the HMD.

[1644] Input: User's message (text or voice)

[1645] Output: Message data sent to the server

[1646] Step 2:

[1647] The server receives the message, transcribes it, and parses it.

[1648] Specifically, the server converts the voice message into text using the Google Cloud Speech-to-Text API, and then uses an NLP library (e.g., spaCy) to extract keywords and sentiment from the message. This process identifies the keywords and sentiment of the message.

[1649] Input: Message data sent to the server

[1650] Output: Translated message, extracted keywords and sentiment data

[1651] Step 3:

[1652] The server selects the optimal layout and design based on the extracted keywords and emotion data.

[1653] Specifically, a generative AI model is used to automatically generate a design and layout for a message card that best suits the emotional data. A prompt sentence is input into the generative AI model to obtain appropriate design elements.

[1654] Input: Translated message, extracted keywords and sentiment data

[1655] Output: Selected layout and design data

[1656] Step 4:

[1657] The server automatically generates a message card based on the selected layout and design.

[1658] Specifically, a message card template is created based on the design elements obtained in the preprocessing, and the message is then appropriately arranged to generate the final digital message card. This generated message card is temporarily saved as digital data.

[1659] Input: Selected layout and design data

[1660] Output: Automatically generated digital data of messages

[1661] Step 5:

[1662] The server provides the generated digital data of the message board to the user, who visually checks it through a head-mounted display.

[1663] Specifically, the digital data of the generated message board is sent to the HMD, where the user can visually check it, confirming the content and design of the message board and making any necessary corrections.

[1664] Input: Automatically generated digital data of messages

[1665] Output: A digital message displayed in the user's field of view

[1666] Step 6:

[1667] The user makes a final confirmation, and the server prints and delivers the message book on the actual medium.

[1668] Specifically, the user performs a final check through the HMD, and after confirming that there are no corrections required, the server sends the data to the printer to print the message book. The printed message book is provided to the user and can be delivered as needed.

[1669] Input: Verified digital message data

[1670] Output: The actual printed message

[1671] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1672] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1673] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1674] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1675] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1676] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1677] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1678] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, motorcycles, and other devices, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1679] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1680] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1681] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1682] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1683] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1684] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1685] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1686] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1687] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1688] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1689] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1690] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1691] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1692] The following is further disclosed regarding the above embodiment.

[1693] (Claim 1)

[1694] a means for receiving a message input by a user when remitting money using a message function of the online remittance service;

[1695] means for analyzing the message and extracting keywords and sentiments from the message;

[1696] means for selecting an optimal layout and design based on the keywords and emotions;

[1697] means for automatically generating a message card based on the layout and design;

[1698] A means for providing the generated message book to the user in a digital format;

[1699] A way to print and deliver digital messages on actual colored paper.

[1700] A system including:

[1701] (Claim 2)

[1702] 10. The system of claim 1, wherein the message book is automatically customized based on a particular theme in response to a user's message.

[1703] (Claim 3)

[1704] 10. The system of claim 1, wherein the analyzing means analyzes the sentiment of the message using natural language processing techniques.

[1705] "Example 1"

[1706] (Claim 1)

[1707] a means for receiving a message input by a user when remitting money using a message function of the online remittance service;

[1708] means for analyzing the message and extracting keywords and sentiments from the message;

[1709] A means for selecting an optimal layout and design based on the keywords and emotions;

[1710] means for automatically generating a message board based on the layout and design;

[1711] A means for providing the generated message book to the user in a digital format;

[1712] A means of printing and delivering digital messages on physical materials.

[1713] A system including:

[1714] (Claim 2)

[1715] 10. The system of claim 1, wherein the message book is automatically customized based on a particular theme in response to a user's message.

[1716] (Claim 3)

[1717] 10. The system of claim 1, wherein the analyzing means analyzes the sentiment of the message using natural language processing techniques.

[1718] "Application Example 1"

[1719] (Claim 1)

[1720] a means for receiving a message input by a user when remitting money using a message function of the online remittance service;

[1721] means for analyzing the message and extracting keywords and sentiments from the message;

[1722] means for selecting an optimal layout and design based on the keywords and emotions;

[1723] means for automatically generating a message card based on the layout and design;

[1724] A means for providing the generated message book to the user in a digital format;

[1725] A way to print and deliver digital messages on actual colored paper,

[1726] A means for generating a message board design using a generative AI model with a specific prompt;

[1727] A means to link with an external printing and delivery service to physically store the generated message books.

[1728] A system including:

[1729] (Claim 2)

[1730] 10. The system of claim 1, wherein the message book is automatically customized based on a particular theme in response to a user's message.

[1731] (Claim 3)

[1732] 10. The system of claim 1, wherein the analyzing means analyzes the sentiment of the message using natural language processing techniques.

[1733] "Example 2: Combining Emotion Engines"

[1734] (Claim 1)

[1735] A means for receiving messages entered by a user during a transaction using a communication function of the online transaction service;

[1736] means for analyzing the message and extracting words and sentiments of the message;

[1737] means for selecting an optimal layout and design based on the words and emotions;

[1738] means for automatically generating a message card based on the layout and design;

[1739] A means to provide the generated message book to users in digital format;

[1740] A means to print and deliver digital messages on paper,

[1741] A system including:

[1742] (Claim 2)

[1743] 10. The system of claim 1, wherein the message book is automatically customized based on a particular theme in response to the user's message.

[1744] (Claim 3)

[1745] 10. The system of claim 1, wherein the analyzing means analyzes the sentiment of the message using natural language processing techniques.

[1746] "Application example 2 when combining emotion engines"

[1747] (Claim 1)

[1748] a means for receiving a message input by a user when remitting money using a message function of the online remittance service;

[1749] means for analyzing the message and extracting keywords and sentiments from the message;

[1750] means for selecting an optimal layout and design based on the keywords and emotions;

[1751] means for automatically generating a message card based on the layout and design;

[1752] A means for providing the generated message book to the user in a digital format;

[1753] A means for inputting messages using a smart device in a physical store and generating a message book;

[1754] A means for checking the generated message board using a head-mounted display and printing it on an actual medium;

[1755] A system including:

[1756] (Claim 2)

[1757] 10. The system of claim 1, wherein the message book is automatically customized based on a particular theme in response to a user's message.

[1758] (Claim 3)

[1759] 10. The system of claim 1, wherein the analyzing means analyzes the sentiment of the message using natural language processing techniques.

[1760] (Claim 4)

[1761] The system of claim 1, wherein the user can visually check the generated message board using a head-mounted display at the physical store.

[1762] (Claim 5)

[1763] 10. The system of claim 1, wherein the generative AI model is used to customize the design and layout of the message board.

[1764] (Claim 6)

[1765] The system of claim 1, wherein a message board is generated based on a user message by inputting a prompt sentence. [Explanation of symbols]

[1766] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for receiving a message input by a user when remitting money using a message function of the online remittance service; means for analyzing the message and extracting keywords and sentiments from the message; means for selecting an optimal layout and design based on the keywords and emotions; means for automatically generating a message card based on the layout and design; A means for providing the generated message book to the user in a digital format; A way to print and deliver digital messages on actual colored paper. A system including:

2. The system of claim 1 , wherein the message book is automatically customized based on a particular theme in response to a user's message.

3. The system of claim 1 , wherein the analyzing means analyzes the sentiment of the message using natural language processing techniques.

Images