Picture book generation system

Abstract

This system not only allows users to read picture books, but also utilizes language during the process of creating them, thereby deepening their understanding of language and effectively reinforcing vocabulary. [Solution] A picture book generation system that generates picture books, It comprises a reception means, an image conversion means, a text generation means, an image generation means, and a text generation means. The aforementioned receiving means accepts zero or more words or phrases for each item. The imaging means uses the word or phrase to create a prompt to be used by the image generation means, The aforementioned cultural means uses the aforementioned words or phrases to create prompts for use by the text generation means, The preceding image generation means generates an image using a machine learning model with a prompt created by the imaging means. The text generation means generates text using a machine learning model with the prompt created by the text generation means. Create a picture book file containing one page, including images and text.

Description

Technical Field

[0001] The present invention relates to a picture book generation system and a picture book generation method specialized for children to deepen their understanding of language.

Background Art

[0002] As a picture book specialized for children to learn words, there is Patent Document 1. Patent Document 1 realizes providing a picture book that is likely to arouse the interest of infants and has a high vocabulary acquisition effect by changing objects such as people and animals that appear in the picture book according to the individual interests and vocabulary acquisition status of infants.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology of Patent Document 1, there is a base picture book, and words related to objects such as people and animals that appear in the picture book are changed according to the individual interests and vocabulary acquisition status of infants. Therefore, it is assumed that a picture book that is interesting and has a high vocabulary acquisition effect can be provided. However, since only words related to objects can be changed, there is a problem that it is difficult to remember some nouns, verbs, and adjectives. In addition, Patent Document 1 is targeted at infants who have difficulty operating to create picture books. Since the picture book production device automatically creates picture books from individual interests and vocabulary acquisition status, and infants themselves are not involved in picture book creation, it is not assumed that they will learn words during the process of creating picture books. There is a problem that it is difficult to obtain the learning effect of using words and deepening the understanding of words during the process of creating picture books.

[0005] This invention aims not only to enhance the reading experience of picture books, but also to deepen language comprehension and solidify vocabulary by utilizing language in the process of creating picture books. [Means for solving the problem]

[0006] To solve the above problems, the present invention provides a picture book generation system for generating picture books, It comprises a reception means, an image conversion means, a text generation means, an image generation means, and a text generation means. The aforementioned receiving means accepts zero or more words or phrases for each item. The imaging means uses the word or phrase to create a prompt to be used by the image generation means, The aforementioned cultural means uses the aforementioned words or phrases to create prompts for use by the text generation means, The preceding image generation means generates an image using a machine learning model with a prompt created by the imaging means. The text generation means generates text using a machine learning model with the prompt created by the text generation means. Create a picture book file containing one page, including images and text.

[0007] By using this configuration, The user simply enters or selects a word or phrase. Images and text using words are easily generated using machine learning. By reviewing the generated results and examining examples of word usage through images and text, we can enhance our understanding of the language. It can generate picture books page by page.

[0008] In a preferred embodiment of the present invention, the receiving means is A field that accepts words or phrases related to time. A field that accepts words or phrases related to places. A field that accepts a word or phrase related to the subject. A field that accepts words or phrases related to verbs. A field that accepts a word or phrase related to the object. It has the following five items.

[0009] This structure allows us to conjugate almost all nouns, verbs, adjectives, and adverbs. This leads to the acquisition of a diverse vocabulary. Furthermore, the minimum necessary information for creating the pages of the picture book can be transmitted to the image generation means and the text generation means.

[0010] In a preferred embodiment of the present invention, the picture book generation system further comprises a storage unit, The memory unit stores words or phrases, The initial registration method is via the user interface, Select a word or phrase.

[0011] This configuration allows even children unfamiliar with the operation to easily select a word or phrase simply by pressing a button.

[0012] In a preferred embodiment of the present invention, the picture book generation system further comprises a storage unit, The memory unit stores the picture book data, The picture book generation system further includes sharing means for sharing the picture book data with an external device or server.

[0013] This structure allows readers to read various books created by others, increasing their opportunities to encounter new words and naturally improving their vocabulary.

[0014] In a preferred embodiment of the present invention, the picture book generation system includes a regeneration means for creating a new picture book based on existing picture book data.

[0015] By structuring it this way, based on your favorite picture book, Without the difficulty of coming up with the entire story yourself, Words or phrases can be utilized while associating with one's own interests and imagination to create a picture book.

[0016] In a preferred form of the present invention, when creating the previous picture book data, the storage unit stores by associating the words or phrases received by the reception means with the previous picture book data. The regeneration means changes the words or phrases associated with the picture book data, and regenerates the picture book data, to have a function of changing the text or image included in the picture book data.

[0017] With such a configuration, based on a favorite book, by changing words or phrases, changing the characters in the picture book or changing the location, without the difficulty of thinking up all the stories oneself, words or phrases can be utilized while associating with imagination to create a picture book.

[0018] In a preferred form of the present invention, the regeneration means has a function for deleting or adding pages included in the picture book data.

[0019] With such a configuration, based on a favorite book, thinking about the continuation of the picture book or changing the development of the picture book, without the difficulty of thinking up all the stories oneself, words or phrases can be utilized while associating with imagination to create a picture book.

Advantages of the Invention

[0020] According to the present invention, by simply inputting or selecting words or phrases by the user, through images and texts automatically generated by machine learning, a picture book can be created while deepening the understanding of language. Furthermore, by recreating and sharing the picture books that have been created, creativity can be nurtured. It can improve the acquisition of diverse vocabulary and enhance learning effectiveness. [Brief explanation of the drawing]

[0021] [Figure 1] Block diagram of the picture book generation system of this embodiment [Figure 2] Hardware configuration diagram of the picture book generation system of this embodiment [Figure 3] Database design diagram for the storage unit of the picture book generation system of this embodiment. [Figure 4] Picture book generation flow of the picture book generation system of this embodiment [Figure 5] Picture book generation screen of the user terminal of the picture book generation system of this embodiment [Figure 6] Picture book sharing screen of the user terminal of the picture book sharing means of this embodiment [Figure 7] History screen of the user terminal in this embodiment [Modes for carrying out the invention]

[0022] The following description of a picture book generation system according to embodiments of the present invention will be explained with reference to the drawings. Note that the embodiments shown below are examples of the present invention, and the present invention is not limited to these embodiments; various configurations can be adopted.

[0023] This embodiment describes the configuration, operation, etc., of the picture book generation system, picture book generation device, and picture book generation program.

[0024] The picture book generation system consists of a computer device. The computer device includes processing units such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit), and storage devices such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive). The computer device can function as a picture book generation device by executing a picture book generation program stored in the storage device using its processing units. The picture book generation method is realized through processing by the computer device, including the picture book generation device.

[0025] In this embodiment, the picture book generation system provides a picture book as output in response to user input. User input is assumed to be information containing at least one word or phrase.

[0026] Figure 1 shows a block diagram of the picture book generation system in this embodiment. The picture book generation system comprises a picture book generation device 1 and a user terminal 2, which are connected via a communication network. Furthermore, the picture book generation device 1 is connected to a storage unit 3 by wire or wireless. These block diagrams are examples, and for example, if you want to isolate only the image generation function using an API, the image generation means 14, which is a component of the picture book generation device 1, may be constructed as a separate device.

[0027] Picture book generation device 1 comprises, as physical components, a receiving means 11 for receiving information transmitted from a user terminal, an imaging means 12 for creating image generation instructions, a text creation means 13 for creating text generation instructions, an image generation means 14, and a text generation means 15. The arrangement of these functional components is just an example, and it is sufficient that some of the functional configurations of picture book generation device 2 are configured to communicate with picture book generation device 2.

[0028] The user can transmit information containing at least one word or phrase via user terminal 3. User terminal 3 can transmit basic user information, including the user's name, email address, and password. User terminal 3 can display a screen for selecting a word or phrase, a screen for reviewing generated images and text, and the created picture book. Although only one user terminal 3 is shown in Figure 1, there may be multiple user terminals 3.

[0029] In generating images, the picture book generation device 2 receives user input information from the user terminal 3. The imaging means 12 creates a prompt using information that includes at least one word or phrase sent from the user terminal, and transmits the created prompt to the image generation means 14.

[0030] In generating the main text, the picture book generation device 2 receives user input information from the user terminal 3. The text generation means 13 creates a prompt using information that includes at least one word or phrase sent from the user terminal, and sends the created prompt to the main text generation means 15.

[0031] The picture book generation device 1 includes an image generation means 14 as a functional component. The image generation means 14 generates an image using a prompt transmitted from the imaging means 12 and transmits the generated image information to the user terminal 2 and the storage unit 3.

[0032] In this embodiment, the image generation means 14 is a machine learning model. The prompt received from the imaging means 12 is converted into an image by a machine learning model such as a neural network.

[0033] The picture book generation device 1 includes a text generation means 15 as a functional component. The text generation means 15 generates images using prompts transmitted from the text generation means 13 and transmits the generated text information to the user terminal 2 and the storage unit 3.

[0034] In this embodiment, the text generation means 15 is a machine learning model. The prompt received from the text formatting means 13 is formatted into text by a machine learning model such as a neural network.

[0035] Memory unit 3 contains user basic information data 31, which is a list of information such as username, email address, and password. Word / phrase data 32, which is a list of words or phrases created by the user for selecting words or phrases. Picture book data 33 is a list of picture books containing images and text generated by users. When creating images and text included in picture book data, a word / phrase data 34 linked to the picture book data is used to associate the input / selected words or phrases. Store it.

[0036] Figure 2 shows the hardware configuration diagram. The parts connected by lines indicate that communication is possible via wired or wireless connections.

[0037] The picture book generation device and memory unit 4 comprises a control device 41 and a memory device 42 as hardware components. In this embodiment, for example, the control device 41 can be a computer or microcontroller with a built-in CPU or GPU, and the memory device 42 can be an HDD or SSD.

[0038] The control device 41 executes a program related to the picture book generation device 1. The memory device 42 stores the data stored in the memory unit 3.

[0039] The user terminal 5 comprises a display device 51, an input device 52, a control device 53, and a storage device 54 as its hardware configuration. In this embodiment, for example, the display device 51 can be a monitor, a smartphone, etc., the input device 52 can be a mouse, keyboard, smartphone, etc., the control device 53 can be a processor such as a CPU, and the storage device 54 can be an HDD, SSD, etc.

[0040] The control device 53 executes the application. The storage device 54 stores information stored in cookies and cache.

[0041] Figure 3 shows an example of a database design in the storage unit 3.

[0042] User basic information data 31 stores, as an example, user ID, username, email address, and password. User ID is used as the primary key to manage information about the user.

[0043] In the word / phrase data 32, as an example, the word / phrase ID, word / phrase name, and item name are stored. The word / phrase ID is used as the primary key to manage information about the word / phrase.

[0044] The picture book data 33 stores the picture book ID, page number, user ID, picture book image path, and text. A composite key of the picture book ID and page ID is used as the primary key to manage data related to the pages of the picture book.

[0045] The word / phrase data 34 linked to the picture book data stores the picture book ID, page number, and word / phrase ID. This allows the original words and phrases to be linked when generating the picture book data.

[0046] Figure 4 shows an example of the picture book generation flow. First, the user terminal 2 transmits information containing at least one word or phrase, which is received by the receiving means 11. The picture book generation process is divided into an image generation flow and a text generation flow. In the image generation flow, the imaging means 12 uses information containing at least one word or phrase to create a prompt in the image generation means 14, the created prompt is sent to the image generation means 14, the image generation means 14 generates an image, and the generated image is sent to the user terminal 2. In the text generation flow, the text generation means 13 uses information containing at least one word or phrase to create a prompt in the text generation means 15, the created prompt is sent to the text generation means 15, the text generation means 15 generates the text, and the generated text is sent to the user terminal 2.

[0047] Figure 5 shows an example of the picture book generation screen on user terminal 2. The user inputs or selects appropriate words or phrases for each of the items 61-65 in fields 71-75.

[0048] Entry 61 is for words or phrases related to time. "When" is an example of an entry related to time.

[0049] Entry 62 is for words or phrases related to place. "Where" is an example of an entry related to place.

[0050] Item 63 is an entry for words or phrases related to the subject. "Who" is an example of an item related to the subject.

[0051] Entry 64 is an entry for a word or phrase related to an object. "What" is an example of an entry related to an object.

[0052] Entry 65 is for words or phrases related to verbs. "What happened?" is an example of an entry related to verbs.

[0053] Note that the arrangement of items 61-65 and 71-75 is just an example; for example, "Who" could be placed on the far left.

[0054] Button 81 generates an image and text based on the selected and entered words. When this button is pressed, an image and text are generated according to the flow shown in Figure 4 and sent from the picture book generation device 1 to the user terminal 2. The generated image is displayed on 91 and the generated text is displayed on 92.

[0055] Pressing 1001 will take you to the picture book generation screen for the previous page, pressing 1002 will take you to the picture book generation screen for the next page, and pressing 1003 will delete the current page.

[0056] Figure 6 shows an example of a picture book sharing method on user terminal 2.

[0057] Each picture book created by the user has a share button 101. When 101 is pressed, a dialog box like 102 appears on the screen of user terminal 2.

[0058] Each of the 102 elements consists of 1021, which displays the details of the selected picture book; 1022, which is an input field for the user ID of the person to share with; and 1023, which is a button to complete the sharing process.

[0059] By entering the user ID of the person you want to share with in field 1022 and pressing 1023, the picture book you want to share will be sent to the other user. The dialog box structure and picture book sharing method are just examples; you can also share using usernames or by posting the picture book to other users.

[0060] Figure 7 shows an example of a picture book regeneration method on user terminal 2. A button 103 for regenerating a picture book is located on the history list page of read picture books.

[0061] Pressing 103 will take you to the picture book generation screen shown in Figure 5. At this point, fields 71-75, 91, and 92 are already filled in based on data stored in memory unit 3. You can regenerate the picture book by changing the words or phrases entered in fields 71-75 to generate images and text, or by modifying the main text entered in field 92. The button layout and modification method shown here are merely examples.

[0062] Pressing 1003 allows you to delete an existing page, and pressing 1002 allows you to create a new page, enabling you to modify the content of the picture book or continue writing it. The placement and modification of these buttons are merely examples. [Explanation of Symbols]

[0063] 1 Picture book generation device 11. Reception methods 12. Image acquisition means 13 Book culture means 14 Image generation means 15 Text generation means 2 User terminals 3 Storage section 31. User Basic Information Data 32 words / phrases data 33 Picture book data 34. Word and phrase data linked to picture book data 4 Picture book generation device and memory unit 41 Control equipment 42 Storage devices 5. User terminals 51 Display equipment 52 Input devices 53 Control equipment 54 Storage devices 61 entries of words or phrases related to time 62 entries of words or phrases related to places 63 Items related to the subject: words or phrases 64. Items related to the object (words or phrases) 65 entries of words or phrases related to verbs 71 A form to select or enter words or phrases related to time. 72. A form to select or enter a word or phrase related to a place. 73. A form to select or enter a word or phrase related to the subject. 74. A form for selecting or entering a word or phrase related to the object. 75. A form to select or enter a word or phrase related to verbs. 81. Button to generate image and text. 91 Display section for image generation results 92 Display section for the text generation result 1001 Button to go to the previous page 1002 Button to proceed to the next page 1003 Button to delete the current page 101 A button that displays a dialog box for sharing picture books. 102 Dialogue for sharing picture books 1021 Shared picture book information 1022 Form to enter the user ID of the person you want to share with. 1023 Share picture book button 103 A button that transitions to the picture book generation screen in order to regenerate the picture book.

Claims

1. A picture book generation system that generates picture books, It comprises a reception means, an image conversion means, a text generation means, an image generation means, and a text generation means. The aforementioned receiving means accepts zero or more words or phrases for each item. The imaging means uses the word or phrase to create a prompt to be used by the image generation means, The aforementioned cultural means uses the aforementioned words or phrases to create prompts for use by the text generation means, The preceding image generation means generates an image using a machine learning model with a prompt created by the imaging means. The text generation means generates text using a machine learning model with the prompt created by the text generation means. This method is characterized by creating picture book data for one page, including images and text. Picture book generation system.

2. The aforementioned receiving means is A field that accepts words or phrases related to time. A field that accepts words or phrases related to places. A field that accepts a word or phrase related to the subject. A field that accepts words or phrases related to verbs. A field that accepts a word or phrase related to the object. It is characterized by having the following five items, The picture book generation system according to claim 1.

3. The aforementioned picture book generation system further comprises a memory unit, The memory unit stores words or phrases, The initial registration method is via the user interface, A feature characterized by selecting a word or phrase, The picture book generation system according to claim 1.

4. The aforementioned picture book generation system further comprises a memory unit, The memory unit stores the picture book data, The picture book generation system is further characterized by comprising sharing means for sharing the picture book data with an external device or server. The picture book generation system according to claim 1.

5. The aforementioned picture book generation system is characterized by comprising a regeneration means for creating a new picture book based on existing picture book data. The picture book generation system according to claim 1.

6. The memory unit stores the words or phrases received by the reception means in association with the picture book data for the first period when creating the picture book data for the first period. The regeneration means modifies the words or phrases associated with the picture book data, By regenerating the aforementioned picture book data, The system is characterized by having a function to modify the text or images included in the aforementioned picture book data. The picture book generation system according to claim 5.

7. The aforementioned regeneration means is The aforementioned picture book data is characterized by having a function to delete or add pages. The picture book generation system according to claim 5.

Images