Manga name generation device, manga name generation method, and manga name generation program

Abstract

To provide a Manga name generation system, method and program for computing relevance degrees among pieces of information contained in a Manga script on the basis of the script to allow even a beginner to create a Manga name.SOLUTION: A Manga name generation system is provided, comprising a reception unit for receiving input of a script related to generation of a Manga name, a generation unit for generating a Manga name defining a panel layout and text and image materials to be placed within panels included in the panel layout on the basis of the input script using generative AI, and an output unit for outputting the Manga name.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a system, method, and program for generating manga names using technologies such as AI based on the text material of a script. [Background technology]

[0002] A manga name is a rough outline of the background, speech bubbles, dialogue, character expressions or actions and their placement, panel layout, etc., that is drawn together before the manga is drawn on manga manuscript paper. In order to create a manga within a set number of pages, manga artists must rewrite the manga's story, how to develop that story, the distribution of dialogue, the placement of illustrations, etc. many times in advance.

[0003] In recent years, artificial intelligence technology has been utilized in a wide range of fields, and the manga industry in particular has been influenced by AI image generation technology, including generative AI, and AI text generation technology.

[0004] The comic data editing method disclosed in Patent Document 1 can generate comics that include movement and comics that include only still images. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-204290 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the manga generation system described in Patent Document 1 does not generate manga names, does not use generation AI or other technologies, and may be difficult to operate for users who have no experience creating manga. Furthermore, the learning model described in Patent Document 1 cannot automatically generate manga images based on text information contained in a script.

[0007] Therefore, the present invention has been made in consideration of the above problems, and aims to provide a manga name generation system that can generate manga names simply by inputting a script. [Means for solving the problem]

[0008] One embodiment of the present invention comprises a receiving unit that inputs a script for generating a manga name, a generating unit that uses a generation AI to generate a manga name based on the input script, with the frame layout and text and image materials to be placed within the frames contained within the frame layout defined, and an output unit that outputs the manga name.

[0009] The above-mentioned manga name generation system may further include a classification unit that classifies text material included in a script into one or more pieces of dialogue information and one or more pieces of non-dialogue information, a calculation unit that calculates a first information relevance indicating the degree of relevance between one or more pieces of dialogue information, and an arrangement unit that arranges the dialogue information and non-dialogue information classified by the classification unit within a frame, wherein the calculation unit calculates the first information relevance indicating the degree of relevance between one or more pieces of dialogue information that are consecutive in the script based on the order in which the dialogue information appears in accordance with the chronological order of the script, and the arrangement unit arranges the consecutive pieces of dialogue information within a frame as text material if the first information relevance is higher than a predetermined threshold. If the first information relevance is lower than a predetermined threshold, the placement unit may separate consecutive pieces of dialogue information and place them in the frames as text material. The calculation unit may calculate a second information relevance indicating the relevance between dialogue information and information other than dialogue that is consecutive in the script in accordance with the chronological order of the script, and the placement unit may place the information other than dialogue within a frame located in the dialogue information if the second information relevance is higher than a predetermined threshold. The calculation unit calculates a second information relevance indicating the degree of relevance between consecutive dialogue information in the script and information other than dialogue in accordance with the chronological order of the script, and the placement unit may place at least one of stage directions, onomatopoeia, scene description, and background description included in the information other than dialogue within the frame if the second information relevance is lower than a predetermined threshold. The generation unit may further include an image material generation unit that generates image material based on information other than dialogue within the frame, and the image material generation unit may generate character material based on information indicating the characteristics of the character from the information other than dialogue, thereby placing the character material within the frame as image material in accordance with the dialogue information. The image material generation unit may use morphological analysis to break down information contained in the frame other than dialogue, excluding character characteristics, and use each of the broken down words as keywords to generate images required for the manga name as image material, and the placement unit may place the image material in the frame. The generating unit may generate a manga name by rearranging frames according to a predetermined rule in accordance with the chronological order of the script and in accordance with the paragraphs in which dialogue information and non-dialogue information are located in the script. The output unit may output the manga name in an editable format based on an input from the user.

[0010] This is a manga name generation method in which a computer executes an input step in which a script for generating a manga name is input, a generation step in which a generation AI is used to generate a manga name based on the input script, with the frame layout and the text and image materials to be placed in the frames contained within the frame layout determined, and an output step in which the manga name is output.

[0011] This is a manga name generation program that executes an input function for inputting a script related to the generation of manga names into a computer, a generation function for using a generation AI to generate manga names with predetermined frame layouts and text and image materials to be placed within the frames contained within the frame layouts based on the input script, and an output function for outputting the manga names. [Effects of the Invention]

[0012] According to a manga name generation system according to an embodiment of the present invention, by inputting a script, a generation unit can generate and provide a manga name. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating a schematic configuration of an embodiment of the present invention. [Figure 2] 1 is a block diagram showing an example of the internal configuration of a manga name generation system according to an embodiment of the present invention. [Figure 3] FIG. 10 is a flowchart illustrating an example of a process for arranging information included in a script in a frame. [Figure 4] FIG. 10 is a diagram illustrating an example of a process for classifying information included in a script. [Figure 5] FIG. 10 is a diagram showing an example of an image in which information contained in a script is arranged in frames. [Figure 6] FIG. 10 is a flowchart illustrating an example of processing related to editing the size and rearrangement of frames. [Figure 7] 10A and 10B are diagrams showing an example of a processing result regarding frame size editing and rearrangement. [Figure 8] FIG. 10 is a diagram showing an example of image generation based on information to be arranged in a frame. [Figure 9] FIG. 10 is a diagram showing an example of generating a manga name based on information within each frame. [Figure 10] FIG. 10 is a flowchart showing an example of a user re-editing a manga name. [Figure 11] FIG. 10 is a diagram illustrating an example of an interface of the manga name generation system. DETAILED DESCRIPTION OF THE INVENTION

[0014] Below, an embodiment of the manga name generation system 100 will be described using each drawing. Note that the manga name generation system 100 is not limited to this embodiment. Also, some components that are not important for explanation will be omitted from each drawing.

[0015] Furthermore, the script according to this embodiment is not limited to headings, scene change instructions, characters, main text, cover, stage directions, and dialogue, but may also include information such as story titles, scene introductions, stage introductions, production effects, production instructions, and psychological descriptions of characters (hereinafter referred to as text material). As an example, a script may first include character descriptions of characters appearing in the script, and the story contained in the script is divided into scenes by chapter or story. Furthermore, each scene may include the dialogue of the characters in the scene, background descriptions, psychological descriptions, titles, production instructions, etc.

[0016] <Summary> 1 is a schematic diagram illustrating the configuration of one embodiment of the present invention. In this embodiment, a manga name generation system 100 is communicably connected to a user terminal 200 via the Internet NW. A user prepares in advance manga name generation materials including various text materials (for example, script information including at least one of information for describing characters, information for describing scenery, information for describing the character's psychology, sound effects, etc.; hereinafter, referred to as script information) on the user terminal 200, and inputs the materials into the manga name generation system 100 via the Internet NW to generate a manga name.

[0017] The manga name generation system 100 according to this embodiment can generate a manga name based on script information received from the user terminal 200. The manga name generation system 100 can also convert the manga name into a form that can be edited by the user, and transmit the resulting data to the user terminal 200. After the user re-edits the manga name on the user terminal 200, the edited manga name can be re-input into the manga name generation system 100, which then outputs the edited manga name.

[0018] The manga name generation system 100 can also generate a final draft of the manga from the edited manga name. The final draft of the manga according to this embodiment may contain more image and text materials than the manga name. For example, if the image material "galaxy" is included in the manga name, the manga name generation system 100 may re-edit this image material "galaxy" to make it a realistic "galaxy," and add beautiful stars, sparkling gaseous interstellar matter, etc. to the image material "galaxy" in the manga name. In other words, the manga name generation system 100 may generate supplementary materials based on the text and image materials included in the manga name and add them to the manga name to generate the final draft of the manga.

[0019] The user terminal 200 according to this embodiment is not limited to functions such as uploading information input by the user and downloading the manga name generated by the manga name generation system 100, and the user can also re-edit the manga name generated by the manga name generation system 100 on the user terminal 200. Furthermore, the implementation of the user terminal 200 is not limited to a personal computer, and may be a mobile terminal such as a smartphone (a so-called mobile phone) or a tablet.

[0020] The editing in this embodiment may be divided into multiple types depending on the editing target. When a user is editing output image material, the user may adjust the position, size, composition, character design, color, etc. of the image material on the user terminal 200. When a user is editing output text material, the user may adjust the position, size, font, character, color, etc. of the image material on the user terminal 200.

[0021] <Configuration> Next, the internal structure of the manga name generation system 100 will be described using Figure 2. The manga name generation system 100 according to this embodiment includes a receiving unit 110, a classification unit 121, a calculation unit 122, an arrangement unit 123, a generation unit 124 including an image material generation unit 125, a memory unit 126, and an output unit 130. The manga name generation system 100 is typically a computer system, and its functions are realized by a CPU (Central Processing Unit), a GPU (Central Processing Unit), etc. Note that Figure 2 is only an example, and the configuration of the manga name generation system 100 is not limited to that shown. Each functional unit of the manga name generation system 100 processes information to automatically generate a manga name based on script information received from a user terminal 200.

[0022] The receiving unit 110 can receive script information prepared in advance from the user terminal 200. Furthermore, the script information received from the user terminal 200 may be passed directly to the intermediate processing unit 120, or may be stored in the storage unit 126 as information for generating a manga name.

[0023] The intermediate processing unit 120 may include a classification unit 121, a calculation unit 122, an arrangement unit 123, a generation unit 124, an image material generation unit 125, and a storage unit 126. The intermediate processing unit 120 can generate a manga name based on the script information received from the user terminal 200. This will be explained in detail below.

[0024] The classification unit 121 can classify the script received from the user terminal 200 into dialogue information and non-dialogue information based on the characteristics of the text material. There may be three methods for classifying script information. First, the classification unit 121 may recognize and classify information within symbols that typically indicate dialogue in a script (e.g., quotation marks, double quotation marks, brackets, double brackets, parentheses, corner brackets, square brackets, angle brackets, etc.) as dialogue information. In this case, the remaining information may be classified as non-dialogue information. Furthermore, if a script contains psychological descriptions of characters, the symbols indicating psychological descriptions are typically displayed separately from dialogue. Therefore, the manga name generation system 100 may identify the symbols indicating psychological descriptions and extract the information within the symbols. Subsequently, the psychological descriptions may be classified as dialogue information or non-dialogue information based on pre-settings in the manga name generation system 100. For example, when psychological description is set as a type of dialogue information, if information indicating dialogue is shown in quotation marks (") and information indicating psychological description is shown in parentheses (()), the classification unit 121 does not determine the characteristics of the information enclosed in quotation marks and parentheses, and after detecting the quotation marks (") and parentheses (()), it may automatically treat the information contained within the parentheses as dialogue information, and treat the part not enclosed in parentheses as information other than dialogue.

[0025] Second, the classification unit 121 may classify the script information received from the user terminal 200 using machine learning. Specifically, the manga name generation system 100 may use dialogue information and non-dialogue information in a script prepared in advance as learning data and load the information into a learning model installed in the manga name generation system 100. In this case, when a script is input to the manga name generation system 100, the manga name generation system 100 may classify information enclosed in parentheses and information not enclosed in parentheses in the script as characteristics based on the learning results, thereby separating the information into dialogue information and non-dialogue information. Furthermore, the learning model may use whether or not information is enclosed in parentheses as learning data. In this embodiment, the characteristics of the information may include, but are not limited to, the presence or absence of a line break between each piece of information (for example, a line break between dialogue information and non-dialogue information), the use of symbols, etc.

[0026] Third, the classification unit 121 may classify information included in a script into spoken dialogue information and written information using morphological analysis. Furthermore, written language (written language) in this embodiment may refer to language commonly used in writing sentences or scripts, and spoken language (colloquial language) in this embodiment may refer to language commonly used in direct conversation with another person. For example, if a script received from the user terminal 200 includes the lines "My husband stopped by a convenience store on his way home from work, but it seemed he didn't buy anything" and "My husband stopped by a convenience store on his way home from work, but he didn't buy anything," the classification unit 121 may detect "mono no" and "yodatta" from "My husband stopped by a convenience store on his way home from work, but it seemed he didn't buy anything" and then compare them with data related to written language stored in the storage unit 126. If the keywords included in the sentence match the written language data stored in the storage unit 126, the classification unit 121 can treat "My husband stopped by a convenience store on his way home from work, but it seemed like he didn't buy anything" as information other than dialogue. Conversely, because "but" and "desu yo" are commonly used in colloquial speech, the classification unit 121 may detect "but" and "desu yo" from "My husband stopped by a convenience store on his way home from work, but he didn't buy anything" and then compare it with data related to colloquial speech stored in the storage unit 126. If the keywords match the colloquial speech data stored in the storage unit 126, the classification unit 121 can treat "My husband stopped by a convenience store on his way home from work, but he didn't buy anything" as dialogue information.

[0027] The calculation unit 122 can calculate a first information relevance indicating the information relevance between pieces of dialogue information, and a second information relevance indicating the information relevance between dialogue information and information other than dialogue. Furthermore, the objects for which the first information relevance and the second information relevance are calculated are those that are chronologically consecutive in the script information (i.e., the order in which the information appears in the script). Details will be explained below.

[0028] As an example, the calculation unit 122 can calculate the degree of relevance between pieces of information included in each paragraph by calculating a first information relevance and a second information relevance between each part through morphological analysis. As an example, the calculation unit 122 separates information included in the script using periods, exclamation marks, question marks, etc., and determines the end of a sentence. The calculation unit 122 may then classify consecutive sentences according to the order in which the lines appear as one set and break each sentence down into nouns, verbs, particles, auxiliary verbs, conjugated forms, etc. through morphological analysis. As an example, if sentences A, B, and C are consecutive chronologically in the script, the calculation unit 122 may classify sentences A and B as one set, and sentences B and C as another set. The calculation unit 122 may then treat each set as one unit, extract the morphemes (i.e., the smallest meaningful units in language) of the two sentences included in the set, and calculate the degree of relevance by detecting the presence or absence of related keywords. If the value is higher than a predetermined threshold, it can be determined that the relevance between the preceding and following sentences is relatively high. Conversely, if the value is lower than the predetermined threshold, it can be determined that the relevance to the preceding and following sentences is relatively low.

[0029] The method for setting a threshold for determining the degree of relevance is not limited, and the degree of relevance between contexts may be compared based on the presence or absence of characteristic words in divided contexts. As an example, between sentence A "Hey, you! Are you a subordinate of Yamata no Orochi?" and sentence B "What is Yamata no Orochi?", the two dialogues may be determined to be related because "Yamata no Orochi" appears as a noun in both dialogues. As another example, between sentence C "I want to be a subordinate of Yamata no Orochi!" and sentence D "I'm sleeping all the time," the characteristic words are different, so the degree of relevance between the contexts may be determined to be low.

[0030] After the calculation unit 122 calculates a first information relevance indicating the relevance between pieces of dialogue information and a second information relevance indicating the relevance between pieces of dialogue information and information other than dialogue, the placement unit 123 may place each text material within a frame generated by the generation unit 124 based on the result of comparing the first information relevance and the second information relevance with a predetermined threshold. Furthermore, if the first information relevance and the second information relevance are higher than the predetermined threshold, the relevance of the consecutive sentences (i.e., sentences forming a set) is high, and therefore the sentences may be placed within a single frame. Conversely, if the second information relevance is lower than the predetermined threshold, the relevance of the consecutive sentences is low, and therefore the set may be separated and the text materials may be placed within separate frames. The generation of frames and frame layout will be described below.

[0031] A frame in this embodiment represents each frame in a manga, and a frame layout may be the layout of a frame. The generation unit 124 can generate a manga name in which the frame layout, text material to be placed in the frame layout, and image material are determined based on the script received from the user terminal 200. The generation unit 124 may also include an image material generation unit 125 that generates an image suitable for the text material using a generation AI technology. The generation AI technology in this embodiment may be a conventional one.

[0032] In this embodiment, the generation unit 124 may generate a frame template of a predetermined size based on the manuscript paper size recommended for publishers, web pages, applications, etc. when submitting a manga. In this case, the generation unit 124 may divide the frame into four or six equal parts depending on the frame size, or each divided frame may be identical and the same size, but is not limited to these. The generation unit 124 can divide the generated frame template based on the manga genre and generate a four-frame or six-frame manga frame layout. The generation unit 124 may generate the spacing between frames (hereinafter referred to as margins) by changing its appearance depending on the manuscript paper size, but the generation unit 124 can also enlarge or reduce the margins according to editing instructions from the user.

[0033] The image material generation unit 125 is equipped with an image generation AI and can generate image material to be used in a manga based on text material included in each frame and information included in the script. The generation AI is an AI that can automatically generate images by inputting text that indicates the content of the target to be generated. The image material generation unit 125 may generate image material by, for example, inputting text material describing characters appearing in the manga included in the script into the image generation AI. The image material generation unit 125 may also accept input of image data of image material generated by a user and generate image material that matches the content of the text material based on that image data. As an example, if image data of a "quiet residential area" is input as image data and the sentence "People are rushing home in the rain with umbrellas" is input as text material, an image of people walking with umbrellas in a residential area in the rain may be generated.

[0034] The storage unit 126 is a storage medium that stores various information and programs required in the manga name generation system 100. The storage unit 126 may realize its functions using, for example, a hard disc drive (HDD), a solid state drive (SSD), flash memory, etc., but is not limited to these, and may also include flash memory, random access memory (RAM), read only memory (ROM), etc.

[0035] The storage unit 126 can store various types of information that can be used in the manga name generation system 100. For example, it may store each information relevance calculated by the calculation unit 122, the manga frames generated by the generation unit 124, the AI image materials generated by the image material generation unit 125, the manga names generated by the generation unit 124, etc., but is not limited to these, and the storage unit 126 may also store what is obtained after the user re-edits the manga names on the user terminal 200.

[0036] The output unit 130 can output a manga name with set specifications in which text material and image material are arranged within a frame. However, what is output to the output unit 130 is not limited to this, and it may output text material, image material, a manga frame having text material and image material, a manga frame having only text material before generating image material, etc.

[0037] The output unit 130 may output the final draft of the manga. After the manga name generation system 100 generates a manga name and transmits it to the user terminal 200, the user may input the manga name to an image generation AI installed in the manga name generation system 100 or to externally connected artificial intelligence application software. Next, the manga name generation system 100 may generate supplementary material based on the material included in the manga name and add it to the manga name to generate the final draft of the manga. As an example, if the manga name generation system 100 generates a manga name including non-dialogue information 1 "The wind is blowing strongly" and non-dialogue information 2 "A person is walking in heavy snow," the user may re-edit the manga name template, specifications, etc. on the user terminal 200 and then input the manga name including non-dialogue information 1 "The wind is blowing strongly" and non-dialogue information 2 "A person is walking in heavy snow" to an image generation AI installed in the manga name generation system 100 or to externally connected artificial intelligence application software. Here, the image generation AI installed in the manga name generation system 100 or externally connected artificial intelligence application software, etc., may detect non-dialogue information 1 "The wind is blowing strongly" and non-dialogue information 2 "A person is walking in heavy snow" contained in the edited manga name, and generate image material related to non-dialogue information 1 "The wind is blowing strongly" (for example, leaves swaying while trees sway and make noise) and image material related to non-dialogue information 2 "A person is walking in heavy snow" (for example, footprints on the snow-covered ground), and add these to the manga name as supplementary material, thereby generating the final draft of the manga.

[0038] <Example of operation and display screen> Next, an embodiment of the manga name generation system 100 will be described based on a flowchart, sample drawings, etc. Fig. 3 shows an example of an operation for classifying information contained in a script into dialogue information and non-dialogue information and arranging the information in frames after receiving the script from the user terminal 200, but the classification method and arrangement procedure are not limited to this.

[0039] First, the manga name generation system 100 receives script information from the user terminal 200 (S101). In this embodiment, the information is not limited to script information, and may include short stories, full-length novels, essays, etc. Furthermore, the information included in the script information may be text material. Thereafter, the classification unit 121 classifies the script information received from the user terminal 200 into dialogue information and non-dialogue information according to the characteristics of the information (S102).

[0040] Thereafter, the calculation unit 122 calculates a first information relevance between pieces of dialogue information that are consecutive in chronological order in the script, and a second information relevance between the dialogue information and information other than dialogue, and proceeds to the next step (S103). Finally, the placement unit 123 places the text material within the frame based on the first information relevance and the second information relevance (S104). After placing the text material within the frame, the placement unit 123 terminates some of the operations of the intermediate processing unit 120.

[0041] In addition, since there is a possibility that non-dialogue information and non-dialogue information may appear consecutively for several lines in chronological order in a script, in this case, the calculation unit 122 may separate each piece of non-dialogue information with a period, an exclamation mark, a question mark, or the like, and calculate a third information relevance indicating the degree of relevance between pieces of non-dialogue information that are consecutive in chronological order. The calculation method of the third information relevance is the same as the first information relevance and the second information relevance, and the placement unit 123 may determine whether each piece of text material related to the non-dialogue information is placed together in the same frame or in different frames based on the third information relevance. As an example, if non-dialogue information X, non-dialogue information Y, and non-dialogue information Z appear consecutively in a script, the calculation unit 122 may calculate the third information relevance between the non-dialogue information X and the non-dialogue information Y, and between the non-dialogue information Y and the non-dialogue information Z. If the third information relevance between the non-dialogue information X and the non-dialogue information Y is higher than a predetermined threshold and the third information relevance between the non-dialogue information Y and the non-dialogue information Z is lower than a predetermined threshold, the arrangement unit 123 may arrange the non-dialogue information X and the non-dialogue information Y in the same frame and arrange the non-dialogue information Z in a separate frame. Alternatively, the calculation unit 122 may calculate the second information relevance with the preceding and following sentences by grouping several consecutive lines of non-dialogue information into one sentence (i.e., an information set of non-dialogue information). For example, if a script contains not only non-dialogue information X, non-dialogue information Y, and non-dialogue information Z, but also dialogue information O before the non-dialogue information X, the calculation unit 122 may treat the non-dialogue information X, non-dialogue information Y, and non-dialogue information Z in the script that continues for several lines as an information set that has a direct information-related relevance. In this case, the calculation unit 122 may calculate the second information relevance between the information set and the dialogue information O and compare it with a predetermined threshold. The placement unit 123 may place each piece of information within a frame based on the result of the comparison.

[0042] On the other hand, the method for calculating each information relevance is not limited to the above. The calculation unit 122 may divide a script into scenes and calculate the information relevance between pieces of information written in each scene as a unit. As an example, a script may include scenes 1, 2, and 3, and the calculation unit 122 may detect the keyword "scene" and then divide the script into "scene 1," "scene 2," and "scene 3." After calculating the information relevance between pieces of information included in each divided scene, the arrangement unit 123 may arrange the pieces of information included in each scene in a frame based on the information relevance between the pieces of information. In this case, since the information relevance between each scene is relatively high (i.e., one scene contains one story), the method of dividing the script into scenes and calculating the information relevance between pieces of information included in each scene is expected to reduce the amount of work required for calculation, compared to calculating the information relevance for the entire script.

[0043] 4 illustrates an example in which information included in a script is classified into dialogue information and non-dialogue information. A script example 400 may generally include at least one of a story title, character descriptions of characters appearing in the story, scenes for developing the story, stage directions, stage information, background information, dialogues, monologues, psychological descriptions between characters, and an ending. After receiving the script example 400 from the user terminal 200, the receiving unit 110 stores the script example 400 in the storage unit 126, and the classification unit 121 may classify the information included in the script example 400 into dialogue information example 410 and non-dialogue information example 420 based on the script example 400 stored in the storage unit 126.

[0044] The example dialogue information 410 may generally include speech of characters placed in the script, but is not limited to this, and may also include onomatopoeia that imitates the voices or actions of people or animals (for example, "boom" that imitates the sound of an explosion or an impact, or "mee-mee" that imitates the sound of a sheep), dialogue that depicts the character's psychology, etc.

[0045] Furthermore, the non-dialogue information example 420 may include information other than the dialogue information example 410 in the script example 400. In general, the non-dialogue information example 420 may include information such as the title of the story included in the script example 400, the clothing, hairstyle, and appearance of the characters appearing in the story, scenes for developing the story, stage directions, setting information, background information, and the like.

[0046] The method for distinguishing between dialogue information and non-dialogue information is not limited. The classification unit 121 may determine whether the information in the parentheses is dialogue information by detecting various types of parentheses (hereinafter referred to as a parenthetical detection method). Alternatively, the classification unit 121 may determine whether the information in the parentheses is dialogue information by analyzing the context of information contained in each scene or information contained in different scenes in the script information using morphological analysis. As an example, in the script example 400, a portion showing a character's psychological state is enclosed in parentheses. When the classification unit 121 detects parentheses, the information in the parentheses may be automatically recognized as a character's psychological state and may be classified as dialogue information. When the classification unit 121 detects parentheses, the information in the parentheses may be a character's remark or line. However, the classification unit 121 may also determine whether the information is dialogue information by analyzing the context of the sentence using morphological analysis based on the information contained in each scene (hereinafter referred to as a context analysis method).

[0047] On the other hand, when the classification unit 121 classifies information included in a script into dialogue information and non-dialogue information, both the parentheses detection method and the context analysis method may classify information about the person speaking the dialogue as non-dialogue information. As an example, if sentence E is written as "A: (I feel unmotivated yesterday and today.)", the classification unit 121 may classify the part "I feel unmotivated yesterday and today" as dialogue information using the parentheses detection method, but since "A:" is not enclosed in parentheses, there is a risk that it will be classified as non-dialogue information. Therefore, after classifying dialogue information and non-dialogue information, the classification unit 121 may detect whether or not there is a line break in the dialogue information. If there is a line break before or after the part where dialogue information is located, the entire part where dialogue information is located may be stored in the storage unit 126. In the above example, "A: (I feel unmotivated yesterday and today.)" may be stored in its entirety in the storage unit 126.

[0048] 5 shows an example of an operation for arranging dialogue information and non-dialogue information in a frame. The arrangement unit 123 according to this embodiment may classify each frame into a "dialogue frame 510," a "monologue frame 520," a "composite frame 530," and a "depiction frame 540" depending on the information arranged in the frame.

[0049] The "dialogue frame 510" according to this embodiment is a frame in which the text material arranged therein consists of a dialogue between two or more characters. If the first information relevance is higher than a predetermined threshold, the arrangement unit 123 may arrange consecutive lines of dialogue calculated based on the first information relevance as text material within the frame.

[0050] A "monologue-type frame 520" according to this embodiment refers to a frame in which the text material placed within the frame consists of a monologue by a single character or a psychological description that reveals the character's true feelings. If the first information relevance is lower than a predetermined threshold, the placement unit 123 may separate the consecutive pieces of dialogue used to calculate the first information relevance and place them in separate frames as text material. As an example, if three people are talking to each other in a script, the calculation unit 122 may separately calculate the first information relevance between Character A and Character B and the first information relevance between Character B and Character C. If, based on the results calculated by the calculation unit 122, the first information relevance between the dialogue information of Character A and Character B is higher than a predetermined threshold and the first information relevance between the dialogue information of Character B and Character C is lower than the predetermined threshold, the dialogue information of Character A and Character B may be placed within the frame as text material, and the dialogue information of Character C may be placed alone within another frame as text material.

[0051] A "composite frame 530" according to this embodiment is a frame in which the text material placed within the frame consists of a character's dialogue information and information other than dialogue. For example, in a script, a scene showing part of a story includes at least one of a scenic description, a psychological description, dialogue, etc., and if the second information relevance between dialogue information and non-dialogue information that are consecutive in chronological order in the script is higher than a predetermined threshold, the dialogue information and non-dialogue information may be placed together as text material within the frame. Furthermore, if the third information relevance, which indicates the information relevance between information other than dialogue, is higher than a predetermined threshold, the non-dialogue information that is consecutive in chronological order may be placed in the composite frame 530 together with the character's dialogue information.

[0052] A "depiction frame 540" according to this embodiment is a frame in which the text material placed within it consists solely of information other than dialogue. As an example, if the second information relevance between dialogue information and non-dialogue information that are consecutive in chronological order in the script is lower than a predetermined threshold, the dialogue information and non-dialogue information may be placed within the frame as text material. Also, if the third information relevance, which indicates the information relevance between information other than dialogue, is lower than a predetermined threshold, the consecutive non-dialogue information may be separated in chronological order and placed separately in the depiction frame 540.

[0053] The rules for arranging text material within a frame are not particularly limited, and an upper limit on the number of characters in the text material included in each frame may be set to make it easier for readers to read. Specifically, if the number of characters in the text material included in a frame is lower than a predetermined upper limit, the text material included in the frame is easier for readers to read, and the arrangement unit 123 does not need to rearrange the text material. Conversely, if the number of characters in the text material included in a frame is higher than the predetermined upper limit, the arrangement unit 123 may rearrange the existing text material by separating it with periods, exclamation marks, or question marks, to make it easier for readers to read the text material included in the frame.

[0054] For example, when dialogue information a, dialogue information b, dialogue information c, and non-dialogue information d, which are highly related and chronologically consecutive, are arranged in a frame, the calculation unit 122 can first calculate the number of characters included in each of dialogue information a, dialogue information b, dialogue information c, and non-dialogue information d, and then calculate the total number of characters of the information included in the frame. Next, the calculation unit 122 compares the total number of characters of the information arranged in the frame with a predetermined character limit. If the total number of characters is higher than the predetermined character limit, the calculation unit 122 calculates the difference between the total number of characters of the information arranged in the frame and the predetermined character limit, and then re-compares the difference with the predetermined character limit. If the difference is lower than the predetermined character limit, the calculation unit 122 may calculate the number of phrases in the information currently in the frame using periods, exclamation marks, and question marks. Alternatively, the arrangement unit 123 may divide the number of phrases evenly according to chronological order and arrange them in two frames, respectively. Conversely, if the difference value is higher than the predetermined upper limit of the number of characters, the difference value may be continuously compared with the predetermined upper limit of the number of characters, and a second difference value between the difference value and the predetermined upper limit of the number of characters may be calculated. The calculation unit 122 may repeatedly calculate the difference value, and if the final difference value is lower than the predetermined upper limit of the number of characters, the arrangement unit 123 may arrange the number of phrases in "calculation count + 1" frames in chronological order, but is not limited to this.

[0055] Figure 6 is an example of a flowchart showing the process of adjusting the size of each frame after placing each line of dialogue information and information other than dialogue within the frame, and the manga name generation system 100 of this embodiment is not limited to this.

[0056] First, the calculation unit 122 assigns a value to the amount of information contained in each frame based on the number of characters of information placed in each frame (S201). Then, the calculated amount of information placed in the frame is compared with a predetermined threshold (S202), and a determination is made as to whether the amount of information is higher than the predetermined threshold (S203). If the amount of information is higher than the predetermined threshold (YES in S203), the manga name generation system 100 increases the size of the frame so that the text material can fit within the frame (S204). Conversely, if the amount of information is lower than the predetermined threshold (NO in S203), the text material and image material already fit within the frame, so the manga name generation system 100 may decrease the size of the frame or leave it as is (S205). Next, the manga name generation system 100 acquires the frame after the size adjustment and stores it in the storage unit 126 (S206). The manga name generation system 100 then rearranges the frames after adjusting their size in chronological order according to the size of the manuscript paper (S207). The frame rearrangement method according to this embodiment is not limited, and the frames may be rearranged from top to bottom, in an S-shape from the top right to the bottom left, or according to a predetermined rule. Finally, the image material generation unit 125 has the image generation AI learn the dialogue information and non-dialogue information arranged within the frames to generate AI image material (S208). The generated AI image material may be inserted into the frame, and the size of the AI image material may be adjusted depending on the size of the frame.

[0057] The manga name generation system 100 can adjust the size of the frames according to a predetermined manga presentation method. Manga presentation methods may be divided into one-panel manga, four-panel manga, one-page manga, and one-shot manga. Figure 7 shows frames rearranged on manuscript paper 600 based on information contained in a script example 400, using a one-page manga as an example. After the classification unit 121 divides the information written in the script into multiple types of frames, the calculation unit 122 calculates the amount of information placed in each frame. The manga name generation system 100 can adjust the frame size based on the result of comparing the calculation result with a threshold. For example, if the information contained in frame 610 is higher than a predetermined threshold and the information contained in frame 620 is lower than the predetermined threshold, the size of frame 610 may be adjusted to be relatively larger and the size of frame 620 may be adjusted to be relatively smaller.

[0058] Furthermore, the generative AI of this embodiment can learn the patterns and relationships of various data contained in the script and generate possible AI image materials for use in manga name generation. For example, if the script contains the statement "A...lightning wraps around his body," the generative AI can automatically detect "lightning" and "wraps around his body" in the statement, generate an AI image related to "lightning" and an AI image having the state of "wraps around his body," and automatically generate a character whose body is wrapped around lightning. Furthermore, the image generation AI of this embodiment can learn the connections between character material and corresponding image material as training data based on image generation material (which may include character material and corresponding image material) uploaded to the manga name generation system 100 in advance. In this case, the more image generation material uploaded, the higher the accuracy of the generated image. Furthermore, the method of generating AI image material can be conventional.

[0059] Next, the image material generation unit 125 inputs the included information into the image generation AI according to this embodiment, and the image generation AI generates AI image material corresponding to each piece of information based on the information arranged in the frame. Figure 8 shows an example in which the image material generation unit 125 generates AI image material based on the information arranged in the frame. If a title 611, a scene 612, a setting 613, and a psychological description 614 are arranged in a frame 610, the image material generation unit 125 may use the above descriptions via the image generation AI to generate a title image material 615, a dialogue balloon material 616, and a setting 613 to generate a person image material 617 and a scene image material 618.

[0060] Furthermore, the image material generation unit 125 may generate different image materials depending on the type of information. As one example, when information indicating a title is input to the image generation AI, the image material generation unit 125 may modify the style, size, etc. of the title without changing the information included in the title, and place it at a predetermined position within the frame. As another example, when information indicating dialogue is input to the image generation AI, the image material generation unit 125 may generate speech bubbles or the like and place them around the person image without changing the dialogue information.

[0061] 9, the image material generation unit 125 may generate an editing frame 700 based on the information arranged in the frame, and then replace the editing frame 700 with the original frame 610. The manga name generation system 100 can generate a manga name by repeating the above-mentioned process of generating an AI image and the process of replacing frames.

[0062] Next, an example of a process for outputting edited data will be explained using Figure 10. Note that the operations in the following flowchart will be mainly performed by the user terminal 200, but operations such as data conversion and output of edited data may also be performed by each functional unit of the manga name generation system 100.

[0063] 10, the manga name generation system 100 converts the manga name into data that can be edited on the user terminal 200 (S301). The editable data according to this embodiment may be data that can be recognized by the user terminal 200, but is not limited to this, and may also be data that can be edited on an external manga homepage, manga app, manga system, etc.

[0064] After the manga name is converted, the output unit 130 of the manga name generation system 100 according to this embodiment outputs the converted manga name as converted data (S302). After the user checks the converted data on the user terminal 200 (S303), it determines whether the manga name generated by the manga name generation system 100 according to this embodiment needs to be re-edited (S304). If the converted data needs to be re-edited (YES in S304), the user may adjust information in the converted data on the user terminal 200 (S305). The adjustable information is not specified, and may include adjustment of the text material (e.g., the content of the text material, the number of characters, the character size, etc.), adjustment of the image material (e.g., the size and position of the image), and adjustment of the position or corresponding information of the speech bubble. After the converted data is edited, it is input to the manga name generation system 100 as edited data, and the final manga name may be output via the output unit 130 installed in the manga name generation system 100 (S306). Conversely, if there is no need to re-edit the converted data (NO in S304), the edited data may be directly re-input into the manga name generation system 100 as edited data, and the final manga name may be output via the output unit 130 installed in the manga name generation system 100 (S306).

[0065] FIG. 11 is a diagram showing an example of the interface of the comic name generation system 100. A user presses an import button 810 on the interface 800 of the comic name generation system 100 to upload previously prepared script information to the comic name generation system 100. In this embodiment, the user may input each scene included in the script to the comic name generation system 100. After receiving the input script information, the comic name generation system 100 may reflect the script information in the text display field 840. Then, information such as the paragraphs and setting located in the "scene" may be extracted from the script using context analysis or morphological analysis, and the information may be reflected in the location and time display field 820.

[0066] Furthermore, in order to generate a manga name suitable for the script, the user may input supplementary settings for generating the manga name into the manga name generation system 100 via the supplementary settings field 830 on the user terminal 200. In this case, the various supplementary settings input by the user may be simultaneously reflected in the production order display field. The supplementary settings according to this embodiment may include information such as character descriptions (e.g., character A is a demon king, character B is a villain), story development (e.g., character A and character B are in a fierce battle and the weather is getting worse), etc.

[0067] The manga name generation system 100 may then automatically extract information indicating the title using the above-mentioned morphological analysis or context analysis method and place it in the title field 850. Information included in the location and time display field 820 may also be automatically placed in the chapter and section field 860 of the manga name. Alternatively, the classification unit 121 included in the manga name generation system 100 may extract dialogue information from a script input by a user, and then the generation unit 124 may generate speech bubble materials 870 appropriate for the dialogue information and place them in the manga name. The position of the generated speech bubble materials 870 is not limited, and the manga name generation system 100 may detect a character image generated by the image generation AI, and then associate the dialogue information corresponding to that character in the script with the character image generated by the image generation AI to form a set.

[0068] Furthermore, the manga name generation system 100 may automatically place stage directions and supplemental settings included in the script in the information confirmation field 880. In this case, the user can determine whether or not to re-edit the script while checking the information confirmation field 880 on the user terminal 200.

[0069] The method for generating a manga name from a script is not limited to the method described in the above embodiment. Other methods may be used as long as they can generate a manga name or manga from a script. As an example, a learning model that has learned the correspondence between a script and images of a manga name to be generated based on the script may be prepared, and the manga name generation system 100 may be configured to input a new script into the learning model and generate a manga name. Alternatively, a learning model that has learned the correspondence between a script and images of a manga to be generated based on the script may be prepared, and the manga name generation system 100 may be configured to input a new script into the learning model and generate a manga.

[0070] The manga name generation system 100 may also include a learning unit (not shown) for generating the learning model, and may be configured to generate a learning model for each user. That is, by learning the correspondence between a script created by a user and the manga name or manga generated by the user based on the script, a learning model can be prepared that outputs a manga name or manga that suits the user's preferences. The learning unit can generate the learning model by performing learning using data that associates text data of the script with image data of the manga name or image data of the manga to be generated based on the script as training data. The learning unit can use existing algorithms to generate the learning model, such as, but not limited to, neural networks, support vector machines, variational autoencoders (VAEs), generative adversarial networks (GANs), and convolutional neural networks (CNNs).

[0071] Furthermore, a learning model may be prepared to realize part of the processing in the above-described process of generating a manga name or manga from a script. For example, a learning model for generating a manga from a generated manga name may be prepared, and the manga name generation system may utilize this learning model. The learning model for generating a manga from a manga name may be a model that has learned the correspondence between image data of the manga name and image data of the manga, and may be a model that outputs image data of the manga by inputting image data of the manga name (a manga name generated by the manga name generation system).

[0072] The manga name generation system may also have a function for accepting input of a script and, if the script is not in a format that the manga name generation system can convert into a manga name, converting the format of the input script into a format that is compatible with the manga name generation system, and a learning model may be used to realize this function. In this case, the learning model is a model that has learned the correspondence between a script written in a format that is incompatible with the manga name generation system and a script that has been modified to be compatible with the manga name generation system. By providing such a learning model, the manga name generation system can generate a manga name or manga even from a script written in a format that the manga name generation system cannot support.

[0073] Note that the operations shown in the above flowcharts are merely examples of the operations of the information processing device 1, and do not limit the order of processing. For example, specific processing may be performed in an order or at a timing different from the processing order in the flowcharts.

[0074] The above describes an embodiment of the present invention with reference to the drawings, but the specific configuration is not limited to this embodiment and may include various modifications within the scope of the present invention.

[0075] <Supplementary information> Although one embodiment of the comic name generation system 100 has been described, it goes without saying that the system is not limited to this embodiment. Various modifications and functions that can be implemented will be described below.

[0076] (1) In the above embodiment, the manga name generation system 100 may periodically collect information related to work production from the Internet network or personal devices to generate a work plan. The work plan may consider the possibility of creating a manga before the manga genre or manga summary is determined. As an example, the manga name generation system 100 may be connected to a large-scale language model (LLM). Information collected from the Internet network or personal devices may be input into the large-scale language model for learning, and a script may be automatically generated. Character designs may also be generated based on the information. In this case, the manga name generation system 100 may generate a manga name through the manga name generation function of this embodiment based on the script and character designs generated by the large-scale language model. Furthermore, the large-scale language model (LLM) may read the creative intention of the work indicated in the name, and the work may be generated using an image generation AI based on a diffusion model (i.e., a diffusion model).

[0077] (2) In the above embodiment, the manga name generation system 100 may have a function for automatically adjusting the relative positions of image and text materials included in the generated manga name. For example, if a frame contains multiple materials, the manga name generation system 100 calculates the distance between each material. The manga name generation system 100 may compare the distances between each material and adjust them to suit the size of the frame. Furthermore, after receiving a command from a user to adjust the position of a material, the manga name generation system 100 may adjust the design and overall layout within the manga name based on the user's personal preferences, etc.

[0078] (3) In the above embodiment, the manga name generation system 100 may analyze the input script information by pairing multiple items using a large-scale language model to divide the script. As an example, the manga name generation system 100 may divide the script information using characters and their appearance order, themes and messages, conflicts and their resolutions, genres and tones, etc., contained in the script information as dividing points. In this case, since there is a relationship between each divided part, manga names with a matching style may be generated based on the style of the divided parts.

[0079] (4) In the above embodiment, the manga name generation system 100 may generate a video based on the generated manga. As an example, the manga name generation system 100 may generate a final draft of the manga and then introduce the final draft of the manga to the video generation unit. The video generation unit may generate character movements based on the relevance of each frame in the final draft of the manga and visualize it. [Explanation of symbols]

[0080] 100 Manga Name Generation System 200 user terminals 110 Receiving unit 120 Intermediate Processing Section 121 Classification Department 122 Calculation Unit 123 Placement section 124 Generation part 125 Image material generation unit 130 Output section 400 script examples 410 Line information example 420 Examples of information other than dialogue 510 Interactive Panels 520 Monologue-type panel 530 Composite Top 540 Descriptive Frames 600 manuscript paper 611 titles 612 scenes 613 Stage 614 Psychological description 615 Title Image Material 616 dialogue balloons 617 People Images 618 Scene Image Materials 700 editing frames 800 Manga Name Generation System Interface 810 Introduction button 820 Location and time display column 830 Replenishment setting field 840 Text display field 850 Title Column 860 Chapter column 870 speech bubble material 880 Information confirmation column

Claims

1. a receiving unit for inputting a script related to the generation of a manga name; A generation unit that uses a generation AI to generate a manga name in which a frame layout, text material to be placed in a frame included in the frame layout, and image material are determined based on the input script; an output unit that outputs the manga name; Manga name generation system.

2. The manga name generation system includes: a classification unit that classifies the text material included in the script into one or more pieces of dialogue information and one or more pieces of non-dialogue information; a calculation unit that calculates a first information relevance degree indicating a relevance degree between one or more pieces of dialogue information; an arrangement unit that arranges the dialogue information and the non-dialogue information classified by the classification unit within the frame, The calculation unit calculating the first information relevance degree indicating the relevance degree between one or more pieces of consecutive line information in the script based on the order in which the line information appears in accordance with the chronological order of the script; The placement unit If the first information relevance is higher than a predetermined threshold, the continuous dialogue information is arranged in the frame as the text material.

2. The comic name generation system according to claim 1.

3. The placement unit If the first information relevance is lower than a predetermined threshold, the consecutive pieces of dialogue information are separated and arranged in the frames as the text material.

3. The comic name generation system according to claim 2.

4. The calculation unit calculating a second information relevance degree indicating a relevance degree between the dialogue information and the information other than the dialogue, which are consecutive in the script, in accordance with the chronological order of the script; The placement unit If the second information relevance is higher than a predetermined threshold, the information other than the dialogue is arranged in the frame located in the dialogue information.

4. The comic name generation system according to claim 3.

5. The calculation unit calculating the second information relevance degree indicating the relevance degree between the dialogue information and the information other than the dialogue, which are consecutive in the script, in accordance with the chronological order of the script; The placement unit If the second information relevance is lower than a predetermined threshold, at least one of stage directions, onomatopoeia, scenery description, and background description included in the information other than the dialogue is arranged in the frame.

5. The comic name generation system according to claim 4.

6. The generation unit an image material generating unit that generates the image material based on information other than the dialogue in the frame; The image material generation unit generates character material based on information indicating characteristics of the character from information other than the dialogue, and places the character material in the frame as the image material in accordance with the dialogue information.

6. The comic name generation system according to claim 5.

7. The image material generation unit The information other than the lines, excluding the characteristics of the characters, contained in the frame is decomposed by morphological analysis, and each decomposed word is used as a keyword to generate an image required for the manga name, and the image material is used as the image material. The placement unit Place the image material in the frame 7. The comic name generation system according to claim 6.

8. The generation unit The manga name is generated by rearranging the frames according to a predetermined rule in accordance with the chronological order of the script and the paragraphs in which the dialogue information and the information other than the dialogue are located in the script.

8. The comic name generation system according to claim 7.

9. The output unit The manga name is output in an editable format based on the input from the user.

2. The comic name generation system according to claim 1.

10. The computer an input step of inputting a script related to the generation of a manga name; a generating step of generating, using a generating AI, a manga name in which a frame layout, text material to be placed in a frame included in the frame layout, and image material are determined based on the input script; an output step of outputting the manga name; How to generate manga names.

11. On the computer, An input function for inputting a script related to the generation of a manga name; A generation function that uses a generation AI to generate a manga name that defines a frame layout and text and image materials to be placed in the frames included in the frame layout based on the input script; An output function for outputting the manga name is executed. Manga name generation program.

Images