Manga creation support system and manga creation support method

Abstract

To create a manga by a simple method.SOLUTION: A manga creation support system 1 includes a control device that executes: an illustration data setting process that sets illustration data being the data representing a content or features of illustrations that constitute one or more frames in a manga; a line data setting process that sets line data being the data representing the lines that constitute the frames; an image data acquisition process that acquires image data having the content or features of the illustration indicated by the set illustration data on the basis of the set illustration data; and a manga creation process that generates data of the manga on the basis of the acquired image data and the set line data.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a manga creation support system and a manga creation support method. [Background technology]

[0002] In recent years, the web advertising market has been on a growth trend, and web advertising is being used to announce a variety of content. Among these, advertisements in the form of manga (manga advertising) have a unique appeal and meet various needs. However, creating manga requires a certain level of skill. For example, Non-Patent Document 1 discloses a platform that allows the creation of manga advertising content by inputting certain information. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] "MANGAFIELD", [online], [Retrieved May 10, 2023], Internet (URL: https: / / lp.manga-field.net / ) Summary of the Invention [Problem to be solved by the invention]

[0004] However, such platforms require users to input prepared compositions (templates) and text contents (speech bubbles or comments) corresponding to the compositions, and the preparation of such data incurs a large cost. In addition, users must select a template to use from various templates proposed by the platform based on such data, and create and embed appropriate comments in the selected template. This work also requires a certain level of skill and time.

[0005] The present invention has been made in view of the above background, and has an object to provide a manga creation support system and a manga creation support method that enable manga to be created in a simple manner. [Means for solving the problem]

[0006] One of the present inventions for solving the above-mentioned problems is a manga creation support system that includes a control device that executes a picture data setting process that sets picture data, which is data representing the content or characteristics of the pictures that make up each of one or more frames in a manga, a dialogue data setting process that sets dialogue data, which is data representing the dialogue that makes up the frames, an image data acquisition process that acquires image data having the content or characteristics of the picture indicated by the set picture data based on the set picture data, and a manga creation process that generates data for the manga based on the acquired image data and the set dialogue data. Effect of the Invention

[0007] According to the present invention, manga can be created in a simple manner. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a manga creation support system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating an example of functions of the comic creation support device. [Diagram 3] FIG. 13 is a diagram showing an example of a drawing prohibition data list. [Figure 4] FIG. 2 is a diagram illustrating an example of functions of an image generating device. [Diagram 5] FIG. 2 is a diagram illustrating an example of hardware included in each information processing device in the manga creation support system. [Figure 6] FIG. 1 is a diagram for explaining an outline of a manga creation support process. [Figure 7] FIG. 13 is a diagram showing an example of a manga creation support screen. [Figure 8] FIG. 11 is a flow diagram illustrating details of a proofreading process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] The manga creation support system according to this embodiment automatically generates image data corresponding to an illustration based on information about the illustration of the manga specified by the user who is creating the manga. The manga creation support system generates manga data based on this generated image data and data of dialogue specified by the user.

[0011] Furthermore, this manga creation support system checks (proofreads) the generated manga data to see if it contains any images that are inappropriate in terms of copyright or social conventions, and corrects the manga data if necessary by editing such inappropriate images.

[0012] 1 is a diagram illustrating an example of the configuration of a manga creation support system 1 according to this embodiment. Manga creation support system 1 includes a user terminal 10, a manga creation support device 100, and an image generating device 200. These devices are connected to each other via a wired or wireless communication network 5, such as the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), or a dedicated line.

[0013] The user terminal 10 is an information processing device used by a user who creates a manga that includes pictures and dialogue.

[0014] Manga creation support device 100 is an information processing device that acquires image data corresponding to a picture from image generation device 200 based on instructions related to pictures and dialogue from user terminal 10, generates manga data based on the acquired image data and the dialogue data, and transmits the generated manga data to user terminal 10. Manga creation support device 100 also reviews the generated manga data to ensure that it does not contain any inappropriate images, and processes (corrects) the manga data as necessary.

[0015] The image generating device 200 is an information processing device that receives instructions for generating pictures (image data) from the comic creation support device 100 and generates the image data based on the received instructions. The image generating device 200 transmits the generated image data to the comic creation support device 100.

[0016] Next, FIG. 2 is a diagram for explaining an example of functions of the comics creation support device 100. As shown in FIG.

[0017] As shown in the figure, the manga production support device 100 stores a drawing prohibited data list 120, a user information DB 140, and an object detection model 160.

[0018] The drawing prohibited data list 120 is data that associates data (hereinafter referred to as prohibited object data) that represents inappropriate images (hereinafter referred to as prohibited objects) that are not permitted as images that make up a manga (for example, drawing targets such as people (including fictional characters), objects, or background patterns; hereinafter also referred to as objects) due to rights relationships, social conventions, etc., with data that indicates the reason why the object is not permitted (hereinafter referred to as prohibited reason data).

[0019] The user information DB 140 stores the manga data generated by the manga creation support device 100 in association with the user's ID.

[0020] The object detection model 160 receives image data and outputs information (text data or data in other formats) indicating an object depicted by the image data. The object detection model 160 is, for example, a neural network having an input layer to which an input value is input, one or more intermediate layers (hidden layers) that extract and output feature amounts of the image data from the input values, and an output layer that outputs information on the object from the feature amounts. Examples of the neural network include a convolution neural network (CNN) and a recurrent neural network (RNN). In addition to neural networks, a model that applies a support vector machine (SVM), a Bayesian network, or a regression tree may be adopted. The object detection model 160 is generated in advance by machine learning or the like. For example, the object detection model 160 is generated by learning the relationship between a plurality of image data and their correct answer data (data that identifies an object). Note that the object detection model 160 is not limited to such a learned model, and may be configured by a database, a template, or the like.

[0021] (Prohibited Data List) 3 is a diagram showing an example of the drawing prohibited data list 120. The drawing prohibited data list 120 has data items of prohibited object data 121 in which prohibited object data is set, reason 122 in which prohibition reason data for the prohibited object is set, and processing method 123 in which information specifying the processing (processing method) to be executed on image data related to the prohibited object is set.

[0022] The prohibited object data 121 may include, for example, text data representing the prohibited object (e.g., the name of a character, hereinafter referred to as prohibited text data), image data relating to the prohibited object (hereinafter referred to as prohibited image data), or information on the storage location of the image data (URL, etc.).

[0023] For example, information indicating the existence of a right holder having a specific right regarding the prohibited object is set in the reason 122. This right holder is, for example, a person other than the user, and if the user uses the image data related to the prohibited object without the consent of the right holder, it will be an infringement of the right. This right holder is, for example, a copyright holder.

[0024] In addition, in the reason 122, for example, information is set indicating that the contents of the prohibited object are against the user's policy or public order and morals.

[0025] In the processing method 123, for example, information specifying the processing method when processing image data of a prohibited object into image data of another object (a different object of the same kind or a different object) is set. This processing is, for example, processing to change the prohibited object into a different object of the same kind (for example, changing a person into a different person), processing to change the prohibited object into a different object of a different kind (for example, changing a person or object into another object or person), or processing to erase the prohibited object (to a plain background). Specifically, in the processing method 123, for example, information specifying the image data after processing is set.

[0026] Next, as shown in FIG. 2, the manga creation support device 100 has the following functional units (programs): a data transmission / reception unit 101, a picture data setting unit 102, a dialogue data setting unit 103, an image data acquisition unit 104, a manga creation unit 105, a manga display unit 106, a proofreading unit 107, and an object detection unit 108.

[0027] The data transmission / reception unit 101 controls communication between the user terminal 10 and the image generating device 200 .

[0028] The pictorial data setting unit 102 sets pictorial data which is data representing the contents or characteristics of a picture (object) constituting each of one or more frames in a manga. For example, the pictorial data setting unit 102 accepts input of pictorial data from the user terminal 10. The pictorial data may be in the form of text data or image data.

[0029] The dialogue data setting unit 103 sets dialogue data which is data representing dialogue constituting a frame. For example, the dialogue data setting unit 103 accepts input of dialogue data from the user terminal 10. In this embodiment, the dialogue data is in the form of text data, but it is not prevented from being in any other data format.

[0030] The image data acquisition unit 104 acquires, based on the pictorial data set by the pictorial data setting unit 102 , image data having the content or characteristics indicated by the pictorial data set by the pictorial data setting unit 102 from the image generating device 200 .

[0031] Manga creation unit 105 generates manga data based on the image data acquired by image data acquisition unit 104 and the dialogue data set by image data acquisition unit 104.

[0032] Manga display unit 106 receives input of picture data and dialogue data from user terminal 10, and displays a screen (hereinafter referred to as a manga creation support screen) that displays the contents of the manga data generated by manga creation unit 105, and the like.

[0033] The proofreading unit 107 identifies data (prohibited object data) that specifies images (prohibited objects) that are not permitted as images that make up a manga, and based on the identified data, determines whether or not the image data acquired by the image data acquisition unit 104 includes prohibited objects as images that make up a manga. If the proofreading unit 107 determines that the image data acquired by the image data acquisition unit 104 includes prohibited objects, it generates new manga data by performing a predetermined process on the data of the prohibited object portion of the image data acquired by the image data acquisition unit 104.

[0034] For example, the proofreading unit 107 acquires prohibited image data, which is image data of illustrations that are not permitted as illustrations constituting a manga, and determines whether the image data acquired by the image data acquisition unit 104 is identical to the prohibited image data based on the acquired prohibited image data, thereby determining whether the image data contains a prohibited object (automatic proofreading process).

[0035] Also, for example, proofreading unit 107 accepts input of prohibited area data from a user, which is data indicating a part or all of the area of ​​a picture constituting a manga, from among the areas of an image indicated by image data acquired by image data acquisition unit 104. Manga creation unit 105 then generates new manga data by applying a predetermined process to the data of the area indicated by the prohibited area data from among the areas of an image indicated by image data acquired by image data acquisition unit 104 (manual proofreading process).

[0036] Also, for example, the proofreading unit 107 calls a specified information processing system (for example, an Internet search system, a specified database), searches for image data managed by the information processing system, and displays the searched image data to present to the user.The proofreading unit 107 then accepts from the user designation of image data that includes a prohibited object among the acquired image data, and creates new manga data by performing a specified process on the data of the prohibited object portion indicated by the designated image data (search proofreading process).In this case, the proofreading unit 107 may also determine whether the searched image data corresponds to the data of the prohibited object, and if it determines that the searched image data corresponds to the data of the prohibited object, create new manga data by performing a specified process on the data of the prohibited object portion of the acquired image data.

[0037] The object detection unit 108 inputs image data specified by the user via the manga creation support device 100 to the object detection model 160, and outputs objects in the image data.

[0038] Next, FIG. 4 is a diagram for explaining an example of functions that the image generating device 200 has. First, the image generation device 200 stores an image generation model 220 .

[0039] Image generation model 220 receives data representing the content or characteristics of pictures in manga frames, along with additional data indicating the positions of the pictures in the manga frames, the relationships between the pictures, or onomatopoeia, mimetic words, or decorations for onomatopoeic words, and outputs image data having the content or characteristics indicated by the data and additional data.

[0040] In this embodiment, the image generation model 220 is a so-called image generation AI (Artificial Intelligence). The image generation model 220 may be a text-to-image model or an image-to-image model. That is, the input data of the image generation model 220 may be text data or image data. When the input data is text data, the image generation model 220 is configured, for example, by a text encoder and an image generator. The text encoder is a model that converts text into a vector consisting of features, and is, for example, a model based on a recurrent neural network (RNN) or a Transformer model. The image generator is a model that converts a vector into image data, and is, for example, a generative adversarial network (GAN) or a diffusion model. When the input data is image data, the image generation model 220 is configured, for example, by various types of generative adversarial networks (GAN) (for example, CGAN (ConditionalGAN)). Note that such a model configuration is an example, and the image generation model 220 includes any type of model having the above functions.

[0041] The image generation model 220 may have a function of receiving image data and a designation of a processing method for the image data, and generating new image data by processing the image data according to the processing method.

[0042] Next, the image generating device 200 has the functions (programs) of a data transmitting / receiving unit 201 and an image generating unit 202.

[0043] The data transmission / reception unit 201 controls communications between the user terminal 10 and the manga creation support device 100 .

[0044] The image generation unit 202 receives data including picture data related to pictures of comic frames and associated data specified from the user terminal 10 via the comic creation support device 100, and outputs image data by inputting the received data into the image generation model 220. The output image data is sent to the comic creation support device 100.

[0045] 5 is a diagram for explaining an example of hardware included in each information processing device (user terminal 10, manga creation support device 100, and image generating device 200) in manga creation support system 1. Each information processing device includes a control device 91 (processor) such as a CPU (Central Processing Unit), a main storage device 92 (memory) such as a RAM (Random Access Memory) or a ROM (Read Only Memory), an auxiliary storage device 93 such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive), an input device 94 including a keyboard, a mouse, a touch panel, or the like, an output device 95 for displaying a screen including a monitor (display), and a communication device 96 including a NIC (Network Interface Card), a wireless communication module, a USB (Universal Serial Interface) module, a serial communication module, or the like.

[0046] The functions of each information processing device are realized by the hardware of each information processing device, or by the control device 91 of each information processing device reading and executing each program stored in the main storage device 92 or the auxiliary storage device 93. In addition, these programs are stored in a storage device such as a secondary storage device, a non-volatile semiconductor memory, a hard disk drive, or an SSD, or a recording medium readable by the information processing device, such as an IC card, an SD card, or a DVD. Note that each information processing device may be realized in whole or in part using virtual information processing resources provided using a virtualization technology, a process space separation technology, or the like, such as a virtual server provided by a cloud system. In addition, all or in part of the functions provided by these devices may be realized by a service provided by a cloud system via an API (Application Programming Interface), for example. Next, the processes performed in the comic creation support system 1 will be described.

[0047] FIG. 6 is a diagram for explaining an outline of the comic creation support process carried out in the comic creation support system 1. As shown in FIG. FIG. 7 is a diagram showing an example of a manga creation support screen 700 displayed on the user terminal 10 or the like in the manga creation support system 1. As shown in FIG.

[0048] The manga creation support process is started, for example, when the manga creation support device 100 receives a predetermined execution instruction from the user terminal 10 of a user who wants to create a manga.

[0049] First, as shown in FIG. 6, the illustration data setting unit 102 of the manga creation support device 100 displays the manga creation support screen 700 on the user terminal 10 and accepts input of information about the illustrations of each frame in the manga (illustration data) from the user terminal 10 (s1).

[0050] Furthermore, the dialogue data setting unit 103 of the manga creation support device 100 causes the user terminal 10 to display the manga creation support screen 700, and accepts input of information about dialogue (dialogue data) for each frame in the manga, and the like, from the user terminal 10 (s3). Furthermore, the manga creation support device 100 accepts input of other data necessary for creating the manga from the user terminal 10.

[0051] 7, manga creation support screen 700 has a frame number designation field 710 that accepts designation of the number of frames of the manga from the user (user terminal 10; the same applies below), a manga definition designation field 720 that accepts designation of illustrations and dialogue for each frame that constitutes the manga from the user, and a send field 790 for instructing image generating device 200 to generate image data based on the information designated in frame number designation field 710 and manga definition designation field 720. Note that manga creation support screen 700 may also have a designation field (not shown) that accepts designation of the frame layout (arrangement of each frame) for the manga to be created from the user.

[0052] The manga definition specification field 720 has one or more frame definition fields 730, the number of which corresponds to the number of frames specified in the frame number specification field 710. Each frame definition field 730 has a premise image specification field 731, a drawing structure definition field 732, a comment definition field 733, a drawing style definition field 734, and a font specification field 735.

[0053] The premise image specification field 731 accepts specification of an image (hereinafter referred to as premise image, corresponding to pictorial data) that forms the basis of the content or characteristics of an image generated by the image generating device 200 from the user. The premise image is, for example, an image that characterizes each object or background pattern in a frame. The premise image specification field 731 is used, for example, when the image generation model 220 of the image generating device 200 is an image-to-image model.

[0054] The drawing structure definition field 732 accepts input of text such as sentences, words, symbols, or identifiers (i.e., input of pictorial data) from the user for specifying image data to be generated by the image generating device 200. In the drawing structure definition field 732, for example, attribute information of the object 736 to be drawn is set. The attribute is, for example, the name, type, shape, size, posture or direction, color, expression or surface of the object 736, onomatopoeia as a decorative expression (specifically, for example, onomatopoeia, mimetic word, decoration for onomatopoeic word, or convergent line, etc.), definition of the relationship between the objects 736, drawing position of the object, etc. These attribute information may include any information for specifying the content or style of the object constituting the manga. The drawing structure definition field 732 is used, for example, when the image generation model 220 of the image generating device 200 is a text-to-image model.

[0055] The comment definition field 733 receives from the user input of each object 737 corresponding to each object 736 defined in the drawing structure definition field 732 and text of the dialogue 738 associated with the object 737 (i.e., input of dialogue data). The comment definition field 733 may also receive from the user designation of the placement attributes of the dialogue within a frame (for example, the character size, position, or definition of vertical or horizontal writing, etc.) (not shown).

[0056] The drawing style definition field 734 receives specification of supplementary data for the picture data. That is, the drawing style definition field 734 receives specification of information indicating the overall characteristics of the picture in the corresponding frame from the user. This information is, for example, information that specifies the generation of a realistic image or a fantastical image.

[0057] The auxiliary data for the pictorial data may include other types of data, for example, data indicating the display format of a speech bubble surrounding a line of dialogue.

[0058] Furthermore, for example, the auxiliary data may include a parameter value (e.g., a seed value) that controls random number generation in generating image data in the image generation model 220. In this case, it is preferable that a common parameter value is set for each frame. Alternatively, it is preferable that the parameter value is adjusted automatically or by user specification to an appropriate value so that the image data of each frame generated by the image generating device 200 has common characteristics. By setting such parameter values, it is possible to maintain the consistency of the manga's style.

[0059] The font specification field 735 accepts the font specification of the text entered in the comment definition field 733 from the user.

[0060] Thereafter, as shown in FIG. 6, the image data acquisition unit 104 of the comic creation support device 100 transmits the picture data input in s1 and s3 and the associated data to the image generating device 200 (s5).

[0061] For example, when the image data acquisition unit 104 receives a specification from a user in the send field 790 of the manga creation support screen 700, it transmits to the image generating device 200 data including the data (picture data) inputted in the premise image specification field 731 or the drawing structure definition field 732 for each frame and the data (ancillary data) inputted in the drawing style definition field 734, etc.

[0062] After that, first, the image data acquisition unit 104 acquires the image data (image data of each frame) generated by the image generation device 200 from the image generation device 200 (s7).

[0063] Specifically, the image generation unit 202 of the image generation device 200 inputs data including picture data and additional data received from the comic creation support device 100 into the image generation model 220, and outputs image data having the content or characteristics indicated by the input data. Then, the image generation unit 202 transmits the output image data to the comic creation support device 100.

[0064] Manga creation unit 105 then generates manga data by combining the image data of each frame received in s7 with the dialogue data set in s3 (s9).

[0065] For example, for each frame, manga creation unit 105 overlays the dialogue indicated by the dialogue data set in s3 and a speech bubble surrounding the dialogue on the image data relating to that frame. More specifically, with regard to the dialogue data, manga creation unit 105 calculates the coordinates (area) of the dialogue in the image data based on the contents specified in comment definition field 733 and font specification field 735, and embeds the characters of the dialogue indicated by the dialogue data into the calculated coordinates (area).

[0066] Furthermore, regarding the speech bubble, manga creation unit 105 calculates the coordinates (area) of the speech bubble based on the coordinates of the text data of the dialogue calculated above, and embeds image data of the speech bubble in the calculated coordinates (area). Note that manga creation unit 105 may calculate the coordinates (area) of the speech bubble in the image data generated by image generating device 200 based on the contents specified in drawing structure definition field 732.

[0067] With regard to the lines or speech bubbles, the image generation model 220 itself may generate image data that draws the picture and the lines or speech bubbles based on the contents of the comment definition field 733 and the font specification field 735, etc.

[0068] Comic book creation unit 105 displays the contents of the comic book data generated in s9 (s11).

[0069] 7, manga creation support screen 700 has generated manga display field 740 which displays the contents of the manga. Generated manga display field 740 has one or more frame areas 750 in which the contents of the manga data for each frame generated in s9 are displayed.

[0070] A picture 751 (contents of image data) of each frame generated by the image generating device 200 is displayed in the frame area 750. Also displayed in the frame area 750 are a line 752 corresponding to the line 738 input in the comment definition field 733, and a speech bubble 753 surrounding the line 739. Also displayed is a background pattern 754 of the frame.

[0071] Thereafter, as shown in FIG. 6, the proofreading unit 107 executes a proofreading process s13 for correcting (processing) the manga data generated in s11.

[0072] Thereafter, the data transmitting / receiving unit 101 transmits the manga data processed in the proofreading process (s13) to the user terminal 10 (s15). This ends the manga creation support process.

[0073] Here, as shown in FIG. 7, the manga creation support screen 700 has, as interfaces for the proofreading process s13, a drawing prohibition list registration field 791 for registering prohibited image data, an automatic proofreading execution field 792 for accepting a designation from the user to execute an automatic proofreading process, a general image proofreading execution field 793 for accepting a designation from the user to execute a search proofreading process, and a manual proofreading execution field 794 for accepting a designation from the user to execute a manual image proofreading process.

[0074] <Review process> FIG. 8 is a flow diagram for explaining the details of the proofreading process s13.

[0075] When manga creation support screen 700 is displayed, proofreading unit 107 receives a selection of the type of processing to be executed (s130). Specifically, proofreading unit 107 receives a selection from the user of automatic proofreading execution field 792, general image proofreading execution field 793, or manual proofreading execution field 794 on manga creation support screen 700.

[0076] When the process to be executed is a search and review process (s130: search; for example, when the general image review execution field 793 is specified), the review unit 107 executes the process of s131.

[0077] If the process to be executed is an automatic proofreading process (s130: automatic; for example, when the automatic proofreading execution field 792 is specified), the proofreading unit 107 executes the process of s135.

[0078] If the process to be executed is manual image review (s130: manual; for example, when the manual review execution field 794 is specified), the review unit 107 executes the process of s140.

[0079] In s131, the proofreading unit 107 searches for image data from a predetermined information processing system. For example, the proofreading unit 107 uses image data of each frame in the manga data (hereinafter referred to as frame image data) or an object in the frame image data as a key to search for and acquire one or more image data related to the frame image data or the object from a predetermined Internet search system or database (a system that stores various image data or manages the location of the data).

[0080] Note that proofreading unit 107 recognizes objects in frame image data, for example, as follows. That is, proofreading unit 107 transmits the frame image data to image generating device 200. Image generating device 200 outputs information on objects constituting the frame image data by inputting the received frame image data to object detection model 160. Image generating device 200 transmits the output information on each object to proofreading unit 107.

[0081] The proofreading unit 107 identifies frame image data including the object to be processed based on the image data searched in s131 (s132).

[0082] For example, the proofreading unit 107 displays each piece of image data searched in s131 on the user terminal 10 to suggest to the user images that are not acceptable as manga images, while accepting designation of frame image data to be actually processed from all of the generated frame image data from the user terminal 10. Furthermore, the proofreading unit 107 searches whether or not each piece of image data searched in s131 is registered in the prohibited object data 121 of the drawing prohibited data list 120, and if found, the frame image data corresponding to that image data may be designated as the frame image data to be processed.

[0083] In addition, when text data (prohibited text data) is set in the prohibited object data 121 of the drawing prohibited data list 120, the proofreading unit 107, for example, obtains image data corresponding to the prohibited text data by querying a specified database or information processing system (search system) using the prohibited text data as a key.

[0084] If the proofreading unit 107 is able to identify the frame image data to be processed in s132, it processes that frame image data or the data of the object portion to be processed in that frame image data using a predetermined processing method (s133).

[0085] At this time, regarding the specification of the editing method, the proofreading unit 107 may accept a specification of the editing method from the user terminal 10. Furthermore, the proofreading unit 107 may specify the editing method by referring to the drawing prohibition data list 120.

[0086] Furthermore, with regard to the execution of the processing, the proofreading unit 107 may transmit instruction data including the frame image data to be processed and a designation of the processing method to the image generating device 200, and the image generating device 200 may process the frame image data in accordance with the instruction data and transmit the processed frame image data to the proofreading unit 107. Furthermore, the proofreading unit 107 may process the frame image data by starting a predetermined image editing program and accepting editing of the frame image data from the user terminal 10. Furthermore, the proofreading unit 107 may process the frame image data by starting a predetermined automatic image processing program.

[0087] The proofreading unit 107 updates the manga data with the frame image data processed in s133 (s134). This completes the proofreading process s13.

[0088] In s 135 , the proofreading unit 107 selects one of the pieces of prohibited data set in the prohibited data list 120 .

[0089] Furthermore, proofreading unit 107 recognizes each object in the image data of each frame in the manga data (frame image data) by, for example, processing similar to that described in s131 (s136).

[0090] The proofreading unit 107 searches whether the image data of each object recognized in s136 is registered in the drawing prohibited data list 120 (s137). For example, the proofreading unit 107 refers to the drawing prohibited data list 120 and searches whether the image data of each object recognized in s136 is registered in the drawing prohibited data list 120.

[0091] If the proofreading unit 107 is able to find image data registered in the drawing prohibited data list 120 in s137, it processes the frame image data in a predetermined processing method, similar to s133 (s138).

[0092] The proofreading unit 107 updates the manga data with the frame image data processed in s138 (s139).

[0093] The proofreading unit 107 executes the above-mentioned processes of s136-s139 for each piece of drawing prohibited data set in the drawing prohibited data list 120 (s140), after which the proofreading process s13 ends.

[0094] In s140, the proofreading unit 107 sets an area to be proofread among the areas of the illustrations in each frame of the manga. For example, the proofreading unit 107 receives a designation of a part or all of the area of ​​a frame drawn in the generated manga display field 740 from the user terminal 10.

[0095] The proofreading unit 107 processes the portion of the frame image data corresponding to the area set in s140 into another image, similar to s138 (s141).

[0096] The proofreading unit 107 updates the manga data with the frame image data processed in s141 (s142). This completes the proofreading process s13.

[0097] When editing an object in frame image data in the processes of s133, s138, and s141, the proofreading unit 107 may erase the dialogue data corresponding to that object.

[0098] As described above, the manga creation support system 1 of this embodiment sets picture data for each frame in a manga and dialogue data for the dialogue that makes up the frame, acquires image data having the content or characteristics of the picture indicated by the picture data based on the set picture data, and generates manga data based on the acquired image data and the set dialogue data.

[0099] In other words, the manga creation support system 1 of this embodiment can automatically generate a manga with dialogue using image data corresponding to such images, by setting picture data and dialogue data that represent the content or characteristics of the pictures in each frame of the manga.

[0100] In this way, according to the comic creation support system 1 of the present embodiment, a comic can be created in a simple manner.

[0101] In addition, when the manga creation support system 1 of this embodiment determines that the image data contains a prohibited object based on the prohibited object data, it generates new manga data by performing a predetermined process on the data for the prohibited object portion of the image data.

[0102] In this way, if the image data of the manga to be generated contains prohibited objects, those portions can be edited to create a manga with appropriate content.

[0103] For example, the comic book creation support system 1 of this embodiment determines, based on the prohibited text data, whether or not the illustration indicated by the image data is the same as the illustration indicated by the prohibited text data.

[0104] In this way, by specifying prohibited objects using text data, the prohibited objects can be easily removed from the generated manga data.

[0105] Furthermore, for example, the manga creation support system 1 of this embodiment accepts input of prohibited range data from a user indicating some or all of the areas of the illustrations that make up the manga within the area of ​​the image indicated by the image data, and generates new manga data by performing a predetermined process on the area of ​​the image indicated by the image data that is indicated by the prohibited range data.

[0106] In this way, by accepting the range of prohibited objects specified by the user, prohibited objects can be reliably removed from the generated manga data.

[0107] Furthermore, for example, the manga creation support system 1 of this embodiment searches for image data using a specified information processing system (such as a search site), displays the searched image data to the user, and also accepts designation from the user of image data that includes prohibited objects from among the acquired image data, and creates new manga data by performing specified processing on the data of the specified prohibited object portion.

[0108] In this way, image data retrieved from an external system is presented to the user, and the user's specification of image data that includes prohibited objects is accepted, and processing is performed on that portion of the image data, making it possible to appropriately set objects that should not be included in the manga based on the user's knowledge.

[0109] Furthermore, for example, the manga creation support system 1 of this embodiment searches for image data using a specified information processing system (such as a search site), and if it determines that the searched image data corresponds to data of a prohibited object based on the drawing prohibited data list 120, etc., it creates new manga data by performing a specified process on the data of the prohibited object portion of the image data.

[0110] In this manner, by automatically determining whether image data includes prohibited objects based on image data and a data list retrieved from a search system or the like, prohibited objects can be broadly identified.

[0111] Furthermore, in this embodiment, the drawing prohibited data list 120 associates data identifying prohibited objects with data indicating the processing method to be performed on the prohibited objects, and the manga creation support system 1 generates new manga data that has been processed as specified based on this drawing prohibited data list 120.

[0112] In this way, by processing image data based on the drawing prohibited data list 120 that associates prohibited objects with processing methods, data processing can be performed according to the properties of the prohibited objects.

[0113] Furthermore, in this embodiment, the drawing prohibited data list 120 associates data identifying a person who has certain rights regarding a prohibited object with data identifying the prohibited object, and the manga creation support system 1 determines whether the image data includes a prohibited object based on this drawing prohibited data list 120.

[0114] In this way, by making a judgment based on a prohibited object associated with a right holder (eg, copyright holder) regarding the prohibited object, it is possible to prevent the created manga from infringing the rights of others.

[0115] In addition, when the manga creation support system 1 of this embodiment determines that the image data contains a prohibited object, it generates new manga data in which the prohibited object portion of the image data is replaced with another object or erased.

[0116] This makes it possible to reliably create manga that does not contain inappropriate images.

[0117] In addition, the manga creation support system 1 of this embodiment acquires image data having the content or characteristics indicated by the pictorial data by inputting the pictorial data into an image generation model 220 which receives data representing the content or characteristics of the pictures that make up the panels in the manga and outputs image data having the content or characteristics indicated by the data.

[0118] This makes it easy to create the pictures (image data) that make up a manga.

[0119] Furthermore, the manga creation support system 1 of this embodiment inputs picture data together with data representing the content or characteristics of pictures in manga frames, as well as auxiliary data indicating the position of the pictures in the manga frames, the relationships between the pictures, or onomatopoeia, mimetic words, or decorations for onomatopoeic words, into an image generation model 220 which outputs image data having the content or characteristics indicated by the data and the auxiliary data, thereby acquiring image data having the content or characteristics indicated by each of the input data.

[0120] This makes it easy to create pictures (image data) with various characteristics that make up manga.

[0121] Moreover, the manga creation support system 1 of this embodiment accepts input of picture data from the user, and also accepts input of data representing dialogue that constitutes a panel from the user.

[0122] This allows users to easily create manga with content that they desire.

[0123] Furthermore, the comic creation support system 1 of this embodiment displays the contents of the generated comic data.

[0124] This allows the user to check the content of the manga they have created.

[0125] The above description of the embodiment is for the purpose of facilitating understanding of the present invention, and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit of the present invention, and the present invention includes equivalents thereof.

[0126] For example, some of the hardware included in each device of the present embodiment may be provided in another device. For example, the manga creation support device 100 and the image generating device 200 may be the same information processing device.

[0127] In addition, each program of each device may be provided in another device, a program may consist of multiple programs, or multiple programs may be integrated into one program. For example, the object detection unit 108 may be provided in the image generating device 200, or in another information processing device capable of communicating with the manga creation support device 100. [Explanation of symbols]

[0128] 1 Manga creation support system, 100 Manga creation support device, 200 Image generation device

Claims

1. A picture data setting process for setting picture data which is data representing the content or characteristics of pictures constituting one or more frames of a manga; a dialogue data setting process for setting dialogue data which is data representing dialogue constituting the frame; an image data acquisition process for acquiring image data having content or characteristics of a picture represented by the set picture data based on the set picture data; A manga creation process for generating data of the manga based on the acquired image data and the set dialogue data. A manga creation support system comprising a control device that executes the above.

2. The control device includes: a determination is made as to whether or not the acquired image data includes an image that is not acceptable as an image constituting a manga based on data that identifies an image that is not acceptable as an image constituting a manga, and if it is determined that the acquired image data includes an image that is not acceptable as an image constituting a manga, a proofreading process is performed to generate new manga data by performing a predetermined process on the data of the unacceptable image portion of the acquired image data; The comic book creation support system according to claim 1 .

3. In the proofreading process, the control device acquires prohibited image data, which is image data of illustrations that are not permitted as illustrations constituting a manga, and determines whether the acquired image data has identity with the prohibited image data based on the acquired prohibited image data, thereby determining whether the acquired image data includes an illustration that is not permitted as an illustration constituting a manga. The comic book creation support system according to claim 2 .

4. In the proofreading process, the control device acquires prohibited text data, which is text data indicating pictures that are not permitted as pictures constituting a manga, and determines whether the picture indicated by the acquired image data is identical to the picture indicated by the prohibited text data, based on the acquired prohibited text data, thereby determining whether the acquired image data includes a picture that is not permitted as a picture constituting a manga. The comic book creation support system according to claim 2 .

5. The control device includes: In the proofreading process, input of prohibited area data is received from a user, the prohibited area data being data indicating a part or all of an area of ​​a picture constituting a manga, from among the areas of an image indicated by the acquired image data; In the manga creation process, new manga data is generated by performing a predetermined process on the area of ​​the image represented by the acquired image data, the area being represented by the prohibited area data. The comic book creation support system according to claim 2 .

6. The control device includes: In the proofreading process, a specified information processing system is used to search for image data, and the searched image data is output. At the same time, a designation of image data that includes illustrations that are not acceptable as illustrations constituting a manga is accepted from among the acquired image data, and new manga data is created by performing a specified process on the data of the unacceptable illustrations indicated by the designated image data. The comic book creation support system according to claim 2 .

7. The control device includes: In the proofreading process, image data is searched for using a specified information processing system, and it is determined based on specified data whether the searched image data corresponds to data of an image that is not acceptable as an image constituting a manga, and if it is determined that the searched image data corresponds to data of an image that is not acceptable as an image constituting a manga, new manga data is created by performing specified processing on the data of the unacceptable image part of the acquired image data. The comic book creation support system according to claim 2 .

8. a storage device for storing a database in which data for identifying illustrations that are not permitted as illustrations constituting the manga is associated with data indicating a processing method to be applied to the illustrations; the control device, in the proofreading process, generates new manga data by performing processing specified based on the database on the data of the unacceptable illustration portion. The comic book creation support system according to claim 2 .

9. a storage device for storing a database in which data identifying a person who has a specific right with respect to an illustration that is not permitted as an illustration constituting the manga is associated with data identifying the illustration; the control device, in the proofreading process, determines, based on the database, whether the acquired image data includes an image that is not acceptable as an image constituting a manga; The comic book creation support system according to claim 2 .

10. The control device includes: If it is determined in the proofreading process that the acquired image data contains an image that is not acceptable as an image constituting a manga, the unacceptable image portion of the acquired image data is replaced with another image or deleted to generate new manga data. The comic book creation support system according to claim 2 .

11. a storage device that stores an image generation model that receives data representing the content or characteristics of pictures constituting a frame of a manga and outputs image data having the content or characteristics represented by the data; The control device includes: In the image data acquisition process, the pictorial data is input to the image generation model to acquire image data having content or characteristics indicated by the pictorial data. The comic book creation support system according to claim 1 .

12. the storage device stores an image generation model that receives data representing the content or characteristics of pictures in a frame of a manga, as well as additional data indicating the position of the pictures in the frame of the manga, the relationship between the pictures, or onomatopoeia, mimetic words, or decorations for onomatopoeia, and outputs image data having the content or characteristics indicated by the data and the additional data; The control device includes: In the image data acquisition process, data representing the content or characteristics of the illustrations in the frames of the manga, together with additional data representing the positions of the illustrations in the frames of the manga, the relationships between the illustrations, or onomatopoeia, mimetic words, or decorations for onomatopoeic words, are input to the image generation model, thereby acquiring image data having the content or characteristics represented by each of the input data. The comic book creation support system according to claim 11.

13. The control device includes: In the picture data setting process, input of the picture data is accepted from a user; In the dialogue data setting process, an input of the dialogue data is accepted from a user. The comic book creation support system according to claim 1 .

14. 2. The comic creation support system according to claim 1, wherein the control device displays the contents of the generated comic data in the comic creation process.

15. An information processing device, A picture data setting process for setting picture data which is data representing the content or characteristics of pictures constituting one or more frames of a manga; a dialogue data setting process for setting dialogue data which is data representing dialogue constituting the frame; an image data acquisition process for acquiring image data having content or characteristics of a picture represented by the set picture data based on the set picture data; A manga creation process for generating data of the manga based on the acquired image data and the set dialogue data. A method for assisting in the creation of manga.

Images