Character enlargement display system, method, and program for displaying manga images

Abstract

To provide a system, method and program for enlarging characters for manga images. [Solution] A system for enlarging and displaying text in a manga image, which displays a manga image including multiple text areas based on manga data representing the manga image, accepts information indicating a request for text enlargement based on user input, and upon accepting the information indicating the request for text enlargement, enlarges and displays each text area based on an enlargement value set for each of the multiple text areas represented by the manga data.

Description

[Technical Field]

[0001] The present invention relates to a system, method, and program for enlarging characters when displaying comic images. [Background technology]

[0002] 2. Description of the Related Art With the recent expansion of digital content usage, services have been provided that distribute manga content via the Internet and allow users to read manga using electronic devices such as smartphones. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-042719 Summary of the Invention [Problem to be solved by the invention]

[0004] In some cases, users may find the size of characters in comic images displayed on electronic devices inappropriate. For example, some users may find the characters too small. Furthermore, when a comic drawn in a specific language is translated into another language, the number of characters changes, and comic image data may be generated in which the size of characters in a speech bubble is inappropriate for the size of the speech bubble. [Means for solving the problem]

[0005] 1. The present invention has been made in consideration of the above-mentioned problems and has the following features. That is, a system according to one embodiment of the present invention is a system for enlarging and displaying characters in a manga image, which displays a manga image including multiple character regions based on manga data representing the manga image, accepts information indicating a request for character enlargement based on user input, and, upon accepting the information indicating the request for character enlargement, enlarges and displays each character region based on an enlargement value set for each of the multiple character regions represented by the manga data. Here, the system may include multiple electronic devices, or it may be a single electronic device.

[0006] 2. In the system of item 1, the enlargement value may be an enlargement ratio or an enlargement size.

[0007] 3. Also, in the system of paragraph 1 or 2, one or more of the character areas included in the plurality of character areas can be a character area group including two or more character areas that are displayed separately when displayed in the comic image.

[0008] 4. In the system of item 3, the plurality of character areas included in the character area group may be character areas of the same frame or page.

[0009] 5. In the system of any one of clauses 1 to 4, the information indicating a character enlargement request based on the user input includes a specified enlargement value, and the enlargement value includes a maximum enlargement value indicating the maximum value allowed for enlarged display, and enlarging and displaying each character area means that if the maximum enlargement value set for the character area indicated by the manga data is greater than the specified enlargement value, the character area is enlarged and displayed based on the specified enlargement value, and if the maximum enlargement value is equal to or less than the specified enlargement value, the character area is enlarged and displayed based on the maximum enlargement value.

[0010] 6. In the system of item 5, the maximum enlargement value and the specified enlargement value may be a maximum enlargement magnification and a specified enlargement rate or a maximum enlargement size and a specified enlargement size.

[0011] 7. In the system of paragraph 6, the maximum enlargement value and the specified enlargement value are the maximum enlargement size and the specified enlargement size, and enlarging and displaying each character area may be performed when the initial size preset for each character area is smaller than the specified enlargement size.

[0012] 8. The system of any one of clauses 5 to 7 may be configured such that the manga image includes at least first and second character areas, a first maximum enlargement value is set for the first character area, and a second maximum enlargement value is set for the second character area, and the system is configured such that if the first maximum enlargement value set for the first character area indicated by the manga data is greater than a specified enlargement value, the first character area is enlarged and displayed at the specified enlargement value, if the first maximum enlargement value is equal to or less than the specified enlargement value, the first character area is enlarged and displayed at the first maximum enlargement value, if the second maximum enlargement value set for the second character area indicated by the manga data is greater than the specified enlargement value, the second character area is enlarged and displayed at the specified enlargement value, and if the second maximum enlargement value is equal to or less than the specified enlargement value, the second character area is enlarged and displayed at the second maximum enlargement value.

[0013] 9. In the system of any one of items 1 to 8, when the comic image includes characters that are not to be enlarged, enlarging and displaying the character area may be performed without enlarging and displaying the characters that are not to be enlarged.

[0014] 10. The system of any one of clauses 1 to 9 determines the characters to be included in a character area, determines the character type of the determined characters, determines whether the character type of the determined characters is a character type to be enlarged, and if it determines that the character type of the determined characters is a character type to be enlarged, sets an enlargement value for the character area of ​​the characters, and if it determines that the character type of the determined characters is not a character type to be enlarged, does not set an enlargement value for the character area of ​​the characters, or sets the enlargement value to 1.0.

[0015] 11. In the system of paragraph 10, if the character type of the determined character is a speech bubble character, it may be determined that the character type is a character to be enlarged, and if the character type of the character is a speech bubble character, setting the enlargement value may include setting an enlargement value for the character area based on the size of a character area including the speech bubble character and the speech bubble area corresponding to the speech bubble character.

[0016] 12. In the system of item 11, the expansion value for the balloon characters can be determined so that the character area including the balloon characters does not exceed the balloon area corresponding to the balloon characters.

[0017] 13. In the system of paragraph 12, the expansion value may include an expansion value determined within a predetermined range in which the outline area of ​​the character exceeds the speech bubble area, in the case where an authorization input is made to allow the character to exceed the speech bubble area.

[0018] 14. In the system of item 10, if the character type of the determined character is an onomatopoeia, a character outside a speech bubble, or a background character, it may be determined that the character type is not a character to be enlarged.

[0019] 15. In the system of any one of items 1 to 14, the character area can be at least one of a polygonal area containing a character, a character outline area defined by polygon data, or a character outline area defined by character data.

[0020] 16. In the system of any one of items 1 to 15, a text area in a comic image may be determined.

[0021] 17. A method according to one embodiment of the present invention is a computer-implemented method for enlarging and displaying characters in a manga image, which displays a manga image including multiple character areas based on manga data representing the manga image, accepts information indicating a request for character enlargement based on user input, and, upon accepting the information indicating the request for character enlargement, enlarges and displays each character area based on an enlargement value set for each of the multiple character areas represented by the manga data.

[0022] A computer program according to one embodiment of the present invention is a program for causing a computer or one or more processors to execute the method described in paragraph 17.

[0023] Furthermore, one computer-readable storage medium of the present invention is a storage medium storing a program for causing a computer or one or more processors to execute the method described in paragraph 17. [Effects of the Invention]

[0024] By using the present invention, it is possible to display characters in a comic image displayed on an electronic terminal at an adjusted size. [Brief explanation of the drawings]

[0025] [Figure 1] 1 is a configuration diagram of a system according to an embodiment of the present invention. [Figure 2] 1 is a diagram illustrating a hardware configuration of an electronic device according to an embodiment of the present invention. [Figure 3] 1 is a flowchart according to an embodiment of the present invention. [Figure 4] FIG. 10 is a diagram illustrating original image data processing according to an embodiment of the present invention. [Figure 5] FIG. 10 is a diagram illustrating original image data processing according to an embodiment of the present invention. [Figure 6] 1 is a flowchart according to an embodiment of the present invention. [Figure 7A] 10 is an example of a user terminal screen according to an embodiment of the present invention. [Figure 7B] 10 is an example of a user terminal screen according to an embodiment of the present invention. [Figure 8] 1 is a flowchart according to an embodiment of the present invention. [Figure 9A] 10 is an example of a user terminal screen according to an embodiment of the present invention. [Figure 9B] 10 is an example of a user terminal screen according to an embodiment of the present invention. [Figure 9C] 10 is an example of a user terminal screen according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0026] Figure 1 shows an example of a system configuration diagram of the present invention. System 100 is a system used to enlarge and display text in comic images, and includes network 110, user terminal 120 connected to network 110, comic providing server 130, comic data storage 140, original image processing server 150, and original image data storage 160. Comic providing server 130 and original image processing server 150 may be integrated, and comic data storage 140 and original image data storage 160 may be integrated. Comic providing server 130, original image processing server 150, comic data storage 140, and original image data storage 160 may also be integrated.

[0027] FIG. 2 is a block diagram showing the hardware configuration of an electronic device according to an embodiment of the present invention. Here, a user terminal 120 will be described as an example of an electronic device. The user terminal 120 includes a processor 121, an output device 122, an input device 123, a storage device 124, and a communication device 125. These components are connected by a bus 126. Note that an interface is interposed between the bus 126 and each component device as necessary. In this embodiment, the user terminal 120 is a smartphone. However, the user terminal 120 can also be an information terminal such as a personal computer, a tablet computer, or a touchpad, as long as it has the above configuration.

[0028] The processor 121 controls the overall operation of the user terminal 120 and is, for example, a CPU. The processor 121 performs various processes by reading and executing a program 127 and data stored in the storage device 124. In one example, the processor 121 is made up of multiple processors.

[0029] The output device 122 displays application screens and the like to the user of the user terminal 120 under the control of the processor 121. Preferably, it is a liquid crystal display or an organic EL display, but any other device that can display information to the user may be used.

[0030] The input device 123 is a user interface that accepts input from a user to the user terminal 120, and is, for example, a touch panel, a touch pad, a keyboard, or a mouse. In this embodiment, the user terminal 120 is a smartphone, and therefore the user terminal 120 is provided with a touch panel as the input device 123, which also functions as the output device 122, and the output device 122 and the input device 123 are integrated into one structure. The output device 122 and the input device 123 may also be separate devices located at different positions.

[0031] The storage device 124 is a storage device provided in a typical smartphone or computer, including RAM, which is a volatile memory, and ROM, which is a non-volatile memory. The storage device 124 may also include an external memory. For example, the storage device 124 stores an application program for implementing this embodiment. The application program includes various data referenced when the program is executed. The application is started in response to a user operation on the user terminal 120, and is executed on an operating system (OS) pre-installed on the user terminal 120.

[0032] In one example, the storage device 124 includes a main storage device and an auxiliary storage device. The main storage device is a volatile storage medium capable of high-speed reading and writing of information, and is used as a storage area and a working area when the processor 121 processes information. The auxiliary storage device stores various programs and data used by the processor 121 when executing each program. The auxiliary storage device is, for example, a hard disk drive, but may be any non-volatile storage or non-volatile memory capable of storing information, and may be removable. The auxiliary storage device stores, for example, an operating system (OS), middleware, application programs, and various data that may be referenced in the execution of these programs.

[0033] The communication device 125 exchanges data with other devices via the network 110 (omitted in FIG. 2). For example, the communication device 125 connects to the network 110 via wireless communication such as mobile communication or wireless LAN. The user terminal 120 uses the communication device 125 to communicate with the manga providing server 130 via the network. The communication device 125 may also perform wired communication using an Ethernet (registered trademark) cable or the like.

[0034] The manga providing server 130 and the original image processing server 150 can also be realized with a similar configuration. As the manga providing server 130 is a server computer, it is equipped with a keyboard and mouse as input devices and an LCD display as a display device. The server application includes functions and various data for allowing the user program to appropriately accept input from users and present information to users on each user terminal 120, which is a user or client of the server.

[0035] The cartoon data storage 140 and the original image data storage 160 can also be realized by a similar configuration, but if they are simply storage devices, the output device 122 and the input device 123 are not necessary. The storages 140 and 160 may be configured to function as databases. For example, the cartoon data storage 140 may be configured as an integrated storage device of the cartoon providing server 130, and the original image data storage 160 may be configured as an integrated storage device of the original image processing server 150. Furthermore, the cartoon providing server 130, the original image processing server 150, the cartoon data storage 140, and the original image data storage 160 may be configured as an integrated device.

[0036] Based on user input, user terminal 120 transmits a request for providing comic content to comic providing server 130, receives comic data, which is comic content, from comic providing server 130, and presents a comic image to the user based on the comic data. In response to a signal from the user requesting the provision of a comic image via user terminal 120, comic providing server 130 obtains comic data from comic data storage 140 and transmits the comic data to the user terminal. Furthermore, in response to a request for text enlargement on user terminal 120, the user can provide comic data including enlarged text to update the comic image presented on user terminal 120.

[0037] The original image processing server 150 acquires the original image data of the manga stored in the original image data storage 160, and performs processes such as extracting character areas and determining enlargement values ​​for each character area to generate manga data, which is then stored in the manga data storage 140.

[0038] A first embodiment of the present invention is a system for enlarging and displaying text in a comic image. The system displays a comic image including multiple text regions based on comic data representing the comic image, accepts information indicating a text enlargement request based on user input, and, upon accepting the text enlargement request, enlarges and displays each text region based on an enlargement value set for each of the multiple text regions represented by the comic data. The enlargement value set for each text region can be different for each text region. For example, a first enlargement value can be set for a first text region, and a second enlargement value different from the first enlargement value can be set for a second text region.

[0039] In the second embodiment, information indicating a character enlargement request based on user input includes a specified enlargement value, and the enlargement value set for each character area includes a maximum enlargement value. The specified enlargement value is an enlargement value specified by the user. The maximum enlargement value is the maximum value allowed for the enlargement value of the characters in that character area. The enlargement value set for each area may also be the maximum enlargement value. If the maximum enlargement value set for a character area indicated by the manga data is greater than the specified enlargement value, the character area is enlarged and displayed based on the specified enlargement value, and if the maximum enlargement value is equal to or less than the specified enlargement value, the character area is enlarged and displayed based on the maximum enlargement value.

[0040] The enlargement value, maximum enlargement value, and specified enlargement value may be the enlargement rate, maximum enlargement rate, and specified enlargement scale, or the enlargement size, maximum enlargement size, and specified enlargement size. The enlargement size may be, for example, the font size. In the following description, unless otherwise specified, the enlargement value, maximum enlargement value, and specified enlargement value will be described using the enlargement rate, maximum enlargement rate, and specified enlargement scale as examples, but the enlargement size, maximum enlargement size, and specified enlargement size can also be realized by similar processing.

[0041] These functions may be distributed among any of the electronic devices included in the system 100, or may be implemented in only one electronic device. For example, these functions may be implemented by the user terminal 120. In this specification, the term "system" includes a single electronic device such as the user terminal 120.

[0042] The processing operation of the system in the first embodiment will be described with reference to Figures 3 to 7. In this embodiment, for the sake of explanation, the operation of one user terminal 120 will be described, but similar processing can be executed in two or more user terminals 120.

[0043] First, FIG. 3 shows the flow (300) of original image data processing executed by original image processing server 150. In the original image data processing, a text area to be enlarged is extracted from the original image data stored in original image data storage 160, a maximum enlargement ratio is determined, and manga data including this information and image data for displaying the manga is stored in manga data storage 140. Original image data typically includes data for displaying the manga as an image, but does not include information about which parts of the manga image are text or what kind of text is included. For example, it may be data obtained by scanning a manga. However, the original image data may include text information or other information. Even with such original image data, the original image data processing of the present invention can be executed to extract information necessary for subsequent processing.

[0044] The original image processing server 150 acquires original image data from the original image data storage 160 (S301). Then, it executes a process to extract a text area in the comic image represented by the acquired original image data (S302). The process to extract a text area includes a process to identify text areas, which are parts of the image that show text and text, a process to identify speech bubble areas, which are parts that show speech bubbles, a process to identify frames and pages, and a process to associate text areas with speech bubble areas, frames, etc. In this embodiment, it also executes a process to identify the character type of the identified text.

[0045] The process of extracting character regions (S302) can be any process that can extract characters and character regions from an image. For example, characters are identified using a pre-trained model, and character regions containing characters are identified and tagged. Furthermore, speech bubble regions are identified, character format is detected, and the presence or absence of a background for the characters is detected. Comparison with pre-identified character regions and image processing are performed to add information such as the type and size of the characters and their relationship to the speech bubbles.

[0046] This can be achieved using the Efficient and Accurate Scene Text Detector, a method for detecting characters using a trained model, but it will be clear to those skilled in the art that it can also be achieved by other methods. Similarly, the process of identifying speech bubbles and frames can be achieved by commonly known methods. For example, it can be achieved by using an object detection model such as YOL, and it will be clear to those skilled in the art that it can also be achieved by the method disclosed in "A Study on Manga Object Recognition Mechanism Using Convolutional Neural Networks" (Yanagisawa Hideaki et al., IEICE Technical Report, Vol. 117, No. 238, PRMU2017-79, pp. 93-94, October 2017).

[0047] The character region extraction process includes a method of extracting characters depicted in an image as text information in addition to character information and coordinate information, and a method of extracting them as polygon regions. Character information is information indicating characters contained in a character region, i.e., information indicating alphabetic characters or other characters contained in a character region. When extracted as text information, the character may be specified as text data such as font information including font size, or as SVG (Scalable Vector Graphics). Furthermore, the region containing the extracted text is specified as a character region. For example, as shown in FIG. 4, the region in which the character is depicted is specified as a rectangular region (411-419). Other shapes, such as a polygonal shape or an elliptical shape, may be used as long as they can contain the region in which the character is depicted. A character outline region defined by character data defining the character may also be used. Furthermore, when extracting a polygon region, for example, the character outline may be specified as a character region (511-516) as shown in FIG. 5, and polygon data defining this character region may be generated.

[0048] Furthermore, the outline of the speech bubble is specified as a polygon area to specify the speech bubble area. Then, the speech bubble area is associated with the character area within that speech bubble area. For example, because character area 411 is included in speech bubble area 421, speech bubble area 421 and character area 411 are associated and stored. On the other hand, character areas 415 to 419 are not character areas included in the speech bubble area, so they are not associated with the speech bubble area. The association can be performed by comparing the coordinates of the speech bubble area and the character area. The character area may extend beyond the speech bubble area. If the center of gravity of the character area is within the speech bubble area, the character area may be associated with the speech bubble area.

[0049] The character type can be determined, for example, using a trained model based on character information indicating the extracted characters. Character type determination can be performed using a single method or a combination of multiple methods. Character type determination is performed by determining the type of character detected in the character region extraction process. Character types can include, for example, speech bubble characters, background characters, characters outside speech bubble, and onomatopoeia. A speech bubble character is a character written inside a speech bubble. Whether or not a character is a speech bubble character can be determined by whether or not the character region of the character is associated with a speech bubble region. If a character is associated with a speech bubble region, it is a speech bubble character. If it is not associated with a speech bubble region, it is another character, such as a character outside speech bubble, background character, or onomatopoeia. Characters outside speech bubble include, for example, explanatory characters and characters indicating a character's feelings. Explanatory characters are characters indicating sentences that explain a situation, such as narration (417). Characters indicating feelings are characters that are not speech bubble characters but express the inner thoughts of a character (419). Background characters are characters drawn as part of the background of a manga, such as characters on a signboard included in the background (418). Onomatopoeia are characters that represent onomatopoeic sounds such as the sound of rain (415, 416), the sound of thunder, and animal cries. Background characters and onomatopoeia may also be used as characters outside the speech bubble, or the character type "character outside the speech bubble" may not be used.

[0050] Next, an enlargement factor is determined for the extracted character region (S304). Whether or not to set an enlargement factor can be determined based on the character type. For example, if the character type is a balloon character, an enlargement factor is determined and set. However, if the character type is a character outside a balloon, a background character, onomatopoeia, or other character, an enlargement factor may not be set, or the enlargement factor may be set to 1.0, i.e., the enlargement process may not be executed. The enlargement factor in this embodiment is an example of an enlargement value, and can be similarly implemented as an enlargement size.

[0051] Any method for determining the enlargement magnification may be used. An administrator or the like may set an optimal magnification for each character region that is easy for the user to read, or the magnification may be determined automatically using predetermined rules or a trained model. After enlargement, line breaks may be added or the position of the line breaks may be changed. For speech bubble characters, the enlargement magnification is preferably set so that the character region does not exceed the speech bubble region to which the character region is associated. After enlargement, line breaks may be added or the position of the line breaks may be changed to increase the enlargement magnification within the range that does not exceed the speech bubble region. The position of the line breaks may be determined manually or automatically as appropriate. If the character region is identified as a rectangular region, the rectangular region is set within the range that does not exceed the speech bubble region, and if the character region is identified as a polygonal region, the polygonal region is set within the range that does not exceed the speech bubble region. For example, scaling may be performed with the center of gravity of the polygonal region for the character region as the origin, to determine an enlargement magnification that does not exceed the range of the speech bubble region. Furthermore, an enlargement magnification that exceeds the speech bubble region may be set as the magnification that is allowed when speech bubble overflow is permitted. For example, if overflow is permitted, the balloon can be enlarged beyond the balloon area, and the enlargement factor may be 1.1 times the enlargement factor when overflow is not permitted.

[0052] In this embodiment, the magnification factor is set for each character region. For example, if there are two speech bubble characters in a single comic image, an independent magnification factor is set for each. Character regions that are recognized as separate character regions in a comic image can be recognized as separate character regions. For example, character regions 411 and 412 in FIG. 4 are displayed separately in the comic image, so they can be considered separate character regions. As a variation, a single magnification factor can be set for multiple character regions as a group. Multiple character regions included in a single frame or a single page can be grouped as a group of character regions, or any multiple character regions can be grouped as a group of character regions. In this case, for example, the magnification factor can be set so that none of the character regions included in a group of character regions exceed the size of the speech bubble when enlarged. A magnification factor can be set for each group of character regions, and different magnification factors can be set for each group. The process of identifying which frame or character a character region is included in can be performed as part of the character region identification process. A single magnification factor can be set for all character regions.

[0053] Next, the extracted character area is deleted from the original image data, and background restoration processing is performed on the deleted portion (S306). Only character areas with a magnification factor greater than 1.0 can be deleted. Character areas with a magnification factor greater than 1.0 are subject to character enlargement processing, while character areas without a magnification factor greater than 1.0 or character areas with a magnification factor of 1.0 are not subject to character enlargement processing. Background restoration processing can be performed by general text area mask generation, character and background inpainting processing using image interpolation, and is clearly understandable to those skilled in the art. The character area identification processing may also include a process for determining whether background restoration processing is necessary, and background restoration processing may be performed only on character areas determined to be necessary. As a variant, background restoration processing may not be performed.

[0054] Comic data is generated for the original image data processed by S301 to S306 and stored in comic data storage 140 (S308). The comic data includes character area-related information related to the extracted character area and image data with the background restored. The character area-related information includes information indicating the character area of ​​rectangular shape or polygon data, the coordinates of the character area, the character type, information associating a speech bubble, and the enlargement ratio. If characters are extracted as text information, the character area-related information further includes text data such as characters and font information. It may also include information for defining other characters. It may also include information indicating the page or frame in which the character area is included, and information for identifying a group of character areas.

[0055] In one embodiment, information about character areas for character types that are not subject to enlargement processing is not stored as comic data. For example, if only balloon characters are subject to enlargement processing, only information about character areas for balloon characters is stored as comic data in comic data storage 140.

[0056] The following table shows an example of character area related information. Here, an example is shown in which characters in a character area are extracted as text information. An identification tag is assigned to a character area recognized by the character area identification process, and the identification tag is associated with the character type, identification information of the associated speech bubble, font information, magnification, and character. A speech bubble area is also identified in the character area identification process and a tag is assigned to it. The tag of the speech bubble area containing the character area is set as identification information of the associated speech bubble, and the speech bubble area and character area are associated and stored. If the character is not a speech bubble character, no information related to the speech bubble is set. Font information is information indicating the font of the characters contained in the character area. Magnification indicates the magnification set for the character area. Coordinate information indicates the coordinates within the image of the character area. If no magnification is set, no value is set. Character is information indicating characters such as alphabets contained in the character area.

[0057] For example, identification tag 001 is identification information associated with character area 411 in FIG. 4. The character type of character area 411 associated with identification tag 001 is balloon character, and since it is contained in balloon area 421, identification information F001 of balloon area 421 is associated with it, and the font information is set to "family: 'Calibri', size: '12px', weight: 'normal', the magnification is set to 1.4, and the characters are set to "It's getting dark." The font information includes the initial size (initial font size) of the characters in the character area to be written. For example, the initial size of identification tag 001 is "12px." [Table 1]

[0058] Next, a flow 600 of processing for enlarging text in a comic image based on comic data will be described with reference to Figure 6. In this embodiment, flow 600 is executed in user terminal 120, but it may also be realized by cooperation between user terminal 120 and comic providing server 130 or other hardware resources. For example, user terminal 120 may request update data for enlarged display from comic providing server 130, and comic providing server 130 may provide this data.

[0059] In this embodiment, the process of the present invention is executed using an application for providing manga installed on the user terminal 120, but it can also be executed using, for example, a general browser. Furthermore, the manga data used in flow 600 is not limited to data generated by flow 300 of the original image data processing described in flow 300. For example, data generated by various methods may be mixed.

[0060] Prior to flow 600 of the enlarged character display process, when a user who is to receive a manga image, which is manga content, sends a signal requesting the provision of manga content to manga providing server 130 via user terminal 120, manga providing server 130 retrieves manga data from manga data storage 140 and sends it to user terminal 120. Based on the manga data received from manga providing server 130, user terminal 120 presents the manga image to the user by displaying it on a display, which is an output device.

[0061] 7A and 7B show examples of application screens 700A and 700B that present a comic image to the user on the user terminal 120. Hereinafter, in relation to FIG. 7, the reference numbers A and B may be omitted and only the numbers may be shown, as referring to all reference numbers with A and B attached. For example, when 700 is written, it means 700A and 700B.

[0062] Reference numeral 711 denotes an enlargement request input section for inputting a character enlargement request for enlarging and displaying characters. When the user touches the enlargement request input section 711 on the display of the user terminal 120, which is a touch panel, the character enlargement request is accepted and character enlargement display processing is executed. When the user touches the enlargement request input section 711 again, a request to cancel the character enlargement request is accepted, the character enlargement processing is terminated, and display processing is executed at the original character size. 711A shows the state before the character enlargement request is accepted, in which the character enlargement request is OFF, and 711B shows the state after the character enlargement request is accepted, in which the character enlargement request is ON, and character enlargement processing is executed. 712 denotes a comic image area showing a comic image presented to the user. 700B shows that the balloon characters in the comic image area 712B are enlarged and displayed based on the enlargement factor set for each character area.

[0063] The flow of the character enlargement display process (600) starts when, after a comic image including multiple character regions based on comic data representing the comic image is displayed on the display, information indicating a character enlargement request is received via the enlargement request input unit (S601). In this embodiment, information indicating a character enlargement request is received by user terminal 120 when the user touches enlargement request input unit 711. Upon receiving the information indicating the character enlargement request, user terminal 120 acquires the enlargement magnification set for each displayed character region from the character region-related information of the comic data (S602). Then, data for enlarging and displaying each character region based on the acquired enlargement magnification set for each character region is generated (S604), and the comic image is updated and displayed based on the generated data (S606). If the enlargement magnification is set for multiple character regions as a group of character regions, the enlargement magnification may be performed for each group of character regions. The data generated for enlarging and displaying the character regions may be data for only the enlarged character regions, or data for the entire comic image including data for each enlarged character region. When generating data of only the enlarged character area, the generated enlarged characters can be superimposed on the comic image and presented to the user.

[0064] For example, when user terminal 120 receives comic data from comic providing server 130, it displays a comic image as shown in 712A in FIG. 7A. The balloon characters to be enlarged are displayed at their initial size in balloons 721A, 722A, 723A, and 724A. The enlargement factors for the balloon characters in balloons 721, 722, 723, and 724 are set to 1.4, 1.0, 1.5, and 1.4, respectively. The character types of the other characters are onomatopoeia, explanatory text, or background characters, and are not the character types to be enlarged. Here, it is assumed that character area-related information is not included in the comic data for character areas that are not the character types to be enlarged. Therefore, they are not subject to flow 600 of the character enlargement display processing. In one variation, character area-related information is included in the comic data for these characters as well. Whether or not to perform the enlargement process may then be determined based on the character type included in the character area-related information. For example, if the character type is a balloon character, it can be determined to be an object to be enlarged, and if the character type is an onomatopoeia, background character, or character outside a balloon, it can be determined not to be an object to be enlarged.

[0065] 7, when the user touches enlargement request input section 711A to input a request for character enlargement (S601), the enlargement magnifications (1.4, 1.0, 1.5, and 1.4) set for each character area (721-724) are acquired (S602). Then, enlargement data is generated based on each acquired enlargement magnification (S604), and a comic image in which the character area is enlarged based on the generated enlargement data is displayed (S606). That is, the characters in speech bubbles 721-724 are enlarged by 1.4, 1.0, 1.5, and 1.4 times and displayed, respectively.

[0066] As one variation, the enlargement factor set for each character region may include an enlargement factor determined within a predetermined range where the character outline region exceeds the speech bubble region, in case a permission input is made to allow the character outline region to exceed the speech bubble region. For example, in addition to the enlargement request input unit 711, an overflow permission input unit may be provided on the application screen to allow the character outline region to be enlarged beyond the speech bubble. When an overflow permission input is made to the overflow permission input unit, the enlargement factor with overflow permission is applied to enlarge the character region. The enlargement factor determined within a predetermined range where the character outline region exceeds the speech bubble region may be the enlargement factor of the character region, or may be a factor that further increases the enlargement factor when overflow permission is not permitted. For example, if the enlargement factor when overflow permission is not permitted is 1.5, the enlargement factor when overflow permission is permitted may be 1.7, or may be a factor (1.1) that increases the 1.5x enlargement factor when overflow permission is not permitted by 1.1x. When using a magnification factor for the enlargement factor when overflow is not permitted, a predetermined magnification factor may be used for all character regions, rather than for each character region.

[0067] As a variant, the enlargement size can be used instead of the enlargement factor. The enlargement size can be the font size displayed during enlargement processing set for each character area. When a user requests character enlargement, the font size set for each character area is compared with the enlargement size, and if the font size is smaller, the character is enlarged and displayed according to the enlargement size. If the font size is larger, the enlargement processing is not performed. For example, in Table 1, the font size indicated by the font information of identification tag 001 is "12px," but if the enlargement size is set to "16px," when a user requests character enlargement, the font size and the enlargement size are compared, it is determined that the enlargement size is larger, and the character is displayed at 16px. A similar process can be performed for each character area to perform the enlargement processing.

[0068] Next, a second embodiment will be described. Differences from the first embodiment will be mainly described, and similar processes will be omitted or briefly described. The second embodiment differs from the first embodiment in that information indicating a character enlargement request based on user input does not simply instruct enlargement, but also includes a specified enlargement factor specifying the magnification factor. The maximum enlargement factor refers to the maximum magnification factor allowed for the enlargement of characters in the character area. If the specified enlargement factor included in the information indicating the character enlargement request is greater than the maximum enlargement factor set for the character area indicated by the manga data, the character area is enlarged and displayed at the specified enlargement factor. If the maximum enlargement factor is equal to or less than the specified enlargement factor, the character area is enlarged and displayed at the maximum enlargement factor.

[0069] As one modification, in addition to the maximum magnification, a preset optimal magnification and a minimum magnification (minimum reduction) may be set. The optimal magnification is, for example, a magnification that a system administrator considers optimal, and does not necessarily mean that it is universally optimal. When a user input instructing an enlarged display at the optimal magnification is received, the enlarged display is executed at the set optimal magnification. When an enlargement request including a specified magnification is received, the enlarged display processing can be executed based on the user-specified magnification. In this case, the enlargement processing can be similar to that of the first embodiment, for example. As a further modification, the user may be allowed to set a specified magnification smaller than 1.0, and the characters may be displayed smaller as a character enlargement processing. In this case, a minimum allowable magnification may be set. Displaying an image smaller than 1.0 may be expressed as reduction rather than enlargement.

[0070] The following describes the enlargement display process when an enlargement request including a specified enlargement magnification is received. First, the flow of original image data processing executed by the original image processing server 150 is the same as that shown in FIG. 3, except that the enlargement magnification determination process (S304) determines the maximum enlargement magnification. In the first embodiment, the enlargement magnification is set based on the enlargement request, whereas in this embodiment, the image is enlarged and displayed at a user-specified enlargement magnification within a range not exceeding the maximum enlargement magnification. The data structure of Table 1 described in relation to the first embodiment can be used in the same way if the enlargement magnification is set to the maximum enlargement magnification.

[0071] Next, a flow 800 of processing for enlarging and displaying characters in a comic image based on comic data will be described using Figure 8. Figures 9A to 9C show examples 900A to 900C of application screens that present comic images to the user on the user terminal 120. In relation to Figure 9, the reference numbers A to C may be omitted and only the numbers may be shown, as if they refer to all of the reference numbers to which A to C are assigned.

[0072] Reference numeral 911 denotes an enlargement request input section for inputting a request for enlarging text for display. The user can specify the requested enlargement ratio by touching the display of user terminal 120, which is a touch panel, and sliding the enlargement request input section. 911A indicates a case where the enlargement ratio specified by the user is 1.0x, 911B indicates a case where it is 1.3x, and 911C indicates a case where it is 1.5x. Reference numeral 912 denotes a comic image area showing a comic image presented to the user. 900B and 900C show that the balloon text in comic image areas 912B and 912C is enlarged and displayed.

[0073] Reference numeral 913 denotes an overflow permission input section for specifying whether or not to allow the speech bubble to overflow when enlarging the text. Reference numerals 913A and 913B indicate cases where overflow is not permitted, and reference numeral 913C indicates a case where overflow is permitted. For example, if the maximum enlargement factor when overflow is not permitted is set to 1.4, the maximum enlargement factor when overflow is permitted is set to 1.1, i.e., 1.54. In this case, if the specified enlargement factor is 1.5, it is smaller than the maximum enlargement factor of 1.54, and therefore the text can be displayed at an enlargement factor of 1.5. Reference numeral 930 indicates that the speech bubble text is displayed beyond the speech bubble area.

[0074] In this embodiment, the designated magnification is presented to the user and they are prompted to input it, but it is also possible to have the user select the designated magnification corresponding to the position of the slider without presenting the magnification to the user. The magnification may be selected from small, medium, or large, with small corresponding to 0.7x, medium corresponding to 1.3x, and large corresponding to 1.5x.

[0075] The flow (800) of the character enlargement display processing starts when a character enlargement request including information indicating a specified enlargement magnification is received via the enlargement request input unit after a comic image including multiple character regions based on comic data representing the comic image is displayed on a display (S801). The user terminal 120 determines whether the maximum enlargement magnification set for the character region indicated by the comic data is greater than the specified enlargement magnification (S802). If the specified enlargement magnification is greater than the maximum enlargement magnification, the enlargement magnification is set to the maximum enlargement magnification (S804). If the specified enlargement magnification is equal to or less than the maximum enlargement magnification, the enlargement magnification is set to the specified enlargement magnification (S806).

[0076] User terminal 120 generates data for enlarging and displaying the character region based on the set magnification factor (S808), and updates and displays the comic image based on the generated data (S810). The processes of S802 to S808 are executed for each of the multiple character regions included in the comic data. If the maximum magnification factor is set for multiple character regions as a group, the process may be executed for each group of character regions.

[0077] As in the first embodiment, when user terminal 120 receives comic data from comic providing server 130, it displays a comic image as shown in 912A in Fig. 9A. The balloon characters to be enlarged are displayed in balloons 921A, 922A, 923A, and 924A at the specified magnification factor (1.0). The magnification factors for the balloon characters in balloons 921, 922, 923, and 924 are set to 1.4, 1.0, 1.5, and 1.4, respectively.

[0078] The user touches and slides the enlargement request input area 911 to change the designated enlargement factor to 1.3 (S801). Because the designated enlargement factor of 1.3 is less than the maximum enlargement factor (1.4, 1.5) for the balloon text in balloons 921, 923, and 924 (S802), the enlargement factor for these balloon text areas is set to 1.3 (S806), and the balloon text in balloons 921, 923, and 924 is enlarged and displayed at 1.3. On the other hand, because the designated enlargement factor of 1.3 is greater than the maximum enlargement factor (1.0) for the balloon text in balloon 922, the enlargement factor is set to 1.0 (S804), and the text is not enlarged. When the user touches the balloon permission input area 913 to enable balloon permission, the maximum enlargement factor is changed to 1.1, allowing the text to be enlarged beyond the balloon area. Here, the maximum designable designated enlargement factor is set to 1.5. When speech bubbles are permitted, the maximum enlargement ratios are 1.4×1.1=1.54 for the speech bubble text in speech bubbles 921 and 924, 1.5×1.1=1.65 for the speech bubble text in speech bubble 923, and 1.0×1.1=1.1 for the speech bubble text in speech bubble 922. When a specified enlargement ratio of 1.5 is input, the speech bubble text in speech bubbles 921, 922, and 924 is enlarged at a ratio exceeding the maximum enlargement ratio when overflow is not permitted, and the speech bubble text is displayed beyond the speech bubble area. On the other hand, the speech bubble text in speech bubble 923 does not exceed the speech bubble area up to 1.5 times, so it is displayed within the speech bubble area.

[0079] As a modified example, instead of the maximum enlargement factor and the specified enlargement factor, a maximum enlargement size and a specified enlargement size can be used. When a user requests character enlargement, the maximum enlargement size set for each character area is compared with the specified enlargement size, and if the maximum enlargement size is larger, the character is enlarged and displayed according to the specified enlargement size. If the maximum enlargement size is smaller than the specified enlargement size, enlargement processing is performed according to the maximum enlargement size. The initial font size set in advance for each character area is compared with the specified enlargement size, and if the initial font size is larger, enlargement processing may not be performed.

[0080] For example, if the font size indicated by the font information of identification tag 001 is "12px," but the maximum enlargement size is set to "16px," and the specified enlargement size specified by the user is "14px," when the enlargement process is executed, the characters in the character area will be displayed at the specified enlargement size of "14px" because the specified enlargement size is smaller than the maximum enlargement size. On the other hand, if the specified enlargement size specified by the user is "18px," when the enlargement process is executed, the characters in the character area will be displayed at the maximum enlargement size of "16px." If the specified font size is "10px," in one embodiment, the specified enlargement size is smaller than the maximum enlargement size, so the characters may be reduced to "10px." In another embodiment, the specified enlargement size is smaller than the initial font size of "12px," so the characters may be excluded from the enlargement process and therefore excluded from the enlargement (reduction) process. Similar processing can be performed on multiple character areas.

[0081] In the above embodiment, the enlargement factor and maximum enlargement factor are included in the data related to the text area included in the comic data, but in one variation, they may be determined during the flow of the text enlargement display process. For example, after receiving a text enlargement request, the maximum enlargement factor may be determined so that the text area does not exceed the speech bubble area associated with that text area.

[0082] In the above-described embodiment, comic data generation processing flow 300 was not described as processing based on a request from user terminal 120. However, like character enlargement processing flows 600 and 800, it may also be executed based on user input via user terminal 120. Furthermore, flows 300, 600, and 800 may be executed as a series of processes. For example, when a user transmits a request for providing comic content to comic providing server 130 via user terminal 120, comic providing server 130 acquires original image data for the comic requested by the user, executes processing to generate comic data (300), and transmits this generated comic data to user terminal 120. User terminal 120 presents a comic image to the user based on the received comic data. When a user inputs a request for character enlargement, it is possible to display a comic image in which the text area is enlarged by a magnification based on the specified magnification (800).

[0083] In the processes or operations described above, the processes or operations can be freely changed as long as no inconsistencies in the processes or operations occur, such as the use of data that should not yet be available in a certain step. Furthermore, the embodiments described above are merely examples for explaining the present invention, and the present invention is not limited to these embodiments. The present invention can be embodied in various forms without departing from the spirit of the invention. [Explanation of symbols]

[0084] 100: System, 110: Network, 120: User terminal, 121: Processor, 122: Output device, 123: Input device, 124: Storage device, 125: Communication device, 126: Bus, 127: Program, 130: Manga providing server, 140: Manga data storage, 150: Original image processing server, 160: Original image data storage

Claims

1. A system for enlarging and displaying characters in a manga image, comprising: Displaying a comic image including a plurality of character regions based on comic data representing the comic image; Accepting information indicating a request for character enlargement based on user input; When the information indicating the character enlargement request is received, the character areas are enlarged and displayed based on the enlargement value set for each of the plurality of character areas indicated by the comic data; When the characters included in the character area are balloon characters, the enlargement value is set based on the size of the balloon area corresponding to the balloon characters, and the enlarged display includes, when the characters included in the character area are balloon characters, enlarging and displaying the balloon characters based on the enlargement value, but not enlarging and displaying the balloon area corresponding to the character area. system.

2. The system of claim 1 , wherein the magnification value is a magnification ratio or a magnification size.

3. The system according to claim 1 , wherein one enlargement value is set for two or more character regions included in the plurality of character regions as one character region group.

4. The system according to claim 3 , wherein the plurality of character regions included in the character region group are character regions of the same frame or page.

5. the information indicating the character enlargement request based on the user input includes a specified enlargement value; the enlargement values ​​include a maximum enlargement value indicating a maximum value allowed for enlarged display; The enlarged display of each character region is If the maximum enlargement value set for the text area indicated by the comic data is greater than the specified enlargement value, the text area is enlarged and displayed based on the specified enlargement value, If the maximum enlargement value is equal to or less than the specified enlargement value, the character area is enlarged based on the maximum enlargement value and displayed. The system of claim 1 .

6. The system according to claim 5 , wherein the maximum magnification value and the specified magnification value are a maximum magnification magnification factor and a specified magnification rate or a maximum magnification size and a specified magnification size.

7. the maximum enlargement value and the designated enlargement value are a maximum enlargement size and a designated enlargement size, The system according to claim 6 , wherein the enlargement and display of each character region is performed when an initial size preset for each character region is smaller than a designated enlargement size.

8. the cartoon image includes at least first and second character regions; a first maximum enlargement value is set for the first character region, and a second maximum enlargement value is set for the second character region; The character area is enlarged and displayed based on a specified enlargement value, If the first maximum enlargement value set for the first character region indicated by the comic data is greater than the designated enlargement value, the first character region is enlarged by the designated enlargement value and displayed; If the second maximum enlargement value set for the second character region indicated by the comic data is greater than the specified enlargement value, the second character region is enlarged and displayed at the specified enlargement value. This includes: The character area is enlarged and displayed based on a maximum enlargement value, If the first maximum enlargement value is equal to or less than the specified enlargement value, the first character region is enlarged and displayed at the first maximum enlargement value; If the second maximum enlargement value is equal to or less than the specified enlargement value, the second character region is enlarged and displayed at the second maximum enlargement value. Including, The system of claim 5.

9. The system according to claim 1 , wherein the comic image includes characters that are not to be enlarged, and enlarging and displaying the character area does not enlarge and display the characters that are not to be enlarged.

10. In order to enlarge and display each character area based on an enlargement value set for each of the plurality of character areas represented by the manga data, determining a text region in the manga image; determining the characters contained in the character region; determining a character type of the determined character; determining whether the character type of the determined character is a character type to be enlarged; If it is determined that the character type of the determined character is a character type to be enlarged, an enlargement value of the character area of ​​the character is set; If it is determined that the character type of the determined character is not a character type to be enlarged, the enlargement value of the character area of ​​the character is not set, or the enlargement value is set to 1.

0. The system of claim 1 .

11. Determining whether the character type of the determined character is a character type to be enlarged includes determining that the character type of the determined character is a character type to be enlarged if the character type of the determined character is a balloon character; When it is determined that the character type of the determined character is a character type to be enlarged, setting an enlargement value for a character area of ​​the character includes, when the character type of the character is a balloon character, setting an enlargement value for the character area within a range in which a character area including the balloon character does not exceed a balloon area corresponding to the balloon character. The system of claim 10.

12. the enlargement value includes an enlargement value determined within a predetermined range in which the outline region of the character exceeds the balloon region when an authorization input permitting the character to exceed the balloon region is made; When the information indicating the character enlargement request is received, the character areas are enlarged and displayed based on the enlargement value set for each of the plurality of character areas indicated by the comic data. If no permission input is made to allow the character area to be exceeded, each character area is enlarged and displayed based on an enlargement value determined within a range that does not exceed the balloon area. When a permission input is made to allow the character area to be exceeded, each character area is enlarged and displayed based on an enlargement value determined within a range exceeding the balloon area. Including, The system of claim 1 .

13. If the character type of the determined character is an onomatopoeia, a character outside a speech bubble, or a background character, it is determined that the character type is not a character to be enlarged. The system of claim 10.

14. The system according to claim 1 , wherein the character region is at least one of a polygonal region containing a character, a character outline region defined by polygon data, and a character outline region defined by character data.

15. 1. A computer-implemented method for enlarging and displaying characters in a comic image, comprising: Displaying a comic image including a plurality of character regions based on comic data representing the comic image; Accepting information indicating a request for character enlargement based on user input; When the information indicating the character enlargement request is received, the character areas are enlarged and displayed based on the enlargement value set for each of the plurality of character areas indicated by the comic data; When a character included in a character area is a speech bubble character, the enlargement value is set based on the size of the speech bubble area corresponding to the speech bubble character, and the enlarged display includes, when a character included in a character area is a speech bubble character, enlarging and displaying the speech bubble character based on the enlargement value, but not enlarging and displaying the speech bubble area corresponding to the character area.

16. A program for causing a computer to execute the method according to claim 15.

Images