Text enlargement display system for displaying comic image, method, and program
The system addresses the issue of inappropriate character sizes in comic images by allowing user-controlled enlargement of characters based on their type and position, enhancing readability and user experience.
Patent Information
- Application Number
- PCT/JP2025/040451
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-16
- Filing Date
- 2025-11-19
- Publication Date
- 2026-11-19
AI Technical Summary
The size of characters in comic images displayed on electronic devices may be perceived as inappropriate, especially when translated or when characters in speech bubbles are not proportionate to the speech bubbles, leading to user dissatisfaction.
A system and method for enlarging and displaying characters in comic images by receiving user input for character enlargement requests, setting specific enlargement values for each character region, and applying these values to adjust the size of characters based on their type and position within the image.
Enables characters in comic images to be displayed at adjusted sizes, ensuring readability and user satisfaction by accommodating different character types and their positions within the image.
Smart Images

Figure JP2025040451_19112026_PF_FP_ABST
Abstract
Description
Character enlargement display system, method, and program for comic image display
[0001] The present invention relates to a character enlargement display system, method, and program for comic image display.
[0002] With the recent expansion of the use of digital content, services have come to be provided that distribute comic content via the Internet and allow users to browse comics using electronic devices such as smartphones.
[0003] Japanese Unexamined Patent Publication No. 2024-042719
[0004] The size of characters in a comic image displayed on an electronic device may be perceived by a user as not appropriate. For example, some users may feel that the characters are too small. In addition, when a comic drawn in a predetermined language is translated into another language, the number of characters changes, so comic image data in which, for example, the size of characters in speech bubbles is not appropriate relative to the size of the speech bubbles may be generated.
[0005] 1. The present invention has been made in view of the above problems, and has the following features. Specifically, a system according to an embodiment of the present invention is a system for enlarging and displaying characters in a comic image, which displays a comic image including a plurality of character regions based on comic data representing the comic image, receives information indicating a character enlargement request based on user input, and upon receiving the information indicating the character enlargement request, enlarges and displays each character region based on an enlargement value set for each of the plurality of character regions indicated by the comic data. Here, the system may include a plurality of electronic devices, or may be a single electronic device.
[0006] 2. In the system according to item 1, the enlargement value may be an enlargement ratio or an enlargement size.
[0007] 3. Further, in the system according to item 1 or 2, the one or more character regions included in the plurality of character regions may be a character region group including two or more character regions that are displayed separately when displayed in the comic image.
[0008] 4. In the system of item 3, multiple character areas included in the character area group may be character areas of the same frame or page.
[0009] 5. The system according to any one of paragraphs 1 to 4 includes, in the information indicating a character enlargement request based on user input, a specified enlargement value, the enlargement value including a maximum enlargement value indicating the maximum value for which enlargement display is permitted, and the display of each character area by enlarging it is as follows: if the maximum enlargement value set for the character area indicated by the manga data is greater than the specified enlargement value, the character area is enlarged and displayed based on the specified enlargement value; if the maximum enlargement value is less than or equal to the specified enlargement value, the character area is enlarged and displayed based on the maximum enlargement value.
[0010] 6. In the system of item 5, the maximum magnification value and specified magnification value may be the maximum magnification ratio and specified magnification rate or the maximum magnification size and specified magnification size.
[0011] 7. In the system of item 6, the maximum magnification value and the specified magnification value are the maximum magnification size and the specified magnification size, and the display of each character area may be performed when the initial size set in advance for each character area is smaller than the specified magnification size.
[0012] 8. The system according to any one of paragraphs 5 to 7 includes at least a first and a second character area in the manga image, a first maximum magnification value is set for the first character area, a second maximum magnification value is set for the second character area, and the system can be configured such that, if the first maximum magnification value set for the first character area indicated by the manga data is greater than a specified magnification value, the first character area is magnified and displayed at the specified magnification value; if the first maximum magnification value is less than or equal to the specified magnification value, the first character area is magnified and displayed at the first maximum magnification value; if the second maximum magnification value set for the second character area indicated by the manga data is greater than a specified magnification value, the second character area is magnified and displayed at the specified magnification value; and if the second maximum magnification value is less than or equal to the specified magnification value, the second character area is magnified and displayed at the second maximum magnification value.
[0013] 9. In any one of paragraphs 1 to 8, if a manga image contains characters that are not subject to enlargement, the system may choose not to enlarge and display the character area.
[0014] 10. The system according to any one of paragraphs 1 to 9 determines the characters to be included in the character area, determines the character type of the determined characters, determines whether the character type of the determined characters is a character type to be enlarged, sets the enlargement value of the character area of the determined characters if it is determined that the character type of the determined characters is a character type to be enlarged, and if it is determined that the character type of the determined characters is not a character type to be enlarged, it may not set an enlargement value for the character area of the determined characters, or may set the enlargement value to 1.0.
[0015] 11. In the system of paragraph 10, if the character type of the determined character is a callout character, it may be determined that it is a character type to be enlarged, and if the character type of the character is a callout character, setting the enlargement value may include setting the enlargement value for the character area based on the size of the character area containing the callout character and the callout area corresponding to the callout character.
[0016] 12. In the system of paragraph 11, the magnification value for the callout text may be determined such that the text area containing the callout text does not exceed the callout area corresponding to the callout text.
[0017] 13. In the system of paragraph 12, the magnification value may include a magnification value determined within a predetermined range in which the contour area of the character extends beyond the callout area, in cases where permission input has been made to allow it to extend beyond the callout area.
[0018] 14. In the system of item 10, if the character type of the determined character is onomatopoeia, text outside a speech bubble, or background text, it may be determined that it is not a character type to be enlarged.
[0019] 15. In the system of any one of paragraphs 1 to 14, the character area may be at least one of a polygonal area containing a character, a character contour area defined by polygon data, or a character contour area defined by character data.
[0020] 16. In any one of the systems described in paragraphs 1 to 15, the text area in the manga image may be determined.
[0021] 17. One embodiment of the present invention is a computer-based method for enlarging and displaying characters in a cartoon image, the method comprising: displaying a cartoon image including a plurality of character areas based on cartoon data representing the cartoon image; receiving information indicating a character enlargement request based on user input; and, upon receiving the information indicating the character enlargement request, enlarging and displaying each of the plurality of character areas represented by the cartoon data based on the enlargement value set for each of them.
[0022] A computer program according to one embodiment of the present invention is a program for causing a computer or one or more processors to perform the method described in item 17.
[0023] Furthermore, one computer-readable storage medium of the present invention is a storage medium that stores a program for causing a computer or one or more processors to execute the method described in item 17.
[0024] By using this invention, it becomes possible to display characters in manga images shown on electronic devices at an adjusted size.
[0025] This is a system configuration diagram relating to one embodiment of the present invention. This is a hardware configuration diagram of an electronic device relating to one embodiment of the present invention. This is a flowchart relating to one embodiment of the present invention. This is a diagram illustrating the processing of raw image data relating to one embodiment of the present invention. This is a diagram illustrating the processing of raw image data relating to one embodiment of the present invention. This is a flowchart relating to one embodiment of the present invention. This is an example of a user terminal screen an example of a user terminal screen relating to one embodiment of the present invention.
[0026] Figure 1 shows an example of a system configuration diagram of the present invention. System 100 is a system used to enlarge and display characters in manga images, and comprises a network 110, a user terminal 120 connected thereto, a manga provision server 130, a manga data storage 140, a source image processing server 150, and a source image data storage 160. The manga provision server 130 and the source image processing server 150 may be integrated, and the manga data storage 140 and the source image data storage 160 may be integrated. Furthermore, the manga provision server 130, the source image processing server 150, the manga data storage 140, and the source image data storage 160 may be integrated.
[0027] Figure 2 is a block diagram showing the hardware configuration of an electronic device according to one embodiment of the present invention. Here, a user terminal 120 will be described as an example of an electronic device. The user terminal 120 comprises a processor 121, an output device 122, an input device 123, a storage device 124, and a communication device 125. These components are connected by a bus 126. An interface is assumed to be interposed between the bus 126 and each component as needed. In this embodiment, the user terminal 120 is a smartphone. However, the user terminal 120 can be an information terminal such as a personal computer, tablet computer, or touchpad, as long as it has the above configuration.
[0028] The processor 121 controls the overall operation of the user terminal 120 and is, for example, a CPU. The processor 121 performs various processes by reading and executing programs 127 and data stored in the storage device 124. In one example, the processor 121 is composed of multiple processors.
[0029] The output device 122 displays application screens and other information to the user of the user terminal 120, in accordance with the control of the processor 121. Preferably, it is a liquid crystal display or an organic EL display, but any other display capable of showing information to the user is acceptable.
[0030] The input device 123 is a user interface that receives input from the user to the user terminal 120, and is, for example, a touch panel, touchpad, keyboard, or mouse. In this embodiment, the user terminal 120 is a smartphone, so the user terminal 120 is equipped with a touch panel as the input device 123, and the touch panel also functions as an output device 122, and the output device 122 and the input device 123 are integrated into a single structure. The output device 122 and the input device 123 may be in separate forms located in different positions.
[0031] The storage device 124 is a typical storage device found in smartphones or computers, including volatile memory (RAM) and non-volatile memory (ROM). The storage device 124 may also include external memory. For example, the storage device 124 stores an application program for implementing this embodiment. The application program includes various data that are referenced when the program is executed. The application is launched in response to user operations on the user terminal 120 and is executed on an operating system (OS) pre-installed on the user terminal 120.
[0032] In one example, the storage device 124 includes main memory and auxiliary storage. The main memory is a volatile storage medium capable of high-speed reading and writing of information, and is used as a storage area and work area when the processor 121 processes information. The auxiliary storage stores various programs and data used by the processor 121 when executing each program. The auxiliary storage is, for example, a hard disk drive, but it can be any non-volatile storage or non-volatile memory that can store information, and it may be removable. The auxiliary storage stores, for example, an operating system (OS), middleware, application programs, and various data that may be referenced in connection with the execution of these programs.
[0033] The communication device 125 exchanges data with other devices via the network 110 (omitted in Figure 2). For example, the communication device 125 connects to the network 110 using wireless communication such as mobile communication or wireless LAN. The user terminal 120 communicates with the manga provision server 130 via the network using the communication device 125. The communication device 125 may also perform wired communication using an Ethernet® cable or the like.
[0034] The manga distribution server 130 and the original image processing server 150 can also be implemented with a similar configuration. Since the manga distribution server 130 is a server computer, it is equipped with a keyboard and mouse as input devices and a liquid crystal display as a display device. The server application includes functions and various data to ensure that user programs appropriately receive input from users and present information to users at each user terminal 120, which is a user or client of the server.
[0035] The manga data storage 140 and the original image data storage 160 can also be realized with a similar configuration, but the output device 122 and input device 123 are not necessary if they are simply used as storage devices. The storage devices 140 and 160 may also be configured to function as databases. The manga data storage 140 may be integrated as a storage device of, for example, the manga provision server 130, and the original image data storage 160 may be integrated as a storage device of the original image processing server 150. Furthermore, the manga provision server 130, the original image processing server 150, the manga data storage 140, and the original image data storage 160 can also be configured as an integrated unit.
[0036] The user terminal 120 sends a request for manga content to the manga provision server 130 based on user input, receives manga data, which is the manga content, from the manga provision server 130, and presents manga images to the user based on the manga data. In response to a signal from the user via the user terminal 120 requesting manga images, the manga provision server 130 retrieves manga data from the manga data storage 140 and transmits the manga data to the user terminal. Furthermore, the user can also respond to a request for text enlargement on the user terminal 120 by providing manga data that includes enlarged text, thereby updating the manga image presented on the user terminal 120.
[0037] The original image processing server 150 retrieves the original image data of the manga stored in the original image data storage 160, performs processes such as extracting character areas and determining the magnification value for each character area to generate manga data, and stores it in the manga data storage 140.
[0038] A system as a first embodiment of the present invention is a system for enlarging and displaying characters in a manga image. Based on manga data representing the manga image, it displays a manga image including multiple character areas, receives information indicating a character enlargement request based on user input, and upon receiving a character enlargement request, enlarges and displays each of the multiple character areas indicated by the manga data based on the enlargement value set for each of them. The enlargement value set for each character area can be different for each character area. For example, a first enlargement value can be set for a first character area, and a second enlargement value different from the first enlargement value can be set for a second character area.
[0039] In the second embodiment, information indicating a character enlargement request based on user input includes a specified enlargement value, and the enlargement value set for each character area includes a maximum enlargement value. The specified enlargement value is the enlargement value specified by the user. The maximum enlargement value is the maximum value allowed for the enlargement of characters within that character area. The enlargement value set for each area may be the maximum enlargement value. If the maximum enlargement value set for a character area indicated by the manga data is greater than the specified enlargement value, the character area is enlarged and displayed based on the specified enlargement value; if the maximum enlargement value is less than or equal to the specified enlargement value, the character area is enlarged and displayed based on the maximum enlargement value.
[0040] The magnification value, maximum magnification value, and specified magnification value can be the magnification ratio, maximum magnification ratio, and specified magnification magnification, or the magnification size, maximum magnification size, and specified magnification size. The magnification size can be, for example, the font size. In the following explanation, unless otherwise specified, the magnification value, maximum magnification value, and specified magnification value will be explained using the magnification ratio, maximum magnification ratio, and specified magnification magnification magnification as examples, but the same process can be used for the magnification size, maximum magnification size, and specified magnification size.
[0041] Each of these functions may be implemented in a distributed manner across any of the electronic devices included in the system 100, or it may be implemented in only one electronic device. For example, these functions can also be realized by a user terminal 120. In this specification, the term "system" includes a single electronic device such as the user terminal 120.
[0042] The processing operation of the system according to the first embodiment will be described with reference to FIGS. 3 to 7. In the present embodiment, the operation of one user terminal 120 will be described for the sake of explanation, but similar processing can be executed on two or more user terminals 120.
[0043] First, FIG. 3 shows a flow (300) of original image data processing executed by the original image processing server 150. In the original image data processing, a character region to be enlarged is extracted from the original image data stored in the original image data storage 160, the maximum enlargement magnification is determined, and comic data including these pieces of information and image data for displaying the comic is stored in the comic data storage 140. The original image data typically includes data for displaying a comic as an image, and does not include information indicating which part in the comic image is a character or what characters are included. For example, the data may be data obtained by scanning a comic. However, the original image data may include character information, or may include other information. Even with such original image data, the original image data processing of the present invention can be executed to extract information necessary for subsequent processing.
[0044] The original image processing server 150 acquires original image data from the original image data storage 160 (S301). Then, processing for extracting a character region in the comic image indicated by the acquired original image data is executed (S302). The processing for extracting the character region includes processing for specifying characters in the image and the character regions that are portions indicating the characters, processing for specifying speech balloon regions that are portions indicating speech balloons, processing for specifying frames and pages, and processing for associating the character regions with the speech balloon regions, frames, and the like. In the present embodiment, processing for specifying the character type of the specified character is further executed.
[0045] The process for extracting text regions (S302) can be any process that can extract text and text regions from an image. For example, a pre-trained model can be used to identify text and text regions containing the text, and these regions can be tagged. Furthermore, processes such as identifying speech bubble regions, detecting text format, and detecting the presence or absence of a background for the text can be performed. These processes can then be compared with the previously identified text regions and image processing can be used to add information such as the type and size of the text and its relationship to speech bubbles.
[0046] This can be achieved using the Efficient and Accurate Scene Text Detector, a method for detecting characters using a pre-trained model, but it is understandable to those skilled in the art that it can also be achieved by other methods. Similarly, the process of identifying speech bubbles and panels can also be achieved by generally known methods. For example, it can be achieved using object detection models such as YOL, and it is also obvious to those skilled in the art that it can be achieved by the method disclosed in "A Study on a Manga Object Recognition Mechanism Using a Convolutional Neural Network" (Hideaki Yanagisawa et al., IEICE Technical Report, vol. 117, no. 238, PRMU2017-79, pp. 93-94, October 2017).
[0047] The character region extraction processing includes, in addition to character information and coordinate information, a method of extracting characters drawn in an image as text information and a method of extracting the same as a polygon region. The character information is information indicating the characters included in the character region, that is, information indicating characters such as alphabets included in the character region. In the case of extraction as text information, the characters may be specified as text data including font information such as a font size, or may be specified as SVG (Scalable Vector Graphics). Further, a region including the extracted text is specified as a character region. For example, as shown in FIG. 4, a region in which characters are drawn is specified as a rectangular region (411 to 419). Other shapes, such as a polygonal shape or an elliptical shape, may be used as long as the region in which the characters are drawn can be enclosed. The character region may be a character outline region defined by character data that defines the characters. In the case of extraction as a polygon region, for example, as shown in FIG. 5, the outline of a character may be specified as a character region (511 to 516), and polygon data defining this character region may be generated.
[0048] Further, the outline of a speech balloon is specified as a polygon region to specify the speech balloon region. Then, the speech balloon region is associated with the character region within that speech balloon region. For example, since the character region 411 is included in the speech balloon region 421, the speech balloon region 421 and the character region 411 are stored in association with each other. On the other hand, the character regions 415 to 419 are not character regions included in any speech balloon region, and thus are not associated with a speech balloon region. The association can be performed by comparing the coordinates of the speech balloon region and the character region. The character region may protrude from the speech balloon region. When the center of gravity of a character region is located within a speech balloon region, that character region may be associated with the speech balloon region.
[0049] Character type identification can be performed, for example, using a trained model based on character information representing the extracted characters. Character type identification may be performed not only by a single method but also by a combination of multiple methods. Character type is determined by determining which type the detected characters belong to during the process of extracting character regions. Character types can include, for example, speech bubble text, background text, non-speech bubble text, and onomatopoeia. Speech bubble text is text written inside a speech bubble. Whether or not a character is speech bubble text can be determined by whether or not the character's region is associated with a speech bubble region. If it is associated with a speech bubble region, it is speech bubble text; if not, it is another type of text, such as non-speech bubble text, background text, or onomatopoeia. Non-speech bubble text includes, for example, explanatory text and text that indicates the feelings of characters. Explanatory text is text that describes the situation, like narration (417). Text that indicates feelings is not speech bubble text but expresses the inner thoughts of characters (419). Background text is text drawn as part of the background of a comic strip; for example, text on a sign included in the background (418). Onomatopoeia is text that represents sounds such as the sound of rain (415, 416), the sound of thunder, or the sounds of animals. Background text and onomatopoeia may also be treated as text outside of speech bubbles, or it may be not necessary to use the text type "text outside of speech bubbles".
[0050] Next, the magnification factor is determined for the extracted text area (S304). Whether or not to set a magnification factor can be determined based on the type of text. For example, if the type of text is a callout text, the magnification factor is determined and set, but if it is text outside the callout, background text, onomatopoeia, or other text, the magnification factor may not be set, or the magnification factor may be set to 1.0, i.e., the magnification process may not be performed. The magnification factor in this embodiment is one example of the magnification value, and the same can be done with the magnification size.
[0051] The method for determining the magnification ratio is flexible. Administrators may set the optimal magnification ratio for each text area to ensure readability for users, or it may be determined automatically using predetermined rules or a trained model. After magnification, line breaks may be added or the position of line breaks may be changed. For callout text, it is preferable that the magnification ratio be set so that the text area does not exceed the callout area to which it is associated. After magnification, the magnification ratio may be increased within the range that does not exceed the callout area by adding line breaks or changing the position of line breaks. The position of line breaks may be determined manually or automatically as needed. If the text area is identified as a rectangular area, the rectangular area will be set so that it does not exceed the callout area; if it is identified as a polygon area, the polygon area will be set so that it does not exceed the callout area. For example, scaling can be performed with the centroid of the polygon area for the text area as the origin, resulting in a magnification ratio that does not go outside the callout area. In addition, when callout overflow is permitted, it may be possible to set a magnification ratio that exceeds the callout area as the magnification ratio that allows magnification. For example, if overflow is permitted, it may be possible to enlarge the speech bubble beyond its designated area, and the enlargement ratio may be 1.1 times that of the enlargement ratio when overflow is not permitted.
[0052] In this embodiment, the magnification factor is set for each text area. For example, if there are two speech bubble texts in a single comic image, a magnification factor is set independently for each. Text areas that are recognized as being displayed separately in a comic image can be recognized as separate text areas. For example, text areas 411 and 412 in Figure 4 are displayed separately in the comic image and can therefore be considered separate text areas. As one modification, multiple text areas can be grouped together and a single magnification factor can be set. Multiple text areas contained in a single panel or a single page may be grouped together, or any multiple text areas may be grouped together. In this case, for example, a magnification factor can be set so that any text area included in the group does not exceed the size of the speech bubble when magnification is performed. A magnification factor can be set for each group of text areas, and different magnification factors can be set for each group. The process of identifying which panel or text a text area is contained in can be performed as part of the text area identification process. A single magnification factor can be set for all text areas.
[0053] Next, the text regions extracted from the original image data are deleted, and background repair processing is performed on the deleted portions (S306). Only text regions with a magnification value greater than 1.0 can be deleted. Text regions with a magnification value greater than 1.0 are subject to text enlargement display processing, while text regions without a magnification value or with a magnification value of 1.0 are excluded. Background repair processing can be performed by general text region mask generation, character interpolation by image interpolation, and background inpainting, and is clearly understandable to those skilled in the art. In the text region identification process, a process to determine whether or not background repair processing is necessary may also be performed, and background processing may be performed only on text regions that are determined to require it. As one variation, background repair processing may not be performed at all.
[0054] Comic data is generated from the original image data processed in S301 to S306 and stored in the comic data storage 140 (S308). The comic data includes character area-related information associated with the extracted character areas and image data with restored backgrounds. The character area-related information includes information indicating the character area as a rectangular shape or polygon data, the coordinates of the character area, the character type, information associating it with a speech bubble, and the magnification factor. The character area-related information further includes text data such as characters and font information if characters were extracted as text information. It may also include information for defining other characters. It may also include information indicating the page or panel containing the character area, or information for identifying a group of character areas.
[0055] In one embodiment, information regarding the character area of character types that are not subject to the enlargement processing is not stored as manga data. For example, if only speech bubble text is subject to the enlargement processing, only the information regarding the character area of the speech bubble text is stored as manga data in the manga data storage 140.
[0056] The following table shows an example of character area-related information. This example shows the case where the characters of a character area are extracted as text information. An identification tag is assigned to the character area recognized by the character area identification process, and the character type, associated callout identification information, font information, magnification, and characters are associated with the identification tag. Callout areas are also identified and assigned tags during the character area identification process. As the associated callout identification information, the tag of the callout area containing the character area is set, so that the callout area and the character area are associated and stored. If it is not a callout character, information related to the callout is not set. Font information is information that indicates the font of the characters contained in the character area. Magnification indicates the magnification set for the character area. Coordinate information indicates the coordinates of the character area within the image. If no magnification is set, no value is set. Characters are information that indicates the characters such as alphabets contained in the character area.
[0057] For example, identification tag 001 is identification information associated with the text area 411 in Figure 4. The text type of the text area 411 associated with identification tag 001 is callout text, and since it is contained within callout area 421, the identification information F001 of callout area 421 is associated with it, the font information "family: "Calibri", size: "12px", weight: "normal" is set, the magnification is set to 1.4, and the text is set to "It's getting dark". The font information includes the initial size of the text within the text area (initial font size). For example, the initial size of identification tag 001 is "12px".
[0058] Next, the flow 600 for processing the enlargement of text in manga images based on manga data will be explained with reference to Figure 6. In this embodiment, the flow 600 is assumed to be executed on the user terminal 120, but it may also be realized through cooperation between the user terminal 120 and the manga provision server 130 or other hardware resources. For example, the user terminal 120 may request update data for enlargement from the manga provision server 130, and the manga provision server 130 may provide it.
[0059] In this embodiment, the processing of the present invention is performed using an application for providing manga installed on the user terminal 120, but it is also possible to perform it using a general browser, for example. Furthermore, the manga data used in flow 600 is not limited to the data generated by flow 300 of the original image data processing described in flow 300. For example, data generated by various methods may be mixed together.
[0060] Prior to the text enlargement processing flow 600, when a user receiving manga content (manga images) sends a signal to the manga provision server 130 via the user terminal 120 requesting the manga content, the manga provision server 130 retrieves the manga data from the manga data storage 140 and sends it to the user terminal 120. Based on the manga data received from the manga provision server 130, the user terminal 120 presents the manga images to the user by displaying them on a display, which is an output device.
[0061] Figures 7A and 7B show examples of application screens 700A and 7B on the user terminal 120 that present manga images to the user. Hereafter, A and B may be omitted and only the numbers will be shown, as they refer to all reference numbers that are A and B in relation to Figure 7. For example, 700 refers to 700A and 700B.
[0062] 711 is a magnification request input unit for inputting a request to enlarge and display text. When a user touches the magnification request input unit 711 on the display of the user terminal 120, which is a touch panel, a text enlargement request is received and the text enlargement display process is executed. When the user touches the magnification request input unit 711 again, a request to cancel the text enlargement request is received, the text enlargement process ends, and the display process is executed at the original text size. 711A indicates the state before the text enlargement request is received, and the text enlargement request is off, while 711B indicates the state after the text enlargement request has been received, when the text enlargement request is on and the text enlargement process is being executed. 712 is a comic image area that shows a comic image presented to the user. 700B indicates that the speech bubble text in the comic image area 712B is displayed enlarged based on the magnification ratio set for each text area.
[0063] The text enlargement display processing flow (600) begins when, after a manga image containing multiple text areas is displayed on the display based on manga data showing a manga image, information indicating a text enlargement request is received via the enlargement request input unit (S601). In this embodiment, the user terminal 120 receives information indicating that a text enlargement request has been made when the user touches the enlargement request input unit 711. When the user terminal 120 receives the information indicating a text enlargement request, it obtains the magnification ratio set for each displayed text area from the text area-related information of the manga data (S602). Then, it generates data for enlarging and displaying each text area based on the magnification ratio set for each obtained text area (S604), and updates and displays the manga image based on the generated data (S606). If the magnification ratio is set for multiple text areas as a group of text areas, this may be done for each group of text areas. The data generated for enlarging and displaying the text areas may be data for only the enlarged text areas, or it may be data for the entire manga image including the data for each enlarged text area. When generating data for only the enlarged text areas, the generated enlarged text can be superimposed on the manga image and presented to the user.
[0064] For example, when user terminal 120 receives manga data from manga provision server 130, it displays the manga image as shown in 712A of Figure 7A. The speech bubble text, which is the text to be enlarged, is displayed in speech bubbles 721A, 722A, 723A, and 724A at its initial size. The enlargement ratios for the speech bubble text in speech bubbles 721, 722, 723, and 724 are set to 1.4, 1.0, 1.5, and 1.4, respectively. The character types of other characters are onomatopoeia, explanatory text, or background text, and are not the character types to be enlarged. Here, it is assumed that the manga data does not contain character area-related information for character areas that are not the character types to be enlarged. Therefore, they are not subject to the character enlargement display processing flow 600. In one modified example, character area-related information is included in the manga data for these characters as well. Then, it may be determined whether or not to perform the enlargement process based on the character type included in the character area-related information. For example, if the text type is speech bubble text, it can be determined to be subject to enlargement, while onomatopoeia, background text, and text outside of speech bubbles can be determined not to be subject to enlargement.
[0065] In the example shown in Figure 7, when the user touches the enlargement request input unit 711A to input a character enlargement request (S601), the enlargement magnifications (1.4, 1.0, 1.5, and 1.4) set for each character area (721 to 724) are acquired (S602). Then, enlargement data is generated based on the acquired enlargement magnifications (S604), and a cartoon image with the character areas enlarged based on the generated enlargement data is displayed (S606). That is, the characters in speech bubbles 721 to 724 are displayed enlarged to 1.4, 1.0, 1.5, and 1.4 times, respectively.
[0066] As one variation, the magnification setting for each character area may include a magnification determined within a predetermined range where the character outline area extends beyond the callout area, in cases where permission input has been given to allow the text to extend beyond the callout area. For example, in an application screen, in addition to the magnification request input unit 711, an overflow permission input unit is provided to allow the text to extend beyond the callout. When overflow permission is given by input to the overflow permission input unit, the magnification setting for when overflow permission is granted is applied, and the character area is magnified. The magnification determined within a predetermined range where the character outline area extends beyond the callout area may be the magnification of the character area, or it may be a magnification that further increases the magnification when overflow permission is not granted. For example, if the magnification when overflow permission is not granted is 1.5 times, the magnification when overflow permission is granted may be 1.7 times, or it may be a magnification (1.1) that increases the magnification of 1.5 times when overflow permission is not granted by 1.1 times. When using a magnification ratio for cases where overflow is not permitted, the predetermined magnification ratio may be applied to all character areas rather than to each individual character area.
[0067] As a variation, the magnification factor can be replaced with the magnification size. The magnification size can be the font size displayed during the magnification process, which is set for each character area. When a user requests character magnification, the font size set for each character area is compared with the magnification size. If the font size is smaller, the character is magnified and displayed according to the magnification size. If the font size is larger, the magnification process is not performed. For example, in Table 1, the font size indicated by the font information of identification tag 001 is "12px," but if the magnification size is set to "16px," when a user requests character magnification, the font size and the magnification size are compared, and it is determined that the magnification size is larger, so the character is displayed at 16px. The same process can be performed for each character area to execute the magnification process.
[0068] Next, a second embodiment will be described. The explanation will focus on the differences from the first embodiment, and similar processes will be omitted or briefly described. The second embodiment differs from the first embodiment in that the information indicating a character enlargement request based on user input not only instructs enlarged display, but also includes a specified enlargement ratio that specifies the magnification ratio to be used. The maximum enlargement ratio means the maximum magnification ratio that is allowed for the characters within that character area. If the specified enlargement ratio included in the information indicating a character enlargement request is greater than the maximum enlargement ratio set for the character area shown in the manga data, the character area will be enlarged and displayed at the specified enlargement ratio. If the maximum enlargement ratio is less than or equal to the specified enlargement ratio, the character area will be enlarged and displayed at the maximum enlargement ratio.
[0069] As one variation, in addition to the maximum magnification, a preset optimal magnification and minimum magnification (minimum reduction) may be set. The optimal magnification is, for example, a magnification that the system administrator considers optimal, and does not necessarily mean that it is universally optimal. When input is received from a user instructing magnification display at the optimal magnification, the system can perform magnification display at the set optimal magnification, and when a magnification request including a specified magnification is received, the system can perform magnification display processing based on the user-specified magnification. In this case, the magnification processing can be the same as that of the first embodiment, for example. Furthermore, as a further variation, the user may be allowed to set a value smaller than 1.0x as the specified magnification, and the text magnification processing may be performed to display the text in a smaller size. In this case, the minimum allowable magnification may be set. When the display is smaller than 1.0x, it may be described as reduction rather than magnification.
[0070] The following describes the magnification display process when a magnification request including a specified magnification is received. First, the flow of original image data processing executed by the original image processing server 150 is the same as that shown in Figure 3, except that the magnification determination process (S304) determines the maximum magnification. In the first embodiment, the magnification is for displaying the image in a magnified state based on the magnification request, whereas in this embodiment, the image is displayed in a magnification specified by the user, within a range that does not exceed the maximum magnification. The data structure in Table 1 described in relation to the first embodiment can be used in the same way if the magnification is set to the maximum magnification.
[0071] Next, using Figure 8, we will explain the flow 800 of the text enlargement display process in manga images based on manga data. Also, Figures 9A to 9C show examples 900A to 9C of application screens that present manga images to the user on the user terminal 120. In relation to Figure 9, A to C may be omitted and only the numbers are shown to refer to all of the reference numbers A to C.
[0072] 911 is a magnification request input unit for inputting a request to enlarge and display characters. The user can specify the desired magnification by touching the display of the user terminal 120, which is a touch panel, and sliding the magnification request input unit. 911A indicates that the magnification specified by the user is 1.0x, 911B indicates that it is 1.3x, and 911C indicates that it is 1.5x. 912 is a comic image area that shows the comic image presented to the user. 900B and 900C indicate that the speech bubble text in the comic image areas 912B and 912C are displayed enlarged.
[0073] 913 is an overflow permission input section for instructing whether or not to allow text to overflow the speech bubble when it is enlarged. 913A and 913B indicate the case where overflow is not permitted, and 913C indicates the case where overflow is permitted. For example, if the maximum magnification when overflow is not permitted is set to 1.4x, then the maximum magnification when overflow is permitted will be 1.1x of the case when overflow is not permitted, i.e., 1.54x. In this case, if the specified magnification is 1.5x, since it is smaller than the maximum magnification of 1.54x, the text can be displayed at a magnification of 1.5x. 930 shows that in the speech bubble of the comic image area, the speech bubble text is displayed beyond the speech bubble area.
[0074] In this embodiment, the user is presented with a specified magnification and asked to input it. However, the user may choose not to be presented with a specified magnification, and instead, a specified magnification may be assigned to the position of the slider. The user may also be allowed to select from small, medium, or large magnification, with small corresponding to 0.7x, medium to 1.3x, and large to 1.5x.
[0075] The text enlargement display processing flow (800) begins when a text enlargement request including information indicating a specified magnification is received via the enlargement request input unit after a manga image containing multiple text areas is displayed on the display based on manga data indicating a manga image (S801). The user terminal 120 determines whether the maximum magnification set for the text area indicated by the manga data is greater than the specified magnification (S802). If the specified magnification is greater than the maximum magnification, the magnification is set to the maximum magnification (S804). If it is less than or equal to the maximum magnification, the magnification is set to the specified magnification (S806).
[0076] The user terminal 120 generates data for enlarging and displaying the text area based on the set magnification ratio (S808), and updates and displays the manga image based on the generated data (S810). Processing S802 to S808 is performed for each of the multiple text areas contained in the manga data. If a maximum magnification ratio is set for multiple text areas as a group of text areas, the process may be performed for each group of text areas.
[0077] Similar to the first embodiment, when the user terminal 120 receives manga data from the manga provision server 130, it displays the manga image as shown in 912A of Figure 9A. The speech bubble text, which is the text to be enlarged, is displayed in speech bubbles 921A, 922A, 923A, and 924A at a specified magnification ratio (1.0). The magnification ratios for the speech bubble text in speech bubbles 921, 922, 923, and 924 are set to 1.4, 1.0, 1.5, and 1.4, respectively.
[0078] The user touches the magnification request input unit 911 and slides it to change the specified magnification to 1.3x (S801). Since the specified magnification of 1.3 is less than or equal to the maximum magnification of the speech bubble text of speech bubbles 921, 923, and 924 (1.4, 1.5) (S802), the magnification for the speech bubble text area becomes 1.3x (S806), and the speech bubble text of speech bubbles 921, 923, and 924 is displayed magnified to 1.3x. On the other hand, since the specified magnification of 1.3 is greater than the maximum magnification of the speech bubble text of speech bubble 922 (1.0), the magnification becomes 1.0x (S804), and it is not displayed magnified. When the user touches the speech bubble permission input unit 913 to enable speech bubble permission, the maximum magnification is changed to 1.1x, and it becomes possible to display magnified text beyond the speech bubble area. Here, the maximum value that can be specified for the specified magnification is 1.5x. When speech bubble permission is enabled, the maximum magnification is 1.4 x 1.1 = 1.54 for speech bubble text in speech bubbles 921 and 924, 1.5 x 1.1 = 1.65 for speech bubble text in speech bubble 923, and 1.0 x 1.1 = 1.1 for speech bubble text in speech bubble 922. When a specified magnification of 1.5x is entered, the speech bubble text in speech bubbles 921, 922, and 924 will be magnified to a magnification exceeding the maximum magnification when overflow permission is disabled, and the speech bubble text will be displayed beyond the speech bubble area. On the other hand, the speech bubble text in speech bubble 923 will not exceed the speech bubble area up to 1.5x magnification, so it will be displayed within the range that does not exceed the speech bubble area.
[0079] As a variation, the maximum magnification and specified magnification can be replaced with the maximum magnification size and specified magnification size. When a user requests text enlargement, the maximum magnification size set for each text area is compared with the specified magnification size. If the maximum magnification size is larger, the text is enlarged and displayed according to the specified magnification size. If the maximum magnification size is smaller than the specified magnification size, the enlargement process is performed according to the maximum magnification size. The initial font size pre-set for each text area is compared with the specified magnification size, and if the initial font size is larger, the enlargement process may not be performed.
[0080] For example, if the font size indicated by the font information of identification tag 001 is "12px", but the maximum enlargement size is set to "16px", and the specified enlargement size specified by the user is "14px", then when the enlargement process is executed, since the specified enlargement size is smaller than the maximum enlargement size, the characters in that character area will be displayed at the specified enlargement size of "14px". On the other hand, if the specified enlargement size specified by the user is "18px", then when the enlargement process is executed, since the specified enlargement size is larger than the maximum enlargement size, the characters in that character area will be displayed at the maximum enlargement size of "16px". If the specified font size is "10px", in one embodiment, since the specified enlargement size is smaller than the maximum enlargement size, it may be displayed at a reduced size of "10px", and in another embodiment, since the specified enlargement size is smaller than the initial font size of "12px", it may be excluded from the enlargement (reduction) process. The same process can be performed on multiple character areas.
[0081] In the embodiments described above, the magnification ratio and maximum magnification ratio were included in the data related to the text area contained in the manga data. However, in one modification, these may be determined within the flow of the text enlargement display process. For example, after receiving a text enlargement request, the maximum magnification ratio may be determined within a range where the text area does not exceed the speech bubble area associated with that text area.
[0082] In the embodiments described above, the manga data generation processing flow 300 was not described as processing based on a request from the user terminal 120. However, it may be executed based on user input via the user terminal 120, similar to the text enlargement display processing flows 600 and 800. Furthermore, flows 300, 600, and 800 may be executed as a series of processes. For example, when a user sends a request for manga content to the manga provision server 130 via the user terminal 120, the manga provision server 130 acquires the original image data for the manga requested by the user and executes a process to generate manga data (300), and sends this generated manga data to the user terminal 120. The user terminal 120 then presents the manga image to the user based on the received manga data. When a text enlargement request is input by the user, the manga image with the text area enlarged by a magnification based on the specified magnification ratio can be displayed (800).
[0083] In the processes or operations described above, the processes or operations can be freely modified, as long as no inconsistencies arise in the processes or operations, such as using data that should not yet be available at a given step. Furthermore, the embodiments described above are illustrative examples for explaining the present invention, and the present invention is not limited to these embodiments. The present invention can be implemented in various forms without departing from its essence.
[0084] 100: System, 110: Network, 120: User terminal, 121: Processor, 122: Output device, 123: Input device, 124: Storage device, 125: Communication device, 126: Bus, 127: Program, 130: Manga provision server, 140: Manga data storage, 150: Original image processing server, 160: Original image data storage
Claims
1. A system for enlarging and displaying text in a manga image, the system displays a manga image containing multiple text areas based on manga data representing the manga image, receives information indicating a text enlargement request based on user input, and, upon receiving the information indicating the text enlargement request, enlarges and displays each of the multiple text areas indicated by the manga data based on the enlargement value set for each of them.
2. The system according to claim 1, wherein the magnification value is a magnification ratio or magnification size.
3. The system according to claim 1, wherein one or more character regions included in the plurality of character regions are a group of character regions that include two or more character regions that are displayed separately when displayed in the cartoon image.
4. The system according to claim 3, wherein the multiple character regions included in the group of character regions are character regions of the same frame or page.
5. The system according to claim 1, wherein the information indicating a character enlargement request based on user input includes a specified enlargement value, the enlargement value includes a maximum enlargement value indicating the maximum value for which enlargement display is permitted, and the system for enlarging and displaying each character area is as follows: if the maximum enlargement value set for the character area indicated by the manga data is greater than the specified enlargement value, the character area is enlarged and displayed based on the specified enlargement value; and if the maximum enlargement value is less than or equal to the specified enlargement value, the character area is enlarged and displayed based on the maximum enlargement value.
6. The system according to claim 5, wherein the maximum magnification value and the specified magnification value are the maximum magnification ratio and the specified magnification rate or the maximum magnification size and the specified magnification size.
7. The system according to claim 6, wherein the maximum magnification value and specified magnification value are the maximum magnification size and the specified magnification size, and the display of each character area is performed when the initial size set in advance for each character area is smaller than the specified magnification size.
8. The cartoon image includes at least a first and a second text area, a first maximum magnification value is set for the first text area, a second maximum magnification value is set for the second text area, and the system displays the first text area magnified by the specified magnification value if the first maximum magnification value set for the first text area indicated by the cartoon data is greater than a specified magnification value, displays the first text area magnified by the first maximum magnification value if the first maximum magnification value is less than or equal to the specified magnification value, displays the first text area magnified by the first maximum magnification value, displays the second text area magnified by the specified magnification value if the second maximum magnification value set for the second text area indicated by the cartoon data is greater than a specified magnification value, displays the second text area magnified by the second maximum magnification value if the second maximum magnification value is less than or equal to the specified magnification value, the system according to claim 5.
9. The system according to claim 1, wherein if a manga image contains characters that are not subject to enlargement, enlarging and displaying the character area does not enlarge and display the characters that are not subject to enlargement.
10. The system according to claim 1, which determines the characters to be included in the character area, determines the character type of the determined characters, determines whether the character type of the determined characters is a character type to be enlarged, sets the enlargement value of the character area of the determined characters if it is determined that the character type of the determined characters is a character type to be enlarged, and does not set the enlargement value of the character area of the determined characters, or sets the enlargement value to 1.0 if it is determined that the character type of the determined characters is not a character type to be enlarged.
11. The system according to claim 10, wherein if the character type of the determined character is a callout character, it is determined to be a character type to be enlarged, and if the character type of the character is a callout character, setting the enlargement value includes setting the enlargement value for the character area based on the size of the character area containing the callout character and the callout area corresponding to the callout character.
12. The system according to claim 11, wherein the magnification value for the speech bubble text is determined within a range such that the text area containing the speech bubble text does not exceed the speech bubble area corresponding to the speech bubble text.
13. The system according to claim 12, wherein the magnification value includes a magnification value determined within a predetermined range in which the contour area of the character exceeds the callout area, in case a permission input is made that allows it to exceed the callout area.
14. The system according to claim 10, wherein if the character type of the determined character is onomatopoeia, text outside a speech bubble, or background text, it is determined that it is not a character type to be enlarged.
15. The system according to claim 1, wherein the character area is at least one of a polygonal area containing a character, a character contour area defined by polygon data, or a character contour area defined by character data.
16. The system according to claim 1 for determining the text area in a manga image.
17. A computer-based method for enlarging and displaying text in a manga image, comprising: displaying a manga image including multiple text areas based on manga data representing the manga image; receiving information indicating a text enlargement request based on user input; and, upon receiving the information indicating the text enlargement request, enlarging and displaying each of the multiple text areas represented by the manga data based on the enlargement value set for each of them.
18. A program for causing a computer to perform the method described in claim 17.
