Information processing device, image processing range designation method, and image processing range designation program

Abstract

To provide an information processing device, an image processing range designation method and an image processing range designation program for enabling a user to simply designate a processing range of an image displayed on a touch panel display.SOLUTION: A trimming function that comic browsing application has identifies a touch position of an indication body on a screen 3a. The trimming function then changes; according to a time period during which the indication body touches the screen 3a; a trimming range 50 of an image displayed on the screen 3a, around the touch position of the indication body regarded as a reference position. Specifically, the trimming function changes the trimming range 50 automatically according to the touch time period when the indication body touches the screen 3a, so that a user can simply designate the trimming range 50 of the image displayed on the screen 3a.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device, an image processing area designation method, and an image processing area designation program. [Background technology]

[0002] In recent years, various online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are delivered to information processing devices such as mobile terminals via computer networks have become widespread.

[0003] Apps include, for example, apps for viewing distributed manga, apps for editing images, etc. Such apps are provided with multiple functions, such as a function for moving forward or backward in the manga displayed on the screen (flip function), a function for cutting out and processing a part of the manga image (trimming function), etc. A user appropriately selects a desired function from among these multiple functions and has the app execute it.

[0004] Here, Patent Document 1 discloses an electronic book or portable information device that performs floating by tracing an area where information that a user wants to cut out is described with an index finger, encircling the area with a rectangle, and then removing the finger from the screen, thereby displaying the enclosed area as if it were floating on the screen. Patent Document 1 also discloses a method of designating two points P1 and P2 on the screen with the finger, and floating a rectangular area with the line segment connecting the two points as its diagonal. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2000-163444 A Summary of the Invention [Problem to be solved by the invention]

[0006] The action of tracing the area of ​​the image to be cut out with a finger as disclosed in Patent Document 1 is similar to the action of moving the area of ​​the image displayed on a touch panel display. Also, the action of specifying two points P1 and P2 on the screen with a finger to determine the area to be cut out is similar to the action of enlarging or reducing the image displayed on a touch panel display.

[0007] For this reason, there is a need to develop new gestures for specifying the area to be trimmed from an image displayed on a touch panel display, and it is also desirable for the gestures to be simple.

[0008] The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, an image processing range designation method, and an image processing range designation program that allow a user to easily specify the processing range of an image displayed on a touch panel display. [Means for solving the problem]

[0009] In order to solve the above problems, an information processing device, an image processing area designation method, and an image processing area designation program according to the present invention employ the following means.

[0010] In order to solve the above problems, an "information processing device" which is one aspect of the present invention is an information processing device which displays content consisting of moving images or still images on a touch panel display, and which is equipped with a contact position identification means which identifies the contact position of a pointer on the touch panel display, and a processing range change means which, based on the contact position, changes the processing range of an image displayed on the touch panel display in accordance with the contact time of the pointer.

[0011] In order to solve the above problems, an "image processing range designation method" according to one embodiment of the present invention is an image processing range designation method carried out by an information processing device that displays content consisting of moving images or still images on a touch panel display, and includes a first step of identifying a contact position of a pointer on the touch panel display, and a second step of changing the processing range of an image displayed on the touch panel display in accordance with the contact time of the pointer, based on the contact position.

[0012] In order to solve the above problems, an "image processing range designation program" which is one aspect of the present invention causes a computer provided in an information processing device which displays content consisting of moving images or still images on a touch panel display to function as a contact position identification means which identifies the contact position of a pointer on the touch panel display, and a processing range change means which, based on the contact position, changes the processing range of an image displayed on the touch panel display in accordance with the contact time of the pointer.

[0013] The above-mentioned "information processing device" may be subject to various technical limitations, as exemplified below. In addition, technical limitations of the same purport may be applied to the processing steps executed by the "image processing range designation method" or the functions of the "image processing range designation program."

[0014] The processing range changing means stops changing the processing range when the indicator is moved away from the touch panel display after starting to change the processing range.

[0015] The processing range changing means alternately enlarges and reduces the processing range by repeatedly bringing the pointer into contact with and separating from the touch panel display.

[0016] The processing range changing means changes the processing range based on the contact position, and when the indicator is moved away from the touch panel display, changes the processing range in the opposite direction to that before, and then stops changing the processing range when the indicator comes into contact with the touch panel display.

[0017] The processing range changing means changes a rate of change of the processing range each time the processing range is repeatedly expanded and contracted.

[0018] The content is a manga having frames, and the processing range changing means changes the processing range based on the frame of the frame.

[0019] The processing-range changing means expands the processing range based on the contact position, and stops expanding the processing range when the processing range expands to the frame including the contact position.

[0020] When the contact position is deviated from the center of the frame including the contact position, the processing range changing means controls the speed of expansion of the processing range so that the periphery of the processing range reaches multiple sides constituting the frame of the frame at the same time. Effect of the Invention

[0021] According to the present invention, there is an advantage that a user can easily specify a processing range of an image displayed on a touch panel display. [Brief description of the drawings]

[0022] [Figure 1] 1 is a configuration diagram of a manga distribution system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing an electrical configuration of a server according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a block diagram showing an electrical configuration of the mobile terminal according to the embodiment of the present invention. [Figure 4] FIG. 4 is a schematic diagram showing a trimming range according to the embodiment of the present invention. [Diagram 5] FIG. 1 is a schematic diagram showing a trimming range for a manga frame border according to an embodiment of the present invention. [Figure 6] 11A to 11C are schematic diagrams showing examples of processing for a trimming range according to an embodiment of the present invention; [Figure 7]FIG. 2 is a functional block diagram relating to a manga viewing function of a mobile terminal according to an embodiment of the present invention. [Figure 8] 4 is a flowchart showing the flow of a trimming area designation process according to an embodiment of the present invention. [Figure 9] FIG. 11 is a schematic diagram showing a trimming range according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Hereinafter, an embodiment of an information processing device, an image processing range designation method, and an image processing range designation program according to the present invention will be described with reference to the drawings. In this embodiment, as an example, a form will be described in which a manga is delivered from a server to a mobile terminal, which is an information processing device, and the delivered manga is viewed by a user using the mobile terminal.

[0024] [1. Manga distribution system configuration] 1 is a schematic diagram of a manga distribution system 1 according to this embodiment. The manga distribution system 1 includes a communication line 2, a plurality of mobile terminals 3, and a server 4.

[0025] The communication line 2 forms a computer network, and is, for example, a wide area communication line provided by an electric utility company.

[0026] The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, a tablet terminal, or a notebook computer, and is used by a user to utilize web services distributed via the communication line 2. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for inputting sound, and a camera 3d for capturing an image of a subject. Here, the touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing object such as a finger, a stylus, or a pen.

[0027] The server 4 is an information processing device that distributes web services to the mobile terminal 3 via the communication line 2.

[0028] The manga distribution system 1 according to the present embodiment distributes manga in the form of digital data from a server 4 to a mobile terminal 3 via a communication line 2 as one of the web services. The manga referred to here is an example of content formed by a series of still images, which are composed of pictures and have a story as a whole. A user uses dedicated application software (hereinafter referred to as a "manga viewing application") to view the manga distributed to the mobile terminal 3. The manga viewing application is pre-installed in the mobile terminal 3. As an example, the manga viewing application can display manga on the mobile terminal 3 page by page, and can also enlarge or reduce the manga displayed on a page by page basis. Note that the manga viewing application can function even when the mobile terminal 3 and the server 4 are not communicating with each other (offline state) as long as manga data has been downloaded from the server 4 to the mobile terminal 3.

[0029] [2. Server configuration] FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to the present embodiment.

[0030] The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20 which is a main control unit that controls the operation of the entire server 4, a ROM in which various programs and various data are stored in advance, The computer includes a Read Only Memory (RAM) 22, a Random Access Memory (RAM) 24 used as a work area when the CPU 20 executes various programs, and a Hard Disk Drive (HDD) 26 as storage means for storing various programs and various data.

[0031] The HDD 26 stores manga data indicating manga to be distributed to the mobile terminal 3. Note that the storage means is not limited to the HDD 26, and may be, for example, another storage medium such as a semiconductor memory, such as a flash memory.

[0032] Furthermore, the server 4 is equipped with an operation input unit 28 composed of a keyboard, a mouse, etc. and which accepts input of various operations, a monitor 30 such as a liquid crystal display device for displaying various images, and an external interface 32 which is connected to other information processing devices such as a mobile terminal 3 via the communication line 2 and which transmits and receives various data to and from the other information processing devices.

[0033] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to one another via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation state of the operation input unit 28, display images on the monitor 30, and transmit and receive various data to and from other information processing devices, etc. via the external interface 32.

[0034] [3. Electrical configuration of mobile terminal] FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG.

[0035] The mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48 in addition to the components shown in FIG.

[0036] The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the overall operation of the mobile terminal 3.

[0037] The main storage unit 42 is configured with, for example, a RAM or a DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

[0038] The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, and programs used for processing by the main control unit 40. The programs stored in the auxiliary storage unit 44 are, for example, an OS (Operating System) for implementing basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing e-mail, web browsing, and various other functions. In addition, the auxiliary storage unit 44 prestores a manga viewing application for displaying manga distributed from the server 4 on the touch panel display 3a.

[0039] The communication unit 46 is, for example, a network interface controller (NIC), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have, instead of or together with the NIC, a function of connecting to a wireless local area network (LAN), a function of connecting to a wireless wide area network (WAN), and a function of enabling short-distance wireless communication such as Bluetooth (registered trademark), infrared communication, and the like.

[0040] The operation buttons 48 are provided on the side surface of the mobile terminal 3, and include a power button for starting and stopping the mobile terminal 3, a volume adjustment button for the sound output by the speaker 3b, and the like.

[0041] The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and operation buttons 48 are electrically connected to one another via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, grasp the operation state of the touch panel display 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0042] [4. Trimming function] The user reads the manga distributed from the server 4 using a manga viewing app installed on the mobile terminal 3. This manga viewing app is equipped with various functions, and the user selects a function as necessary and has the manga viewing app execute it.

[0043] The manga viewing application according to this embodiment has a trimming function. The trimming function specifies a processing range (hereinafter referred to as a "trimming range") to be subjected to image processing and the like for the manga image displayed on the screen 3a (touch panel display 3a). As will be described in detail later, the trimming function according to this embodiment specifies the trimming range by touching and separating an indicator to and from the screen 3a.

[0044] [4-1. Specifying the trimming range] The trimming function according to this embodiment specifies the contact position of the indicator on the screen 3a. The trimming function according to this embodiment uses the contact position of the indicator as a reference and changes the trimming range of the image displayed on the screen 3a according to the contact time of the indicator on the screen 3a. That is, when the indicator contacts the screen 3a, the trimming function according to this embodiment automatically changes the trimming range according to the contact time, so that the user can easily specify the trimming range of the image displayed on the screen 3a.

[0045] As described above, the trimming function according to the present embodiment changes the trimming range based on the contact position of the indicator. As an example of this, the trimming function according to the present embodiment changes the trimming range centered on the contact position of the indicator, but is not limited to this, and the trimming range may be changed centered on a position slightly shifted from the contact position of the indicator. For example, when the indicator is a finger, the trimming range may be changed centered, for example, 1 cm above the contact position of the indicator. This makes it easier for the user to recognize the center of the trimming range because the center of the trimming range is not hidden by the user's finger.

[0046] In this embodiment, the indicator is a user's finger, and the user touches the screen 3a for a predetermined period of time or longer. When the touch panel is pressed and held for a long time (for example, 2 seconds or more), the manga viewing application executes the trimming function. That is, the long press position becomes the contact position. Also, the trimming function cannot be executed when the manga displayed on the screen 3a is scrolling, but can be executed when the scrolling has stopped.

[0047] Fig. 4 is a diagram showing a trimming range 50 that is displayed by a long press on the screen 3a. Note that the example of Fig. 4 shows a state in which a manga is displayed on the screen 3a, although there is no notation.

[0048] As an example, the trimming function according to this embodiment sets the trimming range 50 to a circular closed figure. Specifically, the trimming range 50 is expanded into a circular shape by expanding from the long press position 52 on the screen 3a at a uniform speed in all directions in proportion to the duration of the long press, with the long press position 52 as the center. Note that the speed at which the trimming range 50 expands is set in advance, and as an example, the user can change the set speed.

[0049] The trimming function according to this embodiment stops changing (enlarging) the trimming range 50 when the pointer is moved away from the screen 3a after starting to change the trimming range 50 around the long press position 52 of the pointer. This allows the user to specify the desired trimming range 50 with just a simple operation of touching and moving the pointer to the screen 3a. In the following description, moving the pointer away from the screen 3a is also referred to as touch-off.

[0050] Furthermore, after the user touches off, the trimming function according to this embodiment displays on the screen 3a a confirmation dialog prompting the user to input an input such as saving the image within the specified trimming range 50 or canceling the designation of the trimming range 50. If the specified trimming range 50 is not the desired range, the user performs a long press on the screen 3a to designate the trimming range 50 again.

[0051] Furthermore, when the trimming range 50 is expanded, if the long press position 52 moves without the pointer being separated from the screen 3a, the trimming range 50 also moves together with the movement of the long press position 52. That is, the user can arbitrarily move the center of the trimming range 50 by moving the long press position 52. Note that the trimming function may continue to expand the trimming range 50 even when the long press position 52 is moving, but is not limited thereto. The expansion of the trimming range 50 may be temporarily halted when the long press position 52 is moving, and the expansion of the trimming range 50 may be resumed when the movement of the long press position 52 stops.

[0052] [4-2. Variation 1 of specifying the trimming range] The trimming function may alternately enlarge and reduce the trimming range 50 by repeatedly touching and separating the indicator from the screen 3a. For example, after the trimming function stops enlarging the trimming range 50 by touch-off, if another long press is performed within a predetermined time (e.g., within 5 seconds), the trimming function reduces the trimming range 50, and if another touch-off is performed, the trimming function stops the reduction of the trimming range 50. Furthermore, if a third long press is performed within the predetermined time, the trimming function starts enlarging the trimming range 50.

[0053] This allows the user to easily specify a desired range for the trimming range 50 by repeatedly touching and separating the pointer from the screen 3a. Note that, as an example, the trimming function displays a confirmation dialog on the screen 3a each time the user touches off, prompting the user to input an operation such as enlarging or reducing the trimming range 50, saving the image within the trimming range 50, or canceling the specification of the trimming range 50.

[0054] The trimming function may change the speed of change of the trimming range 50 each time the trimming range 50 is enlarged and reduced. As an example, the speed of change of the trimming range 50 is slowed down in stages. This allows the user to fine-tune the trimming range 50, making it easier to specify the desired trimming range 50. The degree to which the speed of change of the trimming range 50 is slowed down is predetermined. Also, when enlargement and reduction are repeated a predetermined number of times or more, the process of changing the speed of change of the trimming range 50 may not be executed any more. Furthermore, the trimming function may increase the speed of change of the trimming range 50 each time the trimming range 50 is enlarged and reduced. This allows the user to specify the trimming range 50 more quickly.

[0055] [4-3. Variation 2 of specifying the trimming range] The trimming function may change the trimming range 50 around the long press position 52 of the pointer, change the trimming range 50 in the opposite direction when the pointer moves away from the screen 3a, and then stop changing the trimming range 50 when the pointer comes into contact with the screen 3a.

[0056] That is, in the trimming function according to Variation 2, when the trimming range 50 is expanded by starting a long press, the expansion of the trimming range 50 is stopped when the touch is released, but thereafter, the trimming range 50 is automatically reduced. Then, when the trimming range 50 becomes a desired range as a result of the reduction, the user stops the reduction of the trimming range 50 by tapping the screen 3a with the pointer.

[0057] Note that the trimming function according to Variation 2 may temporarily halt the change in the trimming range 50 and display a confirmation dialog on the screen 3a before the trimming range 50 is reduced by touch-off. This confirmation dialog includes buttons that prompt the user to input options such as saving the image shown in the trimming range 50, reducing the trimming range 50, and canceling the designation of the trimming range 50. This allows the user to save the image within the trimming range 50 without reducing it when the trimming range 50 has been enlarged to the desired range.

[0058] Furthermore, when the trimming function is executing automatic reduction of the trimming range 50, if the user presses and holds the screen 3a rather than tapping it, the trimming function may stop the reduction of the trimming range 50 and resume the expansion of the trimming range 50. Furthermore, the trimming function may change the rate of change of the trimming range 50 each time the expansion and reduction of the trimming range 50 is repeated.

[0059] [4-4. Expanding the trimming range according to the manga frame border] The manga that the user views with the manga viewing app according to this embodiment is, as an example, a manga having frames. The manga viewing app recognizes the center position (center of gravity) and shape of the frame of the manga frame (hereinafter referred to as the "frame frame") displayed on the screen 3a, for example, by image recognition or the like. In other words, the frame frame is the outer edge of the frame. In this embodiment, as an example, the frame frame is an area surrounded by lines that define the range of the frame. For example, the frame frame is a rectangular shape such as a square, rectangle, or parallelogram.

[0060] The trimming function may change the trimming range 50 based on the frame border, allowing the user to easily cut out a desired frame of a manga.

[0061] As one example of this, the trimming function may expand the trimming range 50 around the long press position 52, and stop expanding the trimming range 50 when the trimming range 50 expands to the frame border of the frame that includes the long press position 52.

[0062] Now, the enlargement of trimming range 50 according to frame frame 54 (hereinafter referred to as "frame frame-based enlargement process") will be described with reference to Fig. 5. Note that, in the example of Fig. 5, frame frame 54 has a regular square shape, but the shape of frame frame 54 is not limited to this.

[0063] 5A is a schematic diagram showing the expansion of the trimming range 50 when the long press position 52 is the same as the center position of the frame 56. In this case, the frame frame reference expansion process expands the trimming range 50 in all directions at a uniform speed. That is, the trimming range 50 expands from the long press position 52 to the four sides of the frame frame (sides x1, x2, y1, and y2) such that Vx1=Vx2=Vy1=Vy2. Vx1 is the speed toward side x1, Vx2 is the speed toward side x2, Vy1 is the speed toward side y1, and Vy2 is the speed toward side y2. As a result, the trimming range 50 reaches the multiple sides that make up the frame frame 54 at the same time.

[0064] The trimming range 50 changes in size so as to fit the outer edge of the frame frame 54. That is, even if a part of the trimming range 50 reaches the frame frame 54, the other part continues to expand so as to have the same shape as the outer edge of the frame frame 54. As a result, the trimming range 50 eventually has the same shape as the frame frame 54. However, this is not limited to the above, and the trimming range 50 may stop expanding when it reaches all four sides of the frame frame 54 and maintain its circular shape. Also, even if the trimming range 50 has not reached the frame frame 54, the expansion of the trimming range 50 stops when the indicator is touched off from the screen 3a.

[0065] Furthermore, in the frame frame-based enlargement process, even if the trimming range 50 is enlarged until it reaches the frame frame 54, the trimming range 50 may be further enlarged if the long press continues. Specifically, in the frame frame-based enlargement process, if the trimming range 50 is enlarged until it reaches the frame frame 54 and the long press continues, the enlargement of the trimming range 50 is temporarily stopped and then the trimming range 50 is enlarged again. In this way, the frame frame-based enlargement process temporarily stops the enlargement when the trimming range 50 reaches the frame frame 54, thereby giving the user time to select whether to make the trimming range 50 the same as the frame frame 54 or to enlarge the trimming range 50 beyond the frame frame 54.

[0066] 5(B) is a schematic diagram showing the expansion of trimming range 50 when long press position 52 is displaced from the center of frame 56 that contains long press position 52. In this case, the frame frame reference enlargement process controls the speed of expansion of trimming range 50 so that the periphery of trimming range 50 reaches multiple sides that make up frame frame 54 at the same time. As a result, regardless of the user's long press position 52, trimming range 50 expands to match frame frame 54, improving convenience for users who want to specify trimming range 50 based on frame frame 54.

[0067] In the example of FIG. 5B, the long press position 52 is located below the frame 56. That is, the long press position 52 is closer to the side y1 than to the side y2. Meanwhile, the long press position 52 is located midway between the sides x1 and x2. For this reason, the frame frame reference enlargement process controls the enlargement of the trimming range 50 by making Vy2>Vy1 so that the trimming range 50 reaches the sides y1 and y2 at the same timing. Meanwhile, the speed at which the trimming range 50 reaches the side x1 and the speed at which the trimming range 50 reaches the side x2 are set to the same speed (Vx1=Vx2). Then, Vy1, Vy2, Vx1, and Vx2 are controlled so that the above-mentioned relationship of Vy1>Vy2 and Vx1=Vx2 is maintained and the timing at which the trimming range 50 reaches each of the sides x1, x2, y1, and y2 is the same.

[0068] The user can set whether or not to execute the frame frame-based enlargement process. If the frame frame-based enlargement process is not executed, the trimming range 50 is enlarged according to the contact time of the pointer, centered on the long press position 52, as described above, regardless of the positional relationship between the long press position 52 and the frame 56.

[0069] Figure 6 shows another example of frame frame-based enlargement processing, in which the trimming range 50 expands at a constant speed in either direction regardless of the position of the long press position 52, but an area 58 beyond the frame frame 54 is not included in the trimming range 50.

[0070] Furthermore, the trimming range 50 may not only be expanded within a range not exceeding the frame frame 54 as described above, but may also be expanded beyond the frame frame 54 while using the frame frame 54 as a reference.

[0071] For example, when the trimming range 50 is expanded so that the trimming range 50 includes not only the frame 56 that includes the long press position 52 but also other adjacent frames 56, a determination may be made as to whether or not to include those other frames 56 as well and to subject them to trimming.

[0072] In this determination, when the trimming range 50 includes not only the frame 56 including the long press position 52 but also other adjacent frames 56, the range including the adjacent frames 56 is subject to cutting (copying) only if the adjacent frames 56 account for a predetermined ratio or more of the entire trimming range 50. On the other hand, if the adjacent frames 56 account for less than the above-mentioned predetermined ratio, the range including the adjacent frames 56 is not subject to cutting, and only the range of the frame 56 including the long press position 52 is subject to cutting.

[0073] [4-5. Processing the trimming area] The trimming function according to this embodiment may include a process (hereinafter referred to as "image processing") for performing various processes on the image within the trimming range 50. Examples of image processing are given below. Note that the image processing may involve performing processing on the image within the trimming range 50 before the image is saved, or the image within the trimming range 50 may be saved and then processed, and the saved image may be saved separately.

[0074] Image processing includes masking a partial area of ​​the trimming range 50. For example, in the case where the image includes a manga speech bubble, the masking process masks the characters in the speech bubble and the entirety of the speech bubble.

[0075] Furthermore, the image processing includes an image superimposition process in which an image is superimposed on the trimming range 50. The image superimposition process superimposes, for example, character information as an image. The superimposed character information may include, in addition to characters entered as text or handwritten characters, for example, date and time information indicating the date and time of trimming, source information indicating the source of the trimmed manga, copyright information indicating the copyright of the trimmed manga, and the like.

[0076] In addition, as shown in FIG. 6, the image overlay process may filter an area 58 of the trimming range 50 that extends beyond the frame frame 54 (the hatched area in FIG. 6) by filling it in with white or another image, and then overlaying text information or the like on this filtered area 58.

[0077] Furthermore, the image superimposition process may superimpose a decorative image such as a frame or a stamp on the trimming area 50 as another image.

[0078] [5. Functional block of manga viewing function] 7 is a functional block diagram relating to a manga viewing function executed by a manga viewing application installed in the mobile terminal 3 according to this embodiment. The main control unit 40 included in the mobile terminal 3 includes a manga display control unit 60, a scroll control unit 62, and a trimming function execution unit 64. The processes executed by each function included in the main control unit 40 are realized by programs stored in the auxiliary storage unit 44.

[0079] The comic display control unit 60 causes the comic distributed from the server 4 to be displayed on the screen 3a.

[0080] The scroll control unit 62 scrolls the manga displayed on the screen 3a in response to an operation on the screen 3a by a pointer.

[0081] The trimming function execution unit 64 executes the trimming function when the screen 3a is pressed and held for a predetermined period of time or longer. The trimming function execution unit 64 includes a touch determination unit 70, a trimming range change unit 72, and a processing unit 74.

[0082] The touch determination unit 70 determines whether or not the indicator has come into contact with the screen 3a, whether or not a long press has been performed, and if a long press has been performed, identifies the long press position 52. The touch determination unit 70 also determines whether or not a touch-off has occurred from the screen 3a.

[0083] The trimming range changing unit 72 performs the above-mentioned various processes for changing the trimming range 50, such as changing the trimming range 50 in accordance with the contact time of the pointer, centered on the long press position 52 of the pointer on the screen 3a. The various processes also include the frame frame reference enlargement process.

[0084] The image processing unit 74 performs image processing on the image within the trimming area 50 .

[0085] The trimming function execution unit 64 has functions necessary for the trimming function, such as a function for displaying a confirmation dialog on the screen 3a and a function for saving the image within the trimming range 50, in addition to the functions executed by the above configuration.

[0086] [6. Flowchart of trimming range specification process] FIG. 8 is a flowchart showing the flow of a manga browsing process executed by the main control unit 40 included in the mobile terminal 3.

[0087] First, in step 100, the comic display control unit 60 causes the comic distributed from the server 4 to be displayed on the screen 3a.

[0088] In the next step 102, the scroll control unit 62 judges whether or not a scroll operation has been performed on the screen 3a by the user. If the judgment is affirmative, the process proceeds to step 104, and if the judgment is negative, the process proceeds to step .

[0089] In step 104, the scroll control unit 62 scrolls the manga displayed on the screen 3a in response to the user's scroll operation.

[0090] In step 106, when the scrolling of the manga has stopped, the touch determination unit 70 determines whether or not the user has pressed and held the screen 3a. If the determination is affirmative, the process proceeds to step 108, and if the determination is negative, the process proceeds to step 118.

[0091] In step 108, the touch determination unit 70 identifies the long press position 52 on the screen 3a, and the trimming range change unit 72 starts displaying the trimming range 50 with the long press position 52 as the center.

[0092] In the next step 110, the trimming range changing unit 72 changes the trimming range 50 displayed on the screen 3a. Note that the trimming range changing unit 72 according to this embodiment expands the trimming range 50 when a long press is performed on the screen 3a.

[0093] In the next step 112, the touch judgment unit 70 judges whether or not the indicator has been touched off the screen 3a, and if the judgment is positive, the process proceeds to step 114, and if the judgment is negative, the process returns to step 110 and the trimming range change unit 72 continues changing the trimming range 50.

[0094] In step 114 , the trimming range changing unit 72 stops changing the trimming range 50 .

[0095] In the next step 116, the trimming function execution unit 64 displays a confirmation dialog on the screen 3a and performs processing according to the user's instructions input via the confirmation dialog. Note that the processing includes processing of the image within the trimming range 50, saving of the image within the trimming range 50, etc.

[0096] In the next step 118, the manga display control unit 60 judges whether the manga displayed on screen 3a has finished, and if the judgement is affirmative, the manga viewing process ends, whereas if the judgement is negative, the process proceeds to step 102 and the display of the manga continues. Note that, as an example, the manga display control unit 60 judges that the manga has finished when the manga displayed on screen 3a cannot be scrolled any further.

[0097] As described above, the trimming function of the manga viewing process according to this embodiment specifies the contact position of the pointer on the screen 3a. The trimming function then uses the contact position of the pointer as a reference and changes the trimming range 50 of the image displayed on the screen 3a according to the contact time of the pointer on the screen 3a. That is, the trimming function according to this embodiment automatically changes the trimming range 50 according to the contact time when the pointer touches the screen 3a, so that the user can easily specify the trimming range 50 of the image displayed on the screen 3a.

[0098] 7. Other embodiments The present invention has been described above using the above embodiment, but the technical scope of the present invention is not limited to the scope described in the above embodiment. Various modifications or improvements can be made to the above embodiment without departing from the gist of the invention, and the forms with such modifications or improvements are also included in the technical scope of the present invention. In addition, the above embodiments may be combined as appropriate.

[0099] For example, in the above embodiment, the content is described as a comic book, but the present invention is not limited to this. For example, the content may be a video, or the content may be a novel or the like composed of text. When the content is a video, the user pauses the progress of the video when specifying the trimming range 50.

[0100] In the above embodiment, the trimming range 50 is described as being circular, but the present invention is not limited to this. The trimming range 50 may be, for example, a square centered on the contact position (long press position 52) of the indicator as shown in FIG. 9. In the example of FIG. 9, the sides of the trimming range 50 extend parallel to the sides of the screen 3a, thereby expanding the trimming range 50. In the example of FIG. 9, the trimming range 50 is a regular square, but is not limited to this, and the trimming range 50 may be a rectangle. Furthermore, the trimming range 50 is not limited to a square, and may be any other shape as long as it is a closed figure, such as a polygonal shape with pentagons or more and a star shape.

[0101] The trimming range 50 may also be similar in shape to the frame frame that contains the contact position of the pointer. In this case, for example, if the frame frame is a square, the trimming range 50 is also enlarged or reduced in a square, and if the frame frame is a parallelogram, the trimming range 50 is also enlarged or reduced in a parallelogram.

[0102] In the above embodiment, the trimming range 50 is changed by expanding the trimming range 50 based on the contact position (long press position 52) of the indicator, but the present invention is not limited to this. The trimming range 50 may be changed by shrinking it from the periphery of the screen 3a toward the contact position (long press position 52) of the indicator.

[0103] In the above embodiment, the frame frame is the range surrounded by the line that defines the range of the frame, but the present invention is not limited to this. For example, the frame frame may be an area beyond the range. Specifically, if a speech bubble in which a character's lines are written extends beyond the range and cannot be contained, the frame frame also includes the range of the protruding speech bubble. If a character such as a sound effect extends beyond the range and cannot be contained, the frame frame also includes the outline of the protruding character. This makes it possible to cut (copy) speech bubbles that are included in the frame but extend beyond it as the trimming range 50. For this purpose, for example, characters, speech bubbles, sound effects, backgrounds, etc. that make up a manga are identified as objects, and a group of these objects can be recognized as a frame.

[0104] Furthermore, the flow of the trimming range designation process described in the above embodiment is also one example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed, without departing from the spirit of the present invention. [Explanation of symbols]

[0105] 3. Mobile terminals (information processing devices) 3a Touch panel display 50 Cropping range (processing range) 52 Long press position (contact position) 60 Frame Frame (Frame) 62 frames 70 Touch determination unit (contact position identification means) 72 Trimming range change unit (processing range change means)

Claims

1. A processor is provided. The processor identifies a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed; the processor expands a processing range for performing a trimming process on the object corresponding to the contact position in accordance with a contact time of the pointer; the processor stops expanding the processing range when the processing range expands to reach the frame surrounding the object corresponding to the contact position; the processor displays text information based on the object in the processing range superimposed on an image of the object corresponding to the contact position. Information processing device.

2. A processor identifies a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed; a processor expands a processing range in which a trimming process is performed on the object corresponding to the contact position in accordance with a contact time of the pointer; a processor stops expanding the processing range when the processing range expands to reach the frame surrounding the object corresponding to the contact position; a processor displays character information based on the object in the processing range so as to be superimposed on an image of the object corresponding to the contact position; Information processing methods.

3. causing a processor to identify a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed; a processor that expands a processing range in which a trimming process is performed on the object corresponding to the contact position in accordance with a contact time of the pointer; causing a processor to stop expanding the processing range when the processing range expands to reach the frame surrounding the object corresponding to the contact position; causing a processor to display text information based on the object in the processing range superimposed on an image of the object corresponding to the contact position; A program that executes a process.

4. A server and a terminal device are provided, The server, causing the terminal device to specify a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed; causing the terminal device to expand a processing range in which a trimming process is performed on the object corresponding to the contact position in accordance with a contact time of the pointer; causing the terminal device to stop expanding the processing range when the processing range reaches the frame surrounding the object corresponding to the contact position; causing the terminal device to display character information based on the object in the processing range so as to be superimposed on an image of the object corresponding to the contact position; system.

Images