Information processing device, function display method and function display program

Abstract

To provide an information processing device, a function display method and a function display program for improving convenience of a user selecting a function.SOLUTION: An comic browsing application displays a first function image 52 or a second function image 54, as an image showing user-selectable functions, on a touch panel display 3a, and, when an indication body touches the first function image 52 or the second function image 54, the comic browsing application executes a function corresponding to the first function image 52 or the second function image 54 that the indication body touched. The comic browsing application then displays the second function image 54 on the touch panel display during execution of a first function corresponding to the first function image 52. Thus, since the second function image 54 is displayed on the screen 3a during execution of the first function, even when a user executes a desired function, other functions can be selected continuously.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a function display method, and a function display program.

Background Art

[0002] In recent years, various services provided by online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") distributed to information processing apparatuses such as mobile terminals via computer networks have become widely popular.

[0003] Here, apps include, for example, an app for viewing distributed manga, an app for editing images, and the like. Such apps are added with a plurality of functions such as a function (flip function) for forwarding or rewinding the progress of the manga displayed on the screen, and a function (trimming function) for cutting and processing a partial image of the manga. The user appropriately selects a desired function from these multiple functions and causes the app to execute it.

[0004] And in order to improve the ease of use of various functions, that is, the convenience for the user, devices and methods are disclosed in Patent Documents 1 and 2.

[0005] Patent Document 1 discloses a user interface device in which when an option displayed in a first menu is selected, a second menu is further displayed. The user interface device disclosed in Patent Document 1 discloses that when the user drags a pen into the upper right quarter circle of the first menu to select the "paste" menu option, and then without lifting the pen from the screen, drags the pen into the lower quarter circle of the second menu to select the "clipboard c" menu.

[0006] In Patent Document 2, when a user touches the display unit with a pen at any point in the editing target area, an editing icon is displayed on the display unit centered on that point. If the process corresponding to the selected icon requires more detailed process specification, an editing sub-icon corresponding to a more detailed process is displayed on the display unit centered on the point where the pen is located. A data editing method is disclosed.

Prior Art Documents

Patent Documents

[0007]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0008] Here, the devices and methods disclosed in Patent Documents 1 and 2 display a sub-menu corresponding to the menu selected by the user, and the user selects the menu he or she wants to execute from the sub-menu. That is, in the above devices and methods, for example, the user cannot continuously select different menus (functions) during the execution of the menu (function) he or she has selected. Therefore, there is room for further improving the convenience for the user in the selection of functions by the user.

[0009] The present invention has been made in view of such circumstances, and an object thereof is to provide an information processing apparatus, a function display method, and a function display program that can further improve the convenience regarding the selection of functions by a user.

Means for Solving the Problems

[0010] In order to solve the above problems, the information processing apparatus, function display method, and function display program of the present invention employ the following means.

[0011] To solve the above problems, an "information processing apparatus" according to an aspect of the present invention includes a function image display unit that displays a first function image or a second function image on a touch panel display as an image indicating a function selectable by a user, and a function execution unit that executes a function corresponding to the first function image or the second function image with which the indicator has come into contact when the indicator comes into contact with the first function image or the second function image displayed on the touch panel display. The function image display unit displays the second function image corresponding to the second function on the touch panel display while the first function corresponding to the first function image is being executed with the indicator in contact with the first function image.

[0012] To solve the above problems, a "function display method" according to an aspect of the present invention includes a first step of causing a function image display unit to display a first function image or a second function image on a touch panel display as an image indicating a function selectable by a user, and a second step of causing a function execution unit to execute a function corresponding to the first function image or the second function image with which the indicator has come into contact when the indicator comes into contact with the first function image or the second function image displayed on the touch panel display. The function image display unit displays the second function image corresponding to the second function on the touch panel display while the first function corresponding to the first function image is being executed with the indicator in contact with the first function image.

[0013] To solve the above problems, a "function display program" according to an aspect of the present invention causes a computer to function as a function image display unit that displays a first function image or a second function image on a touch panel display as an image indicating a function selectable by a user, and a function execution unit that executes a function corresponding to the first function image or the second function image with which the indicator has come into contact when the indicator comes into contact with the first function image or the second function image displayed on the touch panel display. The function image display unit displays the second function image corresponding to the second function on the touch panel display while the first function corresponding to the first function image is being executed with the indicator in contact with the first function image.

[0014] As exemplified below, various technical limitations may be imposed on the above-described "information processing apparatus". Further, technical limitations of the same purport may be imposed on the processing steps executed by the "function display method" and the functions of the "function display program".

[0015] The function image display means displays the second function image in the vicinity of the first function image with which the indicator is in contact.

[0016] The function image display means displays the second function image in the display area of another first function image corresponding to a function having a low relevance to the first function corresponding to the first function image selected using the indicator.

[0017] The function image display means displays a plurality of the first function images with the contact position of the indicator on the touch panel display as a reference position, and displays the second function image on the opposite side of the reference position across the first function image selected using the indicator.

[0018] The second function is a function related to the first function being executed.

[0019] The second function is a function having the same effect as the first function being executed and having a different degree of effect.

[0020] The second function is a function that the user may select after the completion of the first function being executed.

[0021] Each of the functions has a relevance set with other functions.

[0022] When the indicator separates from the touch panel display while the second function image is being displayed on the touch panel display, the function image display means stops the display of the second function image and continues the display of the first function image.

[0023] When the execution of the first function is stopped, the function execution means returns the display on the touch panel display to the state at the start of the execution of the first function.

[0024] When the execution of the second function is stopped, the function execution means returns the display on the touch panel display to the state at the start of the execution of the second function or the state at the start of the execution of the first function.

[0025] The first function or the second function is a rewind function for rewinding the progress of the content displayed on the touch panel display or a fast-forward function for fast-forwarding the progress of the content.

Effect of the Invention

[0026] According to the present invention, there is an effect that the convenience regarding the selection of functions by the user can be further improved.

Brief Description of the Drawings

[0027]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0028] Hereinafter, an embodiment of an information processing apparatus, a function display method, and a function display program according to the present invention will be described with reference to the drawings. In this embodiment, as an example, a form will be described in which manga is distributed from a server to a mobile terminal which is an information processing apparatus, and the user views the distributed manga using the mobile terminal.

[0029] [1. Configuration of Manga Distribution System] FIG. 1 is a schematic configuration diagram of a manga distribution system 1 according to this embodiment. The manga distribution system 1 includes a communication line 2, a plurality of mobile terminals 3, and a server 4.

[0030] The communication line 2 forms a computer network and is, for example, a wide-area communication line provided by an electric power company.

[0031] The mobile terminal 3 is an information processing terminal such as a smartphone, a tablet terminal, or a notebook personal computer, and is used for the user to use an online service distributed via the communication line 2. The mobile terminal 3 includes a touch panel display 3a for displaying an image, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for imaging a subject, and the like. Here, the touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor receives various input operations performed using an indicator such as a finger, a stylus, or a pen.

[0032] The server 4 is an information processing apparatus that distributes an online service to the mobile terminal 3 via the communication line 2.

[0033] The manga distribution system 1 according to this embodiment distributes digital manga as one of the online services from the server 4 to the mobile terminal 3 via the communication line 2. Here, the manga is an example of content formed by a plurality of consecutive still images, and the plurality of still images are composed of pictures and have a story as a whole. The user views the manga distributed to the mobile terminal 3 using dedicated application software (hereinafter referred to as "manga viewing app"). The manga viewing app is pre-installed on the mobile terminal 3. Further, as an example, the manga viewing app can display the manga in units of pages on the mobile terminal 3, and can also enlarge and reduce the manga displayed in units of pages. Note that the manga viewing app functions even when the mobile terminal 3 and the server 4 are not communicating (offline state) as long as the manga data has been downloaded from the server 4 to the mobile terminal 3.

[0034] [2. Configuration of Server] FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to this embodiment.

[0035] The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20 which is a main control unit that controls the operation of the entire server 4, a ROM (Read Only Memory) 22 in which various programs and various data are stored in advance, a RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and an HDD (Hard Disk Drive) 26 as a storage means for storing various programs and various data.

[0036] The HDD 26 stores manga data indicating the manga to be distributed to the mobile terminal 3. Note that the storage means is not limited to the HDD 26, and may be other storage media such as a semiconductor memory such as a flash memory.

[0037] Furthermore, the server 4 includes an operation input unit 28 composed of a keyboard, a mouse, etc. that accepts input of various operations, a monitor 30 such as a liquid crystal display device that displays various images, and is connected to other information processing devices such as the mobile terminal 3 via the communication line 2, and is provided with an external interface 32 that performs transmission and reception of various data with other information processing devices etc.

[0038] These CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via the system bus 34. Therefore, the CPU 20 can respectively perform access to the ROM 22, RAM 24, and HDD 26, grasp the operation state of the operation input unit 28, display images on the monitor 30, and perform transmission and reception of various data with other information processing devices etc. via the external interface 32.

[0039] [3. Electrical Configuration of Mobile Terminal] FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3.

[0040] In addition to the configuration shown in FIG. 1, the mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary storage unit 44, a communication unit 46, and operation buttons 48.

[0041] The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), etc., and controls the overall operation of the mobile terminal 3.

[0042] The main memory unit 42 is composed of, for example, a RAM or a DRAM (Dynamic Random Access Memory), etc., and is used as a work area etc. when executing processing based on various programs by the main control unit 40.

[0043] The auxiliary storage unit 44 is a non-volatile memory such as a flash memory, and stores various data such as images and programs used for the processing of the main control unit 40. The programs stored in the auxiliary storage unit 44 are, for example, an OS (Operating System) for realizing the basic functions of the mobile terminal 3, drivers for controlling various hardware, programs for realizing functions such as e-mail, web browsing, and other various functions. Further, the auxiliary storage unit 44 stores in advance a manga viewing application for displaying the manga distributed from the server 4 on the touch panel display 3a. In the following description, the touch panel display 3a is also referred to as the screen 3a.

[0044] The communication unit 46 is, for example, a NIC (Network Interface Controller), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), a function of enabling short-range wireless communication such as Bluetooth (registered trademark), and infrared communication, instead of or together with the NIC.

[0045] The operation buttons 48 are provided on the side surface of the mobile terminal 3, and include a power button for starting or stopping the mobile terminal 3 and a volume adjustment button for the sound output from the speaker 3b.

[0046] These main control unit 40, main storage unit 42, auxiliary storage unit 44, communication unit 46, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and operation buttons 48 are electrically connected to each other via the system bus 49. Therefore, the main control unit 40 can access the main storage unit 42 and the auxiliary storage unit 44, display an image on the touch panel display 3a, grasp the operation state of the touch panel display 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0047] [4. Various Functions Related to Manga Viewing] The user views the manga distributed from the server 4 using the manga viewing app installed on the mobile terminal 3. This manga viewing app is equipped with various functions, and the user can select the functions as needed and execute them on the manga viewing app.

[0048] The manga viewing app according to this embodiment displays an image indicating a function selectable by the user (hereinafter referred to as a "function image") on the screen 3a in response to a touch operation by the user on the touch panel display 3a (screen 3a). Then, the manga viewing app executes the function corresponding to the selected function image when the user selects the function image using an indicator. In the following description, the process related to the display of the function image is referred to as the function image display process, and the process related to the execution of the function corresponding to the function image selected by the user is referred to as the function execution process.

[0049] As will be described in detail later, the function image display process according to this embodiment displays a first function image and a second function image on the screen 3a as function images selectable by the user. The first function image and the second function image have different display timings on the screen 3a, and the first function image and the second function image correspond to different functions.

[0050] [4-1. Display of the First Function Image and Execution of the First Function] In the functional image display process according to this embodiment, when the screen 3a is long-pressed (hereinafter referred to as "first long-press") using an indicator, a first functional image is displayed on the screen 3a with the first long-press position as a reference position. Note that the first long-press means a case where the indicator changes from a state of not being in contact with the screen 3a to a state of being in contact, and the contact of the indicator at the same position continues for a predetermined time or more. Also, the first functional image displayed on the screen 3a when the first long-press is performed may not be just one functional image, but a functional image group having a plurality of functional images each indicating a different function. Further, the position on the screen 3a where the first long-press is performed is not limited. That is, the position of the first functional image displayed on the screen 3a changes according to the first long-press position.

[0051] FIG. 4 is a diagram illustrating the positional relationship between the first long-press position 50A and the first functional image 52. In the example of FIG. 4, although there is no notation, a manga is being displayed on the screen 3a, and the pages or frames of the displayed manga scroll from right to left in FIG. 4. That is, the manga progresses from right to left.

[0052] In the functional image display process according to this embodiment, a plurality of first functional images 52 are displayed with the first long-press position 50A, which is the contact position of the indicator with respect to the screen 3a, as a reference position. In the example of FIG. 4, the user's thumb is regarded as the indicator, and the position on the screen 3a where this thumb performs the first long-press is defined as the first long-press position 50A. Then, the functional image display process displays four different types of first functional images 52A, 52B, 52C, 52D in the four directions (up, down, left, and right directions) with the first long-press position 50A as the reference position (center).

[0053] In the example of FIG. 4, the first function image 52A is displayed on the right side of the first long-press position 50A and corresponds to a rewind function that rewinds the progress (page or frame) of the manga displayed on the screen 3a at a predetermined speed. The first function image 52B is displayed on the left side of the first long-press position 50A and corresponds to a forward function that fast-forwards the progress of the manga displayed on the screen 3a at a predetermined speed. The first function image 52C is displayed above the first long-press position 50A and corresponds to a share function that cuts out the image of the manga displayed on the screen 3a and posts (shares) it to a predetermined online service. The first function image 52D is displayed below the first long-press position 50A and corresponds to a clip function that cuts out the image of the manga displayed on the screen 3a and stores it in the mobile terminal 3.

[0054] Note that the image to be shared or clipped is the image corresponding to the first long-press position 50A. For example, a frame including the first long-press position 50A may be cut out and used as the image to be shared or clipped, or the entire image displayed on the screen 3a when the first long-press is performed may be used as the image to be shared or clipped. Further, when the function execution process executes the share function or the clip function, for example, the range of the image to be shared or clipped is shown, and a button image for execution confirmation is displayed on the screen 3a for the user.

[0055] The arrangement positions of the first function images 52 shown in FIG. 4 are merely examples and are not limited thereto. For example, when the manga scrolls in the downward direction from top to bottom, the first function image 52A corresponding to the rewind function may be displayed above the first long-press position 50A, and the first function image 52B corresponding to the forward function may be displayed below the first long-press position 50A. Also, the positional relationship of the plurality of first function images 52 may be based on the first long-press position 50A. For example, a plurality of first function images 52 may be arranged in a row in a predetermined direction with respect to the first long-press position 50A, or a plurality of first function images 52 may be displayed separately in the left-right direction or the up-down direction with respect to the first long-press position 50A.

[0056] When the user selects any one of the plurality of first function images 52, while maintaining the contact state of the indicator with respect to the screen 3a, an operation of moving the finger from the first long-press position 50A to the desired first function image 52 (hereinafter referred to as "slide operation") is performed. Then, when the finger slides to the desired first function image 52 (for example, in the direction of arrow A) and a second long-press is performed to maintain that state for a predetermined time or longer, the function execution process executes the function corresponding to the first function image 52. Note that the position where the second long-press is performed on the screen 3a is referred to as the second long-press position 50B.

[0057] The function execution process according to the present embodiment executes the first function corresponding to the first function image 52 that has been second long-pressed only when the second long-press continues. For example, when the first function image 52A corresponding to the return function is second long-pressed, the manga progresses, in other words, the page is automatically returned at a predetermined speed. Also, when the first function image 52B corresponding to the forward function is second long-pressed, the manga progresses (pages) are automatically forwarded at a predetermined speed.

[0058] Then, when the finger performing the second long-press separates from the screen 3a or the finger performing the second long-press deviates from the first function image 52, etc., and the second long-press on the first function image 52 is released, the function execution process stops the first function being executed. Note that in the following description, when the user separates an indicator such as a finger from the screen 3a, it is also referred to as touch-off.

[0059] [4-2. Display of Second Function Image and Execution of Second Function] The function image display process according to the present embodiment displays a second function image corresponding to the second function on the touch panel display 3a (screen 3a) while the indicator is in contact with the first function image 52 and the first function corresponding to the first function image 52 is being executed. That is, the function image display process according to the present embodiment displays the second function image on the screen 3a when the first function is selected and execution is started. That is, the function image display process according to the present embodiment realizes multiplexing of functions.

[0060] In this way, the functional image display process according to this embodiment displays the second functional image on the screen 3a only while the first function is being continuously executed. Thus, even if the user executes a desired function, other functions can be continuously selected, so that the convenience regarding the selection of functions by the user can be further improved.

[0061] Referring to FIG. 5, the display of the second functional image 54 will be described in detail. FIG. 5 shows an example in which, among the plurality of first functional images 52 shown in FIG. 4, the user slides a thumb from the first long-press position 50A and long-presses (second long-press) a desired first functional image 52. As shown in FIG. 5, when the user's finger long-presses (second long-press) the first functional image 52A, the second functional image 54 (54A) is displayed on the screen 3a while the corresponding first function is being continuously executed.

[0062] Here, although the second function is a function different from the first function being executed, for example, it is a function related to the first function being executed.

[0063] For example, the second function is a function that has the same effect as the first function being executed but has a different degree of effect. In other words, functions having the same effect are functions having the same action and processing content. Different degrees of effect mean that, in other words, although the action and processing content are the same, the degree is different. For example, the speed of the rewind function or the forward function is different, or the trimming range is different.

[0064] Referring to FIG. 5, the function corresponding to the second functional image 54A is a high-speed rewind function that rewinds the manga faster than the rewind function corresponding to the first functional image 52A. That is, the high-speed rewind function as the second function has the same effect as the rewind function as the first function selected by the user, but has a different degree of effect. Also, for example, when the first function being executed is the forward function (medium-speed forward function), forward functions with different speeds (high-speed forward function, low-speed forward function) are used. Also, when the first function being executed is the rewind function (medium-speed rewind function), rewind functions with different speeds (high-speed rewind function, low-speed rewind function) are used.

[0065] Also, the second function may be a function that the user may select after the completion of the first function being executed.

[0066] For example, when the user executes the forward function as the first function, if the user scrolls too far forward through the manga pages and there is a possibility of executing the backward function after the execution of the forward function to correct this. Therefore, when the first function being executed is the forward function, the second function is the backward function. Similarly, when the first function being executed is the backward function, the second function is the forward function. In other words, the forward function and the backward function are functions in the same category although their effects are different.

[0067] Also, when the first function being executed is the forward function, the second function may be a hidden line jump function (details will be described later). That is, it is assumed that when the user executes the backward function to search for a hidden line image corresponding to a predetermined scene by themselves but cannot find it immediately, the hidden line jump function instantaneously displays the hidden line image on screen 3a. Therefore, when the first function being executed is the backward function, the second function may be the hidden line jump function.

[0068] Furthermore, the second function may change according to the execution duration of the first function being executed. For example, when the first function being executed is the forward function and its execution duration exceeds a predetermined time (e.g., 10 seconds) set in advance, the second function is the fast forward function. Note that until the above-mentioned predetermined time elapses, a second function image 54 corresponding to another function different from the fast forward function (e.g., the backward function) is displayed on screen 3a, and when the execution duration exceeds the predetermined time, a second function image 54 corresponding to the fast forward function may be displayed. Also, when the execution duration of the first function being executed exceeds the predetermined time, the display of the second function image 54 may be started. That is, the second function image 54 is not displayed unless the execution duration of the first function exceeds the predetermined time.

[0069] Also, according to the usage frequency of the second function executed after the end of the first function, the second function related to the first function being executed may be determined. For example, when a plurality of second function images 54 are displayed as shown in FIG. 6 described later, the second function image 54 corresponding to the second function with the highest usage frequency is displayed at the position closest to the first function image 52 corresponding to the first function being executed. Also, the second function image 54 corresponding to the second function with a low usage frequency may not be displayed, and the second function image 54 corresponding to the second function with a higher usage frequency may be displayed.

[0070] Here, the relevance of each function to other functions is set.

[0071] For example, a table showing other functions indicating the relevance for each function (hereinafter referred to as "function relevance table") is stored in the mobile terminal 3 or the server 4. The function image display process displays the second function image 54 corresponding to the first function being executed on the screen 3a based on this function relevance table. Specifically, when the first function image 52 is long-pressed for the second time, the function image display process executes the first function corresponding to the first function image 52 and sets the function with the highest relevance to the first function as the second function. Then, the function image display process displays the second function image 54 corresponding to the second function on the screen 3a.

[0072] The following Table 1 is an example of a function relevance table, showing the relevance of each function to other functions. In the example of Table 1, the relevance is indicated by a numerical value, and it is assumed that the smaller the numerical value, the higher the relevance.

[0073]

Table 1

[0074] Also, the function relevance table may include the usage frequency of the second function executed after the end of the first function. That is, the usage frequency of each function is associated with other functions and included in the function relevance table. The usage frequency for each function included in the function relevance table is updated as appropriate.

[0075] Table 2 below is an example of a functional relevance table showing the frequency of use for each function, and shows the number of times the second function was executed after the end of the first function. The higher this number, the higher the frequency of use. In other words, the higher the frequency of use of the second function, the higher the relevance to the first function. The frequency of use of each function may be aggregated for each user of the mobile terminal 3 and the functional relevance table may be updated. As a result, the functional relevance table will be different for each user. Also, the frequency of use of multiple users may be aggregated by the server 4 and the functional relevance table may be updated. As a result, the functional relevance table will be the same for multiple users.

[0076]

Table 2

[0077] In the examples of Table 1 and Table 2, the relevance to other functions is ranked for each function, but not limited to this. Only one function relevant to each function may be determined, and it may be used as the second function that can be selected during the execution of the first function.

[0078] In this way, by making the second function a function related to the first function, the user can intuitively grasp the functions that they can select, so the convenience regarding the selection of functions by the user is further improved.

[0079] Also, the function image display process according to this embodiment displays the second function image 54 in the vicinity of the first function image 52 that the indicator is touching, that is, in the vicinity of the first long-press position 50A. As a result, even while the first function is being executed, the user can execute the second function simply and quickly.

[0080] During the execution of the first function corresponding to the first function image 52 selected using an indicator, a second function image 54 is displayed in the display area of another first function image 52 corresponding to a function that has a low relevance to the first function corresponding to the selected first function image 52. The second function that has a low relevance to the first function is, for example, a function that is contrary to the first function or a function whose action and processing content are completely different. A contrary function is, for example, a function whose effect is contrary like a feed function with respect to a return function, and functions whose action and processing content are completely different are a share function, a clip function, a trimming function, etc. with respect to a return function or a feed function.

[0081] More specifically, for example, based on the function relevance table described above, the display area of the second function image 54 is determined. As an example, four first function images 52 corresponding to a medium-speed return function, a medium-speed feed function, a trimming function, and a hidden line jump function are displayed, and the case where the user selects the medium-speed return function is taken as an example. In this case, since the function that has the lowest relevance to the medium-speed return function in the function relevance table shown in Table 1 is the hidden line jump function, the second function image corresponding to the second function is displayed in the display area of the first function image 52 corresponding to the hidden line jump function.

[0082] Also, during the execution of the first function corresponding to the first function image 52 selected using an indicator, the second function image 54 may be displayed on the opposite side of the selected first function image 52 across the reference position (the first long press position 50A).

[0083] Referring to FIG. 5 for explanation, when the user long presses (the second long press) the first function image 52A, the function corresponding to the first function image 52A is executed. Then, the second function image 54A is displayed in the display area of the first function image 52B, which is on the opposite side of the first function image 52A across the first long press position 50A. In other words, some of the first function images 52 will dynamically change to the second function image 54. In the example of FIG. 5, the displays of the first function images 52C and 52D are stopped, but this is not restrictive, and the first function images 52C and 52D may remain displayed.

[0084] In this way, the user can intuitively know that the second function image 54 is displayed on the screen 3a, and can execute the second function simply and quickly even while the first function is being executed. Also, since the second function image 54 is appropriately separated from the first function image 52 being selected, it is possible to prevent the finger from slipping off the first function image 52 and accidentally pressing the second function image 54.

[0085] When the user executes the second function during the execution of the first function, as an example, without separating the thumb from the screen 3a, move (slide) to the second function image 54 and long-press (third long-press) the second function image 54. Thereby, the function execution process stops the first function corresponding to the first function image 52 and starts the execution of the second function corresponding to the second function image 54. Note that the second function is executed only when the user's indicator is in contact with the second function image 54, and when the indicator separates (touch-off) from the second function image 54, the second function being executed stops.

[0086] Note that the display states of the first function image 52 and the second function image 54 during the execution of the second function are the same as before the execution of the second function. Thereby, even during the execution of the second function, the user can select the first function related to the second function.

[0087] FIG. 6 shows another example of the display state of the second function image 54. In the example of FIG. 6, a second function image 54A is displayed on the opposite side of the first long-press position 50A with respect to the first function image 52 selected by the user, a second function image 54B is displayed above the second function image 54A, and a second function image 54C is displayed below the second function image 54A. The second function image 54B corresponds to a slow rewind function, and the second function image 54C corresponds to a slow feed function.

[0088] FIG. 7 shows another example of the display state of the second function image 54. As shown in FIGS. 5 and 6, the second function image 54 is not displayed on the opposite side of the first long-press position 50A with respect to the first function image 52 selected by the user. Instead, this is an example in which the second function image 54 is displayed with reference to the first function image 52 selected by the user, that is, the second long-press position 50B. In the example of FIG. 7, a second function image 54A corresponding to the fast rewind function is displayed above the second long-press position 50B (the first function image 52A), and a second function image 54B corresponding to the slow rewind function is displayed below the second long-press position 50B (the first function image 52A).

[0089] Also, in the function image display process, when the indicator (the user's finger) touches off the screen 3a while the second function image 54 is being displayed on the screen 3a, the display of the second function image 54 is stopped (erased), and the display of the first function image 52 is continued. In the function execution process, when the indicator touches off the screen 3a while the second function is being executed, the execution of the second function is stopped. As a result, even when the user touches off the screen 3a to stop the execution of the second function, the user can then immediately select the first function image 52 to execute the desired first function, improving the convenience for the user in function selection. If the user does not select the first function image 52 within a predetermined time (for example, within 3 seconds) after touching off, the function image display process stops the display of the first function image 52.

[0090] Note that this is not limited to this. When the indicator touches off while the second function image 54 is being displayed, the display of the second function image 54 may be stopped together with the first function image 52. Also, only when the first function is continuously executed for a predetermined time or more, the second function image 54 may continue to be displayed on the screen 3a even when touched off, enabling the user to select the second function. In this case, when the indicator touches off while the continuous execution of the first function is less than the predetermined time, the first function stops, and the display of the second function image 54 is stopped together with the first function image 52.

[0091] Also, when the indicator deviates from the first function image 52 or the second function image 54 without touching off, the function being executed may be stopped or the function being executed may continue. Which process to adopt when the indicator deviates from the function image is predetermined by settings. Also, when the indicator deviates from the first function image 52 or the second function image 54 by a predetermined distance (predetermined number of dots) or more, the function being executed may be stopped.

[0092] [4-3. Other functions] In addition to the rewind function, forward function, share function, and clip function, the manga viewing app according to this embodiment may have a trimming function, comment addition function, information addition function, character correlation diagram display function, search history storage function, etc. Note that these functions may be executed as the first function or as the second function.

[0093] [4-3-1. Trimming function] The trimming function is a function for changing the range of the image to be shared or clipped. For example, when the share function or clip function is executed as the first function, the second function image 54 corresponding to the trimming function is displayed on the screen 3a. Specifically, when the user selects the second function image 54 corresponding to the trimming function, for example, the range (trimming range) of the image to be shared or clipped centered on the first long-press position 50A expands or contracts.

[0094] [4-3-2. Comment addition function] The comment addition function is a function for adding a comment to the image to be shared or clipped. For example, when the share function or clip function is executed as the first function, the second function image 54 corresponding to the comment addition function is displayed on the screen 3a. Then, when the user selects the second function image 54 indicating the comment addition function, for example, a text box for adding a comment to the image to be shared or clipped is displayed on the screen 3a. The comment may be superimposed on a predetermined position of the image to be shared or clipped, or may be added as metadata.

[0095] [4-3-3. Information addition function] The information addition function is a function of adding predetermined information to an image to be shared or clipped. For example, when the sharing function or the clipping function is executed as the first function, the second function image 54 corresponding to the information addition function is displayed on the screen 3a. The predetermined information is, for example, information indicating the copyright of the image to be shared or clipped, information indicating the user (user ID) who shared or clipped the image, information indicating the date when the image was shared or clipped, and the like. These pieces of information may be superimposed on a predetermined position of the image to be shared or clipped, or may be added as metadata.

[0096] [4-3-4. Character correlation diagram display function] The character correlation diagram display function is a function of displaying, on the screen 3a, a correlation diagram showing the relationship between the characters (characters) appearing in a manga, for example. For example, when the user performs a first long press on the screen 3a, the first function image 52 corresponding to the character correlation diagram display function is displayed on the screen 3a as the first function. Also, for example, when the first long press position 50A overlaps with an image showing a character included in the character correlation diagram or when a character included in the character correlation diagram exists within the frame overlapping with the first long press position 50A, the first function image 52 corresponding to the character correlation diagram display function is displayed on the screen 3a. Note that the display of the character correlation diagram on the screen 3a stops when the user's finger touches off the screen 3a.

[0097] [4-3-5. Search history storage function] The search history storage function is a function of associating an image of a manga scene (hereinafter referred to as the "original image") displayed on the screen 3a at the start of the execution of the return function with an image of the scene (hereinafter referred to as the "foreshadowing image") displayed on the screen 3a at the end of the execution of the return function and storing them in the HDD 26 of the server 4. That is, the search history storage function is a function of automatically storing the history of the user returning the progress (page) of the manga to search for (search) the foreshadowing image that is considered to be related to the original image.

[0098] The functional image display process according to this embodiment, as an example, when the rewind function is executed as the first function, a second functional image 54 corresponding to the search history storage function is displayed on the screen 3a.

[0099] The usage method of the search history storage function according to this embodiment will be described. The user executes the rewind function, which is the first function, to rewind the progress of the manga and continues to execute the rewind function until a foreshadowing image that seems to be related to the original image is discovered. Then, when the image that the user considers to be the foreshadowing image is displayed on the screen 3a, the user stops the long press (second long press) of the first functional image 52 corresponding to the rewind function, moves the finger to the second functional image 54 corresponding to the search history storage function, and performs a long press (third long press) to execute the search history storage function. The search history storage function uses the scene (image) displayed on the screen 3a at the start of the execution of the rewind function as the original image, and the scene (image) displayed on the screen 3a at the timing of the third long press as the foreshadowing image, and transmits the search history information associating these to the server 4 via the communication unit 46 for storage.

[0100] In this way, the search history storage function associates the original image and the foreshadowing image only by a touch operation on the screen 3a and stores them in the server 4. Therefore, the user can easily store the foreshadowing for the manga scene in the server 4.

[0101] Also, the server 4 adds the stored search history information to the corresponding manga. The manga with the search history information added is separately distributed from the server 4 to the mobile terminal 3.

[0102] Note that the search history information stored in the server 4 does not necessarily have to be the original image and the foreshadowing image themselves. For example, it can be the page or frame position (coordinates) of the manga that includes the original image and the foreshadowing image.

[0103] Further, as a first function, a first function image 52 corresponding to the search history storage function may be displayed. In this case, when the user selects the search history storage function, the rewind function is executed and it becomes possible to rewind the progress of the manga displayed on the screen 3a. Then, the search history storage function causes the server 4 to store search history information in which the image that the user rewound and stopped the progress of the manga is associated as a clue image and the image at the start of execution of the rewind function is associated as the original image.

[0104] Further, when the search history storage function is made a partial function of the rewind function and the execution of the rewind function is stopped by being touched off during the execution of the rewind function, a message for confirming whether to store the image displayed on the screen 3a as a clue image may be displayed on the screen 3a. In this case, when the user performs an operation indicating the intention to store in response to the above message, search history information with the image at the start of execution of the rewind function as the original image is stored in the server 4.

[0105] Also, any user who uses the manga viewing app can store the search history information in the server 4. For this reason, there is a possibility that the interpretation of the original image and the clue image may differ depending on the user, and when a plurality of users store the search history information in the server 4, as a result, a plurality of clue images may be associated with one original image. In such a case, the server 4 may perform a process of determining the clue image associated with the original image by statistical processing such as a majority vote, or may store all the search history information as it is.

[0106] The server 4 distributes the manga with the search history information added to the mobile terminal 3. For this reason, the manga viewing app can show the clue image associated with the original image not only to the user who stored the search history information in the server 4 but also to other users.

[0107] For example, the manga viewing app may have a foreshadowing jump function that changes the display state of Screen 3a from the state of displaying the original image to the state of displaying the foreshadowing image associated with the original image based on the search history information added to the distributed manga. That is, when the original image is displayed on Screen 3a, the foreshadowing jump function instantaneously changes the display of Screen 3a to the foreshadowing image associated with the original image in response to the user's operation.

[0108] In addition, when the original image is displayed on Screen 3a, the foreshadowing jump function may provide a notification indicating the existence of the foreshadowing image associated with the original image. Such notification may be, for example, displaying a message "There is a foreshadowing" on Screen 3a when the original image is displayed on Screen 3a, or highlighting the outline of the page or frame including the original image. Thereby, when the original image is displayed on Screen 3a, the user can instantaneously display the foreshadowing image on Screen 3a to check the foreshadowing. When the message "There is a foreshadowing" is displayed on Screen 3a, the first function image 52 corresponding to the foreshadowing jump function may be displayed on Screen 3a.

[0109] As described above, the search history storage function adds search history information to the manga distributed to the mobile terminal 3, and the search history information can be used not only by the user who stores it in the server 4 through the foreshadowing jump function but also by other users. Therefore, the manga distributed from the server 4 is formed as CGM (Consumer Generated Media).

[0110] [4-4. Touch-off Processing] As described above, when the indicator separates (touch-off) from the first function image 52, the running first function stops. Also, when the indicator separates (touch-off) from the second function image 54, the running second function stops.

[0111] Here, conventionally, when the execution of the forward function or the reverse function is completed, the manga page at that time remains displayed on screen 3a. For this reason, when the user wants to return the manga display to the state before the execution of the forward function or the reverse function is started, the user has to perform the reverse operation to return the manga display, which lacks convenience.

[0112] Therefore, the function execution process according to this embodiment may perform a touch-off process of returning the display on screen 3a to the state at the start of the execution of the first function when the execution of the first function is stopped. Further, the function execution process according to this embodiment may perform a touch-off process of returning the display on screen 3a to the state at the start of the execution of the second function or the state at the start of the execution of the first function when the execution of the second function is stopped. Note that the state at the start of execution is the display state of screen 3a immediately before starting the execution of the function selected by the user. Thereby, the convenience for the user regarding function execution and stop is improved.

[0113] Functions subject to the touch-off process are, for example, the reverse function and the forward function. That is, for each function according to this embodiment, whether or not to execute the touch-off process is preset.

[0114] For example, when the user touches off while the reverse function or the forward function is being executed as the first function, the manga displayed on screen 3a returns to the state at the start of the execution of the reverse function or the forward function.

[0115] When both the first function and the second function are the reverse function or the forward function, when the user touches off while the second function is being executed, the manga displayed on screen 3a returns to the state at the start of the execution of the first function or the second function. Note that it may be preset whether to return to the start of the execution of the first function or the start of the execution of the second function when a touch-off is made during the execution of the second function. Further, when the user returns a finger to the second long-press position 50B (the first function image 52 selected previously) while the reverse function or the forward function is being executed as the second function, the execution of the second function may be stopped and the manga displayed on screen 3a may be returned to the state at the start of the execution of the second function.

[0116] [5. Functional Blocks of the Manga Viewing Function] FIG. 8 is a functional block diagram of the manga viewing function executed by the manga viewing application installed in the mobile terminal 3 according to the present embodiment. The main control unit 40 included in the mobile terminal 3 includes a manga display control unit 60, a scroll control unit 62, a function image display unit 64, and a function execution unit 66. The processes executed by the respective functions included in the main control unit 40 are realized by a program stored in the auxiliary storage unit 44.

[0117] The manga display control unit 60 causes the manga distributed from the server 4 to be displayed on the screen 3a.

[0118] The scroll control unit 62 scrolls the manga displayed on the screen 3a in response to an operation on the screen 3a by an indicator.

[0119] The function image display unit 64 displays the first function image 52 or the second function image 54 on the screen 3a as an image indicating a function selectable by the user. Note that the function image display unit 64 displays the second function image 54 on the screen 3a during the execution of the first function corresponding to the first function image 52 when the indicator touches the first function image 52. Also, the function image display unit 64 performs each of the above-described function image display processes.

[0120] When the indicator touches the first function image 52 or the second function image 54 displayed on the screen 3a, the function execution unit 66 executes the function corresponding to the first function image 52 or the second function image 54 touched by the indicator. Also, the function execution unit 66 performs each of the above-described function execution processes.

[0121] [6. Flowchart of Manga Viewing Process] FIG. 9 is a flowchart showing the flow of the manga viewing process executed by the main control unit 40 included in the mobile terminal 3. A program (manga viewing application) for executing the manga viewing process is stored in advance in a predetermined area of the auxiliary storage unit 44.

[0122] First, in step 100, the manga display control unit 60 causes the manga distributed from the server 4 to be displayed on the screen 3a.

[0123] In the next step 102, the scroll control unit 62 determines whether a scroll operation by the user has been performed on the screen 3a. If the determination is affirmative, the process proceeds to step 104.

[0124] In step 104, the scroll control unit 62 scrolls the manga displayed on the screen 3a in response to the user's scroll operation.

[0125] In the next step 106, the function image display unit 64 determines whether a first long press has been performed on the screen 3a. If the determination is affirmative, the process proceeds to step 108. If the determination is negative, the process proceeds to step 124.

[0126] In step 108, the function image display unit 64 displays the first function image 52 on the screen 3a.

[0127] In the next step 110, the function execution unit 66 determines whether the user has selected the first function image 52 by determining whether the user has long pressed (second long press) the first function image 52. If the determination is affirmative, the process proceeds to step 112. On the other hand, if the determination is negative, the process proceeds to step 124.

[0128] In step 112, the function execution unit 66 executes the first function corresponding to the first function image 52 selected (second long pressed) by the user, and the function image display unit 64 displays the second function image 54 on the screen 3a.

[0129] In the next step 114, the function execution unit 66 determines whether the user's finger has been touched off the screen 3a. If the determination is affirmative, the process proceeds to step 122. If the determination is negative, the process proceeds to step 116.

[0130] In step 116, the function execution unit 66 determines whether the user has selected the second function image 54 by determining whether the user has long-pressed (third long-press) the second function image 54. If the determination is affirmative, the process proceeds to step 118. On the other hand, if the determination is negative, the process returns to step 112 to continue the execution of the first function.

[0131] In step 118, the function execution unit 66 executes the second function corresponding to the second function image 54 selected (third long-pressed) by the user.

[0132] In the next step 120, the function execution unit 66 determines whether the user's finger has been touched off the screen 3a. If the determination is affirmative, the process proceeds to step 122. If the determination is negative, the process returns to step 118 to continue the execution of the second function.

[0133] In step 122, the function execution unit 66 stops the currently executing function, and the function image display unit 64 stops the display of the first function image 52 or the second function image 54, and the process proceeds to step 124. If a function with touch-off processing set is being executed, the function execution unit 66 executes the touch-off processing set for the function.

[0134] In step 124, the manga display control unit 60 determines whether the manga displayed on the screen 3a has ended. If the determination is affirmative, this manga viewing process ends. If the determination is negative, the process proceeds to step 102 to continue the display of the manga. As an example, the manga display control unit 60 determines that the manga has ended when the manga displayed on the screen 3a cannot be scrolled any further.

[0135] As described above, the manga viewing process according to this embodiment displays the first function image 52 or the second function image 54 on the touch panel display 3a as an image indicating functions selectable by the user, and when an indicator contacts the first function image 52 or the second function image 54, it executes the function corresponding to the first function image 52 or the second function image 54 contacted by the indicator. Then, during the execution of the first function corresponding to the first function image 52, the manga viewing process displays the second function image 54 on the touch panel display.

[0136] In this way, by displaying the second function image 54 on the screen 3a during the execution of the first function, even if the user executes a desired function, other functions can be continuously selected. Therefore, the manga viewing process according to this embodiment can further improve the convenience regarding the selection of functions by the user.

[0137] [7. Other Embodiments] As described above, the present invention has been described using the above-described embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. Various changes or improvements can be made to the above embodiments without departing from the gist of the invention, and the forms with such changes or improvements are also included in the technical scope of the present invention. Also, the above embodiments may be combined as appropriate.

[0138] [7-1. Other Embodiments 1] In the above embodiment, the form in which the content is manga has been described, but the present invention is not limited to this. For example, the content may be a video, or the content may be a novel or the like composed of text.

[0139] [7-2. Other Embodiments 2] In the above embodiment, the form in which the execution of the first function starts and the second function image 54 is displayed has been described, but the present invention is not limited to this. After the start of the execution of the first function, the second function image 54 may be displayed on the screen 3a after a lapse of a predetermined time or at a predetermined timing.

[0140] For example, when the rewind function is being executed as the first function, the second function image 54 may be displayed so that the slow rewind function or the slow forward function can be selected as the second function when the vicinity of the predetermined content is displayed.

[0141] The predetermined content is, for example, a foreshadowing image that is stored in association with the original image corresponding to the manga at the start of the execution of the first function. Thus, when the user is searching for the foreshadowing image associated with the original image using the rewind function, when the vicinity of the foreshadowing image is displayed on the screen 3a, the function image display process displays the second function image 54 corresponding to the slow rewind function or the slow forward function on the screen 3a.

[0142] Therefore, when the second function image 54 corresponding to the slow rewind function is displayed on the screen 3a while the user is executing the rewind function to search for the foreshadowing image, the user selects and executes it. This can suppress the manga display from returning beyond the foreshadowing image, thus improving convenience for the user. Also, even if the rewind function causes the display to return beyond the foreshadowing image, by selecting and executing the slow forward function as the second function, the foreshadowing image can be easily displayed on the screen 3a.

[0143] The function image display process determines whether the user is searching for the foreshadowing image associated with the original image based on the search history information added to the manga. That is, when the rewind function is executed starting from the original image indicated by the search history information, the function image display process determines that the user is searching for the foreshadowing image associated with the original image. Then, when the manga is rewound to the vicinity of the page or frame including the foreshadowing image indicated by the search history information, the function image display process displays the second function image 54 corresponding to the slow rewind function or the slow forward function on the screen 3a.

[0144] [7-3. Other Embodiment 3] When the user alternately repeats the execution of the first function and the second function, the first function image 52 and the second function image 54 displayed on the screen 3a may be dynamically changed.

[0145] For example, when the high-speed feed function is executed as the first function, an image corresponding to the high-speed return function is displayed as the second function image 54. When the second function image 54 is selected and the high-speed return function is executed, the first function image 52 that can be selected by the user dynamically changes to an image corresponding to the medium-speed feed function. Further, when the medium-speed feed function is selected and executed, an image corresponding to the medium-speed return function is displayed as the second function image 54. When the medium-speed return function is selected and executed, an image corresponding to the low-speed feed function is displayed as the first function image 52. Then, when the low-speed feed function is selected and executed, an image corresponding to the low-speed return function is displayed as the second function image 54.

[0146] That is, in the above example, the first function and the second function change dynamically as follows. First function: high-speed feed function → Second function: high-speed return function → First function: medium-speed feed function → Second function: medium-speed return function → First function: low-speed feed function → Second function: low-speed return function

[0147] As a result, the user can gradually reduce the feed / return speed. For example, when the user wants to search for a desired scene by alternately using the feed function and the return function, the convenience for the user is improved.

[0148] [7-4. Other Embodiment 4] When the user selects the return function or the feed function, a slide bar for speed adjustment is displayed on the screen 3a, and the return / feed speed may be changed according to the direction and magnitude of the swipe operation by the user following the first long-press operation.

[0149] [7-5. Other Embodiment 5] Also, the flow of the manga viewing process described in the above embodiment is merely an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope not departing from the gist of the present invention.

Explanation of Reference Numerals

[0150] 3 Mobile Terminal (Information Processing Device) 3a Screen (Touch Panel Display) 52 First Function Image 54 Second Function Image 64 Function Image Display Unit (Function Image Display Means) 66 Function Execution Unit (Function Execution Means)

Claims

1. Function image display means for displaying a first function image or a second function image on a touch panel display as an image indicating a function selectable by a user; Function execution means for executing a function corresponding to the first function image or the second function image with which the indicator has come into contact when the indicator comes into contact with the first function image or the second function image displayed on the touch panel display; and, The function image display means is an information processing apparatus that displays the second function image corresponding to the second function on the touch panel display while the first function corresponding to the first function image is being executed when the indicator comes into contact with the first function image.

2. The information processing apparatus according to claim 1, wherein the function image display means displays the second function image in the vicinity of the first function image with which the indicator is in contact.

3. The information processing apparatus according to claim 1 or 2, wherein the function image display means displays the second function image in a display area of another first function image corresponding to a function having a low relevance to the first function corresponding to the first function image selected using the indicator.

4. The information processing apparatus according to any one of claims 1 to 3, wherein the function image display means displays a plurality of the first function images with a contact position of the indicator on the touch panel display as a reference position, and displays the second function image on the opposite side of the reference position across the first function image selected using the indicator.

5. The information processing apparatus according to any one of claims 1 to 4, wherein the second function is a function related to the first function being executed.

6. The information processing apparatus according to claim 5, wherein the second function has the same effect as the first function being executed, but has a different degree of effect.

7. The information processing apparatus according to claim 5 or 6, wherein the second function is a function that the user may select after the execution of the first function being executed has ended.

8. The information processing apparatus according to any one of claims 5 to 7, wherein the relevance of each function to other functions is set.

9. The information processing apparatus according to any one of claims 1 to 8, wherein when the indicator separates from the touch panel display while the second function image is being displayed on the touch panel display, the function image display means stops displaying the second function image and continues to display the first function image.

10. The information processing apparatus according to any one of claims 1 to 9, wherein when the execution of the first function is stopped by the function execution means, the display on the touch panel display is returned to the state at the start of the execution of the first function.

11. The information processing apparatus according to any one of claims 1 to 10, wherein when the execution of the second function is stopped by the function execution means, the display on the touch panel display is returned to the state at the start of the execution of the second function or the state at the start of the execution of the first function.

12. The information processing apparatus according to claim 10 or claim 11, wherein the first function or the second function is a rewind function for rewinding the progress of the content displayed on the touch panel display, or a fast-forward function for fast-forwarding the progress of the content.

13. A first step of causing a function image display means to display a first function image or a second function image on the touch panel display as an image indicating a function selectable by a user; A second step of causing the function execution means to execute the function corresponding to the first function image or the second function image contacted by the indicator when the indicator contacts the first function image or the second function image displayed on the touch panel display; and The function image display means displays the second function image corresponding to the second function on the touch panel display during the execution of the first function corresponding to the first function image when the indicator contacts the first function image.

14. A computer, Function image display means for displaying a first function image or a second function image on the touch panel display as an image indicating a function selectable by a user; Function execution means for executing the function corresponding to the first function image or the second function image contacted by the indicator when the indicator contacts the first function image or the second function image displayed on the touch panel display; and functions as The function image display means is a function display program for displaying the second function image corresponding to the second function on the touch panel display during the execution of the first function corresponding to the first function image when the indicator contacts the first function image.

Images