Information processing device, search history storage method and search history storage program

Abstract

To provide an information processing device, a search history storage method and a search history storage program in which a user can simply store an image in association with the scene of contents in storage means.SOLUTION: Cartoon perusal processing stores search history information in which an advance hint image displayed on a screen at the end of executing a return function is associated with an original image displayed on the screen at the start of executing the return function to return the progress of a cartoon displayed on the screen, in an HDD of a server. The cartoon perusal processing changes the display state of the screen from the state of displaying the original image to the state of displaying the advance hint image associated with the original image, based on the search history information added to the cartoon.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a search history storage method, and a search history storage program. [Background technology]

[0002] In recent years, various online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are delivered to information processing devices such as mobile terminals via computer networks have become widespread.

[0003] Apps include, for example, apps for viewing distributed manga and apps for editing images. These apps have multiple functions, such as a function for moving forward or backward in the manga displayed on the screen (flip function), and a function for cutting out and editing a portion of the manga image (trimming function). A user can select a desired function from these multiple functions and have the app execute it.

[0004] Here, Patent Document 1 discloses a function of a content playback device that plays back content: the function of determining whether a comment added to a certain playback section is related to other scenes. This content playback device determines whether a comment is related to other scenes by using, for example, reference information included in the comment information or information about a playback section to which other comments with high content similarity have been added. For example, in content such as a mystery, the device determines that a comment added to a problem-solving scene has a reference relationship with the foreshadowing scene based on the content similarity between the comment added to the problem-solving scene and the comment added to the scene that foreshadows the discovery of the solution. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-267173 Summary of the Invention [Problem to be solved by the invention]

[0006] The content playback device disclosed in Patent Document 1 uses comments added by the user to determine whether a certain playback section is related to other scenes, i.e., whether other scenes are foreshadowing for a certain playback section. However, determination using comments may lack accuracy because it analyzes the context, etc., and also requires the user to input a comment if they feel that a scene is foreshadowing, which is inconvenient. Therefore, there is a need to develop a process that allows users to easily memorize foreshadowing for scenes in content.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, a search history storage method, and a search history storage program that allow a user to easily store images that the user considers relevant to a scene in content in a storage means. [Means for solving the problem]

[0008] In order to solve the above problems, the information processing device, search history storage method, and search history storage program of the present invention employ the following means.

[0009] In order to solve the above problem, an "information processing device" which is one aspect of the present invention is an information processing device which displays content consisting of a video or a plurality of still images on a screen, and which comprises: a function execution means which executes a rewind function which reverses the progress of the content displayed on the screen, or a forward function which advances the progress of the content; and a storage control means which controls the storage means to associate a second image displayed on the screen when the function execution means finishes executing a function with a first image displayed on the screen when the function execution means starts executing a function.

[0010] In order to solve the above problem, one aspect of the present invention, a "search history storage method", is a search history storage method performed by an information processing device that displays content consisting of a video or a plurality of still images on a screen, and includes a first step of executing a rewind function that reverses the progress of the content displayed on the screen or a forward function that advances the progress of the content by a function execution means, and a second step of controlling the function execution means to associate a second image that is displayed on the screen when the function execution means finishes executing the function with a first image that is displayed on the screen when the function execution means starts executing the function, and store the associated image in a storage means.

[0011] In order to solve the above problem, the "search history storage program" of one aspect of the present invention causes a computer provided in an information processing device that displays content consisting of a video or multiple still images on a screen to function as a function execution means that executes a rewind function that reverses the progress of the content displayed on the screen, or a forward function that advances the progress of the content, and a storage control means that controls the storage means to associate a second image displayed on the screen when the function execution means finishes executing a function with a first image displayed on the screen when the function execution means starts executing a function.

[0012] Various technical limitations may be imposed on the above-mentioned "information processing device," as exemplified below. Furthermore, technical limitations of the same purport may be imposed on the processing steps executed by the "search history storage method" or the functions of the "search history storage program."

[0013] The content is distributed from another information processing device, and the storage control means causes the storage means included in the other information processing device to store association information indicating an association between the first image and the second image.

[0014] The content to which the related information is added is distributed from the other information processing device.

[0015] The display device is provided with a related image display means that changes the display state of the screen from a state in which the first image is displayed to a state in which the second image associated with the first image is displayed based on the related information added to the content.

[0016] When the first image is displayed on the screen, the related image display means notifies the user of the existence of the second image related to the first image.

[0017] When the second image is displayed on the screen, the related image display means displays on the screen an image that can be operated by the user to return the image displayed on the screen to the first image.

[0018] The first image can be associated with a plurality of different second images.

[0019] When a plurality of second images are associated with the first image by a plurality of users, the second images associated with the first image are selected by statistical processing executed in the other information processing device.

[0020] A selection image for the user to select a process for storing the first image and the second image in association with each other in the storage means is displayed on the screen. [Effects of the Invention]

[0021] According to the present invention, there is an effect that a user can easily store images that he / she thinks are related to scenes of content in storage means. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a configuration diagram of a manga distribution system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the electrical configuration of a server according to an embodiment of the present invention. [Figure 3] FIG. 2 is a block diagram showing the electrical configuration of the mobile terminal according to the embodiment of the present invention. [Figure 4] 10A and 10B are diagrams illustrating functional images displayed on a mobile terminal according to an embodiment of the present invention. [Figure 5] FIG. 1 is a functional block diagram relating to a manga viewing function of a mobile terminal according to an embodiment of the present invention. [Figure 6] 10 is a flowchart showing the flow of a manga browsing process according to an embodiment of the present invention. [Figure 7] 10 is a flowchart showing the flow of a search history storage process according to the embodiment of the present invention. [Figure 8] 10 is a flowchart showing the flow of foreshadowing jump processing according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0023] An information processing device, a search history storage method, and a search history storage program according to an embodiment of the present invention will be described below with reference to the drawings. In this embodiment, as an example, a form will be described in which manga is distributed from a server to a mobile terminal, which is an information processing device, and the distributed manga is viewed by a user using the mobile terminal.

[0024] [1. Manga distribution system configuration] 1 is a schematic diagram of a manga distribution system 1 according to this embodiment. The manga distribution system 1 includes a communication line 2, a plurality of mobile terminals 3, and a server 4.

[0025] The communication line 2 forms a computer network, and is, for example, a wide area communication line provided by an electric utility company.

[0026] The mobile terminal 3 is an information processing terminal such as a smartphone, tablet terminal, or laptop computer, and is used by the user to access web services distributed via the communication line 2. The mobile terminal 3 includes a touch panel display 3a that displays images, a speaker 3b that outputs sound, a microphone 3c that inputs sound, and a camera 3d that captures an image of a subject. Here, the touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing device such as a finger, a stylus, or a pen.

[0027] The server 4 is an information processing device that distributes web services to the mobile terminal 3 via the communication line 2.

[0028] The manga distribution system 1 according to this embodiment distributes manga in the form of digital data from a server 4 to a mobile terminal 3 via a communication line 2 as one of the web services. The manga referred to here is an example of content formed from a series of still images, which are composed of pictures and have a storyline as a whole. A user views the manga distributed to the mobile terminal 3 using dedicated application software (hereinafter referred to as a "manga viewing app"). The manga viewing app is pre-installed on the mobile terminal 3. For example, the manga viewing app can display manga on the mobile terminal 3 page by page and can also enlarge or reduce the displayed manga page by page. Note that the manga viewing app functions even when the mobile terminal 3 and the server 4 are not communicating (offline) as long as manga data has been downloaded from the server 4 to the mobile terminal 3.

[0029] [2. Server configuration] FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to this embodiment.

[0030] The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20, which is a main control unit that controls the overall operation of the server 4, a ROM in which various programs and various data are stored in advance, (Read Only Memory) 22, RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and HDD (Hard Disk Drive) 26 as storage means for storing various programs and various data.

[0031] The HDD 26 stores manga data indicating manga to be distributed to the mobile terminal 3. Note that the storage means is not limited to the HDD 26, and may be, for example, another storage medium such as a semiconductor memory, such as a flash memory.

[0032] Furthermore, the server 4 is equipped with an operation input unit 28 consisting of a keyboard, mouse, etc., which accepts input of various operations, a monitor 30 such as a liquid crystal display device which displays various images, and an external interface 32 which is connected to other information processing devices such as a mobile terminal 3 via the communication line 2 and sends and receives various data to and from the other information processing devices.

[0033] The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to one another via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation status of the operation input unit 28, display images on the monitor 30, and transmit and receive various data to and from other information processing devices, etc. via the external interface 32.

[0034] [3. Electrical configuration of mobile terminal] FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG.

[0035] The mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48 in addition to the components shown in FIG.

[0036] The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the overall operation of the mobile terminal 3.

[0037] The main storage unit 42 is configured with, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

[0038] The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, as well as programs used in processing by the main control unit 40. The programs stored in the auxiliary storage unit 44 include, for example, an operating system (OS) for implementing the basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing email, web browsing, and various other functions. The auxiliary storage unit 44 also stores in advance a manga viewing application for displaying manga distributed from the server 4 on the touch panel display 3a.

[0039] The communication unit 46 is, for example, a NIC (Network Interface Controller), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have, instead of or together with the NIC, a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc.

[0040] The operation buttons 48 are provided on the side of the mobile terminal 3, and include a power button for starting or stopping the mobile terminal 3, a volume adjustment button for adjusting the volume of the sound output by the speaker 3b, and the like.

[0041] The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and operation buttons 48 are electrically connected to one another via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, grasp the operation status of the touch panel display 3a and operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[0042] [4. Various functions related to manga viewing] The user reads the manga distributed from the server 4 using a manga viewing app installed on the mobile terminal 3. This manga viewing app is equipped with various functions, and the user selects a function as needed and has the manga viewing app execute it. The following describes a case where the user selects and executes a function of the manga viewing app.

[0043] The manga viewing app according to this embodiment displays images (hereinafter referred to as "functional images") indicating functions selectable by the user on the touch panel display 3a (screen 3a) in response to a user's touch operation on the screen 3a. When the user selects a functional image using a pointer, the manga viewing app executes the function corresponding to the selected functional image. In the following description, the process related to the display of the functional image is referred to as functional image display processing, and the execution of the function corresponding to the functional image selected by the user is referred to as function execution processing.

[0044] [4-1. Displaying functional images and executing functions] In the functional image display process according to this embodiment, when the screen 3a is pressed and held with an indicator (hereinafter referred to as a "first long press"), a functional image is displayed on the screen 3a, with the first long press position set as the reference position. The first long press refers to a situation in which the indicator goes from not touching the screen 3a to touching it, and the indicator continues to contact the same position for a predetermined period of time or more. Furthermore, the functional image displayed on the screen 3a when the first long press is performed may not be a single functional image, but may be a functional image group having multiple functional images each representing a different function. Furthermore, the position on the screen 3a where the first long press is performed is not limited. In other words, the position of the functional image 52 displayed on the screen 3a changes depending on the first long press position.

[0045] Fig. 4 is a diagram showing the positional relationship between the first long press position 50A and the functional image 52. Note that the example in Fig. 4 shows a state in which a manga is displayed on the screen 3a, although not otherwise indicated, and the pages or frames of the displayed manga scroll from right to left in Fig. 4. In other words, the manga progresses from right to left.

[0046] The functional image display process according to this embodiment displays a plurality of functional images 52 using a first long press position 50A, which is the contact position of an indicator (thumb) on the screen 3a, as a reference position. In the example of Fig. 4, the user's thumb is used as the indicator, and the position on the screen 3a where the thumb makes the first long press is set as the first long press position 50A. Then, the functional image display process displays four different types of functional images 52A, 52B, 52C, and 52D on all four sides (up, down, left, and right) of the first long press position 50A as the reference position (center).

[0047] In the example of Figure 4, functional image 52A is displayed to the right of first long press position 50A and corresponds to a rewind function that moves the progress (page or frame) of the manga displayed on screen 3a back at a predetermined speed. Functional image 52B is displayed to the left of first long press position 50A and corresponds to a forward function that moves the progress of the manga displayed on screen 3a forward at a predetermined speed. Functional image 52C corresponds to a foreshadowing jump function, which will be described in detail later, and functional image 52D corresponds to a search history storage function, which will be described in detail later.

[0048] When the user selects one of the multiple functional images 52, the user performs an operation of moving the indicator to the desired functional image 52 while keeping the indicator in contact with the screen 3a (hereinafter referred to as a "slide operation"). Then, when the user slides the finger to the desired functional image 52 and performs a second long press by maintaining that state for a predetermined time or longer, the function execution process executes the function corresponding to the functional image 52. The position on the screen 3a where the second long press is performed is referred to as a second long press position 50B.

[0049] When the function image 52A corresponding to the rewind function is pressed and held for a second time, the function execution process automatically moves the manga forward, in other words, the page, at a predetermined speed. When the function image 52B corresponding to the forward function is pressed and held for a second time, the function execution process automatically moves the manga forward (page) at a predetermined speed.

[0050] Then, when the second long press on the functional image 52 is released, for example, by the finger performing the second long press being removed from the screen 3a or the finger performing the second long press being displaced from the functional image 52, the function execution process stops the function being executed. In the following description, the act of the user removing the indicator, such as a finger, from the screen 3a is also referred to as touch-off.

[0051] [4-2. Search history memory function] The search history storage function of this embodiment also has a rewind function that reverses the progress of the manga, and controls the manga scene (hereinafter referred to as the "original image") displayed on screen 3a when the rewind function begins to be executed to be associated with the scene (hereinafter referred to as the "foreshadowing image") displayed on screen 3a when the rewind function ends, and stores the associated images in HDD 26 provided in server 4.

[0052] In other words, the search history memory function allows the user to search for foreshadowing images that are thought to be related to the original image. This function automatically stores the history of manga progression (pages) that have been rewound in order to (search). In the following explanation, the information that associates the original image with the foreshadowing image and is stored in the HDD 26 of the server 4 is referred to as search history information.

[0053] Note that the user can cause the mobile terminal 3 to execute a process of associating the original image with the foreshadowing image and storing them in the HDD 26, that is, a search history storage function, by long pressing (second long pressing) the functional image 52D shown in FIG.

[0054] The original image and the foreshadowing image are, for example, pages and frames that make up the manga. Furthermore, the search history information stored in the server 4 does not necessarily have to be the original image and the foreshadowing image itself, but may be, for example, the position (coordinates) of the page or frame of the manga that includes the original image and the foreshadowing image.

[0055] Here, a method of using the search history storage function according to this embodiment will be described. The user rewinds the progress of the manga by executing the rewind function of the search history storage function, and continues executing the rewind function until a foreshadowing image is found. When an image that the user considers to be a foreshadowing image is displayed on screen 3a, the user ends the rewind function by touching off their finger. The search history storage function then regards the scene (image) displayed on screen 3a at the start of execution of the rewind function as the original image, and the scene (image) displayed on screen 3a at the time of touch-off as the foreshadowing image, and transmits search history information associating these to server 4 via communication unit 46 and stores them in server 4.

[0056] In this way, the search history storage function associates the original image with the foreshadowing image simply by performing a touch operation on the screen 3a, and stores them in the server 4. Therefore, the user can easily store foreshadowing for a manga scene in the HDD 26 of the server 4.

[0057] The ID (hereinafter referred to as "user ID") of the user who stored the search history information may be added (registered) to the search history information. The user ID may be added only with the permission of the user who stored the search history information.

[0058] The server 4 also adds the search history information stored in the HDD 26 to the corresponding manga and stores the manga in the HDD 26. The manga with the added search history information is distributed from the server 4 to the mobile terminal 3. Therefore, the manga viewing app can show foreshadowing images associated with the original image not only to the user who has stored the search history information in the server 4, but also to other users. As an example, the manga viewing app shows foreshadowing images to the user using a foreshadowing jump function, which will be described later.

[0059] In this way, the search history storage function adds search history information to the manga delivered to the mobile terminal 3, and the foreshadowing jump function makes the search history information available not only to the user who stored it on the server 4, but also to other users, so that the manga delivered from the server 4 is formed as CGM (Consumer Generated Media).

[0060] Furthermore, any user who uses the manga viewing app can store search history information in the server 4. For this reason, interpretations of original images and foreshadowing images may differ depending on the user, and multiple users may store search history information in the server 4, which may result in multiple different foreshadowing images being associated with one original image.

[0061] In such a case, it may be possible to associate multiple different foreshadowing images with one original image based on search history information by multiple users. In this case, the server 4 associates multiple different foreshadowing images with one original image and stores them. This allows users to view multiple foreshadowing images for the original image using the foreshadowing jump function described below. Note that the process for when multiple different foreshadowing images are associated with one original image is set by the manga distributor.

[0062] Furthermore, without being limited to this, when multiple users associate multiple foreshadowing images with an original image, the foreshadowing images associated with the original image may be selected by statistical processing executed by the server 4. The statistical processing is a process of selecting foreshadowing images to be associated with the original image according to predetermined conditions, such as majority voting or filtering based on conditions from the current time to a predetermined time.

[0063] In the majority vote, for example, the same foreshadowing image that is most frequently associated with an original image is determined to be the foreshadowing image associated with that original image. In the filtering, older search history information is excluded from the statistical processing because it is believed that the more time has passed since the start of distribution of the manga, the more accurate foreshadowing images users will be able to search for in the original image. Note that the majority vote and filtering, or other conditions, may be combined.

[0064] Furthermore, the search history information may be weighted by the user. For example, the search history information of a user who reads a lot of manga or a user who reads the same manga repeatedly may be weighted more heavily, and statistical processing may be performed so that the search history of that user is ranked higher.

[0065] Furthermore, the top multiple foreshadowing images selected by statistical processing based on multiple pieces of search history information may be associated with the original image.

[0066] [4-3. Foreshadowing Jump Function] As described above, the server 4 delivers the manga to which the search history information has been added to the mobile terminal 3.

[0067] The foreshadowing jump function according to this embodiment changes the display state of the screen 3a from a state in which an original image is displayed to a state in which a foreshadowing image associated with the original image is displayed, based on the search history information added to the distributed manga. In other words, the foreshadowing jump function instantly changes the display of the screen 3a to a foreshadowing image associated with the original image. This allows the user to easily check the foreshadowing image associated with the original image.

[0068] The foreshadowing jump function may notify the user of the presence of a foreshadowing image associated with the original image when the original image is displayed on the screen 3a. For example, the notification may include displaying a message saying "Foreshadowing Found" on the screen 3a when the original image is displayed on the screen 3a, or highlighting the outline of the page or frame containing the original image. This allows the user to instantly display a foreshadowing image on the screen 3a when the original image is displayed on the screen 3a in order to check for foreshadowing. When the message saying "Foreshadowing Found" is displayed on the screen 3a, a functional image 52C corresponding to the foreshadowing jump function may be displayed on the screen 3a.

[0069] Furthermore, when the indicator (user's finger) touches the functional image 52C, the foreshadowing jump function displays a foreshadowing image on the screen 3a and also displays a back button on the screen 3a. This back button is an image that is operated by the user to return the display on the screen 3a to the original image when the foreshadowing jump function displays a foreshadowing image on the screen 3a.

[0070] Therefore, if the back button is touched while a foreshadowing image is displayed on screen 3a, the display on screen 3a is returned to the time when the foreshadowing jump function was first executed. That is, the user can check the foreshadowing image corresponding to the original image by touching function image 52C, and then return to the original image (image including the original image) on screen 3a simply by touching the back button, thereby improving the convenience of the foreshadowing jump function.

[0071] The manga viewing app allows the user to scroll the manga in response to a slide operation using a pointer while a foreshadowing image is displayed on the screen 3a, allowing the user to check the scenes before and after the foreshadowing image. The manga viewing app may also display function image 52 when a long press is performed on screen 3a while a foreshadowing image is displayed on screen 3a.

[0072] Furthermore, if a user ID is added to the search history information, the foreshadowing jump function displays the foreshadowing image on the screen 3a along with the user ID, allowing the user checking the foreshadowing image to know who has stored the foreshadowing image.

[0073] Furthermore, when a plurality of different foreshadowing images are associated with one original image, the foreshadowing jump function causes the plurality of foreshadowing images to be displayed in order on the screen 3a.

[0074] [4-4. Combination of rewind function and foreshadowing jump function]

[0075] Instead of executing the foreshadowing jump function only when the functional image 52C is pressed and held, a function similar to the foreshadowing jump function may be added to the rewind function that is executed by pressing and holding the functional image 52A. In other words, the rewind function may be combined with the foreshadowing jump function.

[0076] As one example, starting from a page containing an original image associated with a foreshadowing image, the user may press and hold functional image 52A to execute the back function, instantly returning the display on screen 3a to the page with the most images associated with the original image (foreshadowing images). Also, if the time period for which functional image 52A is pressed and held exceeds a predetermined time, the display may instantly return to the page with the most images associated with the original image (foreshadowing images). This is because if the time period for which functional image 52A is pressed and held exceeds the predetermined time, it is assumed that the user is searching for a foreshadowing image.

[0077] Furthermore, when a user long-presses functional image 52A to rewind the manga, starting from a page including an original image associated with a foreshadowing image, the speed at which the manga is rewound may be relatively slowed down when the manga page rewinds to the vicinity of the foreshadowing image associated with the original image. Furthermore, the rewind function may further slow down the speed as the page approaches the foreshadowing image.

[0078] By combining the rewind function with the foreshadowing jump function in this way, the user can enjoy searching for foreshadowing images related to the original image, and can also learn about foreshadowing images stored by other users. Note that the user may be able to select whether or not to combine the rewind function with the foreshadowing jump function by switching settings.

[0079] [5. Functional block of manga viewing function] 5 is a functional block diagram of a manga viewing function executed by a manga viewing application installed in the mobile terminal 3 according to this embodiment. The main control unit 40 included in the mobile terminal 3 includes a manga display control unit 60, a scroll control unit 62, a functional image display unit 64, and a function execution unit 66. The processes executed by each function included in the main control unit 40 are realized by programs stored in the auxiliary storage unit 44.

[0080] The manga display control unit 60 displays the manga distributed from the server 4 on the screen 3a.

[0081] The scroll control unit 62 scrolls the manga displayed on the screen 3a in response to an operation on the screen 3a by a pointer.

[0082] The function image display unit 64 displays the function images 52 on the screen 3a as images indicating functions that can be selected by the user.

[0083] When a pointer comes into contact with a function image 52 displayed on the screen 3a, the function executing unit 66 executes a function corresponding to the function image 52 that the pointer has come into contact with. Specifically, the function executing unit 66 includes a forward function executing unit 70 that executes a forward function, a rewind function executing unit 72 that executes a rewind function, a search history storage function executing unit 74 that executes a search history storage function, a foreshadowing jump function executing unit 76 that executes a foreshadowing jump function, and various other executing units that execute other functions.

[0084] [6. Flowchart of each process] The following describes the flow of the manga viewing process using the manga viewing function, the search history storage process using the search history storage function, and the foreshadowing jump process using the foreshadowing jump function, using flowcharts. Note that the search history storage process and the foreshadowing jump process are executed as part of the manga viewing process. [6-1. Manga viewing process flowchart] FIG. 6 is a flowchart showing the flow of the manga browsing process executed by the main control unit 40 provided in the mobile terminal 3.

[0085] First, in step 100, the manga display control unit 60 displays the manga distributed from the server 4 on the screen 3a.

[0086] In the next step 102, the scroll control unit 62 determines whether or not the user has performed a scroll operation on the screen 3a.

[0087] In step 104, the scroll control unit 62 scrolls the manga displayed on the screen 3a in response to the user's scroll operation.

[0088] In step 106, the functional image display unit 64 determines whether or not a long press is being made on the screen 3a. If the determination is affirmative, the process proceeds to step 108; if the determination is negative, the process proceeds to step 118.

[0089] In step 108, the functional image display unit 64 displays the functional image 52 on the screen 3a.

[0090] In the next step 110, the search history storage function execution unit 74 determines whether the user has selected the search history storage function by determining whether the user has pressed and held the functional image 52D (second long press), and if the determination is affirmative, the process proceeds to step 112. On the other hand, if the determination is negative, the process proceeds to step 114.

[0091] In step 112, the search history storage function execution unit 74 executes a search history storage process (search history storage function).

[0092] In step 114, the foreshadowing jump function execution unit 76 determines whether the user has selected the foreshadowing jump function by determining whether the user has pressed and held the functional image 52C (second long press), and if the determination is affirmative, the process proceeds to step 116. On the other hand, if the determination is negative, the process proceeds to step 118. Note that in the manga viewing process according to this embodiment, the user can select the foreshadowing jump function only when the message "Foreshadowing present" is displayed on screen 3a.

[0093] In step 116, the foreshadowing jump function executing section 76 executes the foreshadowing jump process (foreshadowing jump function).

[0094] In step 118, the manga display control unit 60 determines whether the manga displayed on screen 3a has finished, and if the determination is affirmative, the manga viewing process ends, and if the determination is negative, the process proceeds to step 102 and the manga display continues. Note that, as an example, the manga display control unit 60 determines that the manga has finished when the manga displayed on screen 3a cannot be scrolled any further.

[0095] Note that the flowchart shown in Figure 6 explains the steps when the user selects the search history storage function and the foreshadowing jump function, but if the user selects other functions such as the back function or forward function, the function execution unit 66 will also execute the function as appropriate.

[0096] [6-2. Search history storage process flowchart] 7 is a flowchart showing the flow of the search history storage process executed in step 112 of the manga browsing process described above. The search history storage process is executed by the search history storage function execution unit 74, as described above.

[0097] First, in step 200, original image information is acquired. Specifically, the page displayed on screen 3a at the time when the user presses and holds (second long press) functional image 52D corresponding to the search history storage function is taken as the original image, and search history storage function execution unit 74 acquires the page number as original image information. However, without being limited to this, the frame overlapping with the first long press may be taken as the original image, and the page number and frame position including that frame may be acquired as original image information.

[0098] In the next step 202, the user executes a rewind function to rewind the manga. At this time, a speed-adjusting slide bar is displayed on the screen 3a, and the speed of rewinding may be changed depending on the direction and magnitude of the swipe operation following the second long press operation by the user. For example, if a swipe operation is performed to the right parallel to the slide bar, the speed of rewinding becomes relatively faster. Furthermore, the forward function may be executed by swiping to the left based on the second long press position 50B. By performing such operations, the user searches for foreshadowing images related to the original image.

[0099] In the next step 204, it is determined whether or not the indicator has been touched off the screen 3a. If the determination is affirmative, the process proceeds to step 206, and if the determination is negative, the process returns to step 202 and the execution of the return function continues.

[0100] In the next step 206, the page number of the manga that was touched off is acquired as foreshadowing image information. Note that the frame that the pointer was in contact with immediately before the touch off may be regarded as the foreshadowing image, and the page number and the position of the frame that includes that frame may be acquired as foreshadowing image information.

[0101] In the next step 208, the original image information acquired in step 200 and the foreshadowing image information acquired in step 206 are associated with each other to generate search history information.

[0102] In the next step 210, the communication unit 46 is caused to execute a process of transmitting the search history information to the server 4. The search history information transmitted to the server 4 is stored in the HDD 26 and added to the manga data indicating the corresponding manga.

[0103] In the next step 212, the display on the screen 3a is returned to the state at the start of the search history storage process, that is, the page including the original image, and the search history storage process is terminated.

[0104] [6-3. Flowchart of foreshadowing jump function] 8 is a flowchart showing the flow of the foreshadowing jump process executed in step 116 of the manga browsing process described above. Note that the foreshadowing jump process is executed by the foreshadowing jump function executing unit 76, as described above.

[0105] First, in step 300, foreshadowing image information indicating a foreshadowing image corresponding to the original image selected by the user is obtained. Specifically, the page displayed on screen 3a at the time when the user long-presses (second long-press) functional image 52C corresponding to the foreshadowing jump function is used as the original image, and foreshadowing image information indicating the foreshadowing image associated with this original image is read from the search history information attached to the manga.

[0106] In the next step 302, a back button is displayed on screen 3a together with the foreshadowing image (page including the foreshadowing image) indicated by the foreshadowing image information. That is, in step 302, the display on screen 3a is switched from the original image to the foreshadowing image. However, this is not limiting, and in order to clearly let the user recognize that the manga displayed on screen 3a is changing from the original image to the foreshadowing image, for example, the page may be quickly reversed from the original image to the foreshadowing image.

[0107] In the next step 304, it is determined whether or not the pointer has touched the back button displayed on the screen 3a, and if the determination is affirmative, the process proceeds to step 306, whereas if the determination is negative, the process returns to step 302 and the foreshadowing image continues to be displayed. In other words, the foreshadowing image continues to be displayed on the screen 3a until the back button is touched, allowing the user to check the foreshadowing image.

[0108] In step 306, the display on the screen 3a is returned to the state at the start of the foreshadowing jump process, that is, the page containing the original image, and this foreshadowing jump process is terminated.

[0109] As described above, the manga viewing process according to this embodiment stores search history information in the HDD 26 of the server 4, which associates the foreshadowing image displayed on the screen 3a when the execution of the rewind function, which reverses the progress of the manga displayed on the screen 3a, with the original image displayed on the screen 3a when the execution of the rewind function begins. Therefore, the manga viewing process enables the user to easily store images that the user thinks are related to scenes in the manga, i.e., foreshadowing, in the server 4.

[0110] Furthermore, the manga viewing process according to this embodiment changes the display state of the screen 3a from a state in which the original image is displayed to a state in which a foreshadowing image associated with the original image is displayed, based on the search history information added to the manga. Therefore, the manga viewing process allows the user to easily check the foreshadowing image associated with the original image.

[0111] 7. Other Embodiments Although the present invention has been described above using the above-mentioned embodiments, the technical scope of the present invention is not limited to the scope described in the above-mentioned embodiments. Various modifications or improvements can be made to the above-mentioned embodiments without departing from the gist of the invention, and such modifications or improvements are also included in the technical scope of the present invention. Furthermore, the above-mentioned embodiments may be combined as appropriate.

[0112] For example, in the above embodiment, the content is described as a manga, but the present invention is not limited to this. For example, the content may be a video, or the content may be a novel or the like composed of text. When the content is a video, the original image information and the foreshadowing image information each represent the elapsed time from the start of the video.

[0113] In the above embodiment, the page numbers and frame positions of the original images and foreshadowing images are stored as search history information, but the present invention is not limited to this. For example, the image data itself showing the original images and foreshadowing images may be stored in the server 4 as search history information.

[0114] In the above embodiment, the foreshadowing jump function is described as switching the display on the screen 3a from the original image to the foreshadowing image, but the present invention is not limited to this. For example, a new window may be displayed on the screen 3a, and the foreshadowing image may be displayed in that window.

[0115] In the above embodiment, the search history information is stored in the server 4 and attached to the manga through the operation of the user who has viewed the manga, but the present invention is not limited to this. For example, the search history information may be attached to the manga in advance, regardless of the operation by the user.

[0116] In the above embodiment, the foreshadowing jump function is executed when the functional image 52C is pressed and held, but the present invention is not limited to this. For example, the foreshadowing jump function may be executed when the user presses and holds the screen 3a displaying the original image associated with the foreshadowing image or the page including the original image.

[0117] Furthermore, in the above embodiment, when the back button is touched while a foreshadowing image is displayed on the screen 3a, the display on the screen 3a is returned to the state when the foreshadowing jump function was first executed. However, the present invention is not limited to this. For example, the foreshadowing image may be displayed only when the indicator is in contact with the functional image 52C (second long press), and when the indicator is released from the functional image 52C, the display on the screen 3a may be returned to the state when the foreshadowing jump function was first executed. In other words, the user can check the foreshadowing image corresponding to the original image by touching the functional image 52C, and then return the screen 3a to the original image (an image including the original image) simply by releasing the indicator, thereby improving the convenience of the foreshadowing jump function.

[0118] Furthermore, while the foreshadowing image is displayed on the screen 3a, a slide bar for moving forward or backward in the manga may be displayed on the screen 3a. Then, depending on the direction and size of the swipe operation performed by the user following the second long press operation, it is possible to move forward or backward in the manga starting from the foreshadowing image displayed on the screen 3a. This allows the user to check the scenes before and after the foreshadowing image.

[0119] Furthermore, in the above embodiment, the search history information is stored in the server 4, but the present invention is not limited to this. For example, the search history information may be stored in the auxiliary storage unit 44 of the mobile terminal 3 and added to the distributed manga.

[0120] In the above embodiment, the search history information is generated by the mobile terminal 3, but the present invention is not limited to this. For example, information on the original image and information on the foreshadowing image may be transmitted from the mobile terminal 3 to the server 4, and the server 4 may generate the search history information based on this information.

[0121] In the above embodiment, the screen 3a is a touch panel display, but the present invention is not limited to this. For example, the screen 3a may be an LCD or the like that is not a touch panel display, and a cursor may be displayed on the LCD, and the manga may be viewed by operating the cursor with a mouse or the like.

[0122] Furthermore, in the above embodiment, a configuration has been described in which a first image (original image) displayed on the screen 3a when execution of the rewind function is started is associated with a second image (foreshadowing image) displayed on the screen 3a when execution of the rewind function is finished, and these are stored in the HDD 26 provided in the server 4, but the present invention is not limited to this. A first image displayed on the screen 3a when execution of the forward function is started may be associated with a second image displayed on the screen 3a when execution of the forward function is finished, and these may be stored in the HDD 26 provided in the server 4. In this configuration, the first image is the foreshadowing image, and the second image is the original image.

[0123] Furthermore, the manga distributed from server 4 may be divided into multiple manga data, in other words, multiple volumes. In this case, if a foreshadowing image corresponding to an original image is contained in different manga data, identification information (information indicating the volume number of the volume) of the manga data containing the foreshadowing image is added to the search history information in order to associate the foreshadowing image with the original image. When a foreshadowing image contained in different manga data (different volumes) is to be displayed on screen 3a, the manga data is read from auxiliary storage unit 44 or server 4.

[0124] Furthermore, the flow of the manga viewing process, search history storage process, and foreshadowing jump process described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope of the gist of the present invention. [Explanation of symbols]

[0125] 3. Mobile terminals (information processing devices) 3a screen 4 Servers (other information processing devices) 26 HDD (storage means) 52D Functional Image (Selected Image) 64 Functional image display unit (functional image display means) 70 Feeding function execution unit (function execution means) 72 Return function execution unit (function execution means) 74 Search history storage function execution unit (storage control means) 76 Foreshadowing jump function execution unit (related image display means)

Claims

1. An information processing device that displays content consisting of a moving image or a plurality of still images on a screen, a function execution means for executing a rewind function for reversing the progress of the content displayed on the screen or a forward function for advancing the progress of the content; an information processing device comprising: a storage control means for controlling the storage means to associate a first image displayed on the screen when the function execution means starts to execute a function with a second image displayed on the screen when the function execution means finishes executing a function.

2. the content is distributed from another information processing device, 2. The information processing apparatus according to claim 1, wherein the storage control means causes the storage means of the other information processing apparatus to store association information indicating the association between the first image and the second image.

3. 3. The information processing apparatus according to claim 2, wherein the content to which the related information is added is distributed from the other information processing apparatus.

4. 4. The information processing device according to claim 3, further comprising a related image display means for changing the display state of the screen from a state in which the first image is displayed to a state in which the second image associated with the first image is displayed based on the related information added to the content.

5. 5. The information processing apparatus according to claim 4, wherein the related image display means, when the first image is displayed on the screen, notifies the user of the existence of the second image related to the first image.

6. 6. An information processing device according to claim 4, wherein the related image display means, when displaying the second image on the screen, displays on the screen an image that can be operated by the user to return the image displayed on the screen to the first image.

7. The information processing apparatus according to claim 1 , wherein the first image can be associated with a plurality of different second images.

8. An information processing device described in any one of claims 2 to 7, wherein when multiple second images are associated with the first image by multiple users, the second images associated with the first image are selected by statistical processing performed on the other information processing device.

9. 9. The information processing apparatus according to claim 1, wherein a selection image for a user to select a process for storing the first image and the second image in association with each other in the storage means is displayed on the screen.

10. A search history storage method performed by an information processing device that displays content consisting of a moving image or a plurality of still images on a screen, comprising: a first step of executing, by a function execution means, a rewind function for reversing the progress of the content displayed on the screen or a forward function for advancing the progress of the content; a second step of controlling the storage means to associate a first image displayed on the screen when the function execution means starts to execute a function with a second image displayed on the screen when the function execution means finishes executing the function, and to store the associated second image in the storage means.

11. A computer included in an information processing device that displays content consisting of a moving image or a plurality of still images on a screen, a function execution means for executing a rewind function for reversing the progress of the content displayed on the screen or a forward function for advancing the progress of the content; A search history storage program for functioning as a storage control means that controls the storage means to associate a first image displayed on the screen when the function execution means starts executing a function with a second image displayed on the screen when the function execution means finishes executing a function, and store the associated image in the storage means.

Images