Information processing device, storage medium, and computer program product

Abstract

The present invention provides an information processing device and a storage medium, which can easily identify the information shown in a plurality of thumbnails displayed at a glance. The information processing device (10) obtains the information shown in each of the plurality of thumbnails (8) displayed at a glance, and determines the size of the thumbnails (8) that can identify the information for each of the plurality of thumbnails (8), and controls the plurality of thumbnails (8) to be displayed at a glance in such a way that the size of the plurality of thumbnails (8) becomes larger than the determined size.

Description

Technical Field

[0001] The present invention relates to an information processing device and a storage medium. Background Art

[0002] Patent document 1 discloses a data transmission device, which includes: a structure analysis component that performs structure analysis on input data; a determination component that determines the generation ratio of each attribute of the data structured by the structure analysis component; and a data transmission component that transmits the data structured by the structure analysis component in units of a number determined in advance corresponding to the determination result of the determination component.

[0003] Patent document 2 discloses a thumbnail generation processing program that enables a computer included in a thumbnail generation device that generates a thumbnail of content displayed by a display device to function as the following components: an acquisition component that acquires the content; a discrimination component that discriminates the type of the content acquired by the content acquisition component; an extraction component that extracts from the content a portion of the content that is equivalent to a predetermined extraction range corresponding to the identified type on the display of the content; and a generation component that generates the thumbnail of the display image that is equivalent to the extracted portion.

[0004] Patent document 3 discloses a content display device, which includes: a display component that displays a plurality of contents on a screen in a first arrangement in which the arrangement order of the respective contents is predetermined; an input component that accepts input from a user of an instruction to change the display size of a designated content of any one of the plurality of contents displayed on the screen; a change component that, when the input has been accepted, changes the display size of a specified number of contents that include the designated content and are continuously arranged on the screen in the arrangement order; and a moving component that moves the specified number of contents on the screen in a manner such that they are displayed on the screen in a second arrangement in which the arrangement order is predetermined and different from the first arrangement.

[0005] [Prior art literature]

[0006] [Patent Document]

[0007] Patent Document 1: Japanese Patent Application Publication No. 2008-77171

[0008] Patent Document 2: Japanese Patent Application Publication No. 2010-170500

[0009] Patent Document 3: International Publication No. 2012 / 141048 Summary of the invention

[0010] [Problems to be solved by the invention]

[0011] In multiple abbreviations Figure 1 In the case of a browsing display, when the reduction ratios of a plurality of thumbnails are the same, the thumbnails may become smaller and the information shown in the thumbnails may be difficult to recognize due to the thumbnails.

[0012] The object of the present invention is to provide a method for converting a plurality of abbreviations into Figure 1 In the case of a list display, the information processing device and the storage medium can easily identify the information represented by each of the plurality of thumbnails displayed in a list, compared with a case where the reduction ratio of the plurality of thumbnails is the same.

[0013] [Technical means to solve the problem]

[0014] In order to achieve the above object, the invention of the information processing device described in technical solution 1 includes: an acquisition component that acquires information shown by each of a plurality of thumbnails displayed at a glance; a determination component that determines the size of a thumbnail that can identify the information for each of the plurality of thumbnails; and a display control component that controls in the following manner: displaying the plurality of thumbnails in a manner that becomes larger than the size determined by the determination component for the plurality of thumbnails Figure 1 Browse display.

[0015] The invention described in claim 2 is that the size of the thumbnail enlarged to a size larger than the size is determined according to the content of the thumbnail and the plurality of thumbnails are enlarged to a size larger than the size. Figure 1 Set the size and resolution of the displayed screen.

[0016] The invention described in Technical Solution 3 includes a detection unit for detecting the degree of occupancy of an image relative to the size of the multiple thumbnails, and the display control unit performs the following control: as the proportion of thumbnails whose degree of occupancy detected by the detection unit relative to the multiple thumbnails is above a predetermined threshold value increases, the size of the thumbnails enlarged to a size larger than the size is adjusted to be smaller.

[0017] The invention described in claim 4 is that the display control unit performs the following control: using visual features related to the appearance of characters included in the thumbnail, the size of the thumbnail adjusted according to the occupancy degree is further adjusted.

[0018] The invention described in Technical Solution 5 is that when the difference between the color distribution of text contained in the thumbnail and the color distribution of text contained in other adjacent thumbnails is greater than a predetermined threshold, the display control component controls the size of the thumbnail enlarged to a size larger than the size to become smaller than the size of the thumbnail set according to the occupancy degree.

[0019] The invention described in Technical Solution 6 is that when the similarity between the configuration of text contained in a thumbnail and the configuration of text contained in other adjacent thumbnails is less than a predetermined similarity, the display control component controls the size of the thumbnail enlarged to a size larger than the size to become smaller than the size of the thumbnail set according to the occupancy degree.

[0020] The invention described in claim 7 is that the display control unit uses at least one of the thickness of the arranged characters, the size of the characters, and the type of the characters for measuring the similarity.

[0021] The invention described in Technical Solution 8 is that when the difference between the distribution of blank spaces contained in a thumbnail and the distribution of blank spaces contained in other adjacent thumbnails is greater than a predetermined threshold, the display control component controls the size of the thumbnail enlarged to a size larger than the size to become smaller than the size of the thumbnail set according to the occupancy degree.

[0022] The invention described in Technical Solution 9 is that the display control component controls the size of the thumbnails in such a way that the sizes of the thumbnails displayed along the horizontal edges of the page displaying the thumbnails become the same among the thumbnails that have been enlarged to a size larger than the size adjusted for each thumbnail.

[0023] The invention described in claim 10 is that the display control unit performs the following control: the other thumbnails are enlarged until they become the same size as the largest thumbnail among the thumbnails that have been enlarged to a size larger than the size and are displayed along the lateral side.

[0024] The invention described in technical solution 11 is that the display control component performs the following control: further enlarging the length of the vertical side intersecting the horizontal side of the thumbnail that has been enlarged to a size larger than the size and is arranged in the final row of the page along the horizontal side, so as to reduce the blank space that appears at the bottom of the final row.

[0025] The invention described in technical solution 12 includes an accepting component that accepts an instruction to enlarge the size of a thumbnail in accordance with the movement amount of the indicator, and the display control component is controlled in such a manner that the size of each of the multiple thumbnails is enlarged to a size larger than the size in accordance with the instruction accepted by the accepting component, and each of the thumbnails that have been enlarged to a size larger than the size is displayed side by side.

[0026] The invention described in claim 13 is that the display control unit controls in the following manner: the thumbnail that has been enlarged to the size corresponding to the indicated size is not displayed on the plurality of thumbnails until the thumbnail is enlarged to a size that makes it impossible to maintain the state in which the thumbnails are displayed in each page without overlapping each other without increasing the number of pages displaying the thumbnails. Figure 1 on the browsing display screen.

[0027] The invention described in claim 14 is that the display control unit controls the display of each page of thumbnails enlarged to a size larger than the size in such a manner that the number of pages is changed according to the movement amount of the indicator accepted by the acceptance unit.

[0028] The invention described in technical solution 15 is that when the receiving component receives the start of the movement of the indicator, the display control component controls the display of the total number of pages after the change at the following position, which is a position on the extension line of the moving direction of the indicator and is a position at which the change in the number of pages of each enlarged thumbnail can be obtained.

[0029] The invention described in claim 16 is that the display control unit performs control to make the enlargement amount of the thumbnail variable according to at least one of the size and content of the thumbnail to be enlarged even when the same movement amount is received from the receiving unit.

[0030] The invention described in claim 17 is that the display control unit performs control in such a manner that the smaller the size of the thumbnail to be enlarged is, the larger the enlargement amount of the thumbnail for the same amount of movement becomes.

[0031] The invention described in technical solution 18 includes a detection unit that detects the degree of occupancy of an image relative to the size of a thumbnail, and the display control unit is controlled in such a manner that the amount of enlargement of the thumbnail relative to the same amount of movement increases as the degree of occupancy of the image contained in the thumbnail that is the object of enlargement detected by the detection unit becomes lower.

[0032] The invention described in claim 19 is that the movement amount of the indicator received by the receiving component is that the indicator does not contact the plurality of thumbnails. Figure 1 The amount of movement while browsing the displayed screen.

[0033] The invention described in Technical Solution 20 is that the display control component divides the multiple thumbnails into multiple areas that are larger than the size and are displayed on one page in a non-overlapping manner, and when any one of the multiple areas has been selected, control is performed in a manner such that each thumbnail contained in the selected area is displayed on one page.

[0034] The invention described in claim 21 is that the display control unit controls the division of the plurality of thumbnails in such a manner that the divided areas further include the plurality of areas.

[0035] The invention described in Technical Solution 22 is that the display control component establishes a correspondence between each of the multiple pages and the thumbnails that have been enlarged to a size larger than the size that have been divided into each block, in a manner that switches pages for each block divided corresponding to the association of the content in the file represented by the thumbnail, and controls the display of each of the thumbnails that have been enlarged to a size larger than the size in the multiple pages.

[0036] The invention described in claim 23 is that the end portions provided along the respective sides of the page displaying the thumbnail images each include a receiving area for receiving a switching instruction of the displayed page, and

[0037] The display control unit performs control to set the width of the end portion so that the width of the end portion including the acceptance region becomes longer than the width of the end portion not including the acceptance region.

[0038] The invention described in claim 24 is that the display control unit controls the arrangement of each of the thumbnails enlarged to a size larger than the size displayed on the page, corresponding to the type of language used in the description of the file included in the thumbnail.

[0039] The invention described in technical solution 25 is that the display control component controls the arrangement of each thumbnail that has been enlarged to a size larger than the size and is displayed on the page according to the type of the language and the writing direction of the language.

[0040] The storage medium of the invention described in claim 26 stores an information processing program that causes a computer to function as each component of the information processing device described in any one of claims 1 to 25.

[0041] [Effects of the Invention]

[0042] According to the invention described in technical solution 1 and technical solution 26, the following effects are achieved: Figure 1 In the case of a list display, the information shown in each of the plurality of thumbnails displayed at a glance can be easily recognized compared to a case in which the reduction ratio of the plurality of thumbnails is the same.

[0043] According to the invention described in claim 2, there is an effect that the visibility and operability of the thumbnails can be improved compared to the case where the sizes of the enlarged thumbnails are set to the same size for each thumbnail in advance.

[0044] According to the invention described in claim 3, the following effect is achieved: the size of the thumbnail can be adjusted according to the degree of occupancy of the image included in the thumbnail.

[0045] According to the invention described in technical solution 4, the following effect is achieved: the size of the thumbnail can be adjusted according to the visual features of the text contained in the thumbnail.

[0046] According to the invention described in claim 5, there is an effect that the size of the thumbnail can be adjusted according to the difference in color distribution of the characters included in adjacent thumbnails.

[0047] According to the invention described in claim 6, there is an effect that the size of the thumbnails can be adjusted according to the similarity of the arrangement of the characters included in the adjacent thumbnails.

[0048] According to the invention described in claim 7, there is an effect that the size of the thumbnail can be adjusted according to the similarity of the attribute representing the appearance of the text.

[0049] According to the invention described in claim 8, there is an effect that the size of the thumbnail can be adjusted according to the distribution difference of the blank space between adjacent thumbnails.

[0050] According to the invention described in claim 9, there is an effect that the arrangement order of the thumbnails can be made clear compared to a case where thumbnails of different sizes are displayed along the horizontal side of the page.

[0051] The invention according to technical solution 10 has the following effect: compared with the case where the size of the thumbnails displayed along the horizontal edge of the page is made consistent with the size of thumbnails other than the largest thumbnail, the arrangement order of the thumbnails can be made clear without reducing the visibility and operability of the thumbnails.

[0052] According to the invention described in technical solution 11, the following effect is achieved: the visibility and operability of the thumbnails can be improved without changing the arrangement order of the thumbnails.

[0053] According to the invention described in claim 12, there is an effect that the size of each of the plurality of thumbnails is enlarged in accordance with the movement amount of the indicator.

[0054] According to the invention described in claim 13, there is an effect that the size of each thumbnail can be discretely enlarged.

[0055] According to the invention described in technical solution 14, the following effect is achieved: thumbnails can be displayed in a dispersed manner on multiple pages.

[0056] According to the invention described in claim 15, there is an effect that the amount of movement of the indicator required for enlarging and displaying the thumbnail can be visually understood.

[0057] According to the invention described in claim 16, there is an effect that the operability of the thumbnails can be improved compared to the case where the enlargement amount of the thumbnails is controlled in proportion to the movement amount of the indicator.

[0058] According to the invention described in claim 17, there is an effect that the thumbnail can be enlarged to a desired size with a smaller movement amount of the indicator, compared with a case where the enlargement amount of the thumbnail is controlled in proportion to the movement amount of the indicator.

[0059] According to the invention described in claim 18, there is an effect that the smaller the image occupancy rate of a thumbnail is, the smaller the amount of movement of the indicator can be used to enlarge the thumbnail to a desired size.

[0060] According to the invention described in claim 19, there is an effect that the size of the thumbnail can be made variable even when the pointer is moved in a space where the user does not touch the screen.

[0061] According to the invention described in claim 20, there is an effect of being able to indicate the positional relationship of the displayed thumbnail, such as the thumbnail representing the content of a certain part of the file.

[0062] According to the invention described in technical solution 21, the following effects are achieved: Figure 1 Compared with the case where the page including the desired thumbnail is displayed on the screen, the page including the desired thumbnail can be displayed on the screen in a shorter time.

[0063] The invention according to technical solution 22 has the following effect: the desired thumbnail can be found from multiple thumbnails based on the blocks of the file.

[0064] According to the invention described in claim 23, there is an effect that, compared with the case where the acceptance area is set within the display range of the thumbnail, it is possible to suppress the occurrence of erroneous operation of selecting a thumbnail unintentionally while intending to select the acceptance area.

[0065] According to the invention described in claim 24, there is an effect that thumbnails can be easily confirmed compared to a case where the arrangement of thumbnails in a page is fixed in one direction for any language.

[0066] According to the invention described in claim 25, the following effect is achieved: thumbnails can be confirmed more easily than when the arrangement of thumbnails in a page is fixed in a predetermined direction corresponding to the language used in the document. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 This is a diagram showing an example of the functional configuration of the information processing device according to the first embodiment.

[0068] Figure 2 This is a diagram showing a configuration example of a main part of an electrical system in an information processing device.

[0069] Figure 3 This is a flowchart showing an example of the flow of thumbnail processing.

[0070] Figure 4 This is a flowchart showing an example of the flow of content detection processing.

[0071] Figure 5 This is a diagram showing an example of an enlarged table.

[0072] Figure 6 This is a flowchart showing an example of the flow of the adjustment process using the color distribution of characters.

[0073] Figure 7 This is a diagram showing an example of color distribution of text.

[0074] Figure 8 This is a flowchart showing an example of the flow of the adjustment process using the similarity of the arrangement of characters.

[0075] Fig. 9 This is a flowchart showing an example of the flow of adjustment processing for adjusting the size of thumbnails individually.

[0076] Fig.10 (A) and Fig.10 (B) is a diagram showing an example of a page whose size is adjusted for each thumbnail.

[0077] Fig.11 This is a flowchart showing an example of the flow of adjustment processing for adjusting the size of thumbnails in units of lines.

[0078] Fig.12 (A) and Fig.12 (B) is a diagram showing an example of a page in which the size of the thumbnail is adjusted so that the blank space within the line is reduced.

[0079] Fig.13 This is a diagram showing an example of a page in which a blank space is generated in the last row.

[0080] Fig.14 This is a diagram showing an example of a page in which the size of the thumbnail is adjusted so that the blank space of the last row is reduced.

[0081] Fig.15 It is a diagram showing an example of the functional configuration of an information processing device according to the second embodiment.

[0082] Fig.16 This is a flowchart showing an example of the flow of adjustment processing when an adjustment instruction is accepted from the user.

[0083] Fig.17 (A) to Fig.17 (C) is a diagram showing an example of a page change by a pinch-out operation.

[0084] Fig.18 This is a diagram showing an example of a displayed guide.

[0085] Fig.19 This is a graph showing an example of the relationship between the size of the thumbnail before enlargement and the number of pages increased for the same amount of movement.

[0086] Fig. 20 It is a diagram showing an example of selection of pages displayed on the screen.

[0087] Fig.21 (A) and Fig.21 (B) is a diagram showing an example of a page in which thumbnails are arranged in each chapter of a document.

[0088] Fig. 22 This is a diagram showing an example of a page in which a reception area for receiving a page switching instruction is provided at an end of the page.

[0089] Explanation of symbols

[0090] 2: Communication unit

[0091] 4: Input unit

[0092] 6: Display unit

[0093] 8(8A): Thumbnail

[0094] 10(10A): Information processing device

[0095] 11: Control Department

[0096] 12: Display unit

[0097] 13: Inspection Department

[0098] 14: File DB

[0099] 15: Reception Department

[0100] 16: Region

[0101] 20: Computer

[0102] 21: CPU

[0103] 22: ROM

[0104] 23: RAM

[0105] 24: Non-volatile memory

[0106] 28: Icons

[0107] 30(30A, 30B, 30C, 30D): Page

[0108] 31: Zoom in table

[0109] α, β, γ, δ, ε: threshold

[0110] R: The scale of the image

[0111] S: Number of thumbnails

[0112] W: Image area occupancy ratio DETAILED DESCRIPTION

[0113] Below, while referring to the attached Figure 1 The present embodiment is described while the present embodiment is described. In addition, the same symbols are given to the components and processes with the same functions in all the drawings, and repeated descriptions are omitted. In addition, the "user" in the present embodiment refers to a person who instructs to display files in the information processing device 10 using thumbnails.

[0114] <First embodiment>

[0115] Figure 1 1 is a diagram showing an example of a functional configuration of an information processing device 10 according to the present embodiment. The information processing device 10 includes functional units such as a control unit 11 , a display unit 12 , and a detection unit 13 , and a file database (DB) 14 .

[0116] The control unit 11 obtains the file designated by the user from the files stored in the file DB 14, and generates a thumbnail representing the contents included in each page of the file. Figure 8 (Refer to Fig.10 (A) and Fig.10 (B), etc.) The control unit 11 generates each thumbnail Figure 8 Each thumbnail is displayed on the same screen in the same size and without overlapping. Figure 8 When the size of becomes smaller than the threshold α, each thumbnail is Figure 8 The size of the control is enlarged to above the threshold α.

[0117] Then, the control unit 11 causes each thumbnail enlarged to a value greater than the threshold value α to be Figure 8 The display unit 12 is controlled so as to display the thumbnails side by side on the screen. That is, the control unit 11 is an example of a determination unit and a display control unit in this embodiment. Figure 8 Get thumbnails by size Figure 8The information shown is therefore also an example of the acquisition component of this embodiment.

[0118] In addition, the control unit 11 enlarges each thumbnail to a value greater than the threshold value α. Figure 8 When displaying on the screen side by side, in order to determine the Figure 8 Position each thumbnail on the screen. Figure 8 The thumbnails are arranged in a page 30 that matches the size of the screen and then displayed on the screen. In this case, if the thumbnails cannot be accommodated in one page 30, Figure 8 When divided into multiple pages 30 to configure each thumbnail Figure 8 is displayed on the screen.

[0119] The display unit 12 displays each thumbnail image that has been enlarged to a level greater than the threshold value α by the control unit 11 according to the control content from the control unit 11. Figure 8 The information is displayed on the screen of the display unit 6 described later.

[0120] The detection unit 13 is an example of a detection means in this embodiment, and detects each thumbnail image that has been enlarged to a value greater than the threshold value α by the control unit 11. Figure 8 The "image" in this embodiment means information represented by a diagram such as a graph, a photograph, and an illustration. In other words, an "image" is information other than information represented by text. In addition, when text is included in a diagram such as an illustration, the text is a text recorded incidentally in the use of the diagram, etc., based on the existence of the diagram, so the combination of the diagram and the text becomes an "image".

[0121] The document DB 14 is a document that generates thumbnails by the control unit 11. Figure 8 In the file DB 14, for example, files transmitted from an external device via a communication unit 2 (described later) connected to a communication line (not shown) or files created by the information processing device 10 are stored.

[0122] In addition, a database sometimes refers to an application that manages files by establishing an association with a predetermined primary key. However, the "database" in this embodiment does not necessarily mean that files are managed using various commercial or non-commercial database applications, but rather refers to all architectures that store and manage files. Therefore, a file system used for file management is also an example of a database. Of course, the information processing device 10 can also use a database application for file management.

[0123] The file DB 14 is not necessarily required in the information processing device 10 and may be constructed in an external device connected to a communication line (not shown). In this case, the information processing device 10 only needs to obtain a file designated by the user from the external device via the communication unit 2 .

[0124] Figure 1 The information processing device 10 shown in FIG. 1 is configured using a computer 20 , for example. Figure 2 1 is a diagram showing a configuration example of a main part of an electrical system in the information processing device 10 .

[0125] The computer 20 includes: Figure 1 The functional units of the information processing device 10 of the present embodiment shown in FIG. 1 include a central processing unit (CPU) 21, a read-only memory (ROM) 22 for storing information processing programs, a random access memory (RAM) 23 used as a temporary work area of ​​the CPU 21, a nonvolatile memory 24, and an input / output interface (I / O) 25. The CPU 21, ROM 22, RAM 23, nonvolatile memory 24, and I / O 25 are connected via a bus 26, respectively.

[0126] The nonvolatile memory 24 is an example of a storage device that maintains stored information even when power supplied to the nonvolatile memory 24 is cut off, and a semiconductor memory may be used, but a hard disk may also be used. For example, a file DB 14 is constructed in the nonvolatile memory 24 .

[0127] On the other hand, the I / O 25 is connected to, for example, the communication unit 2 , the input unit 4 , and the display unit 6 .

[0128] The communication unit 2 is connected to a communication line (not shown) and includes a communication protocol for acquiring a file from an external device connected to the communication line.

[0129] The input unit 4 is an input device that receives instructions from an operator who directly operates the information processing device 10 and notifies the CPU 21 , and can use buttons, a keyboard, a mouse, a touch panel, a laser pointer, etc., for example.

[0130] The display unit 6 is a display device that displays information processed by the CPU 21 , and for example, a liquid crystal display, an organic electroluminescence (EL) display, or a projector that displays an image on a wall or the like can be used.

[0131] Then, refer to Figure 3 The operation of the information processing device 10 according to this embodiment will be described.

[0132] Figure 3 This is a flowchart showing an example of the flow of thumbnail processing executed by the CPU 21 when an instruction to display files as thumbnails is accepted from the user.

[0133] The information processing program that defines the thumbnail process is stored in advance in, for example, the ROM 22 of the information processing device 10. The CPU 21 of the information processing device 10 reads the information processing program stored in the ROM 22 and executes the thumbnail process.

[0134] First, in step S10 , the CPU 21 acquires a file that has been designated by the user from the file DB 14 .

[0135] In step S20, the CPU 21 generates thumbnails of the pages constituting the file acquired in step S10. Figure 8 Note that the page constituting the document is different from the page 30 on which the generated thumbnails are arranged and displayed on the screen, and therefore will be referred to as a “document page” hereinafter.

[0136] Then, the CPU 21 generates each thumbnail Figure 8 The thumbnails are arranged in a page 30 so that they are of the same size and do not overlap each other. Figure 8 The size of the thumbnail configured on page 30 Figure 8 The shape of is not limited, for example, it can be circular or triangular, but as an example, it will be abbreviated Figure 8 The shape of is set to a rectangle for illustration.

[0137] In step S30, CPU 21 determines whether the thumbnails that have been placed on page 30 in step S20 Figure 8 Is the size of less than the threshold α? Here, “abbreviation Figure 8 The size of the Figure 8 The length of the shortest side of the sides, or abbreviated Figure 8 Here, as an example, the area of Figure 8 The length of the side is compared to the abbreviated Figure 8 The size of the example is described below.

[0138] Therefore, the threshold α is set in advance to a length such that when a thumbnail displayed on the screen is selected by the pointer, Figure 8 When you select the desired thumbnail, you will not mistakenly select it. Figure 8 Other abbreviations Figure 8 (For example, the abbreviation you want to select Figure 8 Other abbreviations for adjoining Figure 8 ).

[0139] For example, when a touch screen as the input unit 4 is provided on the surface of the display unit 6 of the display screen, the user's finger becomes the thumbnail selection. Figure 8 Therefore, when the finger is selected as the thumbnail Figure 8 In the case of an indicator body, the following results were obtained through experiments: if the size of the area where the finger touches the screen is such that the thumbnail is larger than 0.9 cm square, the thumbnail size is smaller than 0.9 cm square. Figure 8 In comparison, abbreviated Figure 8 Therefore, the threshold α is set to, for example, "0.9 cm". The threshold α is an example of a "predetermined size" in this embodiment.

[0140] The threshold value α does not need to be limited to 0.9 cm, and may be set to other lengths. The threshold value α is stored in advance in the nonvolatile memory 24, for example.

[0141] When in abbreviated Figure 8 If there is an edge whose value is less than the threshold value α among any of the edges, CPU 21 moves to step S40.

[0142] In step S40, the CPU 21 performs a Figure 8 , will be shortened Figure 8 The enlargement is performed until the length of the side that is less than the threshold value α reaches the threshold value α. Figure 8 The aspect ratio is enlarged and the thumbnail is zoomed in Figure 8 Equal magnification of .

[0143] In the abbreviation Figure 8 When the length of the edge reaches the threshold α, the image is zoomed in. Figure 8 How many pixels should be enlarged is determined by the size and resolution of the screen.

[0144] The resolution of a screen is represented by the number of pixels arranged vertically and horizontally in the screen, for example, in the case of high definition (HD) resolution, it is represented as 1280×720. That is, even if the screen has the same resolution, if the screen size is different, the distance between pixels will be different. Therefore, in order to Figure 8 The CPU 21 only needs to calculate the number of pixels per inch (ppi) according to the screen size and the screen resolution to enlarge the edge of the image until the threshold α is reached.

[0145] CPU 21 obtains the screen size and screen resolution from display unit 6 in advance and stores them in nonvolatile memory 24. Depending on the type of operating system executing the information processing program, PPI may be obtained from the operating system using a dedicated application programming interface (API).

[0146] On the other hand, when it is determined in the determination process of step S30 that the thumbnail Figure 8 When the size of is not less than the threshold α, the thumbnail Figure 8 The size of is greater than the threshold α, so the process of step S40 is not executed and the process moves to step S50.

[0147] In step S50, CPU 21 selects Figure 8 From the perspective of visibility, perform further adjustments to the thumbnail Figure 8 Specifically, in the content detection process, a setting is provided to allow the user to select the content according to the thumbnail size. Figure 8 The contents of the document are appropriately shortened to Figure 8 The threshold value β (β≧α) of the size is β, but the details of the content detection processing will be described later.

[0148] In step S60, the CPU 21 determines whether the thumbnail Figure 8 is less than the threshold value β set in the content detection process of step S50. Figure 8 When there is an edge whose value is less than the threshold value β among any of the edges, move to step S70.

[0149] In step S70, the CPU 21 performs a Figure 8 , will be shortened Figure 8 The entire image is enlarged until the length of the side that is less than the threshold value β reaches the threshold value β. In this case, as in step S40, the CPU 21 enlarges the thumbnail using the ppi obtained according to the size of the screen and the resolution of the screen. Figure 8 .

[0150] On the other hand, if it is determined in the determination process of step S60 that the thumbnail Figure 8 When the size of is not less than the threshold β, the Figure 8 The size of is greater than the threshold value β, so the process of step S70 is not executed and the process moves to step S80.

[0151] In step S80, CPU 21 Figure 8 The size and number of the thumbnails are set to the minimum number of pages required in the following case: Figure 8In the case where the corresponding thumbnails are arranged in a non-overlapping manner on page 30, and are arranged in order from the head of the file page Figure 8 situation.

[0152] In step S90, the CPU 21 enlarges each thumbnail to a size greater than the threshold value β. Figure 8 The pages 30 set in step S80 are arranged in the order of the document pages, and the thumbnail images are arranged in a row. Figure 8 The display unit 6 is controlled in such a way that the first page of the page is displayed on the screen. When thumbnails are arranged in the plurality of pages 30 Figure 8 When receiving an instruction from the user to change the page 30 displayed on the screen, the CPU 21 controls the display unit 6 so that the instructed page 30 is displayed on the screen, thereby switching the page 30 .

[0153] Through the above steps, the Figure 3 The thumbnail processing shown in Figure 8 The size of is enlarged to above the threshold β, so it is similar to the thumbnail Figure 8 Compared with the case where the size of the thumbnail is less than the threshold α, the thumbnail that is accidentally selected and the one that is intended to be selected is suppressed. Figure 8 Different other abbreviations Figure 8 The situation, or from the abbreviation Figure 8 The situation that the content of the file cannot be remembered occurs.

[0154] In addition, in order to remind users of the content of the file, the thumbnail Figure 8 The size of is at least greater than the threshold value β, so when the thumbnail is already Figure 8 When the size of the thumbnail is set larger than the threshold value β, even if the CPU 21 reduces the thumbnail Figure 8 The size of the Figure 8 operability and visibility.

[0155] Next, the content detection process in step S50 will be described. Figure 4 This is a flowchart showing an example of the flow of content detection processing executed by the CPU 21 .

[0156] In step S100, the CPU 21 performs a Figure 8 , from the abbreviation Figure 8 The area where the image is arranged (image area) is extracted, and each thumbnail is Figure 8 The data is associated with the image area and stored in RAM 23 .

[0157] In step S110, the CPU 21 performs a Figure 8 , calculate the value of the thumbnail in step S100 Figure 8 Establish the corresponding image area relative to the thumbnail Figure 8 The image area occupancy ratio W is the ratio of the area occupied by the thumbnail (hereinafter referred to as "the image area occupancy ratio W"). The image area occupancy ratio W is the ratio of the area occupied by the thumbnail Figure 8 An example of an indicator of the degree of occupancy of an image of an area.

[0158] Images are easier to retain in memory than text, so users prefer to look at images rather than thumbnails. Figure 8 The text inside tends to remind people more of the content of the document.

[0159] Therefore, first, in step S120, the CPU 21 calculates the number of thumbnails S for which the occupation ratio W of the image area becomes greater than or equal to the threshold value γ. The threshold value γ is a value indicating a reference value at which the user can easily recall the content of the file from the image if the occupation ratio W is greater than or equal to this value, and is a value obtained in advance through experiments using an actual machine of the information processing device 10 or computer simulation based on the design specifications of the information processing device 10. The threshold value γ is stored in advance in the nonvolatile memory 24, for example.

[0160] In step S130, the CPU 21 calculates thumbnail images corresponding to the pages of the documents that constitute the document acquired in step S10. Figure 8 The number of thumbnails S is calculated in step S120 with respect to the ratio R (hereinafter referred to as “image ratio R”).

[0161] In step S140 , the CPU 21 sets the threshold value β using the image ratio R calculated in step S130 . Specifically, the CPU 21 sets the threshold value β by referring to the enlargement table 31 stored in advance in the nonvolatile memory 24 .

[0162] Figure 5 31 is a diagram showing an example of the enlargement table 31. The enlargement table 31 is a table in which the ratio R of the image is associated with the threshold value β, and is set so that the threshold value β becomes smaller as the ratio R of the image becomes higher. Figure 5 In the case of the enlargement table 31 in , when the ratio R of the image is 10%, 1.9α is set as the threshold β, and when the ratio R of the image is 100%, α is set as the threshold β.

[0163] The reason is that: the higher the image ratio R becomes, the more images are included in the file. As mentioned above, images are more likely to remain in the memory than text. Therefore, when the image ratio R is relatively high, there is a possibility that even if the thumbnail is Figure 8 The size of the image is set small, which tends to remind people of the content of the file. As described above, the ratio R of the image is associated with the threshold β, thereby minimizing the image. Figure 8 The size is excessively enlarged, the configuration is abbreviated Figure 8In other words, the thumbnails displayed on one page Figure 8 The number of increases.

[0164] In the enlargement table 31, the threshold value β is set to be equal to or larger than the threshold value α even when the image ratio R is 100%. Figure 8 operability.

[0165] The CPU 21 refers to the enlargement table 31 and sets a value corresponding to the ratio R of the image calculated in step S130 as the threshold value β.

[0166] Through the above steps, the Figure 4 The content detection process shown in .

[0167] exist Figure 4 In step S140, the threshold value β is obtained using the enlargement table 31, but this is just an example, and the CPU 21 may obtain the threshold value β using a predetermined function formula that calculates the threshold value β as long as a variable including the ratio R of the image is input.

[0168] Thus, according to the information processing device 10 of this embodiment, after each abbreviated Figure 8 After the size is enlarged to a value above the threshold α, each thumbnail is Figure 8 Non-overlapping method will abbreviate Figure 8 The information processing device 10 arranges the pages in the order of the file pages. Figure 8 Adjust the proportions of the images contained in each thumbnail Figure 8 size.

[0169] <Modification 1 of the first embodiment>

[0170] In the embodiment described, according to the abbreviation Figure 8 Adjust the proportions of the images contained in each thumbnail Figure 8 size, but used for abbreviating Figure 8 The resized file content is not just thumbnailed Figure 8 For example, the information processing device 10 may also use the ratio of the image included in the thumbnail. Figure 8 The visual features related to the appearance of the text contained in the further adjustment according to the abbreviation Figure 8 The included images are thumbnails that have been adjusted in proportion to the image Figure 8 size.

[0171] Figure 6 It means that the thumbnails have been sorted in the order of the file pages. Figure 8 When arranged on page 30, the adjacent thumbnails Figure 8 Adjust the color of the text used in each thumbnail Figure 8 A flowchart of an example of the process of resizing processing. Figure 6 The adjustment process shown in FIG. 1 is performed by the CPU 21, for example, Figure 4 The content detection process shown in FIG. 1 is performed between step S130 and step S140.

[0172] The information processing program that defines the adjustment process is stored in advance in, for example, the ROM 22 of the information processing device 10. The CPU 21 of the information processing device 10 reads the information processing program stored in the ROM 22 and executes the adjustment process.

[0173] First, in step S200, the CPU 21 Figure 8 When the files are displayed on the screen in the order of 30 pages, select two thumbnails displayed adjacently. Figure 8 (Hereafter, referred to as "adjacent thumbnails").

[0174] In step S210, CPU 21 obtains the color distribution of each character in the adjacent thumbnails selected in step S200. The colors of the pixels constituting the screen are represented by the pixel values ​​of red (R), green (G), and blue (B). Figure 8 The content as a configuration has abbreviated Figure 8 Therefore, in the case where each thumbnail has been Figure 8 In the case of overlap, the pixels at the same position are assigned the same number. Figure 8 Each image contained in the image is assigned a pixel number, so that for each thumbnail Figure 8 For example, a color distribution (hereinafter referred to as “color distribution”) is acquired in which pixel numbers are arranged on the horizontal axis and pixel values ​​of RGB are arranged on the vertical axis.

[0175] Figure 7 It indicates abbreviation Figure 8 An example of the color distribution of the text contained in . Figure 8 If the pixel value of the pixel at the position corresponding to the image is set to "0", only the thumbnail can be obtained. Figure 8 The color distribution of the text contained in .

[0176] Abbreviation Figure 8 The method of expressing the color distribution of the text contained in is not limited to Figure 7 For example, the pixel values ​​of cyan, magenta, yellow, and black may be used to represent the image.

[0177] In step S220, CPU 21 calculates the difference in color distribution of adjacent thumbnails for each color of RGB, for example, and calculates the average value of the calculated differences in color distribution. Hereinafter, the average value of the differences in color distribution is referred to as the "difference in color distribution" in adjacent thumbnails.

[0178] In step S230, the CPU 21 determines whether the difference in the color distribution of the text calculated in step S220 is greater than a threshold value δ. The threshold value δ is a reference value indicating that if there is a difference exceeding this value, the user is likely to recall the content of the file from the difference in the color of the text included in the adjacent thumbnail, and is obtained in advance by an experiment using an actual machine of the information processing device 10 or a computer simulation based on the design specifications of the information processing device 10. The threshold value δ is stored in advance in the nonvolatile memory 24, for example.

[0179] When the difference in the color distribution of the text is greater than the threshold δ, the process proceeds to step S240 .

[0180] The difference in the color distribution of the text is greater than the threshold δ, which can be considered as follows: Figure 8 The image contained in the file is used as a clue, and the color of the text is also used as a clue to recall the content of the file. Therefore, even if the value of the threshold β is smaller than the threshold β set according to the occupancy ratio W of the image area, there is no visible change in the probability that the user recalls the content of the file.

[0181] Therefore, in step S240, CPU 21 increases Figure 4 The ratio R of the image calculated in step S130 is set so that the threshold value β becomes smaller than the case where the threshold value β is set only based on the occupation ratio W of the image area. In addition, the greater the difference in the color distribution of the text becomes than the threshold value δ, the more the CPU 21 increases the ratio R of the image. The CPU 21 associates the increased ratio R of the image with the adjacent thumbnail and stores it in the RAM 23.

[0182] On the other hand, when it is determined in the determination process of step S230 that the difference in color distribution of the text is less than the threshold value δ, the CPU 21 compares the adjacent thumbnail with the adjacent thumbnail. Figure 4 The image ratio R calculated in step S130 is associated and stored in RAM 23, and the process of step S240 is not executed and the process proceeds to step S250.

[0183] In step S250 , the CPU 21 determines whether there is a combination of adjacent thumbnails that has not been selected in step S200 , and if there is a combination of adjacent thumbnails that has not been selected, the process proceeds to step S200 .

[0184] The processing of step S200 to step S250 is repeatedly executed until all combinations of adjacent thumbnails that have not been selected in step S200 are selected, whereby the ratio R of the images associated with the respective adjacent thumbnails is stored in the RAM 23 .

[0185] Therefore, in step S260 , the CPU 21 calculates the average value of the ratios R of the images with respect to the respective adjacent thumbnail images stored in the RAM 23 .

[0186] Through the above steps, the Figure 6 The adjustment process shown in .

[0187] exist Figure 4 In step S140, the average value of the ratio R of the image calculated in step S260 is used. Therefore, the more adjacent thumbnails with a difference in color distribution of the text greater than the threshold value δ, the smaller the threshold value β is compared with the threshold value β set only based on the image area occupation ratio W. That is, the more adjacent thumbnails with a difference in color distribution of the text greater than the threshold value δ, the smaller the threshold value β is compared with the threshold value β set only based on the image area occupation ratio W. Figure 8 Compared to the size of Figure 8 The smaller the size becomes, the smaller the thumbnails displayed on a page Figure 8 The number of increases.

[0188] <Modification 2 of the first embodiment>

[0189] In the first modification example of the first embodiment, Figure 8 Adjust the color of each thumbnail according to the color of the text contained in it Figure 8 The resizing process is described, but for abbreviated Figure 8 The visual features related to the appearance of the text that are adjusted in size are not limited to the different colors of the text. For example, the information processing device 10 may also use thumbnails Figure 8 The similarity of the configuration of the text contained in the text is further adjusted according to the similarity with the abbreviation Figure 8 The included images are thumbnails that have been adjusted in proportion to the image Figure 8 size.

[0190] Figure 8 It means that the thumbnails are sorted according to the order of the file pages. Figure 8 The similarity of the text arrangement in adjacent thumbnails when arranged on page 30 is adjusted for each thumbnail. Figure 8 A flowchart of an example of the process of resizing processing.

[0191] Figure 8 The adjustment process shown in Figure 6The difference from the adjustment process shown in is that steps S210 to S240 are replaced with steps S210A to S240A, respectively.

[0192] After the adjacent thumbnail is selected in step S200, step S210A is executed.

[0193] In step S210A, the CPU 21 obtains each thumbnail in the adjacent thumbnail Figure 8 The so-called "text distribution" refers to the arrangement of text in the thumbnail. Figure 8 The distribution of the pixel number is shown in a graph, for example, by setting a pixel number on the horizontal axis and a value indicating whether the pixel represented by the pixel number is a pixel representing text on the vertical axis. In the text distribution, for example, in the case of a pixel representing text, the value of the corresponding pixel number is set to "1", and in the case of a pixel that does not represent text, such as a blank or an image, the value of the corresponding pixel number is set to "0". In addition, the so-called "blank" refers to an area where neither an image nor text is configured.

[0194] In step S220A, the CPU 21 calculates the size of each thumbnail in the adjacent thumbnail images acquired in step S210A. Figure 8 The difference in character distribution is represented by, for example, the sum of the differences in the values ​​in each pixel number or the average value of the differences in the values ​​in each pixel number.

[0195] In step S230A, the CPU 21 determines whether the difference in the character distribution calculated in step S220A is greater than a threshold value ε. The threshold value ε is a reference value indicating that if there is a difference exceeding this value, the user is likely to recall the content of the file based on the difference in the arrangement of the characters included in the adjacent thumbnails, and is obtained in advance by experiments using an actual machine of the information processing device 10 or computer simulation based on the design specifications of the information processing device 10. The threshold value ε is stored in advance in the nonvolatile memory 24, for example.

[0196] When the difference in the text distribution is greater than the threshold ε, the process proceeds to step S240A.

[0197] The difference in text distribution is greater than the threshold ε, which can be considered as follows: Figure 8 The image contained in the image also uses the configuration of the text as a clue to recall the content of the file. Therefore, even if the value of the threshold β is smaller than the threshold β set according to the occupancy ratio W of the image area, there is no visible change in the probability that the user recalls the content of the file.

[0198] Therefore, in step S240A, CPU 21 increases Figure 4The ratio R of the image calculated in step S130 is set so that the threshold value β becomes smaller than the case where the threshold value β is set only based on the occupation ratio W of the image area. In addition, the greater the difference in text distribution becomes than the threshold value δ, the more the CPU 21 increases the ratio R of the image. The CPU 21 associates the increased ratio R of the image with the adjacent thumbnail and stores it in the RAM 23.

[0199] On the other hand, when it is determined in the determination process of step S230A that the difference in the text distribution is less than the threshold value ε, the CPU 21 compares the adjacent thumbnail with the adjacent thumbnail. Figure 4 The image ratio R calculated in step S130 is associated and stored in RAM 23, and the process of step S240A is not executed and the process moves to step S250.

[0200] Later, calculate the Figure 6 As described above, the processing of steps S200 to S250 is repeatedly performed until all combinations of adjacent thumbnails that have not been selected in step S200 are selected, and the average value of the ratios R of images associated with the adjacent thumbnails is obtained.

[0201] Through the above steps, the Figure 8 The adjustment process shown in .

[0202] Therefore, the lower the similarity of the arrangement of the characters in the adjacent thumbnails, the greater the difference in the thumbnail arrangement compared to the thumbnail arrangement set only based on the occupation ratio W of the image area. Figure 8 Compared to the size of Figure 8 The smaller the size becomes, the smaller the thumbnails displayed on a page Figure 8 The number of increases.

[0203] In addition, Figure 8 In the adjustment process shown in , the similarity of the arrangement of characters is expressed by the difference in character distribution, but the similarity of the arrangement of characters may be calculated using a known method such as template matching, for example.

[0204] In addition, Figure 8 In the adjustment process shown in FIG. 1 , the similarity of the arrangement of characters is used to adjust the thumbnail. Figure 8 , but as long as the view is changed, it becomes to use the similarity of the whitespace distribution to adjust the thumbnail Figure 8 That is, the information processing device 10 obtains the size of each thumbnail in the adjacent thumbnail in step S210A. Figure 8When the difference in the blank distribution of each thumbnail in the adjacent thumbnails becomes larger than the threshold value ε, the blank configuration may be used as a clue to recall the content of the file, so the processing of step S240A may be performed. In this case, the lower the similarity of the blank distribution in the adjacent thumbnails becomes, the closer the thumbnail is to the image area occupancy ratio W. Figure 8 Compared to the size of Figure 8 The smaller the size becomes, the smaller the thumbnails displayed on a page Figure 8 The number of increases.

[0205] Furthermore, the information processing device 10 may adjust the differences in color distribution, character distribution, and space distribution of characters using at least one character-related attribute of character thickness, character size, and character type. The character type is also called "font."

[0206] For example, even if the difference in the color distribution of the text is the same, as long as the abbreviation Figure 8 If at least one of the thickness of the text, the size of the text, and the type of the text contained in the adjacent thumbnails is different, the actual similarity becomes lower than the similarity of the adjacent thumbnails represented by the difference in the color distribution of the text. Therefore, the information processing device 10 may also correct the difference in the color distribution of the text by increasing the difference in the color distribution of the text as the similarity of at least one of the thickness of the text, the size of the text, and the type of the text contained in the adjacent thumbnails becomes lower. The same applies to the correction of the difference in the distribution of the text and the difference in the distribution of the blank space.

[0207] The title in the document uses different types of characters from the characters in other parts, and there is a tendency to use characters that are larger and thicker than the characters in other parts, so it is easy to remain in the user's impression. Therefore, the similarity of at least one of the thickness of the characters, the size of the characters, and the type of the characters is calculated in the adjacent thumbnails. The lower the similarity, the easier it is for the user to recall the content of the document, so the thumbnails are placed next to each other. Figure 8 The size is set small.

[0208] <Modification 3 of the first embodiment>

[0209] In the described embodiment, each thumbnail that will be generated from the same file Figure 8 The example of setting the size to the same size is described, but it is also possible to correspond to the size of the thumbnail. Figure 8 The contents of the document page represented, for each thumbnail Figure 8 Adjust thumbnail Figure 8 size.

[0210] Fig. 9 It means that for each abbreviation Figure 8Adjust thumbnail Figure 8 A flowchart of an example of the process of resizing processing. Fig. 9 The adjustment process shown in Figure 3 The thumbnail processing shown in is performed afterward.

[0211] First, in step S300, the CPU 21 selects each thumbnail that has been enlarged to a size greater than the threshold value β. Figure 8 , select a resized thumbnail Figure 8 .

[0212] In step S310, CPU 21 determines whether the thumbnail selected in step S300 Figure 8 Whether the occupancy ratio W of the image area in is less than the threshold value γ, if the occupancy ratio W of the image area is less than the threshold value γ, move to step S320.

[0213] If the image area occupation ratio W is less than the threshold value γ, the following situation may occur: even if the user has seen the thumbnail selected in step S300 Figure 8 , and the thumbnail with a proportion W of the image area that has been seen above the threshold γ Figure 8 Compared with the situation, it is difficult to Figure 8 The image contained in the file is remembered.

[0214] Therefore, in step S320, CPU 21 processes the thumbnail selected in step S300. Figure 8 The image area occupancy ratio W in the image is enlarged. Figure 8 For example, CPU21 can be shortened as Figure 8 The image area occupancy ratio W in becomes lower than the threshold value γ, and the image is shortened. Figure 8 Enlarge the size of the selected thumbnail Figure 8 size.

[0215] On the other hand, when it is determined in the determination process of step S310 that the thumbnail selected in step S300 Figure 8 When the occupancy ratio W of the image area in is greater than the threshold value γ, the process of step S320 is not performed and the process proceeds to step S330.

[0216] In step S330, the CPU 21 determines whether each thumbnail generated from the same file Figure 8 Is there any unselected thumbnails in Figure 8 , when there is an unselected thumbnail Figure 8 When , move to step S300.

[0217] In step S300, an unselected thumbnail is selected. Figure 8, and repeat steps S300 to S330 until all thumbnails are selected Figure 8 Until the image area occupancy ratio W is less than the threshold value γ, the thumbnail Figure 8 The size of is amplified according to the difference with the threshold γ.

[0218] When it is determined in the determination process of step S330 that there is no unselected thumbnail Figure 8 When, end Fig. 9 The adjustment process shown in .

[0219] Fig.10 (A) means that Fig. 9 The adjustment process shown in Figure 8 Resized thumbnails Figure 8 FIG. 30 is an example of a page 30 arranged in the order of the corresponding document pages. Figure 8 In the case of Fig.10 As shown in (A), an individual symbol "-N (N is a positive integer)" for individually specifying a thumbnail is added after the symbol "8" indicating the thumbnail.

[0220] For each abbreviation Figure 8 When resized, each thumbnail Figure 8 The sizes are not unified, so even if the thumbnails are Figure 8 Arrange in the order of the document pages on page 30, with the thumbnails already Figure 8 It is also sometimes difficult to understand the order of arrangement compared to when the sizes are uniform.

[0221] Therefore, if Fig.10 As shown in (B) of FIG. 1 , the information processing device 10 can also Figure 8 Resized thumbnails Figure 8 The thumbnails displayed on the screen along the horizontal side (also called "row direction") of the page 30 Figure 8 Adjust the size of each thumbnail to the same Figure 8 size.

[0222] exist Fig.10 (A) and Fig.10 In the example (B), the thumbnails arranged in the row direction are Figure 8-1 , Abbreviation Figure 8-2 , and abbreviations Figure 8-3 The size of each is adjusted to the largest thumbnail in this row Figure 8-2 size and then placed on page 30. In addition, the thumbnails arranged in the row direction Figure 8-4 , and abbreviations Figure 8-5 The size of each is adjusted to the largest thumbnail in this row Figure 8-5The size is configured later on page 30.

[0223] Fig.11 It means Fig.10 As shown in (B), the thumbnail in page 30 is configured Figure 8 The size of each row becomes the same way, adjust the thumbnail Figure 8 A flowchart of an example of the process of resizing processing.

[0224] Fig.11 For example, the adjustment process shown in Figure 8 Adjust thumbnail Figure 8 Size Fig. 9 The adjustment process shown in is performed afterward.

[0225] In step S400, CPU 21 performs Fig. 9 The thumbnails have been resized according to the resizing process shown in Figure 8 Page 30, select the configuration with thumbnails from the first row Figure 8 The unselected rows.

[0226] In step S410, CPU 21 stores each thumbnail included in the row selected in step S400. Figure 8 The size is the same as the largest thumbnail in the selected row. Figure 8 Thus, the thumbnails arranged in the row direction are enlarged in a manner consistent with the size of the thumbnails. Figure 8 become the same size.

[0227] In step S420, CPU 21 resizes the thumbnails that have been resized in step S410. Figure 8 Temporarily arranged in the row selected in step S400.

[0228] In step S430, the CPU 21 determines whether the thumbnails which have been resized in step S420 have been Figure 8 When temporarily configured in page 30, the abbreviated Figure 8 Whether it exceeds the line direction of page 30. Figure 8 If the number exceeds the row direction of page 30, the process moves to step S440.

[0229] In step S440, the CPU 21 replaces the thumbnails that have exceeded the line direction of the page 30. Figure 8 The thumbnail is reconfigured in the next row of page 30 in the order of the document pages. Figure 8 In this case, the reconfiguration will be performed Figure 8 After the size is restored to the original size before enlargement in step S410, reconfiguration is performed.

[0230] On the other hand, when the determination process of step S430 determines that each thumbnail temporarily arranged in the page 30 Figure 8 If the page 30 has not exceeded the row direction, the process of step S440 is not performed and the process proceeds to step S450 .

[0231] In step S450, the CPU 21 determines whether the thumbnail in step S440 Figure 8 The result of the reconfiguration is whether the abbreviation that has been configured in the next line Figure 8 Overruns the bottom of page 30. In the reconfigured thumbnail Figure 8 If the page exceeds the bottom of the page 30, the process proceeds to step S460.

[0232] In step S460, the CPU 21 removes the thumbnail that has extended beyond the bottom of the page 30. Figure 8 Without changing the abbreviation Figure 8 The arrangement order is reconfigured in the first row of the next page 30.

[0233] On the other hand, when it is determined in the determination process of step S450 that the reconfigured thumbnail Figure 8 If the page has not exceeded the lower end of the page 30, the process of step S460 is not performed and the process proceeds to step S470.

[0234] In step S470 , the CPU 21 determines whether or not there is an unselected row, and if there is an unselected row, the process proceeds to step S400 .

[0235] In step S400, the next row that is not selected (in the case of alternating pages 30, the first row of the next page 30) is selected, and the processing of steps S400 to S470 is repeated, thereby displaying the thumbnails along the row direction. Figure 8 The size becomes resized in the same way.

[0236] When it is determined in the determination process of step S470 that all rows have been selected, the process ends. Fig.11 The adjustment process shown in .

[0237] Fig.12 (A) and Fig.12 (B) means execution Fig.11 The adjustment process shown in the figure is shown in the row direction with each thumbnail Figure 8 The size becomes the same as the figure of an example of page 30 displayed on the screen after the control is performed in the same manner.

[0238] like Fig.12 As shown in (A), sometimes the abbreviated Figure 8The size of the page 30 is changed to a blank space in the row as shown in area 16. In this case, the CPU 21 can also use area 16 as a thumbnail. Figure 8 Filling method, enlarge each thumbnail in the same row as area 16 Figure 8 (exist Fig.12 In the case of example (A), the abbreviation Figure 8-1 ~Abbreviation Figure 8-3 ).

[0239] Fig.12 (B) indicates the use of abbreviations Figure 8 The figure is an example of an enlargement in a manner to fill the area 16. Of course, the CPU 21 uses each thumbnail located in the same row as the area 16. Figure 8 The size becomes the same way as zooming in.

[0240] When the final line of the page 30 contains the thumbnail image due to the enlargement Figure 8 If the thumbnail has exceeded the bottom of page 30, CPU 21 only needs to Figure 8 It can be reconfigured in the first row of the next page 30. Moreover, when the thumbnail is added to the next page 30 Figure 8 , which results in the next page 30 containing the thumbnail Figure 8 If the page exceeds the bottom of page 30, the next page 30 will be thumbnailed. Figure 8 Afterwards, when the thumbnails contained in each page 30 Figure 8 When the pages 30 are extended from the bottom of the chain, the pages 30 are successively reduced from the first page 30 to the last page 30. Figure 8 reconfiguration.

[0241] In addition, sometimes when executing Fig.11 The adjustment process shown in the figure is shown in the row direction with each thumbnail Figure 8 The size becomes the same way as in the case of a control, in the presence of thumbnails Figure 8 There is also white space below the final line.

[0242] Fig.13 1 is a diagram showing an example of the above situation, and area 16 is blank. In this case, CPU 21 can also use area 16 as a thumbnail. Figure 8 Each abbreviation filled in and located in the final row Figure 8 (exist Fig.13 In the case of example, the abbreviation Figure 8-4 and abbreviations Figure 8-5 ) is resized in the same way, further enlarging each thumbnail in the final row Figure 8 That is, CPU 21 will be connected with the thumbnail along the row direction. Figure 8 The edge (called abbreviation Figure 8 The length of the longitudinal side that intersects the "horizontal side" of the image is enlarged to a length such that the blank space appearing at the bottom of the final line is as small as possible.

[0243] Fig.14 It means to enlarge the thumbnail by filling the area 16 Figure 8-4 and abbreviations Figure 8-5 Figure 1 shows an example of the latter.

[0244] like Fig.14 As shown, the thumbnail is enlarged in such a way that the blank space within the page 30 is minimized. Figure 8 , thereby making it easier for the user to remember the contents of the file compared to leaving the blank space as it is.

[0245] <Second embodiment>

[0246] In the first embodiment, the information processing device 10 autonomously adjusts the thumbnails displayed on the screen. Figure 8 The example of the size of the thumbnail is described, but it is also possible to set the user to instruct the information processing device 10 to display the thumbnail on the screen. Figure 8 size.

[0247] In the second embodiment, the abbreviated Figure 8 The information processing device 10A that enlarges or reduces the size to the size instructed by the user will be described.

[0248] Fig.15 10A is a diagram showing an example of a functional configuration of an information processing device 10A according to the present embodiment. Figure 1 The functional configuration example of the information processing device 10 shown in FIG. 1 is different in that the detection unit 13 is replaced by the reception unit 15 , and the other functional units are the same as those of the information processing device 10 .

[0249] The receiving unit 15 is an example of a receiving means in this embodiment, and receives a zoom-in or zoom-out request from the user based on the amount of movement of the indicator. Figure 8 Specifically, when the indicator is a finger of the user, the receiving unit 15 receives an instruction corresponding to the thumbnail size (hereinafter referred to as "adjustment instruction") from the action of the finger touching the touch screen as an example of the input unit 4. Figure 8 In addition, since the touch screen is installed on the display unit 6 that displays the screen in an overlapping manner, sometimes the finger contacting the touch screen is referred to as "the finger contacting the screen".

[0250] In the corresponding abbreviation Figure 8In the zoom operation, for example, a pinch operation to enlarge the distance between two fingers is included, so-called corresponding to the thumbnail Figure 8 The zoom-out operation includes, for example, a pinch-in operation of reducing the distance between two fingers.

[0251] Hereinafter, the accepting unit 15 will be described as accepting an adjustment instruction through a pinch-out operation and a pinch-in operation on the touch screen performed by the user, but the method of the adjustment instruction is not limited thereto.

[0252] For example, the display unit 12 controls a projector as an example of the display unit 6 to display a picture on a wall or other screen, and the user uses a laser pointer to select thumbnails. Figure 8 In the case of an adjustment instruction, the receiving unit 15 only needs to determine the movement amount of the laser pointer and the type of operation by using at least one of the movement direction, movement speed, movement acceleration, angular velocity, and angular acceleration of the laser pointer.

[0253] In addition, pinch-in and pinch-out operations do not necessarily require the fingers to touch the touch screen, and can be performed in space without touching the touch screen. In this case, the pinch-in and pinch-out operations performed by the user in space can be captured by a camera, and the movement amount of the fingers and the type of operation can be determined using known motion detection technology and image processing technology.

[0254] In addition, the main part configuration example of the electrical system in the information processing device 10A is similar to Figure 2 The main part configuration example of the electrical system in the information processing device 10 shown in FIG. 1 is the same as that in FIG. 1 , and is configured using a computer 20 .

[0255] Next, the operation of the information processing device 10A according to the present embodiment will be described.

[0256] Fig.16 This means that after receiving the adjustment thumbnail from the user Figure 8 A flowchart of an example of the flow of adjustment processing executed by CPU 21 when a user indicates to adjust the size of the thumbnail displayed on the screen. Figure 8 Since a pinch operation is performed when the operability and visibility are improved compared to the current situation, the adjustment process when a pinch operation is accepted is described here as an example.

[0257] The information processing program that defines the adjustment process is stored in advance in, for example, the ROM 22 of the information processing device 10A. The CPU 21 of the information processing device 10A reads the information processing program stored in the ROM 22 and executes the adjustment process.

[0258] In addition, when executing Fig.16 Before the adjustment process shown in Figure 3 That is, the CPU 21 obtains the file specified by the user from the file DB 14, and generates each thumbnail from the obtained file. Figure 8 The thumbnails are pre-adjusted so that they are of the same size and are arranged on one page 30 without overlapping each other. Figure 8 size.

[0259] In step S500, the CPU 21 determines whether the user has performed a pinch-in operation based on the finger movement direction notified from the touch screen. If the user has not performed a pinch-in operation, the CPU 21 repeatedly executes the determination process of step S500 to monitor the execution of the pinch-in operation.

[0260] On the other hand, when a pinch-out operation is performed, the process moves to step S510.

[0261] In step S510, CPU 21 determines whether the movement amount of the finger accompanying the pinch-out operation has reached a predetermined movement amount. The so-called "predetermined movement amount" refers to the movement amount corresponding to the movement of each thumbnail. Figure 8 The amount of finger movement required to enlarge the image to the size that would be required if the thumbnail is not added to a single page. Figure 8 If the page is 30, you cannot Figure 8 The size is such that the pages 30 are arranged so as not to overlap each other and the blank space of each page 30 including the added page 30 is reduced as much as possible.

[0262] The specified movement corresponds to the thumbnail Figure 8 Number, abbreviation Figure 8 and the size of the page 30. When the movement amount of the user's finger reaches the predetermined movement amount, the process proceeds to step S520.

[0263] In step S520, the CPU 21 adds a page of configuration thumbnails. Figure 8 Page 30 of .

[0264] In step S530, the CPU 21 converts each thumbnail into Figure 8 The image is enlarged to the amount corresponding to the specified movement amount, and the thumbnail in each page 30 is displayed. Figure 8 The configuration location becomes the same way, while keeping the thumbnails Figure 8 The enlarged thumbnail will be displayed in the order of Figure 8 The data are re-arranged in each page 30 including the page 30 added in step S520 .

[0265] Since the thumbnails are arranged at the same position for each page 30 Figure 8 , so for example, if there are twelve thumbnails Figure 8, and there are two pages 30, while keeping the thumbnails Figure 8 In the state of the arrangement order, six thumbnails are arranged at the same position on the first page and the second page respectively. Figure 8 .

[0266] In step S540, the CPU 21 enlarges and rearranges the thumbnails in step S530. Figure 8 The display unit 6 is controlled so as to display the thumbnails on the screen in units of pages 30. Thus, the thumbnails enlarged to a size corresponding to the predetermined movement amount are displayed. Figure 8 The information is displayed on the screen of the display unit 6 in units of pages 30 .

[0267] On the other hand, when it is determined in the determination process of step S510 that the movement amount of the user's finger has not reached the predetermined movement amount, the process of steps S520 to S540 is not executed and the process proceeds to step S550.

[0268] In step S550 , the CPU 21 determines whether the pinch-out process has ended based on the information regarding the presence or absence of finger contact notified from the touch screen.

[0269] If the pinch-to-zoom process is still in progress, the process proceeds to step S500, and steps S500 to S550 are repeatedly executed, so that before the pinch-to-zoom process is completed, the CPU 21 adds a page 30 each time the finger movement reaches a predetermined movement amount, and performs thumbnails on each page 30 until the page 30 is enlarged to the enlargement amount corresponding to the predetermined movement amount. Figure 8 and displays it on the screen.

[0270] That is, the CPU 21 does not display the thumbnail corresponding to the amount of movement of the finger indicated by the pinch-out operation until the thumbnail is enlarged to a size such that ... Figure 8 Displayed on the screen, the size is if the configuration thumbnail is not increased Figure 8 If the page is 30, it is impossible to keep the thumbnails Figure 8 The size of the state in which the pages 30 are arranged without overlapping each other and the blank space of each page 30 including the added page 30 is as small as possible. Therefore, the thumbnail that is continuously enlarged in conjunction with the change in the amount of movement of the finger is not displayed on the screen. Figure 8 , each time the finger moves a certain amount, the enlarged thumbnail is displayed. Figure 8 Until the finger moves to the next specified amount, the thumbnails displayed on the screen will remain unchanged regardless of how the finger moves. Figure 8 In other words, the size of each thumbnail does not change. Figure 8 The size of varies discretely.

[0271] On the other hand, if it is determined in the determination process of step S550 that the pinch-to-release process has ended, the process ends. Fig.16 The adjustment process shown in .

[0272] Fig.17 (A) to Fig.17 (C) means according to Fig.16 2 is a diagram showing an example of how page 30 changes when the adjustment process shown in 2 is performed on a pinch operation.

[0273] like Fig.17 As shown in (A), for example, when twelve thumbnails are displayed on a page Figure 8 When the finger moves to a certain amount, a second page is added. Fig.17 (B) Generally, six enlarged thumbnails are placed on the first page and six on the second page. Figure 8 . Furthermore, in Fig.17 Continue the pinch-and-release operation in the state (B). If the finger movement reaches the specified movement amount, a third page is added. Fig.17 (C) As in the example, four enlarged thumbnails are arranged on each of the first to third pages 30. Figure 8 .

[0274] In addition, Fig.16 , the adjustment process when a pinch-out operation is performed is described in , but the same process as the pinch-out operation can also be performed on the pinch-in operation.

[0275] Specifically, when the CPU 21 receives the pinch operation, if the movement amount of the finger reaches a predetermined movement amount in the pinch operation, the number of pages 30 is reduced one by one. Figure 8 The zoom-out amount is reduced to a value corresponding to a predetermined amount of movement in the pinch operation, and the thumbnails in each page 30 are displayed. Figure 8 The configuration location becomes the same way, while keeping the thumbnails Figure 8 The reduced thumbnails will be sorted in the order of Figure 8 Reconfigured in each page 30.

[0276] The so-called "predetermined movement amount in the pinch operation" refers to the amount of movement corresponding to the movement of each thumbnail. Figure 8 The amount of movement of the finger until the thumbnail is reduced to a size that allows each thumbnail to be displayed even if one page is deleted from the total number of pages. Figure 8 The size is such that the pages 30 are arranged so as not to overlap each other, and the blank space of each page 30 is reduced as much as possible after the number of pages is reduced.

[0277] That is, even in the pinch operation, the display is performed in the following manner: each time the movement amount of the finger reaches a predetermined movement amount in the pinch operation, the reduced thumbnail is displayed. Figure 8 Until the finger moves to the next specified amount, the thumbnails displayed on the screen will remain unchanged regardless of how the finger moves. Figure 8 The size of each does not change, Figure 8 The size of varies discretely.

[0278] <Modification 1 of the Second Embodiment>

[0279] As described above, the information processing device 10A adds a page 30 and displays the thumbnail as the thumbnail every time the finger movement amount in the pinch operation reaches a predetermined movement amount. Figure 8 Displayed on the screen, so even if you move your finger, the thumbnail displayed on the screen Figure 8 Therefore, it is preferable to display the display guide in an overlapping manner on the configuration thumbnail. Figure 8 In page 30 of FIG. 1 , the display guide indicates to what extent the user moves the finger before the enlarged thumbnail is displayed. Figure 8 .

[0280] When the information processing device 10A receives information from the touch screen indicating that two fingers have touched the touch screen and the fingers have started to move in order to enlarge the interval between the two fingers, the total number of pages after the additional page 30 can be displayed at a position that is a position on an extension line of the finger movement direction and is a position where the enlarged thumbnail can be obtained. Figure 8 The number of pages 30 changes like the position of the prescribed movement amount.

[0281] Fig.18 FIG. 1 is a diagram showing an example of displaying a guide. Fig.18 If you zoom in until the "2P" is displayed, the enlarged thumbnail Figure 8 like Fig.17 If you zoom in until you reach the position where "3P" is displayed, the enlarged thumbnail will be displayed. Figure 8 like Fig.17 The display is shown on three pages as shown in (C).

[0282] In addition, if you zoom in on your finger Fig.18 After reaching the "3P" position of the image, pinch in until it reaches the "2P" position, and the thumbnail will be displayed. Figure 8 The number of pages is restored from three pages to two pages.

[0283] <Modification 2 of the second embodiment>

[0284] For example, abbreviation Figure 8 The smaller the size, the smaller the Figure 8 To zoom in to a predetermined size, you need to move your finger larger to increase the amount of finger movement. Figure 8 The pinch-to-zoom operation must be repeated multiple times to enlarge the image to the size the user desires.

[0285] Therefore, even when the information processing device 10A receives the same amount of movement from the touch screen, it is possible to perform the operation in accordance with the thumbnail. Figure 8 Size and size of Figure 8 At least one of the contents of the document represented is abbreviated Figure 8 The amount of magnification can be varied.

[0286] Fig.19 It is a thumbnail before zooming in by pinching. Figure 8 An example of a graph showing the relationship between the size of and the number of additional pages 30 for the same amount of movement. Fig.19 In the graph, the more you move in the direction of the arrow on the horizontal axis, the smaller the image is before zooming in. Figure 8 The larger the value is, the more the number of pages 30 increases with the same amount of movement, as the direction of the arrow on the vertical axis is advanced.

[0287] like Fig.19 As shown in the figure, if you pinch and hold to enlarge the thumbnail before Figure 8 The size of the page 30 is inversely proportional to the increase in the number of pages 30 with the same amount of movement, so the thumbnail before enlargement Figure 8 The smaller the size of the thumbnail is, the more the number of pages 30 increases for the same amount of movement. Figure 8 The smaller the size, the smaller the size will be relative to the same amount of movement Figure 8 Therefore, by adjusting Fig.19 The diagram shown in the figure can also be viewed as a thumbnail before enlarging Figure 8 Regardless of the size of Figure 8 Set the method to enlarge to the same size.

[0288] In addition, for example, as in the first embodiment, Figure 4 As described in the above, the information processing device 10A is provided with a detection unit 13, which detects each thumbnail before enlargement. Figure 8 The image area occupation ratio W is calculated, and the number of thumbnails S corresponding to the image area occupation ratio W becoming greater than the threshold value γ is divided by the total number of thumbnails corresponding to the file. Figure 8 The ratio R of the number of images obtained makes the thumbnail with respect to the same amount of movement Figure 8 The amount of magnification can be varied.

[0289] Specifically, in order to remind the user of the content of the file, the lower the ratio R of the image, the larger the thumbnail must be enlarged. Figure 8 , so the same amount of movement will be abbreviated Figure 8 The amount of amplification is set large.

[0290] Alternatively, the information processing device 10A may also select each thumbnail before enlarging. Figure 8 The proportion of the detected image area W in the image is Figure 8 The average value of the image area occupancy ratio W in the image area becomes lower, and the thumbnail with the same amount of movement Figure 8 The amount of amplification is set large.

[0291] In addition, the information processing device 10A may also use the same as described in the first embodiment. Figure 8 The appearance of the text contained in the text is related to the visual characteristics, so that the same amount of movement relative to the thumbnail Figure 8 The amount of magnification can be varied.

[0292] For example, in order to remind the user of the content of the file, the smaller the average value of at least one of the difference in color distribution of text, the difference in text distribution, and the difference in blank distribution of adjacent thumbnails becomes, the larger the thumbnail must be enlarged. Figure 8 , so the same amount of movement will be abbreviated Figure 8 The amount of amplification is set large.

[0293] <Modification 1 common to the first embodiment and the second embodiment>

[0294] Hereinafter, the abbreviations respectively applicable to the information processing device 10 in the first embodiment and the information processing device 10A in the second embodiment will be described. Figure 8 A variation example related to the display method is described.

[0295] In the information processing device 10 and the information processing device 10A, thumbnails are displayed in page order. Figure 8 . The so-called "display thumbnails in page order" Figure 8 ", for example, means that when the third page is displayed on the screen while the first page is displayed on the screen, the pages 30 displayed on the screen are displayed in sequence according to the arrangement order of the pages 30 in a manner such that the second page is temporarily displayed and then the third page is displayed.

[0296] However, the information processing device 10 or the information processing device 10A does not necessarily need to display thumbnails in the order of pages. Figure 8 .

[0297] Fig. 20 The information processing device 10 and the information processing device 10A are shown in abbreviated form. Figure 8 The following is an example of a display of Fig. 20 As shown, the information processing device 10 and the information processing device 10A first convert each thumbnail Figure 8 As each abbreviation Figure 8 The size that does not overlap and can be accommodated in one page is arranged in page 30.

[0298] The information processing device 10 and the information processing device 10A convert the thumbnails arranged in one page into Figure 8 Split into corresponding to each abbreviation Figure 8 becomes greater than the threshold value α, and the thumbnails displayed in each page 30 Figure 8 Multiple areas of each page 30 are displayed in a manner that does not overlap each other and that the blank space of each page 30 is minimized. Fig. 20 In the example shown in , the area 32A and the area 32B are each a plurality of areas corresponding to the page 30 .

[0299] In addition, the processing described above is applicable to the method of dividing into multiple regions. For example, in the case of the information processing device 10, when executing Figure 3 After the thumbnail processing shown in FIG. 1 is performed, the thumbnail is enlarged so that the blank space of each page 30 is as small as possible. Figure 8 The number of pages and the thumbnails displayed on each page 30 Figure 8 , and display the enlarged thumbnail in advance Figure 8 Page 30 with thumbnails Figure 8 Then, the information processing device 10 establishes a correspondence between each page 30 and the thumbnail. Figure 8 Each thumbnail will be arranged in a size that does not overlap and can fit on one page. Figure 8 Page 30 to display the enlarged thumbnail Figure 8 The page 30 is divided into a plurality of regions, and for example Fig. 20 The regions 32A and 32B shown in FIG. 3 are generally displayed with dotted lines or the like on the page 30 so as to make the range of the divided regions clear.

[0300] exist Fig. 20 For example, when the area 32A has been selected by the user, the information processing device 10 displays the page 30A corresponding to the area 32A and the thumbnail corresponding to the page 30A. Figure 8 In addition, when the area 32B has been selected by the user, the information processing device 10 displays the page 30B corresponding to the area 32B and the thumbnail corresponding to the page 30B. Figure 8 is displayed on the screen.

[0301] In the case of the information processing device 10A, the thumbnails displayed on each page 30 are stored assuming that the user has performed a pinch operation so that the number of pages increases to a predetermined number of pages (for example, two pages). Figure 8 , and display the enlarged thumbnail in advance Figure 8 Each page 30 with thumbnails Figure 8 Then, similarly to the case of the information processing device 10, the information processing device 10A generates a corresponding image based on the pages 30 and the thumbnails. Figure 8 Each thumbnail will be arranged in a size that does not overlap and can fit on one page. Figure 8 Page 30 to display the enlarged thumbnail Figure 8 The page 30 is divided into a plurality of regions as a unit, and is displayed on the page 30 in a manner such that the ranges of the divided regions are known.

[0302] In addition, the enlarged thumbnail is displayed. Figure 8 The areas of each page 30 are arranged in the row direction from the upper left of the page 30 to the right in the order of the pages. When the right end of the page 30 is reached, the areas are arranged in the row direction from the left side to the right side of the next row of the page 30. In this way, the divided areas corresponding to each page 30 are arranged in the order of the pages in a predetermined direction, so the positions of the divided areas represent the thumbnails displayed on the screen. Figure 8 The abbreviation of the first page Figure 8 .

[0303] In addition, if Fig. 20 As shown, when the page 30A corresponding to the selected area 32A is displayed on the screen, the page 30A may be further divided into a plurality of areas (e.g., area 32C and area 32D). For example, when area 32C is selected in the page 30A, the information processing device 10A displays the page 30C corresponding to area 32C on the screen. In this way, the information processing device 10 and the information processing device 10A may further divide the area corresponding to one page 30 into a plurality of areas corresponding to a plurality of pages 30.

[0304] When the area corresponding to one page 30 is further divided into a plurality of areas, the information processing device 10 or the information processing device 10A may also, for example, Fig. 20 In area 32A of page 30, a separator such as a dotted line indicating area 32C and area 32D is displayed in advance.

[0305] <Modification 2 common to the first and second embodiments>

[0306] In the information processing device 10 and the information processing device 10A, thumbnails are arranged so that the blank space of each page 30 is as small as possible. Figure 8 , or place thumbnails at the same position on each page 30 Figure 8 However, in making such abbreviations Figure 8 In the case of the configuration, the position of the page separator corresponds to the thumbnail configured in page 30 Figure 8 The size of the Figure 8 With the thumbnail displayed Figure 8 The relational aspects of page 30 have no particular significance.

[0307] On the other hand, there are blocks in the file that are divided according to the relevance of the content. For example, the directory of chapters in the file is an example of a block divided according to the relevance of the content. In addition to chapters, the block also includes sections, items, etc. Figure 8 Compared with the configuration in page 30, Figure 8 When the information is collected in each block and arranged on page 30, it is easier for the user to browse the information based on the number of blocks and the thumbnail of each block. Figure 8 The content of the file can be remembered by the number of (i.e., the number of file pages) and the like.

[0308] Therefore, the information processing device 10 and the information processing device 10A may also, for example, enlarge the size of the thumbnail images to a value greater than the threshold value α. Figure 8 Collected in each block of the file, and with the thumbnails contained in each block Figure 8 Included in the same page 30, configure each thumbnail Figure 8 That is, the information processing device 10 or the information processing device 10A displays the enlarged thumbnails in a manner of switching pages 30 for each block of the file. Figure 8 The corresponding pages 30 are displayed on the screen.

[0309] In addition, when it is not possible to include all the thumbnails contained in the same block Figure 8 When the thumbnails are arranged in the same page 30 in a non-overlapping manner, the information processing device 10 and the information processing device 10A may also arrange the thumbnails included in the same block. Figure 8 The content is divided into a plurality of pages 30 and arranged.

[0310] Fig.21 (A) indicates that each chapter in the file is configured with an abbreviation. Figure 8 For example, if the file contains ten chapters, Fig.21 (A) of the table below will correspond to the abbreviations of the document pages that constitute Chapter 1. Figure 8 Configured in the first page, will correspond to the thumbnails of the document pages that make up Chapter 2 Figure 8It is placed on the second page. After that, the thumbnails of the document pages that make up each chapter up to Chapter 10 will be Figure 8 Configured in each page 30.

[0311] Since the abbreviation is configured in each chapter Figure 8 Therefore, even if there is a blank space on page 30, the abbreviations contained in other chapters will not be included. Figure 8 On the contrary, if the same chapter thumbnails are arranged in the same page 30 Figure 8 , the information processing device 10 and the information processing device 10A may also abbreviate Figure 8 Zoom in to minimize the white space within page 30.

[0312] In addition, as an effective use of blank space, such as Fig.21 As shown in (B), the information processing device 10 and the information processing device 10A can also use the thumbnails included in the chapters corresponding to the blank pages 30. Figure 8 Different display formats will display the abbreviations contained in the next chapter. Figure 8 A is displayed in the blank space of page 30.

[0313] Therefore, the information processing apparatus 10 and the information processing apparatus 10A visually display thumbnails of other chapters in the blank space. Figure 8 A and the thumbnail corresponding to page 30 are established from the beginning Figure 8 For example, the information processing device 10 or the information processing device 10A displays thumbnails of other chapters in the blank space. Figure 8 A and the thumbnail corresponding to page 30 are established from the beginning Figure 8 Perform image processing to add a sense of blur rather than making the image unclear.

[0314] The information processing device 10 and the information processing device 10A convert the abbreviations of other chapters into Figure 8 A is displayed in a blank space of page 30, and the user is notified of the existence of the subsequent page 30. In addition, the information processing device 10 and the information processing device 10A display thumbnails of other chapters displayed in the blank space. Figure 8 The display format of A is the same as the thumbnail corresponding to page 30 from the beginning. Figure 8 The display format is different, and the user is notified of the thumbnail Figure 8 A is the same page as 30 other abbreviations contained in Figure 8 Various other chapter abbreviations Figure 8 A.

[0315] The information processing apparatus 10 and the information processing apparatus 10A do not cause the thumbnails of other chapters to be arranged on the next page 30 and thereafter. Figure 8 Move to display in the blank space, but after copying the next page 30, the thumbnail configured Figure 8 After that, the copied abbreviation Figure 8 After image processing, it is placed in the blank space.

[0316] <Modification 3 common to the first and second embodiments>

[0317] In the abbreviation Figure 8 Gathered in each chapter of the document, and the abbreviations contained in the same chapter Figure 8 In the example of being arranged on the same page 30, in order to notify the user that there is a subsequent page 30, the thumbnail of the subsequent chapter is arranged in the blank space of the page 30. Figure 8 .

[0318] In this way, since it is assumed that the user wants to confirm whether there is another page 30 after the page 30 displayed on the screen, it is preferable to notify, for example, information indicating whether there is another page 30 before or after the page 30 displayed on the screen. Furthermore, when there is another page 30 before or after, it is preferable to display where the operation page 30 is when the other page 30 is displayed.

[0319] Therefore, the information processing device 10 and the information processing device 10A are Figure 8 When the thumbnail is placed in each page 30, after ensuring an acceptance area for accepting a switch instruction of the page 30 in each page 30, the thumbnail is placed Figure 8 .

[0320] The receiving area for receiving the switching instruction of the page 30 is set at, for example, the end of the page 30. The end of the page 30 is, for example, Fig. 22 As shown, it means that no abbreviation is configured. Figure 8 , and areas set along the edges of page 30. Fig. 22 In the example shown in , areas with a width of L1 respectively arranged on the left and right sides of the page 30 along the longitudinal edge of the page 30 and areas with a width of L2 respectively arranged on the upper and lower sides of the page 30 along the transverse edge of the page 30 are the ends of the page 30.

[0321] When the information processing device 10 or the information processing device 10A switches the page 30 by moving the page 30 horizontally, the end portion (first end portion) of the page 30 arranged along the longitudinal edge of the page 30 is set as a receiving area for accepting switching instructions of the page 30 in a manner consistent with the page switching direction; when the page 30 is switched by moving the page 30 vertically, the end portion (second end portion) of the page 30 arranged along the transverse edge of the page 30 is set as a receiving area for accepting switching instructions of the page 30.

[0322] In order to indicate to the user whether the acceptance area for accepting switching instructions for the page 30 is set at the first end or the second end, the information processing device 10 and the information processing device 10A set the width of the end where the acceptance area for accepting switching instructions for the page 30 is set to be longer than the width of the end where the acceptance area is not set.

[0323] exist Fig. 22 In the example of , width L1 is set to be greater than width L2, thereby indicating that an acceptance area for accepting instructions for switching pages 30 is set at the first end. In addition, when an acceptance area for accepting instructions for switching pages 30 is set at the second end, information processing device 10 or information processing device 10A sets the width of the second end to be longer than the width of the first end.

[0324] In addition, the information processing device 10 and the information processing device 10A not only make the width of the end of the acceptance area where the switching indication of the acceptance page 30 is set longer than the width of the other end, but also can display graphics such as icons indicating that there are other pages 30 in front of or behind the page 30 displayed on the screen at the end where the acceptance area is set.

[0325] exist Fig. 22 In the example, a triangular icon 28 indicating the switching direction of the page 30 is displayed at the first end. In addition, since there is no page 30 before the first page 30 and after the last page 30, the information processing device 10 and the information processing device 10A do not set an acceptance area for accepting the switching instruction of the page 30 at the first end on the left side of the first page 30 and the first end on the right side of the last page 30. Therefore, the information processing device 10 and the information processing device 10A do not display the icon 28 at the end where the acceptance area is not set even at the first end.

[0326] <Modification 4 common to the first and second embodiments>

[0327] So far, as an example, the thumbnail in page 30 Figure 8 In the order of the document pages, start from the upper left corner of page 30 and move in the row direction, that is, in the right direction. Figure 8 The example described above is that when the content is arranged up to the right end of page 30, the content is moved to the next line and arranged rightward from the left end of the next line.

[0328] However, it is sometimes more preferable to consider the abbreviation Figure 8 The language used in the document to be displayed determines the sorting abbreviation Figure 8 direction.

[0329] For example, in English or German, documents are read from left to right, but in Arabic or Hebrew, documents are read from right to left. When a document is written in a language that is read from right to left as described above, it is necessary to use an abbreviation to represent the contents of the document. Figure 8 Compared with arranging from left to right on page 30, arranging from right to left on page 30 makes the direction of the user's line of sight of the document more consistent with the thumbnails. Figure 8 The order of arrangement is consistent and easy to read.

[0330] Therefore, the information processing device 10 and the information processing device 10A may also correspond to the abbreviated Figure 8 The language used in the document to be displayed determines the sorting abbreviation Figure 8 direction.

[0331] The information processing device 10 or the information processing device 10A obtains the type of language used in the description of the file based on the file attribute, and determines the arrangement abbreviation by referring to the language table stored in advance in the nonvolatile memory 24. Figure 8 In addition, the so-called language table refers to the abbreviation of language and arrangement. Figure 8 The corresponding table is established in the direction.

[0332] In addition, some languages ​​have a plurality of writing directions. For example, Japanese has two writing directions: horizontal writing and vertical writing.

[0333] In horizontal writing, the abbreviations are arranged from left to right. Figure 8 It also makes the user's line of sight and thumbnails more Figure 8 However, when writing vertically, the order of the abbreviations is consistent and easy to read. Figure 8 In contrast, thumbnails are arranged from the top of page 30 to the bottom. Figure 8 It also makes the user's line of sight and thumbnails more Figure 8 The order of arrangement is consistent and easy to read.

[0334] Therefore, the information processing device 10 and the information processing device 10A may also correspond to the abbreviated Figure 8 The writing direction of the language used in the document to be displayed determines the arrangement of the abbreviations Figure 8 direction.

[0335] The present invention has been described above using the embodiments, but the present invention is not limited to the scope described in the embodiments. Various changes or improvements may be applied to the embodiments without departing from the scope of the present invention, and the forms to which the changes or improvements are applied are also included in the technical scope of the present invention. For example, the order of processing may also be changed without departing from the scope of the present invention.

[0336] In addition, in this embodiment, as an example, the thumbnail processing, content detection processing, and adjustment processing are implemented by software, but it is also possible to implement the same. Figure 3 , Figure 4 , Figure 6 , Figure 8 , Fig. 9 , Fig.11 ,and Fig.16 The processing equivalent to the flowchart shown in is implemented in, for example, an application specific integrated circuit (ASIC) and processed by hardware. In this case, the processing speed can be increased compared to the case where each process is implemented by software.

[0337] In addition, in the embodiment, the form of installing the information processing program in ROM22 is described, but it is not limited to this. The information processing program of the present invention can also be provided in the form of being recorded in a storage medium that can be read by a computer. For example, the information processing program of the present invention can also be provided in the form of being recorded in a compact disc (CD)-ROM or a digital versatile disc (DVD)-ROM or other optical discs. In addition, the information processing program of the present invention can also be provided in the form of being recorded in a semiconductor memory such as a universal serial bus (USB) memory and a flash memory. Furthermore, the information processing device 10 and the information processing device 10A can also obtain the information processing program of the present invention from other devices connected to a communication line not shown in the figure.

Claims

1. An information processing device, comprising: An acquisition component is used to acquire information shown in each of the plurality of thumbnails displayed at a glance; a detection unit for detecting an occupation degree of the image relative to the sizes of the plurality of thumbnails; a determining component, for determining the size of each of the plurality of thumbnails capable of identifying the information; as well as The display control unit controls the display of the plurality of thumbnails whose sizes are set according to the contents of the thumbnails and the size and resolution of the screen on which the plurality of thumbnails are displayed at a glance so as to be larger than the size determined by the determination unit for the plurality of thumbnails. The display control unit performs control such that as the ratio of thumbnails whose image occupancy is detected by the detection unit to be greater than a predetermined threshold value increases relative to the number of the plurality of thumbnails, the size of the thumbnails enlarged to a size greater than the size becomes smaller. Furthermore, when the difference between the color distribution of text contained in the thumbnail and the color distribution of text contained in other adjacent thumbnails is greater than a predetermined threshold, the display control component controls the size of the thumbnail enlarged to a size larger than the size to become smaller than the size of the thumbnail set according to the occupancy degree.

2. The information processing device according to claim 1, wherein: The display control component controls the size of the thumbnail enlarged to a size larger than the size to become smaller than the size of the thumbnail set according to the occupancy degree when the similarity between the configuration of text contained in the thumbnail and the configuration of text contained in other adjacent thumbnails is smaller than a predetermined similarity.

3. The information processing device according to claim 2, wherein: The display control unit uses at least one of the thickness of the arranged characters, the size of the characters, and the type of the characters for measuring the similarity.

4. The information processing device according to any one of claims 1 to 3, wherein: The display control unit controls the size of the thumbnail enlarged to a size larger than the size to become smaller than the size of the thumbnail set according to the occupancy degree when the difference between the distribution of blank spaces contained in the thumbnail and the distribution of blank spaces contained in other adjacent thumbnails is larger than a predetermined threshold.

5. The information processing device according to any one of claims 1 to 3, wherein: The display control unit controls the size of the thumbnails so that the sizes of the thumbnails displayed along the horizontal side of the page displaying the thumbnails become the same among the thumbnails that have been resized for each thumbnail and enlarged to a size larger than the size.

6. The information processing device according to claim 5, wherein: The display control unit performs control to enlarge the other thumbnails to the same size as the largest thumbnail among the thumbnails enlarged to the size or larger and displayed along the lateral side.

7. The information processing device according to claim 5, wherein: The display control unit performs the following control: further enlarging the length of the longitudinal side intersecting the horizontal side of the thumbnail that has been enlarged to a size larger than the horizontal side and is arranged in the final row of the page along the horizontal side so as to reduce the blank space that appears at the bottom of the final row.

8. The information processing device according to claim 1, wherein: The device includes a receiving unit for receiving an instruction to enlarge the size of the thumbnail image according to the amount of movement of the indicator, and The display control unit controls to enlarge the size of each of the plurality of thumbnails to a size larger than the size according to the instruction accepted by the acceptance unit, and to display the thumbnails enlarged to a size larger than the size side by side.

9. The information processing device according to claim 8, wherein: The display control component controls in the following manner: the thumbnail enlarged to the size corresponding to the indicated size is not displayed on the screen displaying the multiple thumbnails at a glance until the thumbnail is enlarged to a size that makes it impossible to keep the thumbnails displayed in each page without overlapping each other unless the page displaying the thumbnails is increased.

10. The information processing device according to claim 8 or 9, wherein: The display control unit controls so as to change the number of pages of thumbnails enlarged to a size or larger in accordance with the amount of movement of the indicator accepted by the acceptance unit.

11. The information processing device according to claim 10, wherein: When the receiving unit receives the start of movement of the indicator, the display control unit controls the display so as to display the total number of pages after the change at a position that is on an extension line of the direction of movement of the indicator and is a position at which the amount of movement of the indicator can be obtained such that the number of pages of each enlarged thumbnail image can be displayed.

12. The information processing device according to claim 8 or 9, wherein: The display control unit performs control to make the enlargement amount of the thumbnail variable according to at least one of the size and content of the thumbnail to be enlarged even when the same movement amount is received from the receiving unit.

13. The information processing device according to claim 12, wherein: The display control means performs control such that the smaller the size of the thumbnail to be enlarged is, the larger the amount of enlargement of the thumbnail for the same amount of movement becomes.

14. The information processing device according to claim 12, wherein: comprising a detection unit for detecting the degree of occupancy of the image relative to the size of the thumbnail, and The display control means performs control such that the amount of enlargement of the thumbnail with respect to the same amount of movement increases as the occupancy level of the image included in the thumbnail to be enlarged detected by the detection means decreases.

15. The information processing device according to claim 8 or 9, wherein: The movement amount of the indicator received by the receiving unit is a movement amount in a state where the indicator is not in contact with the screen displaying the plurality of thumbnails in a list.

16. The information processing device according to any one of claims 1 to 3, wherein: The display control unit divides the plurality of thumbnails into a plurality of areas that are displayed on one page in a manner that is larger than the size and does not overlap with each other, and when any one of the plurality of areas is selected, controls the display of each thumbnail included in the selected area on one page.

17. The information processing device according to claim 16, wherein: The display control unit performs control to divide the plurality of thumbnail images so that the plurality of areas are further included in the divided areas.

18. The information processing device according to any one of claims 1 to 3, wherein: The display control component establishes a correspondence between each of the multiple pages and the thumbnails that have been divided into each block and have been enlarged to a size larger than the size, in a manner that switches pages for each block divided corresponding to the association of the content in the file represented by the thumbnail, and controls in a manner that each of the thumbnails that have been enlarged to a size larger than the size is displayed on the multiple pages.

19. The information processing device according to any one of claims 1 to 3, wherein: The end portions provided along the respective sides of the page displaying the thumbnails each include a receiving area for receiving an instruction to switch the displayed page, and The display control unit performs control to set the width of the end portion so that the width of the end portion including the acceptance region becomes longer than the width of the end portion not including the acceptance region.

20. The information processing device according to any one of claims 1 to 3, wherein: The display control unit controls the arrangement of each of the thumbnails enlarged to a size larger than the size and displayed on the page, according to the type of language used in the description of the file included in the thumbnail.

21. The information processing device according to claim 20, wherein: The display control unit controls the arrangement of the thumbnails enlarged to a size larger than the size and displayed on the page, according to the type of the language and the writing direction of the language. 22 . A storage medium storing an information processing program for causing a computer to function as each component of the information processing device according to claim 1 .

23. A computer program product for causing a computer to function as each component of the information processing device according to any one of claims 1 to 21.

Images