Display method and display device

Abstract

To provide a display method and display device which improve a user's convenience.SOLUTION: A control section 150 of a display device 100 displays, on a display surface 135, a browsing screen 20B including a first thumbnail image bundle 21, which is a bundle of first thumbnail images 211 obtained by reducing in size each page of a document file 165, and the document file 165, in response to receiving a pinning operation of pinning a page included in the document file 165, and registers the selected page of the document file 165 as a pinned page. The control section 150 displays a second thumbnail image bundle 33, in which each page of the document file 165 is more reduced in size than in the first thumbnail image bundle 21, as a pinning icon 31 on the display surface 135.SELECTED DRAWING: Figure 15

Description

Technical Field

[0001] The present invention relates to a display method and a display device.

Background Art

[0002] Conventionally, there is known a device that displays a plurality of thumbnail images in a list arrangement in a predetermined order on a display surface, and displays a menu icon associated with a desired thumbnail image by touching and selecting the desired thumbnail image. For example, in Patent Document 1, in an image bundle composed of a plurality of thumbnail images, when a thumbnail image or an image bundle is selected, a menu icon associated with the selected thumbnail image or image bundle is displayed at a position that does not overlap with the image bundle.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when a plurality of document files are open, it takes time to search for pages to be viewed from the plurality of document files.

Means for Solving the Problems

[0005] One aspect of the present disclosure is a display method that includes displaying a viewing screen on a display surface, which includes a first reduced image bundle, which is a bundle of first reduced images obtained by reducing each page of a document file, and the document file; accepting a pinning operation to pin a page contained in the document file; registering the page of the document file selected by the pinning operation as a pinned page; and displaying a second reduced image bundle, which is a bundle of each page of the document file reduced to a smaller size than the first reduced image bundle, as icons on the display surface.

[0006] Another aspect of the present disclosure is a display device comprising: a control unit that performs the following actions on a display surface: displaying a first reduced image bundle, which is a bundle of first reduced images obtained by reducing each page of a document file, and the document file; receiving a pinning operation to pin pages contained in the document file; registering the pages selected by the pinning operation of the document file as pinned pages; and displaying a second reduced image bundle, obtained by reducing the first reduced image bundle of the document file, as an icon on the display surface. [Brief explanation of the drawing]

[0007] [Figure 1] A diagram showing the configuration of a display device. [Figure 2] A diagram showing an example of the first set of thumbnail images. [Figure 3] A diagram illustrating the method for generating an overhead view image of the first set of thumbnail images. [Figure 4] A diagram illustrating the method for generating an overhead view image of the first set of thumbnail images. [Figure 5] A diagram illustrating the method for generating an overhead view image of the first set of thumbnail images. [Figure 6] A diagram illustrating the method for generating an overhead view image of the first set of thumbnail images. [Figure 7] A diagram showing an example of a list screen. [Figure 8] A diagram showing an example of a browsing screen. [Figure 9] A diagram showing an example of the first set of thumbnail images displayed in the first display area. [Figure 10] This diagram shows the display screen with a group of menu icons. [Figure 11] A diagram showing the pinned icon displayed in the third display area. [Figure 12] This diagram shows the state when the second set of thumbnail images is touched. [Figure 13] A diagram showing the pinned items screen. [Figure 14] This diagram shows the state when multiple pinned icons are displayed in the third display area. [Figure 15] A flowchart illustrating the operation of a display device. [Figure 16] A flowchart illustrating the operation of a display device. [Modes for carrying out the invention]

[0008] The embodiments will be described below with reference to the attached drawings. Figure 1 shows the configuration of the display device 100. The configuration of the display device 100 will be explained with reference to Figure 1. The display device 100 comprises a wireless communication unit 110, a display unit 130, and a control unit 150. The display device 100 can be, for example, a notebook, desktop, or tablet personal computer, or a smartphone.

[0009] The wireless communication unit 110 is equipped with a wireless module and an antenna, and communicates with external devices such as server equipment via a wireless network.

[0010] The display unit 130 includes a touch panel 131 that includes a display panel and a touch sensor. For the display panel, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel is used. The touch sensor detects a touch operation on the display panel. The touch sensor detects a touch position, which is the position on the touch panel 131 where an indicator such as an electronic pen or the user's finger has made contact. The touch sensor outputs an operation signal including the detected touch position to the control unit 150. The touch position is indicated by coordinates in the coordinate system set for the display panel.

[0011] The control unit 150 includes a storage unit 160 and a processor 170.

[0012] The storage unit 160 includes a volatile semiconductor memory such as a RAM (Random Access Memory) and a non-volatile semiconductor memory such as a ROM (Read Only Memory). Also, for example, when the display device 100 is a smartphone, it may be configured to include an SD card as the storage unit 160. Further, when the display device 100 is a personal computer, it may be configured to include an auxiliary storage device such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).

[0013] The storage unit 160 stores an OS (Operating System) 161 and an application program 163 that the processor 170 executes. The application program 163 is hereinafter referred to as an app 163.

[0014] Also, the storage unit 160 stores a document file 165. The document file 165 includes, for example, an electronic manual, an e-book, a document created by the user, etc. The document file 165 may be a file generated by the user executing the app 163, or may be a file acquired from an external device by the wireless communication unit 110.

[0015] The processor 170 is composed of a CPU (Central Processing Unit). Alternatively, the control unit 150 may be composed of a System-on-a-Chip (SoC) equipped with a CPU, a Graphics Processing Unit (GPU), a communication interface, and various sensors. The processor 170 executes the OS 161 and application 163 to control the various parts of the display device 100.

[0016] The control unit 150 includes a thumbnail image bundle generation unit 171 and a display generation unit 173 as functional blocks. These functional blocks are a convenient representation of the functions realized by the processor 170 executing the OS 161 and application 163.

[0017] Figure 2 shows an example of the first thumbnail image bundle 21. The thumbnail image bundle generation unit 171 reads the document file 165 from the storage unit 160 and generates first thumbnail images 211 by reducing the images of each page of the read document file 165. The first thumbnail images 211 correspond to the first reduced images. Based on the first thumbnail image bundle 21, which is a bundle of the generated first thumbnail images 211, the thumbnail image bundle generation unit 171 generates an overhead image that provides an overhead view of the first thumbnail image bundle 21. The overhead image is the image that an observer would see if they viewed the first thumbnail image bundle 21, which is placed in the virtual space, from any viewpoint in the virtual space. The first thumbnail image bundle 21 corresponds to the first reduced image bundle.

[0018] The thumbnail image bundle generation unit 171 arranges multiple first thumbnail images 211 in the direction of a first virtual axis Q parallel to the horizontal direction of the display surface 135 of the touch panel 131. The multiple first thumbnail images 211 can be moved along the first virtual axis Q in response to user operations. Furthermore, the thumbnail image bundle generation unit 171 rotates a plurality of first thumbnail images 211 around a second virtual axis M that is parallel to the vertical direction of the display surface 135 and intersects with the first virtual axis Q. The thumbnail image bundle generation unit 171 further generates an overhead view image of the first thumbnail image bundle 21 by rotating it around the first virtual axis Q.

[0019] Here, we will explain how to generate an overhead image of the first thumbnail image bundle 21, referring to Figures 3 to 6.

[0020] First, the thumbnail image bundle generation unit 171 applies a vertical deformation to the first thumbnail image 211-1 shown in Figure 3, as viewed from the front, while keeping the width unchanged, as shown in Figure 4. This generates a first thumbnail image 211-2, as shown in Figure 4, in which the right side of the first thumbnail image 211-1 is shifted relative to the left side by S·sinθ·tanφ. The angle φ is not shown.

[0021] Next, as shown in Figure 5, the thumbnail image bundle generation unit 171 reduces the first thumbnail image 211-2 horizontally by a factor of cosθ to generate the first thumbnail image 211-3. As a result, the width of the first thumbnail image 211-3 becomes S·cosθ.

[0022] Finally, as shown in Figure 6, the thumbnail image bundle generation unit 171 generates a first thumbnail image 211-4 by vertically reducing the first thumbnail image 211-3 by a factor of cosφ. As a result, the vertical dimension of the first thumbnail image 211-4 is L·cosφ. This results in a first thumbnail image 211-4 obtained by rotating the first thumbnail image 211-1 around the second virtual axis M by a rotation angle θ, and further rotating it around the first virtual axis Q. In other words, a first thumbnail image 211-4 is obtained by rotating the first thumbnail image 211-1 around the second virtual axis M by a rotation angle θ, and also by viewing the first thumbnail image 211-1 from a viewpoint above the top edge of the first thumbnail image 211-1 at a downward angle φ.

[0023] The rotation angle θ is set to a predetermined rotation angle based on the position on the first virtual axis Q. In other words, the rotation angle θ is set to a gradually larger angle as you move away from the center of the display surface 135.

[0024] The thumbnail image bundle generation unit 171 similarly generates overhead images for the menu icon group 27 and the second thumbnail image bundle 33, which will be described later.

[0025] The display control unit 173 generates an application screen 20 to be displayed on the display surface 135 of the touch panel 131 based on the first thumbnail image bundle 21 generated by the thumbnail image bundle generation unit 171, the menu icon group 27, and the second thumbnail image bundle 33. The application screen 20 includes a list screen 20A, a browsing screen 20B, and a pinned screen 20C. The list screen 20A, the browsing screen 20B, and the pinned screen 20C each display a home button 11 associated with the operation to return to the home screen and a back button 13 associated with the operation to return to the previous screen. The back button 13 corresponds to the back button.

[0026] The application screen 20 will be explained with reference to Figures 7 to 14. In Figures 7 to 14, the upward direction is indicated by the symbol UP, the downward direction is indicated by the symbol DW, the leftward direction is indicated by the symbol L, and the rightward direction is indicated by the symbol R.

[0027] Figure 7 shows an example of the list screen 20A. The list screen 20A is a screen that displays a list of document files 165 stored in the storage unit 160. In the list screen 20A, a combination of the first thumbnail image bundle 21 and the main thumbnail image 23 is displayed for each document file 165. In the following explanation, we will assume that the storage unit 160 stores document files 165A, B, C, ..., up to N. The first thumbnail image bundle 21 of document file 165A will be displayed as the first thumbnail image bundle 21A, and the main thumbnail image 23 will be represented as the main thumbnail image 23A. The same applies to documents B, ..., and N. In this embodiment, we will also explain the case where the first thumbnail image bundle 21A and the main thumbnail image 23A, ..., the first thumbnail image bundle 21N and the main thumbnail image 23N are displayed on the list screen 20A. However, the list screen 20A can display a further number of document files 165, including a first thumbnail image bundle 21 and a main thumbnail image 23.

[0028] On the list screen 20A, the combination of the first thumbnail image bundle 21A based on the document file 165A and the main thumbnail image 23A is displayed in a predetermined position. Additionally, the list screen 20A displays combinations of the first thumbnail image bundle 21B and the main thumbnail image 23B based on the document file 165B. The combinations of the first thumbnail image bundle 21B and the main thumbnail image 23B are displayed below the combination of the first thumbnail image bundle 21A and the main thumbnail image 23A. Additionally, the list screen 20A displays the combination of the first thumbnail image bundle 21C and the main thumbnail image 23C based on the document file 165C. The combination of the first thumbnail image bundle 21C and the main thumbnail image 23C is displayed below the combination of the first thumbnail image bundle 21B and the main thumbnail image 23B.

[0029] The first thumbnail image bundle 21 is a group of images in which multiple first thumbnail images 211 are arranged horizontally. Each of the first thumbnail images 211 included in the first thumbnail image bundle 21 is displayed in a state that provides an overhead view from a predetermined viewpoint. One first thumbnail image 211 included in the first thumbnail image bundle 21 corresponds to one page of the corresponding document file 165. The first thumbnail image 211 in this embodiment is a rectangular image.

[0030] The main thumbnail image 23 is a thumbnail image corresponding to a representative page of document file 165. A representative page could be, for example, the top page of document file 165. The list screen 20A may display a portion of the first thumbnail image 211 of a given page as the main thumbnail image 23, or it may display the entire first thumbnail image 211 of a given page as the main thumbnail image 23.

[0031] On the list screen 20A, users can input a selection operation by touch to choose a combination of the first thumbnail image bundle 21 and the main thumbnail image 23. When the selected combination is chosen on the list screen 20A, the display control unit 173 displays the browsing screen 20B for the selected document file 165.

[0032] Figure 8 shows an example of the browsing screen 20B. The viewing screen 20B includes a first display area 221, a second display area 223, and a third display area 225.

[0033] The first display area 221 is the area that displays the first thumbnail image bundle 21 selected on the list screen 20A. When a combination of the main thumbnail image 231 and the first thumbnail image bundle 21 is selected on the list screen 20A, the first thumbnail image bundle 21 included in the selected combination is displayed in the first display area 221.

[0034] The display control unit 173 changes the display mode of the first thumbnail image bundle 21 when a predetermined touch operation, such as a slide operation, is performed by an indicator within the first display area 221.

[0035] When a slide operation is performed to the right within the first display area 221, the multiple first thumbnail images 211 within the first display area 221 move from left to right in accordance with the amount of rightward movement of the indicator. When a slide operation is performed to the left, the multiple first thumbnail images 211 within the first display area 221 move from right to left in accordance with the amount of leftward movement of the indicator.

[0036] The second display area 223 is the area that displays the page image 25 of the page corresponding to the first thumbnail image 211 selected in the first display area 221. In the following description, the page image 25 corresponding to the Mth page of the document shown in document file 165N will be denoted as page image 25N-M, where M is an integer greater than or equal to 1. The page image 25B-111 shown in Figure 4 shows the page image 25 corresponding to the 111th page of document file 165B.

[0037] In the second display area 223, the displayed page image 25 is switched when a predetermined touch operation, such as a slide operation, is performed by the indicator.

[0038] If a predetermined touch operation is performed to the right in the second display area 223, the page image 25 of the page preceding the page corresponding to the page image 25 displayed before the touch operation will be displayed in the second display area 223. If a predetermined touch operation is performed to the left in the second display area 223, the page image 25 of the page following the page corresponding to the page image 25 displayed before the touch operation will be displayed in the second display area 223.

[0039] In the state shown in Figure 8, if a slide operation is performed to the right within the second display area 223, the page image 25B-110 of the page immediately preceding page image 25B-111 will be displayed in the second display area 223. The illustration of page image 25B-110 is omitted. Furthermore, in the state shown in Figure 8, if a slide operation is performed to the left within the second display area 223, the page image 25B-112 of the page immediately following page image 25B-111 will be displayed in the second display area 223. The illustration of page image 25B-112 is omitted.

[0040] In the following description, the first thumbnail image 211 corresponding to page M of the document shown in document file 165N will be denoted as first thumbnail image 211N-M. For example, first thumbnail image 211B-98 shows the first thumbnail image 211 corresponding to page 98 of document file 165B. When the page image 25 displayed in the second display area 223 changes, the display mode of the first thumbnail image bundle 21 changes within the first display area 221. Specifically, the first thumbnail image 211 corresponding to the page image 25 after the change is displayed approximately in the center of the first display area 221 in the left-right direction. For example, when page image 25B-110 is displayed in the second display area 223, the first thumbnail image 211B-110 is displayed approximately in the center of the first display area 221 in the left-right direction. Also, when page image 25B-112 is displayed in the second display area 223, the first thumbnail image 211B-112 is displayed approximately in the center of the first display area 221 in the left-right direction.

[0041] Furthermore, when a slide operation is performed within the first display area 221 and the first thumbnail image 211B-110 is displayed approximately in the center of the first display area 221 in the horizontal direction, the page image 25B-110 is displayed in the second display area 223. Similarly, when a slide operation is performed within the first display area 221 and the first thumbnail image 211B-112 is displayed approximately in the center of the first display area 221 in the horizontal direction, the page image 25B-112 is displayed in the second display area 223.

[0042] Here, we will explain in detail the first thumbnail image bundle 21 displayed in the first display area 221. Figure 9 is a diagram showing an example of the first thumbnail image bundle 21 displayed in the first display area 221. Figure 9 shows the display configuration of the first display area 221 when page image 25B-98 is displayed in the second display area 223. The first thumbnail image bundle 21B is displayed in the first display area 221, and the first thumbnail image 211B-98 is displayed approximately in the center of the first display area 221 in the left-right direction.

[0043] In the first display area 221, each of the first thumbnail images 211 is displayed side by side on the virtual axis KJ of the display surface 135 of the touch panel 131. The virtual axis KJ is an axis parallel to the left-right direction.

[0044] The first display area 221 has a right area 221R and a left area 221L. The right area 221R and the left area 221L are aligned horizontally with a switching line L1 in between. The switching line L1 is a virtual line located to the left of the center line L2, which indicates the horizontal center of the first display area 221, and extends vertically. The center line L2 also extends vertically, similar to the switching line L1.

[0045] In Figure 9, the first thumbnail image 211B-98 is displayed superimposed on the center line L2. The first thumbnail image 211B-97, which corresponds to the page preceding the page corresponding to the first thumbnail image 211B-98, is displayed in the left region 221L. The first thumbnail images 211B-98 and 211B-99 are displayed in the right region 221R. In the first display area 221, the orientation of the first thumbnail image 211 is switched based on the switching line L1.

[0046] Figure 10 shows the state in which the menu icon group 27 is displayed on the display surface 135. When a predetermined touch operation is detected, the display control unit 173 displays a group of menu icons 27 on the display surface 135. Figure 10 shows an example in which the group of menu icons 27 is displayed in the second display area 223, but the display position of the group of menu icons 27 is not limited to the second display area 223.

[0047] The menu icon group 27, like the first thumbnail image bundle 21, is an image bundle in which multiple menu icons 271 are arranged horizontally on the display surface 135. Each menu icon 271 is associated with an operation, such as pinning or printing. In addition, each menu icon 271 displays text, symbols, graphics, etc., indicating the operation associated with that menu icon 271. Figure 10 shows an example of displaying text indicating the operation associated with a menu icon 271.

[0048] Figure 11 shows the pin icon 31 displayed in the third display area 225. The third display area 225 is the area for displaying the pinned icon 31. The pinned icon 31 is an icon that indicates the existence of a pinned, or registered, document file 165, specifically the page image 25. The pinned icon 31 corresponds to an icon.

[0049] The display control unit 173 executes the pinning process when a menu icon 271 associated with a pinning operation is selected by touch operation. Hereinafter, touching the menu icon 271 associated with a pinning operation will be referred to as the pinning operation. First, the display control unit 173 stores the page image 25 of the document file 165 displayed in the second display area 223 and the first thumbnail image bundle 21 displayed in the first display area 221 in the storage unit 160 as pinned pages. At this time, in order to secure the storage capacity of the storage unit 160, the display control unit 173 may reduce the resolution of the first thumbnail image bundle 21 to be stored in the storage unit 160, or reduce the resolution of the first thumbnail image bundle 21 that has already been stored.

[0050] Next, the display control unit 173 generates a second thumbnail image bundle 33 based on the first thumbnail image bundle 21 of the first display area 221 as a pinning process. The second thumbnail image bundle 33 corresponds to a second reduced image bundle. The second thumbnail image bundle 33 is a bundle of images with reduced size and resolution compared to the first thumbnail image bundle 21. As shown in Figure 11, the second thumbnail image bundle 33 comprises a plurality of second thumbnail images 331, which are arranged side by side horizontally on the display surface 135. The display control unit 173 displays the generated second thumbnail image bundle 33 as a pinning icon 31 in the third display area 225. Note that the second display area 223 and the third display area 225 may overlap at least partially. In this case, the second thumbnail image bundle 33 is displayed on the front side, and the page image 25 is displayed on the back side.

[0051] As explained with reference to Figures 3 to 6, the second thumbnail image bundle 33, like the first thumbnail image bundle 21, has multiple second thumbnail images 331 arranged within it. That is, the second thumbnail image bundle 33 is arranged on the first virtual axis Q, and the multiple second thumbnail images 331 rotate around the second virtual axis M that intersects the first virtual axis Q, and further rotate around the first virtual axis Q. In addition, the second thumbnail images 331, like the first thumbnail images 211, can be moved along the first virtual axis Q in response to user operations.

[0052] When a slide operation is performed, the multiple second thumbnail images 331 move from left to right in proportion to the amount of movement to the right during the slide operation, similar to the first thumbnail image bundle 21. The display control unit 173 moves the second thumbnail image 331 selected by the slide operation from left to right in proportion to the amount of movement during the slide operation. Similarly, when a slide operation is performed to the left, the multiple second thumbnail images 331 move from right to left in proportion to the amount of movement to the left during the slide operation. The display control unit 173 moves the second thumbnail image 331 selected by the slide operation from right to left in proportion to the amount of movement during the slide operation.

[0053] Figure 12 shows the state when the second thumbnail image bundle 33B is touched. Figure 13 shows the pinning screen 20C. When the pinning operation shown in Figure 11 was performed, the second display area 223 displayed the page image 25B-100 of page 100 of document file 165B. In other words, the page image 25B-100 of page 100 of document file 165B was registered, and the second thumbnail image bundle 33B of document file 165B was displayed as the pinning icon 31. Subsequently, it is assumed that the second display area 223 displays page image 25B-70 of page 70 of document file 165B, as shown in Figure 12, due to the user's slide operation. Then, when the second thumbnail image bundle 33B is selected by touch operation, the display control unit 173 displays the pinning screen 20C shown in Figure 13. The pinning screen 20C, like the browsing screen 20B, includes the first display area 221, the second display area 223, and the third display area 225. Furthermore, while the browsing screen 20B is displayed, for example, by selecting one of the document files 165 from the list screen 20A, the pinning screen 20C is displayed by touch operation on the pinning icon 31.

[0054] The pinning screen 20C shown in Figure 13 is the same screen as the browsing screen 20B shown in Figure 11 when the pinning operation is performed. To allow the user to recognize whether the screen displayed on the display surface 135 is the pinning screen 20C or the browsing screen 20B, the background colors of the pinning screen 20C and the browsing screen 20B are different.

[0055] As shown in Figure 13, the second display area 223 of the pinning screen 20C displays the page image 25B-100 of page 100 of the document file 165B. In addition, the first display area 221 displays the first thumbnail image bundle 21B based on the document file 165B. At this time, the display control unit 173 displays the first thumbnail image 211B-100 so that it overlaps with the center line L2.

[0056] Figure 14 shows the state in which multiple pinned icons 31 are displayed in the third display area 225. As shown in Figure 14, multiple pinned icons 31 can be displayed in the third display area 225. Pinning can be performed even on different pages of the same document file 165. Furthermore, pinning can be performed even if the document file 165 that serves as the source for the page image 25 displayed in the second display area 223 is changed. In other words, it is possible to register a page from a different document file 165 as a pinned page, even if that document file 165 is not the one that was originally pinned.

[0057] Figure 14 shows an example where the third display area 225 displays three pinned icons 31: the second thumbnail image bundle 33B-70, the second thumbnail image bundle 33B-100, and the second thumbnail image bundle 33D-30. In this case, the storage unit 160 stores the page images 25B-70 of page 70 of document file 165B, the page images 25B-100 of page 100 of document file 165B, and the first thumbnail image bundle 21B as pinned pages. The storage unit 160 also stores the page images 25D-30 of page 30 of document file 165D and the first thumbnail image bundle 21D as pinned pages.

[0058] Next, we will explain the screen transitions displayed on the display surface 135. When the list screen 20A is displayed on the display surface 135, if one of the document files 165 is selected, the display control unit 173 displays the browsing screen 20B for viewing the selected document file 165 on the display surface 135.

[0059] Next, when the viewing screen 20B is displayed on the display surface 135 and a pinning operation is received, the display control unit 173 stores the page image of the document file displayed in the second display area 223 of the viewing screen 20B in the storage unit 160. The display control unit 173 also stores the first thumbnail image bundle 21 displayed in the first display area 221 in the storage unit 160.

[0060] Next, when the display control unit 173 receives an operation on the back button 13, it returns from the browsing screen 20B to the list screen 20A. Then, when another document file 165 is selected, the display control unit 173 displays the browsing screen 20B for viewing the selected document file 165 on the display surface 135.

[0061] Furthermore, when the browsing screen 20B is displayed on the display surface 135, if one of the multiple second thumbnail image bundles 33 displayed in the third display area 225 is selected by touch, the display control unit 173 displays the pinning screen 20C. The display control unit 173 displays the first thumbnail image bundle 21 associated with the touched second thumbnail image bundle 33 in the first display area 221. The display control unit 173 also displays the page image 25 of the corresponding page of the document file 165 associated with the touched second thumbnail image bundle 33 in the second display area 223.

[0062] Furthermore, while the pinning screen 20C is displayed on the display surface 135, assume that another second thumbnail image bundle 33 displayed in the third display area 225 is selected by touch operation. In this case, the display control unit 173 displays the first thumbnail image bundle 21 associated with the other second thumbnail image bundle 33 that was touched in the first display area 221. The display control unit 173 also displays the page image 25 of the corresponding page of the document file 165 associated with the other second thumbnail image bundle 33 that was touched in the second display area 223.

[0063] Furthermore, when the pinned screen 20C is displayed on the display surface 135 and the back button 13 is pressed, the display control unit 173 displays the browsing screen 20B on the display surface 135. Specifically, it displays the browsing screen 20B that was displaying the page image 25 of the document file 165 that was displayed on the display surface 135 before the pinned screen 20C was displayed.

[0064] Furthermore, when the browsing screen 20B is displayed on the display surface 135, pressing the back button 13 will display the list screen 20A on the display surface 135. Furthermore, when the list screen 20A is displayed on the display surface 135, it is assumed that a different document file 165 from the document file 165 selected by the pinning operation is selected. In this case, the display control unit 173 displays the selected document file 165 on the browsing screen 20B.

[0065] Figures 15 and 16 are flowcharts showing the operation of the control unit 150. First, we will explain the operation of the display device 100 up to the point where the pin icon 31 is displayed on the browsing screen 20B, referring to the flowchart shown in Figure 15.

[0066] First, the control unit 150 determines whether or not it has received an operation to launch the application 163 (step S1). If the control unit 150 has not received an operation to launch the application 163 (step S1 / NO), it waits until it receives an operation to launch the application 163.

[0067] When the control unit 150 receives an operation to launch the application 163 (step S1 / YES), it displays a list screen 20A on the display surface 135 (step S2). The list screen 20A displays a combination of the first thumbnail image bundle 21 and the main thumbnail image 23 for each document file 165.

[0068] Next, the control unit 150 determines whether the first thumbnail image bundle 21 or the main thumbnail image 23 has been selected (step S3). If the first thumbnail image bundle 21 or the main thumbnail image 23 has not been selected (step S3 / NO), the control unit 150 waits until the first thumbnail image bundle 21 or the main thumbnail image 23 is selected.

[0069] When the first thumbnail image bundle 21 or the main thumbnail image 23 is selected (step S3 / YES), the control unit 150 displays the browsing screen 20B on the display surface 135 (step S4). The browsing screen 20B displays the first thumbnail image bundle 21 selected on the list screen 20A, and the page image 25 of the page corresponding to the selected first thumbnail image 211.

[0070] Next, the control unit 150 determines whether or not it has received an operation (step S5). If the control unit 150 has not received an operation (step S5 / NO), it waits until it receives an operation. If the control unit 150 has received an operation (step S5 / YES), it determines whether or not the received operation is an operation to display the menu icon group 27 (step S6).

[0071] If the control unit 150 determines that the received operation is not an operation to display the menu icon group 27 (step S6 / NO), it executes the processing corresponding to the received operation (step S9). For example, if the back button 13 is selected by touch operation, the control unit 150 displays the list screen 20A on the display surface 135. Also, if a slide operation is performed within the first display area 221, the control unit 150 moves the multiple first thumbnail images 211 in the direction corresponding to the operation direction of the slide operation by an amount of movement corresponding to the amount of operation. After that, the control unit 150 returns to the determination in step S5.

[0072] Furthermore, if the control unit 150 determines that the received operation is an operation to display the menu icon group 27 (step S6 / YES), it displays the menu icon group 27 on the browsing screen 20B (step S7).

[0073] Next, the control unit 150 determines whether the menu icon 271 associated with the pinning operation has been selected by touch operation (step S8). If the menu icon 271 associated with the pinning operation has not been selected by touch operation (step S8 / NO), the control unit 150 executes the process associated with the menu icon 271 selected by touch operation (step S9). For example, if the print menu icon 271 is selected, the control unit 150 instructs a printer driver (not shown) to generate print data based on the document file 165 displayed on the browsing screen 20B. After that, the control unit 150 returns to the determination in step S5.

[0074] Furthermore, the control unit 150 executes the pinning process when the menu icon 271 associated with the pinning operation is selected by touch operation (step S8 / YES). The control unit 150 stores the page image 25 of the document file 165 displayed in the second display area 223 and the first thumbnail image bundle 21 displayed in the first display area 221 as pinned pages in the storage unit 160 (step S10).

[0075] Next, the control unit 150 generates a second thumbnail image bundle 33 based on the first thumbnail image bundle 21 in the first display area 221 as a pinning process (step S11). The control unit 150 displays the generated second thumbnail image bundle as a pinning icon 31 in the third display area 225 (step S12).

[0076] Next, we will continue to explain the operation of the display device 100 with reference to the flowchart shown in Figure 16. Next, the control unit 150 determines whether or not it has received an operation (step S13). If the control unit 150 has not received an operation (step S13 / NO), it waits until it receives an operation.

[0077] When the control unit 150 receives an operation (step S13 / YES), it determines whether the received operation is a touch operation of the pinned icon 31 (step S14). If the received operation is a touch operation of the pinned icon 31 (step S14 / YES), the control unit 150 displays the pinned screen 20C on the display surface 135 (step S15). The control unit 150 displays the page image 25 associated with the touched pinned icon 31, i.e., the second thumbnail image bundle 33, in the second display area 223 (step S15). The control unit 150 also displays the first thumbnail image bundle 21 associated with the touched second thumbnail image bundle 33 in the second display area 223 (step S15). After that, the control unit 150 returns to the determination in step S13.

[0078] Furthermore, if the control unit 150 determines that the received operation is not a touch operation on the pin icon 31 (step S14 / NO), it determines whether the received operation is a touch operation on the back button 13 (step S16). If the control unit 150 determines that the received operation is a touch operation to the back button 13 (step S16 / YES), it determines whether the application screen 20 displayed on the display surface 135 is the browsing screen 20B (step S17).

[0079] If the application screen 20 displayed on the display surface 135 is a browsing screen 20B (step S17 / YES), the control unit 150 displays a list screen 20A on the display surface 135 (step S18). If the application screen 20 displayed on the display surface 135 is not a browsing screen 20B (step S17 / NO), the control unit 150 determines whether the application screen 20 displayed on the display surface 135 is a pinned screen 20C (step S19).

[0080] If the application screen 20 currently displayed on the display surface 135 is the pinned screen 20C (step S19 / YES), the control unit 150 displays the browsing screen 20B that was displayed before the pinned screen 20C was displayed (step S20). Furthermore, if the application screen 20 currently displayed on the display surface 135 is not the pinned screen 20C (step S19 / NO), the control unit 150 returns to the determination in step S13.

[0081] Furthermore, if the received operation is not a touch operation of the back button 13 (step S16 / NO), the control unit 150 determines whether the received operation is an exit operation to terminate the application 163 (step S21). If the received operation is not an exit operation to terminate the application 163 (step S21 / NO), the control unit 150 executes the processing corresponding to the received operation (step S22). For example, if the control unit 150 receives a slide operation, it changes the display on the display surface 135 in accordance with the received operation. Also, if the received operation is an exit operation to terminate the application 163 (step S21 / YES), the control unit 150 terminates this processing flow.

[0082] As explained above, the control unit 150 of the display device 100 performs the following processing. A viewing screen 20B displaying the document file 165 and a first thumbnail image bundle 21, which is a bundle of first thumbnail images 211 that are reduced versions of each page of the document file 165, are displayed on the display surface 135. Furthermore, the control unit 150 receives a pinning operation to pin a page from the document file 165 displayed on the display surface 135, and registers the page from the document file 165 selected by the pinning operation as a pinned page. The control unit 150 then displays each page of the document file 165 as a pinned icon 31 on the display surface 135, using a second thumbnail image bundle 33 which is smaller than the first thumbnail image bundle 21.

[0083] In this configuration, the pages of the document file 165 selected by the pinning operation are registered as pinned pages. Furthermore, each page of the document file 165 is displayed on the display surface 135 as a pinned icon 31 in a second thumbnail image bundle 33, which is smaller than the first thumbnail image bundle 21. Therefore, by selecting the pinned icon 31, the pages of the document file 165 selected by the pinning operation can be easily displayed on the display surface 135, improving user convenience.

[0084] The control unit 150 displays a list screen 20A on the display surface 135, which shows multiple sets of first thumbnail images 21 based on multiple document files 165. When a selection operation is received to select one of the multiple sets of first thumbnail images 21, the control unit 150 displays a browsing screen 20B on the display surface 135, which shows the selected set of first thumbnail images 21 and the document files 165 from which the first thumbnail image set 21 originates.

[0085] With this configuration, one first thumbnail image bundle 21 can be selected from multiple first thumbnail image bundles 21 displayed on the list screen 20A, and the document file 165 that is the source of the selected first thumbnail image bundle 21 can be displayed on the browsing screen 20B.

[0086] When the second thumbnail image bundle 33 is selected, the control unit 150 displays a pinned screen 20C on the display surface 135, which includes the page of the document file 165 registered as a pinned page and the first thumbnail image bundle 21 of the document file 165.

[0087] With this configuration, by selecting the second thumbnail image bundle 33, a viewing screen 20B including the pages of the document file 165 that were pinned by the pinning operation and the first thumbnail image bundle 21 generated based on the document file 165 can be displayed on the display surface 135.

[0088] When the control unit 150 receives a pinning operation to pin a page different from the page registered as a pinned page in document file 165, or a page in a different document file from the document file, it registers the different page from the document file, or a page in a different document file, as a pinned page. Furthermore, the control unit 150 displays a second thumbnail image bundle 33 on the pinning screen 20C, which is a smaller version of each page of the document file or a different document file than the first thumbnail image bundle 21, as a pinning icon 31. Also, when the second thumbnail image bundle 33 is selected, the control unit 150 displays the pages of the document file 165 or a different document file 165 that are the source of the selected second thumbnail image bundle 33 on the browsing screen 20B.

[0089] This configuration allows you to register different pages from document file 165 that are already registered as pinned pages, or pages from different document files 165, as pinned pages.

[0090] When the control unit 150 receives an operation to select the back button displayed on the display surface 135 while the pinned screen 20C is displayed on the display surface 135, it displays the browsing screen 20B that was displayed before the pinned screen 20C was displayed on the display surface 135.

[0091] With this configuration, the screen displayed on the display surface 135 can be switched back from the pinned screen 20C to the browsing screen 20B.

[0092] The second thumbnail image bundle 33 has multiple second thumbnail images placed on the first virtual axis Q, and the multiple second thumbnail images rotate around the second virtual axis M that intersects the first virtual axis Q, and then rotate again around the first virtual axis Q.

[0093] With this configuration, a bundle of images is formed by arranging multiple second thumbnail images in the direction of the first virtual axis Q, each second thumbnail image being positioned on the first virtual axis Q, rotated around a second virtual axis M that intersects the first virtual axis Q, and further rotated around the first virtual axis Q. This allows the bundle of second thumbnail images 33, which includes multiple second thumbnail images, to be displayed as an overhead view image.

[0094] Multiple second thumbnail images are moved along the first virtual axis Q in response to user actions.

[0095] With this configuration, the user can move multiple second thumbnail images along the first virtual axis Q.

[0096] When a document file 165 different from the document file 165 selected by the pinning operation is selected from the list screen 20A, the control unit 150 displays the selected document file 165 on the browsing screen 20B.

[0097] With this configuration, the selected document file 165 can be displayed and viewed on the viewing screen 20B.

[0098] The embodiments described above are preferred embodiments of the present invention. However, the invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the invention. For example, the functional units of the display device 100 shown in Figure 1 represent functional configurations, and the specific implementation form is not particularly limited. In other words, it is not necessarily required that hardware corresponding to each functional unit be implemented individually, and it is certainly possible to have a configuration in which a single processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other parts of the display device 100 can also be arbitrarily changed without departing from the spirit of the present invention.

[0099] Furthermore, the processing units in the flowcharts shown in Figures 15 and 16 are divided according to the main processing content in order to facilitate understanding of the processing of the display device 100. The present invention is not limited by the way the processing units are divided or the names of the processing units shown in the flowcharts of Figures 15 and 16. In addition, the processing of the control unit 150 can be further divided into more processing units depending on the processing content, or it can be divided so that one processing unit contains even more processing. Also, the processing order in the flowcharts above is not limited to the examples shown.

[0100] Furthermore, when the display method is implemented using the computer provided by the display device 100, and the computer provided by the display device 100, the program to be executed by these computers can be configured in the form of a recording medium. Alternatively, the program to be executed by these computers can be configured in the form of a transmission medium for transmitting it. Magnetic, optical, or semiconductor memory devices can be used as recording media. Specifically, portable or fixed recording media such as flexible disks, HDDs (Hard Disk Drives), CD-ROMs, DVDs (Digital Versatile Discs), Blu-ray Discs, magneto-optical disks, flash memory, and card-type recording media can be used. In addition, the above recording media may be non-volatile storage devices such as RAM, ROM, and HDDs, which are internal storage devices provided by server equipment. Blu-ray is a registered trademark. [Explanation of Symbols]

[0101] 1...Display device, 11...Home button, 13...Back button, 20...App screen, 20A...Menu screen, 20A...List screen, 20B...Browse screen, 20C...Pin screen, 21, 21A, 21B, 21C, 21D, 21N...First thumbnail image bundle, 23, 23A, 23B, 23C, 23N...Main thumbnail image, 25, 25B, 25D, 25N...Page image, 27...Menu icon group, 31...Pin icon, 33, 33B, 33D...Second thumbnail image bundle, 110...Wireless communication unit, 131...Touch panel, 150...Control unit, 160...Storage unit, 161...OS, 163...Application case 165...Document file, 165A, 165B, 165C, 165D, 165N...Document file, 170...Processor, 171...Thumbnail image bundle generation unit, 173...Display control unit, 211, 211B, 211N, 211-1, 211-2, 211-3, 211-4...First thumbnail image, 221...First display area, 221L...Left area, 221R...Right area, 223...Second display area, 225...Third display area, 231...Main thumbnail image, 271...Menu icon, KJ...Virtual axis, L1...Switching line, L2...Center line, M...Second virtual axis, Q...First virtual axis.

Claims

1. A viewing screen is displayed on the display surface, which includes a first reduced image bundle, which is a bundle of first reduced images obtained by reducing each page of the document file, and the document file itself. The system accepts a pinning operation to pin pages contained within the aforementioned document file, The page of the document file selected by the aforementioned pinning operation is registered as a pinned page, Each page of the document file is displayed on the display surface as an icon in a second reduced image bundle, which is smaller than the first reduced image bundle. Display methods, including those mentioned above.

2. Displaying a list screen containing multiple sets of first reduced images based on multiple document files on the display surface, When a selection operation is received to select one of the plurality of first reduced image bundles, the viewing screen including the first reduced image bundle selected by the selection operation and the document file from which the first reduced image bundle is derived is displayed on the display surface. The display method according to claim 1, including the method described in claim 1.

3. The operation to select the second reduced image bundle is accepted, Displaying a pinned screen on the display surface that shows the page of the document file registered as the pinned page and the first reduced image bundle generated based on the document file, A display method according to claim 1 or 2, including the method described in claim 1 or 2.

4. The system accepts pinning operations to pin a page different from the page registered as the pinned page in the aforementioned document file, or a page in a different document file from the aforementioned document file. Registering a different page of the aforementioned document file, or a page of the aforementioned different document file, as a pinned page, On the pinning screen, each page of the document file or the different document files is displayed as an icon in a second set of reduced images, which is smaller than the first set of reduced images. When the second reduced image bundle is selected, the pages of the document file or the different document file that are the source of the selected second reduced image bundle are displayed on the viewing screen. The display method according to claim 3, including the method described in claim 3.

5. With the aforementioned pin screen displayed, the system accepts the operation of selecting the back button displayed on the display surface, Displaying the browsing screen that was displayed before the pinning screen on the display surface, The display method according to claim 3 or 4, including the method described in claim 3 or 4.

6. The second reduced image bundle comprises a plurality of second reduced images included in the second reduced image bundle arranged on a first virtual axis. The plurality of second reduced images rotate around a second virtual axis that intersects the first virtual axis, and further rotate around the first virtual axis. The display method according to any one of claims 3 to 5.

7. The plurality of second reduced images are moved along the first virtual axis in response to user operations. The display method according to claim 6.

8. If a document file different from the document file selected by the aforementioned pinning operation is selected from the list screen, the selected document file will be displayed on the viewing screen. The display method according to claim 2.

9. Displaying a first reduced image bundle, which is a bundle of first reduced images obtained by reducing each page of a document file, and the document file itself on a display surface, The system accepts a pinning operation to pin pages contained within the aforementioned document file, The page selected by the pinning operation of the aforementioned document file is registered as a pinned page, A control unit that performs the following actions: displaying each page of the document file as an icon on the display surface, using a second set of reduced images that is smaller than the first set of reduced images; A display device equipped with the following features.

Images