Display device, display method, and program

Abstract

To prevent a user from feeling uncomfortable when viewing a document.SOLUTION: A smartphone 1 comprises a touch panel 12 and a display control unit 103 for displaying on the touch panel 12 a thumbnail image group having a plurality of thumbnail images corresponding to each page of a document indicated by document data. The display control unit 103 is capable of setting a display mode of the thumbnail image group to a first display mode in which the plurality of thumbnail images are arranged with the page numbers increasing to the right or a second display mode in which the plurality of thumbnail images are arranged with the page numbers increasing to the left.SELECTED DRAWING: Figure 1

Description

Technical Field

[0004] , ,

[0005] , ,

[0001] The present invention relates to a display device, a display method, and a program.

Background Art

[0002] Conventionally, a technique for displaying a plurality of thumbnail images corresponding to each page constituting a document has been known. For example, Patent Document 1 discloses a technique for arranging and displaying a plurality of thumbnail images in page number order from the right side to the left side of an image display unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the display where thumbnail images are arranged in page number order from the right side to the left side, the moving direction of the thumbnail images when the page is switched may not match the direction in which the user scrolls the page when actually viewing the document. For example, in the case of a right-opening document, the direction in which the page is scrolled when reading the document is from left to right, but in the display of Patent Document 1, the moving direction of the thumbnail images is from right to left. Therefore, in the display of Patent Document 1, the user may feel discomfort when viewing the document.

Means for Solving the Problems

[0005] One embodiment for solving the above problem is a display device comprising a display unit and a display control unit that causes the display unit to display a group of thumbnail images, each having multiple thumbnail images corresponding to a page in a document indicated by document data, wherein the display control unit can set the display mode of the group of thumbnail images to either a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction.

[0006] Another embodiment for solving the above problem is a display method by a display device, wherein the display mode of a group of thumbnail images, each having multiple thumbnail images corresponding to a page for each page of a document shown by document data, is set to either a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction, and the group of thumbnail images is displayed.

[0007] Another embodiment for solving the above problem is a program that causes the processor of a display device equipped with a display unit to function as a display control unit that causes the display unit to display a group of thumbnail images having multiple thumbnail images corresponding to each page of a document indicated by document data, and the display control unit can set the display mode of the group of thumbnail images to either a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction. [Brief explanation of the drawing]

[0008] [Figure 1] A diagram showing the configuration of the printing system. [Figure 2] A diagram showing an example of a list application UI. [Figure 3] A diagram showing an example of a selection app UI. [Figure 4] A figure showing an example of a group of thumbnail images in the first display mode. [Figure 5] A diagram showing an example of a group of thumbnail images in the second display mode. [Figure 6] An explanatory diagram illustrating the first direction of rotation. [Figure 7] An explanatory diagram illustrating the second direction of rotation. [Figure 8] This diagram shows an example of a selection app UI that displays a group of icons. [Figure 9] A diagram showing an example of a list application UI. [Figure 10] A diagram showing an example of a thumbnail image display area. [Figure 11] A diagram showing an example of a thumbnail image display area. [Figure 12] A flowchart illustrating the operation of the display control unit. [Modes for carrying out the invention]

[0009] Figure 1 shows the configuration of the printing system 1000. The printing system 1000 includes a smartphone 1, which is an operating terminal, and a printer 2. The smartphone 1 and printer 2 are connected to a network NW. The network NW may be a local network, or it may be a global network consisting of the internet, a dedicated circuit, a public circuit, etc. Smartphone 1 corresponds to an example of a display device.

[0010] In addition to smartphone 1, a notebook PC (Personal Computer), a desktop PC, and a tablet device may also be used as the operating terminal. Smartphone 1 has a display app 111 installed, which is an application program that displays images based on document data. Document data is data that represents a document consisting of multiple pages. Examples of document data formats include Word format and PDF (Portable Document Format). Display app 111 has the function of displaying page images PG, which are images of the pages that make up the document shown by the document data. Display app 111 also has the function of displaying thumbnail images SG corresponding to the pages that make up the document shown by the document data. Display app 111 also has the function of generating print data that corresponds to the command system of printer 2 connected to smartphone 1, or print data that corresponds to the command system of other printers not shown. Display app 111 also has the function of sending the generated print data to printer 2. Display application 111 corresponds to an example program.

[0011] Printer 2 is a device that prints images onto a printing medium. There are no restrictions on the type of printing medium, and examples include cut paper of a predetermined size, roll paper, and sheets made of synthetic resin. There are no restrictions on the printing method of Printer 2, and printing methods such as dot impact, dye sublimation, and thermal can be used. This embodiment exemplifies the case where the printing method of Printer 2 is inkjet.

[0012] Let's describe the configuration of smartphone 1. Smartphone 1 comprises a control unit 10, a communication unit 11, and a touch panel 12. The touch panel 12 corresponds to an example of a display unit.

[0013] The control unit 10 includes a processor 100 that executes programs such as a CPU (Central Processing Unit) or MPU (Micro-processing unit), and a storage unit 110, and controls each part of the smartphone 1. The processor 100 reads out the programs stored in the storage unit 110 and executes various processes by hardware and software. The processor 100 executes the display application 111 stored in the storage unit 110 and functions as an application execution unit 101.

[0014] The storage unit 110 is a memory that stores programs executed by the processor 100 and data processed by the processor 100. The storage unit 110 stores the display application 111 executed by the processor 100, various programs, and other various data. The storage unit 110 has a non-volatile storage area and a volatile storage area. The volatile storage area may constitute the work area of the processor 100.

[0015] The communication unit 11 is a communication interface that communicates according to a predetermined communication standard, and communicates with the printer 2 via the network NW under the control of the control unit 10. The communication unit 11 transmits the print data output by the display application 111 to the printer 2. The print data includes print conditions and print commands. The communication unit 11 receives document data from a server device or a client device (not shown) via the network NW.

[0016] The touch panel 12 includes a display panel such as a liquid crystal display panel and a touch sensor provided overlapping or integrally with the display panel. The display panel displays various images under the control of the control unit 10. The touch sensor detects a touch operation and outputs it to the control unit 10. The control unit 10 executes a process corresponding to the touch operation based on the input from the touch sensor.

[0017] The processor 100 functions as an application execution unit 101. The application execution unit 101 functions as a communication control unit 102, a display control unit 103, and a reception unit 104 as functional units. The communication control unit 102 corresponds to an example of a reception unit.

[0018] The communication control unit 102 communicates with devices connected to the network NW via the communication unit 11. The communication control unit 102 transmits print data to the printer 2 via the communication unit 11. The print data transmitted to the printer 2 includes image data of any page among the pages that make up the document indicated by the document data. The communication control unit 102 receives document data from information processing devices such as server devices and client devices (not shown) via the communication unit 11.

[0019] The display control unit 103 displays the user interface on the touch panel 12. The user interface displayed by the display control unit 103 is called the "app UI" and is denoted by the code "200". The display control unit 103 provides various information to the user by displaying the app UI 200 on the touch panel 12. The display control unit 103 changes the display content of the app UI 200 in response to various instructions from the user via the app UI 200.

[0020] The reception unit 104 receives various operations from the user via the application UI 200.

[0021] Refer to Figures 2-11 to explain the app UI200. In Figures 2-11, the upward direction is indicated by the symbol UP, the downward direction by the symbol DW, the leftward direction by the symbol L, and the rightward direction by the symbol R. These four directions—up, down, left, and right—represent the four directions when viewing the display surface 12A of the touch panel 12. The right side corresponds to an example of the first direction. The left side corresponds to an example of the second direction.

[0022] The display control unit 103 displays a list application UI 201, which displays document data in a list, on the touch panel 12. The list application UI 201 is included in the application UI 200. Figure 2 shows an example of a list application UI 201 displayed on the display surface 12A of the touch panel 12.

[0023] The list application UI201 displays the KM (Keywords) for each document, which is a combination of the thumbnail image group SSG and the first thumbnail image TMG. In the following explanation, the group of thumbnail images SSG for the nth document data will be represented as the nth thumbnail image group SSGn. The first thumbnail image TMG for the nth document data will be represented as the nth first thumbnail image TMGn. n is an integer greater than or equal to 1. Also, the thumbnail image SG corresponding to the mth page will be represented as the mth thumbnail image SGm. m corresponds to the page number and is an integer greater than or equal to 1. The leading thumbnail image (TMG) is an example of an enlarged thumbnail image.

[0024] A thumbnail image group SSG is a group of images in which multiple thumbnail images SG are arranged horizontally. Each thumbnail image SG included in the thumbnail image group SSG is displayed in a manner that provides an overhead view from a predetermined viewpoint. One thumbnail image SG included in the thumbnail image group SSG corresponds to one page of the document indicated by the corresponding document data. In this embodiment, the thumbnail image SG is a rectangular image. In the thumbnail image group SSG, adjacent thumbnail image SGs overlap to some extent. The degree of overlap between thumbnail image SGs increases from approximately the center to the left in the horizontal direction, and also increases from approximately the center to the right. In this embodiment, except in predetermined cases, a configuration in which all thumbnail image SGs partially overlap with adjacent thumbnail image SGs is illustrated, but some thumbnail image SGs may not partially overlap with adjacent thumbnail image SGs. The predetermined case is when the thumbnail image group SSG includes a thumbnail image viewed during switching. The thumbnail image viewed during switching will be described later.

[0025] The first thumbnail image TMG is the thumbnail image SG corresponding to the first page of the document data. The first page is the page with page number 1. The list application UI201 may display a portion of the thumbnail image SG of the first page as the first thumbnail image TMG, or it may display the entirety of the thumbnail image SG of the first page as the first thumbnail image TMG. The first thumbnail image TMG is an image of the thumbnail image SG of the first page that is enlarged more than the thumbnail image SG included in the thumbnail image group SSG.

[0026] The list application UI201 shown in Figure 2 displays KM1, which is a combination of the first thumbnail image group SSG1 and the first leading thumbnail image TMG1 corresponding to the first document data. Furthermore, the list application UI201 shown in Figure 2 displays KM2, which is a combination of the second thumbnail image group SSG2 and the second leading thumbnail image TMG2 corresponding to the second document data. The combination KM2, which is a combination of the second thumbnail image group SSG2 and the second leading thumbnail image TMG2, is displayed below the combination KM1, which is a combination of the first thumbnail image group SSG1 and the first leading thumbnail image TMG1. Furthermore, the list application UI201 shown in Figure 2 displays KM3, which is a combination of the third thumbnail image group SSG3 and the third leading thumbnail image TMG3, corresponding to the third document data. The combination KM3 of the third thumbnail image group SSG3 and the third leading thumbnail image TMG3 is displayed below the combination KM2 of the second thumbnail image group SSG2 and the second leading thumbnail image TMG2.

[0027] In the list app UI201, the display positions of the thumbnail image group SSG and the leading thumbnail image TMG differ depending on whether the display mode of the thumbnail image group SSG is set to the first display mode or the second display mode. The first and second display modes will be described later. In the list app UI201, the thumbnail image group SSG set to the first display mode is displayed on the right, and the leading thumbnail image TMG that corresponds to this thumbnail image group SSG is displayed on the left. Also, in the list app UI201, the thumbnail image group SSG set to the second display mode is displayed on the left, and the leading thumbnail image TMG that corresponds to this thumbnail image group SSG is displayed on the right.

[0028] Figure 2 illustrates the case where the display mode of the first thumbnail image group SSG1 is set to the second display mode, and the display modes of the second thumbnail image group SSG2 and the third thumbnail image group SSG3 are set to the first display mode. Therefore, in the list application UI 201 shown in Figure 2, the first thumbnail image group SSG1 is displayed on the left, and the first leading thumbnail image TMG1 is displayed on the right. Also, in the list application UI 201 shown in Figure 2, the second thumbnail image group SSG2 is displayed on the right, and the second leading thumbnail image TMG2 is displayed on the left. Furthermore, in the list application UI 201 shown in Figure 2, the third thumbnail image group SSG3 is displayed on the right, and the third leading thumbnail image TMG3 is displayed on the left.

[0029] In the list application UI201, the display position of the document information BJ for the document corresponding to the thumbnail image group SSG differs depending on whether the display mode of the thumbnail image group SSG is set to the first display mode or the second display mode. The document information BJ is, for example, the name of the document indicated by the document data. In the list application UI201, the document information BJ for the document corresponding to the thumbnail image group SSG is displayed in the lower left corner of the thumbnail image group SSG set to the first display mode. Also, in the list application UI201, the document information BJ for the document corresponding to the thumbnail image group SSG is displayed in the lower right corner of the thumbnail image group SSG set to the second display mode.

[0030] In the list application UI201 shown in Figure 2, the document information BJ1 corresponding to the first thumbnail image group SSG1 is displayed in the lower right corner of the first thumbnail image group SSG1. Similarly, in the list application UI201 shown in Figure 2, the document information BJ2 corresponding to the second thumbnail image group SSG2 is displayed in the lower left corner of the second thumbnail image group SSG2. Furthermore, in the list application UI201 shown in Figure 2, the document information BJ3 corresponding to the third thumbnail image group SSG3 is displayed in the lower left corner of the third thumbnail image group SSG3.

[0031] In the list application UI201, when the reception unit 104 receives a predetermined touch operation in the combination display area HA1 that displays one combination KM, the display position of the thumbnail image SG displayed in the combination display area HA1 changes. A predetermined touch operation is a slide operation, which is a touch operation in which an object is moved while in contact with the touch panel 12. When the reception unit 104 receives a slide operation to the right, the display control unit 103 moves the thumbnail image SG to the right one by one from left to right within the combination display area HA1 according to the amount the object is slid to the right. When the reception unit 104 receives a slide operation to the left, the display control unit 103 moves the thumbnail image SG to the left one by one from right to left within the combination display area HA1 according to the amount the object is slid to the left.

[0032] The list application UI201 allows users to select combination KMs via touch operation. When a combination KM is selected in the list application UI201, the display control unit 103 displays the selection application UI202 for the document corresponding to the selected combination KM. The selection application UI202 is included in the application UI200.

[0033] Figure 3 shows an example of the selection application UI202. The selected application UI202 has a page image display area HA2 and a thumbnail image group display area HA3.

[0034] The page image display area HA2 is the area that displays the page image PG. The page image PG can be a PDF image or a thumbnail. The page image display area HA2 displays the page image PG corresponding to the thumbnail image SG that overlaps with the center line L1 in the thumbnail image group display area HA3. Furthermore, if one thumbnail image SG is selected in the thumbnail image group display area HA3, the page image display area HA2 displays the page image PG corresponding to the selected thumbnail image SG. Note that the center line L1 is a virtual line that indicates the horizontal center of the thumbnail image group display area HA3 and extends vertically.

[0035] The thumbnail image group display area HA3 is the area that displays the thumbnail image group SSG of the combination KM selected in the list application UI201. For example, if combination KM1 is selected in the list application UI201, the thumbnail image group display area HA3 will display the first thumbnail image group SSG1. Figure 3 shows an example of the thumbnail image group SSG in the first display mode.

[0036] In the thumbnail image group display area HA3, when the reception unit 104 receives a predetermined touch operation, the display position of the thumbnail image SG to be displayed changes. A predetermined touch operation is a slide operation. When the reception unit 104 receives a slide operation to the right, the display control unit 103 moves the thumbnail images SG one by one to the right from left to right within the thumbnail image group display area HA3 according to the amount the indicator is slid to the right. When the reception unit 104 receives a slide operation to the left, the display control unit 103 moves the thumbnail images SG one by one to the left from right to left within the thumbnail image group display area HA3 according to the amount the indicator is slid to the left.

[0037] In the selected application UI202, the display mode of the thumbnail image group SSG displayed in the thumbnail image group display area HA3 can be set to either the first display mode or the second display mode.

[0038] Here, we will explain the first and second display modes. Figure 4 shows an example of a thumbnail image group SSG in the first display mode. The thumbnail image group SSG shown in Figure 4 is an example of a thumbnail image group SSG displayed in the thumbnail image group display area HA3. Figure 5 shows an example of a thumbnail image group SSG in the second display mode. The thumbnail image group SSG shown in Figure 5 is an example of a thumbnail image group SSG displayed in the thumbnail image group display area HA3.

[0039] As shown in Figures 4 and 5, in the thumbnail image group display area HA3, the thumbnail image group SSG is displayed in a line along a virtual line KL that runs parallel to the left and right. The direction in which the virtual line KL extends is left and right, which is the direction in which the thumbnail images SG are arranged. The virtual line KL is set at the bottom of the thumbnail image group display area HA3. In addition, in each of the combination display areas HA1 of the list application UI201, a virtual line similar to the virtual line KL set in the thumbnail image group display area HA3 is set, and in the combination display area HA1, the thumbnail images SG are arranged along this virtual line.

[0040] The first display mode is one in which multiple thumbnail images SG are arranged so that the page numbers increase sequentially from right to left. That is, the first display mode is one in which multiple thumbnail images SG are arranged so that the page numbers increase sequentially from left to right. Furthermore, the first display mode is one in which all thumbnail images SG are rotated in the first rotation direction, except in predetermined cases.

[0041] The second display mode is one in which multiple thumbnail images SG are arranged so that the page numbers increase sequentially from left to right. In other words, the second display mode is one in which multiple thumbnail images SG are arranged so that the page numbers increase sequentially from right to left. Furthermore, in the second display mode, except in specified cases, all thumbnail images SG are rotated in the second rotation direction.

[0042] The first and second rotation directions will be explained with reference to Figures 6 and 7. Figure 6 is an explanatory diagram illustrating the first direction of rotation. Figure 7 is an explanatory diagram illustrating the second direction of rotation.

[0043] As shown in Figures 6 and 7, each thumbnail image SG is displayed in the application UI 200 as an image viewed from a predetermined viewpoint within the virtual space, showing the thumbnail image SG positioned within the virtual space. The virtual space includes a virtual horizontal plane KHM and a virtual axis KJ perpendicular to the virtual horizontal plane KHM. The direction in which the virtual axis KJ extends corresponds to the vertical direction. A reference line KJL is set on the virtual horizontal plane KHM. The direction in which the reference line KJL extends corresponds to the horizontal direction, and also to the direction in which the virtual line KL extends.

[0044] The display control unit 103 rotates each of the thumbnail images SG by a predetermined rotation angle with respect to the reference line KJL and the virtual axis KJ as the rotation axis. Each of the thumbnail images SG is displayed in a manner that is tilted diagonally with respect to the reference line KJL.

[0045] In Figure 6, the string "-M1" is appended to the thumbnail image SG rotated in the first rotation direction. In Figure 7, the string "-M2" is appended to the thumbnail image SG rotated in the second rotation direction. In addition, in Figures 6 and 7, the string "-MN" is appended to the thumbnail image SG that has not been rotated in either the first or second rotation direction.

[0046] The thumbnail image SG-MN is an image in virtual space where the top edge JH and bottom edge KH are parallel to the reference line KJL. In this embodiment, when the top edge JH and bottom edge KH in virtual space are parallel to the reference line KJL, the surface normal MH of the thumbnail image SG is oriented in the same direction as the surface normal of the display surface 12A of the touch panel 12. Therefore, the surface normal MH of the thumbnail images SG-M1 and SG-M2 are oriented differently from the surface normal of the display surface 12A of the touch panel 12.

[0047] As shown in Figure 6, thumbnail image SG-M1 is a thumbnail image SG rotated in the virtual space within the range of 0°>α>-90°, where the reference line KJL is 0° and the direction indicated by arrow Y1 is the negative direction. The surface normal MH of the image plane of thumbnail image SG-M1 points to the left in the direction in which the reference line KJL extends in the virtual space. The first rotation direction is the direction indicated by arrow Y1 in the virtual space.

[0048] As shown in Figure 7, thumbnail image SG-M2 is a thumbnail image SG rotated in the virtual space within the range of 0° < β < 90°, where the reference line KJL is 0° and the direction indicated by arrow Y2 is the positive direction. The surface normal MH of the image plane of thumbnail image SG-M2 points to the right in the direction in which the reference line KJL extends in the virtual space. The second rotation direction is the direction indicated by arrow Y2 in the virtual space.

[0049] Returning to the description of the thumbnail image display area HA3, as shown in Figures 4 and 5, the thumbnail image display area HA3 has a right area HA3-R and a left area HA3-L. The right area HA3-R and the left area HA3-L are aligned horizontally with the center line L1 in between.

[0050] Referring to Figure 4, when the display mode of the thumbnail image group SSG is the first display mode, the rotation angle of the thumbnail image SG becomes larger the further to the left it is from the thumbnail image SG superimposed on the center line L1. In other words, when the display mode of the thumbnail image group SSG is the first display mode, the rotation angle of the thumbnail image SG becomes larger the further the page number is from the page corresponding to the thumbnail image SG superimposed on the center line L1. Furthermore, when the display mode of the thumbnail image group SSG is the first display mode, the rotation angle of the thumbnail image SG becomes a larger negative value the further to the right it is from the thumbnail image SG superimposed on the center line L1. In other words, when the display mode of the thumbnail image group SSG is the first display mode, the rotation angle of the thumbnail image SG becomes a larger negative value the greater the page number is from the page corresponding to the thumbnail image SG superimposed on the center line L1.

[0051] Referring to Figure 5, when the display mode of the thumbnail image group SSG is the second display mode, the rotation angle of the thumbnail image SG becomes a larger positive value the further to the left it is from the thumbnail image SG superimposed on the center line L1. In other words, when the display mode of the thumbnail image group SSG is the second display mode, the rotation angle of the thumbnail image SG becomes a larger positive value the greater the page number is from the page corresponding to the thumbnail image SG superimposed on the center line L1. Furthermore, when the display mode of the thumbnail image group SSG is the second display mode, the rotation angle of the thumbnail image SG becomes a larger positive value the further to the right it is from the thumbnail image SG superimposed on the center line L1. In other words, when the display mode of the thumbnail image group SSG is the second display mode, the rotation angle of the thumbnail image SG becomes a larger positive value the smaller the page number is from the page corresponding to the thumbnail image SG superimposed on the center line L1.

[0052] Returning to the description of the selection application UI 202, when the reception unit 104 receives a predetermined operation in the selection application UI 202, the display control unit 103 displays an icon group ICG, which includes a setting icon SIC for setting the display mode of the thumbnail image group SSG, in the selection application UI 202. Examples of predetermined operations include selecting an icon to display in the icon group ICG.

[0053] Figure 8 shows an example of a selection application UI202 that displays a group of icons (ICG). Figure 8 illustrates a case where the icon group ICG is displayed approximately in the vertical center of the selected application UI202, but the display position of the icon group ICG is not limited to approximately in the vertical center.

[0054] The icon group ICG includes multiple icon ICs, including the setting icon SIG. Besides the setting icon SIC, the multiple icon ICs included in the icon group ICG also include, for example, an icon for instructing printing.

[0055] When the thumbnail image group SSG displayed by the thumbnail image group display area HA3 is in the first display mode, and the reception unit 104 receives an operation to the setting icon SIC, the display control unit 103 changes the display mode of the thumbnail image group SSG displayed by the thumbnail image group display area HA3 from the first display mode to the second display mode. Furthermore, when the display mode of the thumbnail image group SSG displayed by the thumbnail image group display area HA3 is the second display mode, and the reception unit 104 receives an operation to the setting icon SIC, the display control unit 103 changes the display mode of the thumbnail image group SSG displayed by the thumbnail image group display area HA3 from the second display mode to the first display mode.

[0056] Returning to the description of the selected app UI 202, when the reception unit 104 receives a predetermined operation in the selected app UI 202, the display control unit 103 returns the app UI 200 to be displayed on the touch panel 12 from the selected app UI 202 to the list app UI 201. Examples of predetermined operations include operating on the icon to return to the list app UI 201, or touch operations to return to the list app UI 201.

[0057] Figure 9 shows an example of the list application UI201. The list application UI201 shown in Figure 9 represents the list application UI201 when the display mode of the second thumbnail image group SSG2 shown in Figure 2 is changed from the first display mode to the second display mode.

[0058] When returning to the list app UI201 from the selection app UI202, the display mode of the thumbnail image group SSG displayed by the selection app UI202 that was most recently displayed is reflected in the corresponding thumbnail image group SSG. As described above, the list app UI201 shown in Figure 9 shows the list app UI201 in which the display mode of the second thumbnail image group SSG2 shown in Figure 2 has been changed from the first display mode to the second display mode. In other words, Figure 9 shows that when returning to the list app UI201 from the selection app UI202 displaying the second thumbnail image group SSG2, the display mode of the second thumbnail image group SSG2 displayed by the selection app UI202 was the second display mode.

[0059] The list application UI201 shown in Figure 9 displays a group of thumbnail images SSG, including the thumbnail image viewed during the switch. The thumbnail image viewed during the switch is the thumbnail image SG corresponding to the page image PG that the page image display area HA2 was displaying when switching the display from the selection application UI202 to the list application UI201.

[0060] Figure 9 shows the first thumbnail image SG1 of the second thumbnail image group SSG2 as an example of a thumbnail image viewed during switching. As shown in Figure 9, in the second thumbnail image group SSG2, the first thumbnail image SG1 has a different rotation direction compared to the other thumbnail images SG. That is, in the second thumbnail image group SSG2 shown in Figure 9, the first thumbnail image SG1 is open to the second thumbnail image SG2.

[0061] In the app UI200, the thumbnail image viewed during switching and the thumbnail image SG of a page with a smaller page number than the page corresponding to the thumbnail image viewed during switching are rotated in the opposite direction to the rotation direction corresponding to the display mode set in the thumbnail image group SSG. More specifically, if the thumbnail image group SSG in the first display mode includes a thumbnail image viewed during switching, then in this thumbnail image group SSG, the thumbnail image viewed during switching and the thumbnail image SG of a page with a smaller page number than the page corresponding to the thumbnail image viewed during switching are rotated in the second rotation direction. Furthermore, if the thumbnail image group SSG in the first display mode includes a thumbnail image viewed during switching, then in this thumbnail image group SSG, the thumbnail image SG of a page with a larger page number than the page corresponding to the thumbnail image viewed during switching are rotated in the first rotation direction. If the thumbnail image group SSG in the second display mode includes a thumbnail image viewed during switching, then in this thumbnail image group SSG, the thumbnail image viewed during switching and the thumbnail image SG of a page with a smaller page number than the page corresponding to the thumbnail image viewed during switching will be rotated in the first rotation direction. Furthermore, if the thumbnail image group SSG in the second display mode includes a thumbnail image viewed during switching, then in this thumbnail image group SSG, the thumbnail image SG of a page with a larger page number than the page corresponding to the thumbnail image viewed during switching will be rotated in the second rotation direction.

[0062] As described above, when a combination KM is selected in the list application UI201, the display control unit 103 displays the selection application UI202 on the touch panel 12, which displays the thumbnail image group SSG of the selected combination KM. When a combination KM including a thumbnail image to be viewed during switching, as shown in Figure 9, is selected, the display control unit 103 displays a group of thumbnail images SSG in the selected application UI 202 that reflects the state in which the thumbnail image to be viewed during switching is open.

[0063] Figures 10 and 11 show an example of the thumbnail image group display area HA3.

[0064] The thumbnail image group display area HA3 shown in Figure 10 includes the thumbnail image viewed during switching and displays the thumbnail image group SSG in the first display mode. That is, in Figure 10, the 11th thumbnail image SG11 is the thumbnail image viewed during switching.

[0065] In the thumbnail image group display area HA3, if the thumbnail image group SSG is in the first display mode and includes a thumbnail image viewed at the time of switching, the thumbnail image SG corresponding to the page before the thumbnail image viewed at the time of switching is displayed in a state rotated in the first rotation direction. On the other hand, in the thumbnail image group display area HA3, in this case, the thumbnail image viewed at the time of switching and the thumbnail image SG corresponding to pages after the page corresponding to the thumbnail image viewed at the time of switching are displayed in a state rotated in the second rotation direction.

[0066] The thumbnail image group display area HA3 shown in Figure 11 includes the thumbnail image viewed during switching and displays the thumbnail image group SSG in the first display mode. That is, in Figure 11, the 11th thumbnail image SG11 is the thumbnail image viewed during switching.

[0067] In the thumbnail image group display area HA3, if the thumbnail image group SSG is in the second display mode and includes a thumbnail image viewed at the time of switching, the thumbnail image SG corresponding to the page after the thumbnail image at the time of switching is displayed in a state rotated in the first rotation direction. On the other hand, in the thumbnail image group display area HA3, in this case, the thumbnail image SG corresponding to the page before the page corresponding to the thumbnail image at the time of switching and the thumbnail image viewed at the time of switching is displayed in a state rotated in the second rotation direction.

[0068] Next, the operation of the display control unit 103 will be described. Figure 12 is a flowchart showing the operation of the display control unit 103.

[0069] The display control unit 103 determines whether or not to display the list application UI 201 (step S1). If the display application 111 is launched, the display control unit 103 makes a positive determination in step S1.

[0070] If the display control unit 103 determines that it is appropriate to display the list application UI 201 (step S1), it displays the list application UI 201 (step S2).

[0071] Next, the display control unit 103 determines whether or not combination KM has been selected in the list application UI 201 (step S3).

[0072] If the display control unit 103 determines that no combination KM has been selected (step S3: NO), it returns to step S2.

[0073] On the other hand, if the display control unit 103 determines that one combination KM has been selected (step S3: YES), it displays the selection application UI 202 corresponding to the selected combination KM (step S4).

[0074] The display control unit 103 determines whether or not the setting icon SIC has been operated in the selected application UI 202 (step S5).

[0075] If the display control unit 103 determines that the setting icon SIC has not been operated in the selected application UI 202 (step S5: NO), it performs the process in step S7.

[0076] On the other hand, if the display control unit 103 determines that the setting icon SIC has been operated in the selected application UI 202 (step S5: YES), it switches the display mode of the thumbnail image group SSG displayed in the thumbnail image group display area HA3 (step S6).

[0077] Next, the display control unit 103 determines whether or not to return to the list application UI 201 (step S7). If the display control unit 103 determines not to return to the list application UI 201 (step S7: NO), it returns to step S5 and performs the process of step S5 again.

[0078] On the other hand, if the display control unit 103 determines that it is time to return to the list application UI 201 (step S6: YES), it displays the list application UI 201 (step S7).

[0079] Next, the display control unit 103 determines whether or not to terminate the display of the list application UI 201 (step S8). If the display control unit 103 determines that it does not terminate the display of the list application UI 201 (step S8: NO), it returns to step S3 and performs the determination in step S3 again.

[0080] On the other hand, if the display control unit 103 determines that it is time to end the display of the list application UI 201 (step S8: YES), it ends the display of the application UI 200 (step S9).

[0081] [2. Second Embodiment] Next, a second embodiment will be described. In the first embodiment, the display mode of the thumbnail image group SSG is set for each thumbnail image group SSG according to the user's settings operation. In the second embodiment, the display mode of the thumbnail image group SSG is automatically set to either the first display mode or the second display mode.

[0082] The display control unit 103 sets the display mode of the thumbnail image group SSG to either the first display mode or the second display mode depending on whether the document indicated by the document data is a right-to-left or left-to-right document. Specifically, if the document indicated by the document data is a right-to-left document, the display control unit 103 sets the display mode of the thumbnail image group SSG corresponding to the right-to-left document to the second display mode. If the document indicated by the document data is a left-to-left document, the display control unit 103 sets the display mode of the thumbnail image group SSG corresponding to the left-to-left document to the first display mode. A right-to-left document is one in which the pages are turned from left to right. Examples include Japanese novels written vertically, and documents written in Arabic.

[0083] The display control unit 103 determines whether the document data to be processed is a right-to-left or left-to-right document using, for example, the following method. The method for determining whether a document is right-to-left or left-to-right will be described below.

[0084] The document data includes additional information indicating whether it is a right-to-left or left-to-right document. The display control unit 103 refers to this additional information in the document data to determine whether the document shown in the document data is a right-to-left or left-to-right document. This additional information may be originally attached to the document data. Alternatively, this additional information may be attached by the information processing device that sent the document data to the smartphone 1. For example, if the information processing device has a printer driver installed, and the printer driver sends the document data to the smartphone 1, the printer driver may attach the additional information to the document data. In this example, the communication control unit 102 receives the document data with the attached information from the information processing device with the printer driver installed. The display control unit 103 then sets the display mode of the thumbnail image group SSG corresponding to the received document data based on the additional information attached to the document data received by the communication control unit 102.

[0085] [3. Third Embodiment] Next, a third embodiment will be described. In the third embodiment, the display mode of the thumbnail image group SSG is set to either the first display mode or the second display mode depending on the language in which the document data is used.

[0086] The display control unit 103 identifies the language used in the document data being processed by character recognition of the characters written in the document. Once the language is identified, the display control unit 103 refers to a database in which the display modes of the thumbnail image group SSG are defined for that language, and sets the display mode of the thumbnail image group SSG to the display mode corresponding to the identified language. This database may be stored on the smartphone 1, or on a device that can communicate with the smartphone 1.

[0087] [4. Fourth Embodiment] Next, a fourth embodiment will be described. In the fourth embodiment, the display mode of the thumbnail image group SSG is set to either the first display mode or the second display mode depending on the region where the user of the smartphone 1 resides.

[0088] Smartphone 1 has the region where the user of Smartphone 1 resides pre-registered as data. The display control unit 103 refers to a database that defines the region and the display mode of the thumbnail image group SSG, and sets the display mode of the thumbnail image group SSG to the display mode corresponding to the region where the user of Smartphone 1 resides. This database may be stored in Smartphone 1, or in a device that can communicate with Smartphone 1.

[0089] [5. Fifth Embodiment] Next, a fifth embodiment will be described. In the fifth embodiment, for documents published only as ebooks, the display mode of the thumbnail image group SSG is automatically set to either the first display mode or the second display mode.

[0090] The display control unit 103 determines whether the document indicated by the document data to be processed is a document published only as an e-book. In this determination, the display control unit 103 communicates with a predetermined server device, for example, and receives information on whether the document indicated by the document data to be processed is a document published only as an e-book. If the document indicated by the document data to be processed is a document published only as an e-book, the display control unit 103 sets the display mode of the thumbnail image group SSG to either the first display mode or the second display mode.

[0091] [6. Other Embodiments] Each of the embodiments described above represents one aspect and can be arbitrarily modified and applied.

[0092] Printer 2 may have functions other than printing, such as scanning or facsimile functions.

[0093] The display device is not limited to a smartphone. The display device may also be a PC, such as a tablet PC, desktop PC, or laptop PC.

[0094] The display unit is not limited to the touch panel 12. The display unit can be any display composed of LEDs (Light Emitting Diodes) or OLEDs (Organic Light Emitting Diodes), etc. In this case, the configuration that receives user input is hardware such as operation switches, a mouse, or a keyboard, and the reception unit 104 receives various user inputs via this hardware.

[0095] The functions of the control unit 10 may be implemented by multiple processors or semiconductor chips.

[0096] The parts shown in Figure 1 are examples and are not particularly limited. It is not necessarily required that each part be individually equipped with corresponding hardware; it is certainly possible to configure a system where a single processor executes programs to realize the functions of each part. Some functions implemented in software may also be implemented in hardware, and vice versa. Furthermore, the specific details of the configuration of other parts of smartphone 1 can be arbitrarily changed.

[0097] The operation steps shown in Figure 12 are divided according to the main processing content to facilitate understanding of the operation of the display control unit 103, and are not limited by the way the processing units are divided or their names. Depending on the processing content, it may be further divided into more steps. It may also be divided so that one step unit contains even more processing. Furthermore, the order of the steps may be changed as appropriate.

[0098] [7. Configurations supported by the above embodiments] The above embodiment supports the following configuration:

[0099] (Composition 1) A display device comprising: a display unit; and a display control unit that causes the display unit to display a group of thumbnail images, each having multiple thumbnail images corresponding to a page of a document indicated by document data, wherein the display control unit can set the display mode of the group of thumbnail images to either a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction. According to the display device of Configuration 1, the display mode of the thumbnail image group can be set to either a first display mode or a second display mode. This allows the direction in which the thumbnail images move when a page is switched to match the direction in which the user actually turns pages when viewing a document. Therefore, it is possible to suppress the user from feeling any discomfort while viewing a document.

[0100] (Configuration 2) The display device according to configuration 1, wherein the first display mode is a mode in which the thumbnail images are rotated in a first rotational direction with respect to a virtual axis orthogonal to the arrangement direction of the thumbnail images as the axis of rotation, and the second display mode is a mode in which the thumbnail images are rotated in a second rotational direction different from the first rotational direction with respect to the virtual axis as the axis of rotation. According to the display device of configuration 2, since the rotation direction of the thumbnail images differs between the first display mode and the second display mode, it is possible to suppress the display area for displaying the thumbnail image group from becoming too wide, and the user can easily grasp the document that the thumbnail image represents.

[0101] (Composition 3) The display device according to configuration 1 or configuration 2, wherein adjacent thumbnail images in the group of thumbnail images partially overlap. According to the display device of configuration 3, since parts of adjacent thumbnail images overlap, the display area for displaying the thumbnail image group can be further suppressed from becoming too wide, and the user can easily grasp the document that the thumbnail image represents.

[0102] (Composition 4) The display control unit is capable of displaying an enlarged thumbnail image obtained by enlarging the thumbnail image corresponding to the first page and the group of thumbnail images side by side, and when the display mode of the group of thumbnail images is set to the first display mode, the group of thumbnail images is displayed in the second direction from the enlarged thumbnail image and the document information of the document indicated by the document data is displayed in the corner of the enlarged thumbnail image in the second direction, and when the display mode of the group of thumbnail images is set to the second display mode, the group of thumbnail images is displayed in the second direction from the enlarged thumbnail image and the document information of the document indicated by the document data is displayed in the corner of the enlarged thumbnail image in the first direction, as described in any one of configurations 1 to 3. According to the display device of configuration 4, by displaying a group of thumbnail images and a group of enlarged thumbnail images side by side, users can easily understand what kind of document the group of thumbnail images represents. Furthermore, since the document information can be displayed in a position that does not overlap the thumbnail images as much as possible, users can understand what kind of document the group of thumbnail images represents even more easily.

[0103] (Composition 5) A display device according to any one of configurations 1 to 4, comprising a receiving unit for receiving an operation to set the display mode of the thumbnail image group, wherein the display control unit sets the display mode of the thumbnail image group to the first display mode when the receiving unit receives an operation to set to the first display mode, and sets the display mode of the thumbnail image group to the second display mode when the receiving unit receives an operation to set to the second display mode. According to the display device of configuration 5, the user can set the display mode corresponding to the desired document to their preferred display mode, thereby further reducing the likelihood of the user experiencing discomfort while viewing documents.

[0104] (Composition 6) The display device according to any one of configurations 1 to 4, wherein the first direction is to the left when the display surface of the display unit is viewed, the second direction is to the right when the display surface is viewed, and the display control unit sets the display mode of the thumbnail image group to the first display mode when the document indicated by the document data is a left-opening document, and sets the display mode of the thumbnail image group to the second display mode when the document indicated by the document data is a right-opening document. According to the display device of configuration 6, the display mode of the thumbnail image group can be automatically set to the appropriate display mode depending on whether the document is a right-to-left or left-to-right document. Therefore, it is possible to suppress the user from feeling uncomfortable when viewing documents and to improve user convenience.

[0105] (Composition 7) The display device according to configuration 6, comprising a receiving unit that receives the document data transmitted from an information processing device by a printer driver, wherein the document data received by the receiving unit is accompanied by additional information indicating whether the document shown in the document data is a right-opening document or a left-opening document, and the display control unit sets the display mode of the thumbnail image group to the first display mode or the second display mode based on the additional information accompanied by the document data. According to the display device of configuration 7, the thumbnail image corresponding to the document data output from the printer driver can be automatically set to an appropriate display mode.

[0106] (Composition 8) A display device according to any one of configurations 1 to 4, wherein the display mode of the thumbnail image group is set to the first display mode or the second display mode according to at least one of the following: the language used in the document indicated by the document data, the region in which the user of the display device resides, and the fact that the document indicated by the document data is an ebook. The display device of configuration 8 can automatically set the display mode of the thumbnail image group to an appropriate display mode according to at least one of the following: the language used in the document shown by the document data, the region where the user of the display device resides, and whether the document shown by the document data is an e-book. Therefore, it is possible to suppress the user from feeling uncomfortable while viewing the document and to improve user convenience.

[0107] (Composition 9) A display method using a display device, wherein the display mode of a group of thumbnail images, each having multiple thumbnail images corresponding to a page of a document shown by document data, is set to either a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction, and the group of thumbnail images is displayed. The display method of configuration 9 produces the same effect as the display device of configuration 1.

[0108] (Composition 10) A program that causes the processor of a display device equipped with a display unit to function as a display control unit that displays a group of thumbnail images on the display unit, each having multiple thumbnail images corresponding to a page of a document indicated by document data, and the display control unit can set the display mode of the group of thumbnail images to either a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction. According to the program of configuration 10, it produces the same effect as the display device of configuration 1. [Explanation of Symbols]

[0109] 1...Smartphone (display device). 2...Printer, 10...Control unit, 11...Communication unit, 12...Touch panel, 100...Processor, 101...Application execution unit, 102...Communication control unit (receiving unit), 103...Display control unit, 104...Reception unit, 110...Storage unit, 1000...Printing system, BJ, BJ1, BJ2, BJ3...Document information, KJ...Virtual axis, NW...Network, SG...Thumbnail image, SSG...Thumbnail image group.

Claims

1. Display unit and The system includes a display control unit that causes the display unit to display a group of thumbnail images, each having multiple thumbnail images corresponding to a page in the document data, The display control unit, The display mode of the thumbnail image group can be set to a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or to a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction. The first direction is to the left when viewing the display surface of the display unit. The second direction is to the right when the display surface is being viewed. The display control unit, If the document data indicates a document that opens from left to right, the display mode of the thumbnail image group is set to the first display mode. If the document data indicates a document that opens from right to left, the display mode of the thumbnail image group is set to the second display mode. The printer driver includes a receiving unit that receives the document data transmitted from the information processing device, The document data received by the receiving unit includes additional information indicating whether the document indicated by the document data is a right-to-left or left-to-right document. The display control unit sets the display mode of the thumbnail image group to the first display mode or the second display mode based on the additional information added to the document data. Display device.

2. The first display mode is a mode in which the thumbnail image is rotated in a first rotational direction with a virtual axis orthogonal to the arrangement direction of the thumbnail images as the axis of rotation, The second display mode is a mode in which the thumbnail image is rotated in a second rotation direction different from the first rotation direction, with the virtual axis as the axis of rotation. The display device according to claim 1.

3. In the aforementioned group of thumbnail images, adjacent thumbnail images partially overlap. The display device according to claim 2.

4. The display control unit, The thumbnail image corresponding to the first page, enlarged, and the group of thumbnail images can be displayed side by side. When the display mode of the thumbnail image group is set to the first display mode, the thumbnail image group is displayed in the first direction from the enlarged thumbnail image, and the document information of the document indicated by the document data is displayed in the corner of the enlarged thumbnail image in the second direction. When the display mode of the thumbnail image group is set to the second display mode, the thumbnail image group is displayed in the second direction from the enlarged thumbnail image, and the document information of the document indicated by the document data is displayed in the corner of the enlarged thumbnail image in the first direction. The display device according to any one of claims 1 to 3.

5. The system includes a receiving unit that accepts an operation to set the display mode of the aforementioned group of thumbnail images, The display control unit, When the reception unit receives an operation to set the display to the first display mode, it sets the display mode of the thumbnail image group to the first display mode. When the reception unit receives an operation to set the display mode to the second display mode, the display mode of the thumbnail image group is set to the second display mode. The display device according to claim 1.

6. A display method using a display device, The display mode of the thumbnail image group, which has multiple thumbnail images corresponding to each page of the document data, is set to either a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction, and the thumbnail image group is displayed. The first direction is to the left when the display surface is viewed. The second direction is to the right when the display surface is being viewed. If the document data indicates a document that opens from left to right, the display mode of the thumbnail image group is set to the first display mode. If the document data indicates a document that opens from right to left, the display mode of the thumbnail image group is set to the second display mode. The printer driver receives the document data transmitted from the information processing device, The received document data includes additional information indicating whether the document indicated by the document data is a right-to-left or left-to-right document. Based on the additional information attached to the document data, the display mode of the thumbnail image group is set to the first display mode or the second display mode. Display method.

7. The processor of a display device equipped with a display unit is The system functions as a display control unit that displays a group of thumbnail images on the display unit, each having multiple thumbnail images corresponding to a page of the document data, and a receiving unit that receives the document data transmitted from the information processing device by the printer driver. The display control unit, The display mode of the thumbnail image group can be set to a first display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a first direction, or to a second display mode in which the multiple thumbnail images are arranged so that the page numbers increase sequentially in a second direction opposite to the first direction. The first direction is to the left when viewing the display surface of the display unit. The second direction is to the right when the display surface is being viewed. The display control unit, If the document data indicates a document that opens from left to right, the display mode of the thumbnail image group is set to the first display mode. If the document data indicates a document that opens from right to left, the display mode of the thumbnail image group is set to the second display mode. The document data received by the receiving unit includes additional information indicating whether the document indicated by the document data is a right-to-left or left-to-right document. The display control unit sets the display mode of the thumbnail image group to the first display mode or the second display mode based on the additional information added to the document data. program.

Images