Display control method, program, and display device

Abstract

To perform processing according to a user's purpose of use on an image corresponding to a desired page, while allowing the user to easily grasp the summary of the desired page.SOLUTION: There is provided a display control method for displaying a first thumbnail image and a second thumbnail image indicating the pages constituting a document side by side on a virtual axis of a display surface, and the method includes: when receiving a tag addition operation for the first thumbnail image from a user, adding, to the first thumbnail image, a tag image extending to the outside of an image surface of the first thumbnail image; and when receiving an upward moving operation for the second thumbnail image from the user, moving the second thumbnail image in an upper direction.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The present invention relates to a display control method, a program, and a display device.

Background Art

[0002] An apparatus that performs processing in response to an operation received from a user is known. Patent Document 1 discloses an information processing apparatus that displays images of a plurality of pages constituting a document and, when an insertion operation is received from a user with respect to the images of the plurality of pages, attaches an electronic note to the page images.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In Patent Document 1, in order for a user to grasp the outline of a desired page, an electronic note in which characters are input is attached to the page image. However, in Patent Document 1, the user needs to input characters in order to grasp the outline, and the user cannot easily grasp the outline of the desired page.

Means for Solving the Problems

[0005] One aspect for solving the above problems is a display control method for arranging and displaying a first image and a second image corresponding to pages constituting a document on a virtual axis of a display surface, wherein when a first operation is received from a user with respect to the first image, an object that extends outside the image plane of the first image is added to the first image, and when a second operation is received from the user with respect to the second image, the second image is moved in a predetermined direction.

[0006] Another aspect for solving the above problem is a program that causes a processor of a display device having a display surface to display a first image and a second image corresponding to pages constituting a document side by side on a virtual axis of the display surface, and when a first operation is received from a user with respect to the first image, an object extending outside the image plane of the first image is added to the first image, and when a second operation is received from the user with respect to the second image, the second image is moved in a predetermined direction.

[0007] Yet another aspect for solving the above problem is a display device including an operation unit that receives a user operation, a display unit having a display surface, and a display control unit that causes the display unit to display a first image and a second image corresponding to pages constituting a document side by side on a virtual axis of the display surface, wherein the display control unit adds an object extending outside the image plane of the first image to the first image when the operation unit receives a first operation from the user with respect to the first image, and moves the second image in a predetermined direction when the operation unit receives a second operation from the user with respect to the second image. BRIEF DESCRIPTION OF THE DRAWINGS

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0009] FIG. 1 is a diagram showing the configuration of the printing system 1000. The printing system 1000 includes a smartphone 1 and a printer 2. The smartphone 1 and the printer 2 are connected to the network NW. The network NW may be a local network or a global network composed of the Internet, a dedicated circuit, a public circuit, or the like. The smartphone 1 corresponds to an example of a display device.

[0010] The smartphone 1 may be a notebook PC (Personal Computer), a desktop PC, or a tablet terminal. An application program, a display app 111, for displaying an image based on document data is installed on the smartphone 1. The document data is data indicating a document composed of one or a plurality of pages. Examples of the data format of the document data include the Word format and the PDF (Portable Document Format). The display app 111 has a function of displaying a page image PG, which is an image of a page constituting the document indicated by the document data. The display app 111 has a function of displaying a thumbnail image SG of the page based on the document data. The display app 111 has a function of generating print data corresponding to the command system of the printer 2 connected to the smartphone 1 or print data corresponding to the command system of another printer (not shown). The display app 111 has a function of transmitting the generated print data to the printer 2. The display app 111 corresponds to an example of a program.

[0011] Printer 2 is a device that prints an image on a printing medium. There is no limitation on the type of the printing medium, and examples thereof include cut paper of a predetermined size, roll paper, a sheet made of synthetic resin, and the like. There is no limitation on the printing method of printer 2, and printing methods such as dot impact type, thermal sublimation type, and thermal type can be adopted. This embodiment exemplifies the case where the printing method of printer 2 is an inkjet type.

[0012] The configuration of smartphone 1 will be described. Smartphone 1 includes a control unit 10, a communication unit 11, and a touch panel 12. Touch panel 12 corresponds to an example of an operation unit and a display unit.

[0013] Control unit 10 includes a processor 100 that executes programs such as a CPU (Central Processing Unit) and an MPU (Micro-processing unit), and a storage unit 110, and controls each part of smartphone 1. Processor 100 reads out the program stored in storage unit 110 and executes various processes by hardware and software. Processor 100 executes display application 111 stored in storage unit 110 and functions as display control unit 101.

[0014] Storage unit 110 is a memory that stores programs executed by processor 100 and data processed by processor 100. Storage unit 110 stores display application 111, various programs, and other various data executed by processor 100. Storage unit 110 has a non-volatile storage area and a volatile storage area. The volatile storage area may constitute a work area of processor 100.

[0015] The communication unit 11 is a communication interface that communicates according to a predetermined communication standard. It communicates with the printer 2 via the network NW under the control of the control unit 10. The communication unit 11 transmits the print data output by the display application 111 to the printer 2. The print data includes print conditions and print commands. The communication unit 11 receives document data from a server device or a client device (not shown) via the network NW.

[0016] The touch panel 12 includes a display panel such as a liquid crystal display panel and a touch sensor provided over or integrally with the display panel. The display panel displays various images under the control of the control unit 10. The touch sensor detects a touch operation and outputs it to the control unit 10. The control unit 10 executes a process corresponding to the touch operation based on the input from the touch sensor.

[0017] The processor 100 functions as a display control unit 101. The display control unit 101 communicates with a device connected to the network NW via the communication unit 11. The display control unit 101 transmits the print data generated by the control unit 10 to the printer 2 via the communication unit 11. The display control unit 101 receives document data from a server device or a client device (not shown) via the communication unit 11. The print data generated by the control unit 10 includes page print data for printing any page among the pages constituting the document indicated by the document data.

[0018] The display control unit 101 causes the touch panel 12 to display a plurality of user interface screens. When not distinguishing the plurality of user interface screens, it is denoted as app UI202. The display control unit 201 provides various information to the user and receives various instructions from the user by causing the touch panel 12 to display the app UI202.

[0019] The app UI202 will be described with reference to FIGS. 2 - 8. In FIGS. 2 - 8, the upward direction in the figure is indicated by the symbol UP, the downward direction in the figure is indicated by the symbol DW, the leftward direction in the figure is indicated by the symbol L, and the rightward direction in the figure is indicated by the symbol R.

[0020] The display control unit 101 causes the list application UI 202A for displaying document data in a list to be displayed on the touch panel 12. The list application UI 202A is included in the application UI 202. FIG. 2 is a diagram showing an example of the list application UI 202A.

[0021] The list application UI 202A displays a combination of a thumbnail image group SSG and a main thumbnail image MSG for each document data. In the following description, the thumbnail image group SSG of the n-th document data is represented as the n-th thumbnail image group SSGn. The main thumbnail image MSG of the n-th document data is represented as the n-th main thumbnail image MSGn. n is an integer of 1 or more.

[0022] The list application UI 202A shown in FIG. 2 displays a combination of the first thumbnail image group SSG1 and the first main thumbnail image MSG1 based on the first document data at a predetermined position. The list application UI 202A displays a combination of the second thumbnail image group SSG2 and the second main thumbnail image MSG2 based on the second document data. The combination of the second thumbnail image group SSG2 and the second main thumbnail image MSG2 is displayed side by side below the combination of the first thumbnail image group SSG1 and the first main thumbnail image MSG1. The list application UI 202A displays a combination of the third thumbnail image group SSG3 and the third main thumbnail image MSG3 based on the third document data. The combination of the third thumbnail image group SSG3 and the third main thumbnail image MSG3 is displayed side by side below the combination of the second thumbnail image group SSG2 and the second main thumbnail image MSG2.

[0023] The thumbnail image group SSG is a group of images in which a plurality of thumbnail images SG are arranged side by side in the horizontal direction. Each of the thumbnail images SG included in the thumbnail image group SSG is displayed in a state where it appears as seen from a predetermined viewpoint from above. One thumbnail image SG included in the thumbnail image group SSG corresponds to one page of the document indicated by the corresponding document data. The thumbnail image SG of the present embodiment is a rectangular image.

[0024] The main thumbnail image MSG is a thumbnail image SG corresponding to the representative page of the document data. As an example of the representative page, the top page of the document data can be cited. The list application UI202A may display a part of the thumbnail image SG of a predetermined page as the main thumbnail image MSG, or may display all of the thumbnail image SG of a predetermined page as the main thumbnail image MSG.

[0025] The list application UI202A can select a combination of the thumbnail image group SSG and the main thumbnail image MSG by a touch operation. When the combination is selected in the list application UI202A, the display control unit 101 displays the selection application UI202B related to the selected document. The selection application UI202B is included in the application UI202.

[0026] FIG. 3 is a diagram showing an example of the selection application UI202B.

[0027] The selection application UI202B has a thumbnail image group display area HA1 and a page image display area HA2.

[0028] The thumbnail image group display area HA1 is an area for displaying the thumbnail image group SSG selected in the list application UI202A. When a combination of the first main thumbnail image MSG1 and the first thumbnail image group SSG1 is selected in the list application UI202A, the thumbnail image group display area HA1 displays the first thumbnail image group SSG1 included in the selected combination.

[0029] The display control unit 101 changes the display mode of the thumbnail image group SSG when a predetermined touch operation such as a slide operation is performed by an indicator within the thumbnail image group display area HA1.

[0030] When a rightward slide operation is performed, within the thumbnail image group display area HA1, the plurality of thumbnail images SG move from left to right according to the amount of movement of the indicator to the right. When a leftward slide operation is performed, within the thumbnail image group display area HA1, the plurality of thumbnail images SG move from right to left according to the amount of movement of the indicator to the left.

[0031] The page image display area HA2 is an area for displaying a page image PG of a page corresponding to the thumbnail image SG selected in the thumbnail image group display area HA1. In the following description, the page image PG corresponding to the m-th page of the document indicated by the n-th document data is appended with the number n - m following the symbol PG. m is an integer greater than or equal to 1. The page image PG2-111 shown in FIG. 3 indicates the page image PG corresponding to the 111th page of the document indicated by the second document data.

[0032] In the page image display area HA2, when a predetermined touch operation such as a slide operation is performed by an indicator, the page image PG to be displayed is switched.

[0033] When a predetermined rightward touch operation is performed in the page image display area HA2, within the page image display area HA2, the page image PG of the page before the page corresponding to the page image PG displayed before the touch operation is displayed. When a predetermined leftward touch operation is performed in the page image display area HA2, within the page image display area HA2, the page image PG of the page after the page corresponding to the page image PG displayed before the touch operation is displayed.

[0034] In the state of FIG. 3, when a slide operation is performed to the right, in the page image display area HA2, the page image PG2-110 is displayed. In the state of FIG. 3, when a slide operation is performed to the left, in the page image display area HA2, the page image PG2-112 is displayed.

[0035] When the page image PG is switched in the page image display area HA2, in the thumbnail image group display area HA1, the display mode of the thumbnail image group SSG changes, and the thumbnail image SG corresponding to the page image PG after switching is located approximately at the center in the horizontal direction.

[0036] The thumbnail image group display area HA1 will be described in detail. In the following description, for the thumbnail image SG corresponding to the m-th page of the document indicated by the n-th document data, a number of n - m is appended to the symbol SG. The thumbnail image SG2-98 indicates the thumbnail image SG corresponding to the 98th page of the document indicated by the second document data.

[0037] FIG. 4 is a diagram showing an example of the thumbnail image group SSG displayed in the thumbnail image group display area HA1.

[0038] FIG. 4 exemplifies the case where the thumbnail image group display area HA1 is displaying the second thumbnail image group SSG2. The thumbnail image group display area HA1 in FIG. 4 is in the display mode when the page image PG2-98 is displayed in the page image display area HA2, and is displaying the second thumbnail image group SSG2.

[0039] In the thumbnail image group display area HA1, each of the thumbnail images SG is displayed side by side on the virtual axis KJ of the display surface 12A of the touch panel 12. The virtual axis KJ is an axis parallel to the horizontal direction.

[0040] The thumbnail image group display area HA1 has a right area HA1-R and a left area HA1-L. The right area HA1-R and the left area HA1-L are arranged side by side in the left-right direction with a switching line L1 in between. The switching line L1 is a virtual line located to the left of the center line L2 and extends in the up-down direction. The center line L2 is a virtual line indicating the center in the left-right direction of the thumbnail image group display area HA1 and extends in the up-down direction.

[0041] In FIG. 4, the thumbnail image SG2-98 is displayed overlapping the center line L2. The thumbnail image SG2-97 corresponding to the page before the page corresponding to the thumbnail image SG2-98 is displayed in the left area HA1-L. The thumbnail image SG2-98 and the thumbnail image SG2-99 corresponding to the page after the page corresponding to the thumbnail image SG2-98 are displayed in the right area HA1-R.

[0042] In the thumbnail image group display area HA1, based on the switching line L1, the orientation of the image plane of the thumbnail image SG is switched.

[0043] Referring to FIGS. 5 and 6, the orientation of the image plane of the thumbnail image SG will be described in detail. FIGS. 5 and 6 are diagrams for explaining the orientation of the image plane of the thumbnail image SG.

[0044] As shown in FIGS. 5 and 6, each of the thumbnail images SG is displayed in the thumbnail image group display area HA1 as an image seen by looking down on the thumbnail image SG arranged in the virtual space from a predetermined viewpoint in the virtual space. The virtual space includes a virtual horizontal plane KHM and a rotation axis KTJ perpendicular to the virtual horizontal plane KHM. The direction in which the rotation axis KTJ extends corresponds to the up-down direction. The direction in which the reference line KJL set on the virtual horizontal plane KHM extends corresponds to the left-right direction and the direction in which the virtual axis KJ extends.

[0045] The display control unit 101 rotates each of the thumbnail images SG by a predetermined rotation angle around the rotation axis KTJ with respect to the reference line KJL. Each of the thumbnail images SG is displayed in a manner inclined obliquely with respect to the reference line KJL.

[0046] In this embodiment, the orientation of the image plane of the thumbnail image SG is the orientation of the surface normal MH. FIG. 5 shows a thumbnail image SG whose image plane faces the first orientation and a thumbnail image SG whose image plane faces neither the first orientation nor the second orientation. FIG. 6 shows a thumbnail image SG whose image plane faces the second orientation and a thumbnail image SG whose image plane faces neither the first orientation nor the second orientation.

[0047] In FIGS. 5 and 6, the string “-M1” is attached to the thumbnail image SG whose image plane faces the first orientation. In FIGS. 5 and 6, the string “-M2” is attached to the thumbnail image SG whose image plane faces the second orientation. In FIGS. 5 and 6, the string “-MN” is attached to the thumbnail image SG whose image plane faces neither the first orientation nor the second orientation.

[0048] The thumbnail image SG-MN is an image in the virtual space in which the upper side JH and the lower side KH are parallel to the reference line KJL. In this embodiment, when the upper side JH and the lower side KH in the virtual space are parallel to the reference line KJL, the surface normal MH of the thumbnail image SG is set to the same orientation as the surface normal MH of the display surface 12A. The thumbnail image SG-MN is an image whose image plane orientation is the same as the orientation of the display surface 12A. The thumbnail image SG-M1 and the thumbnail image SG-M2 are images whose image plane orientations are different from the orientation of the display surface 12A.

[0049] As shown in FIG. 5, when the reference line KJL is 0° and the direction indicated by the arrow Y1 is the positive direction, the thumbnail image SG-M1 is a thumbnail image SG rotated within the range of 0° < α < 90° in the virtual space. The surface normal MH of the image plane of the thumbnail image SG-M1 faces left in the direction in which the reference line KJL extends in the virtual space. The first orientation is a direction that faces left in the direction in which the reference line KJL extends in the virtual space. The first orientation is a direction that faces left of the virtual axis KJ. Left corresponds to an example of one side.

[0050] As shown in FIG. 6, the thumbnail image SG-M2 is a thumbnail image rotated within a range of 0° > β > -90° in the virtual space with the reference line KJL as 0° and the direction indicated by the arrow Y2 as the negative direction. The surface normal MH of the image plane of the thumbnail image SG-M2 faces rightward in the direction in which the reference line KJL extends within the virtual space. The second direction is the direction facing rightward in the direction in which the reference line KJL extends. The second direction is the direction facing rightward of the virtual axis KJ. Rightward corresponds to one example of the other.

[0051] The thumbnail image SG displayed in the right region HA1-R is an image whose image plane faces the first direction. For each of the thumbnail images SG to be displayed in the right region HA1-R, the display control unit 101 superimposes a part of an adjacent thumbnail image SG and displays it after rotating it by a rotation angle α corresponding to the position in the left-right direction.

[0052] The thumbnail image SG displayed in the left region HA1-L is an image whose image plane faces the second direction. For each of the thumbnail images SG to be displayed in the left region HA1-L, the display control unit 101 superimposes a part of an adjacent thumbnail image SG and displays it after rotating it by a rotation angle β corresponding to the position in the left-right direction.

[0053] Returning to the description of FIG. 4, in the thumbnail image group display area HA1 shown in FIG. 4, the thumbnail images SG2-92 are displayed in a state of being moved upward. The upward direction corresponds to an example of a predetermined direction. The touch panel 12 accepts an upward movement operation by a predetermined touch operation for each of the thumbnail images SG displayed in the thumbnail image group display area HA1. The predetermined touch operation includes a slide operation upward. When the touch panel 12 accepts an upward movement operation, the display control unit 101 moves the thumbnail image SG that is the operation target of the upward movement operation upward in the thumbnail image group display area HA1. The touch panel 12 accepts a downward movement operation by a predetermined touch operation for the thumbnail image SG that has been moved upward by the upward movement operation. When the touch panel 12 accepts a downward movement operation for the thumbnail image SG, the display control unit 101 moves the thumbnail image SG that is the operation target of the downward movement operation downward in the thumbnail image group display area HA1 and returns it to the position before being moved by the upward movement operation. The upward movement operation corresponds to an example of the second operation.

[0054] In the thumbnail image group display area HA1 shown in FIG. 4, a sticker image FG is added to each of the thumbnail images SG2-91, SG2-93, SG2-96, and SG2-102. The sticker image FG is an image that extends in the vertical direction. Each of the sticker images FG extends upward from the upper end of the thumbnail image SG toward the outside of the image plane of the thumbnail image SG. The sticker image FG corresponds to an example of an object.

[0055] The sticker image FG is added at the first position I1 to the thumbnail image SG whose image plane faces the first direction. The sticker image FG is added at the second position I2 to the thumbnail image SG whose image plane faces the second direction.

[0056] Referring to FIGS. 7 and 8, the addition position of the sticker image FG will be described in detail. FIGS. 7 and 8 are diagrams for explaining the addition position of the sticker image FG.

[0057] Referring to FIG. 7, the first position I1 will be described. The sticker image FG is added to the thumbnail image SG whose image plane faces the first direction at the first position I1. The first position I1 is a position to the right of the central virtual axis CKJ from the vertical virtual axis SKJ. The central virtual axis CKJ is a virtual axis in the image plane parallel to the upper side JH and the lower side KH of the thumbnail image SG and passes through the center CS in the image plane. The vertical virtual axis SKJ is a virtual axis perpendicular to the central virtual axis CKJ in the image plane and parallel to the right side RH and the left side LH of the thumbnail image SG.

[0058] FIG. 7 shows, in a two-dot chain line, the thumbnail image SG corresponding to the page before the page corresponding to the thumbnail image SG to which the sticker image FG is added. The first position I1 is a position in the direction in which the reference line KJL extends and within a region where the thumbnail image SG corresponding to the previous page does not overlap. The first position I1 is a position not included in the movement region IA of the thumbnail image SG corresponding to the previous page. The movement region IA is a region where the thumbnail image SG moves by an upward movement operation and a downward movement operation.

[0059] The display control unit 101 adds the sticker image FG with the first position I1 as a reference. The display control unit 101 adds the sticker image FG at a position where the center in the short side direction of the sticker image FG coincides with the first position I1 in the direction in which the reference line KJL extends. Although the first position I1 is a position that does not overlap with the thumbnail image SG of the previous page, a part of the sticker image FG added to the first position I1 may be hidden by the thumbnail image SG of the previous page.

[0060] Referring to FIG. 8, the second position I2 will be described. The sticker image FG is added to the thumbnail image SG whose image plane faces the second direction at the second position I2. The second position I2 is a position to the left of the central virtual axis CKJ from the vertical virtual axis SKJ in the direction in which the reference line KJL extends.

[0061] FIG. 8 shows, by a two-dot chain line, a thumbnail image SG corresponding to a page after the page corresponding to the thumbnail image SG with the sticker image FG added thereto. The second position I2 is a position within a region where the thumbnail image SG corresponding to the subsequent page does not overlap in the direction in which the reference line KJL extends. The second position I2 is a position not included in the movement region IA of the thumbnail image SG corresponding to the subsequent page.

[0062] The display control unit 101 adds the sticker image FG with reference to the second position I2. The display control unit 101 adds the sticker image FG at a position where the center in the short side direction of the sticker image FG coincides with the second position I2 in the direction in which the reference line KJL extends. Although the second position I2 is a position where the thumbnail image SG of the subsequent page does not overlap, a part of the sticker image FG added to the second position I2 may be hidden by the thumbnail image SG of the previous page.

[0063] As described with reference to FIGS. 7 and 8, the sticker image FG is added to the first position I1 and the second position I2. As shown in FIG. 4, the sticker image FG is added in front of the thumbnail image SG that can be seen in a bird's-eye view from a predetermined viewpoint in the thumbnail image group display area HA1. Suppose that the sticker image FG is added behind the thumbnail image SG that can be seen in a bird's-eye view from a predetermined viewpoint. In this case, if there is a thumbnail image SG that has moved upward like the thumbnail image SG2-92, the sticker image FG may be hidden by the thumbnail image SG that has moved upward. If the configuration is such that the sticker image FG is added behind, in FIG. 4, the sticker image FG added to the thumbnail image SG2-91 is hidden by the thumbnail image SG2-92 that has moved upward. However, the sticker image FG of the present embodiment is added in front of the thumbnail image SG. As shown in FIG. 4, all of the sticker image FG added to the thumbnail image SG2-91 is not hidden by the thumbnail image SG2-92 that has moved upward, and the user can recognize the sticker image FG added to the thumbnail image SG2-91.

[0064] Next, the operation of the display control unit 101 will be described. FIG. 9 is a flowchart showing the operation of the display control unit 101.

[0065] The display control unit 101 determines whether an upward movement operation has been received in the thumbnail image group display area HA1 (step SA1).

[0066] When the display control unit 101 determines that an upward movement operation has not been received (step SA1: NO), the process proceeds to step SA3.

[0067] When the display control unit 101 determines that an upward movement operation has been received (step SA1: YES), it moves the thumbnail image SG that is the operation target of the upward movement operation upward (step SA2).

[0068] The display control unit 101 determines whether a downward movement operation has been received in the thumbnail image group display area HA1 (step SA3).

[0069] When the display control unit 101 determines that a downward movement operation has not been received (step SA3: NO), the process proceeds to step SA5.

[0070] When the display control unit 101 determines that a downward movement operation has been received (step SA3: YES), it moves the thumbnail image SG that is the operation target of the downward movement operation downward (step SA4).

[0071] The display control unit 101 determines whether a sticker addition operation has been received in the selected app UI202B (step SA5). The sticker addition operation is an operation of adding a sticker image FG and is performed by a predetermined touch operation. The sticker addition operation corresponds to an example of the first operation.

[0072] When the display control unit 101 determines that a sticker addition operation has not been received in the selected app UI202B (step SA5: NO), the process proceeds to step SA7.

[0073] When the display control unit 101 determines that it has received a sticker addition operation in the selected app UI 202B (step SA5: YES), it adds the sticker image FG to the thumbnail image SG that is the target of the sticker addition operation (step SA6).

[0074] In step SA6, when the thumbnail image SG that is the target of the operation is located within the right region HA1-R, the display control unit 101 adds the sticker image FG at the first position I1. In step SA6, when the thumbnail image SG that is the target of the operation is located within the left region HA1-L, the display control unit 101 adds the sticker image FG at the second position I2.

[0075] When the display control unit 101 determines that it has not received a sticker deletion operation in the selected app UI 202B (step SA7: NO), it returns the process to step SA1.

[0076] When the display control unit 101 determines that it has received a sticker deletion operation in the selected app UI 202B (step SA7: YES), it deletes the sticker image FG from the thumbnail image SG that is the target of the sticker deletion operation (step SA8).

[0077] Figure 10 is a flowchart showing the operation of the display control unit 101. The operation in Figure 10 is performed for each of the thumbnail images SG to which the sticker image FG is added among the thumbnail images SG displayed in the thumbnail image group display region HA1.

[0078] The display control unit 101 determines whether the sticker image FG is added at the first position I1 or at the second position I2 (step SB1).

[0079] When the display control unit 101 determines that the sticker image FG is added at the first position I1 (step SB1: the first position), it determines whether the thumbnail image SG has moved to the left region HA1-L (step SB2).

[0080] When the display control unit 101 determines that the thumbnail image SG has not moved to the left area HA1-L (step SB2: NO), the process returns to step SB1.

[0081] When the display control unit 101 determines that the thumbnail image SG has moved to the left area HA1-L (step SB2: YES), it adds the sticker image FG to the second position I2 (step SB3).

[0082] Returning to the description of step SB1, when the display control unit 101 determines that the sticker image FG has been added to the second position I2 (step SB1: second position), it determines whether the thumbnail image SG has moved to the right area HA1-R (step SB4).

[0083] When the display control unit 101 determines that the thumbnail image SG has not moved to the right area HA1-R (step SB4: NO), the process returns to step SB1.

[0084] When the display control unit 101 determines that the thumbnail image SG has moved to the right area HA1-R (step SB4: YES), it adds the sticker image FG to the first position I1 (step SB5).

[0085] Another embodiment will be described. Second Embodiment In the first embodiment, the page image PG and the thumbnail image group SSG are displayed on the selection app UI202B. In the second embodiment, only the thumbnail image group SSG is displayed on the selection app UI202B, and the page image PG is not displayed.

[0086] Third Embodiment In the third embodiment, the thumbnail image group SSG displayed on the selected app UI 202B and the thumbnail image group SSG displayed on the list app UI 202A are displayed in the same display state. When a sticker image FG is added to the thumbnail images SG1-12 displayed on the selected app UI 202B, the sticker image FG is added to the thumbnail images SG1-12 of the first thumbnail image group SSG1 displayed by the list app UI 202A. When the thumbnail image SG2-111 displayed on the selected app UI 202B moves upward, the thumbnail image SG2-111 of the second thumbnail image group SSG2 displayed by the list app UI 202A is displayed in the upward-moved state.

[0087] According to the above-described embodiment, the following effects can be obtained. In the following description, the first thumbnail image SG and the second thumbnail image SG do not indicate a specific thumbnail image SG. The first thumbnail image SG indicates an arbitrary thumbnail image SG, and the second thumbnail image SG indicates a thumbnail image SG different from the first thumbnail image SG. The first thumbnail image SG corresponds to an example of the first image. The second thumbnail image SG corresponds to an example of the second image.

[0088] As described above, the display control method by the smartphone 1 arranges and displays the first thumbnail image SG and the second thumbnail image SG corresponding to the pages constituting the document on the virtual axis KJ of the display surface 12A. In this display control method, when a sticker addition operation is received from the user for the first thumbnail image SG, a sticker image FG extending outside the image plane of the first thumbnail image SG is added to the first thumbnail image SG, and when an upward movement operation is received from the user for the second thumbnail image SG, the second thumbnail image SG is moved upward.

[0089] By moving the desired thumbnail image SG upward, the user can grasp a part of the image plane of the desired thumbnail image SG and easily grasp the outline of the desired thumbnail image SG. By adding a sticker image FG to the desired thumbnail image SG, processing can be performed on the desired thumbnail image SG for purposes other than grasping the outline. The user can easily grasp the outline of the desired page, and processing corresponding to the user's purpose can be performed on the thumbnail image SG corresponding to the desired page.

[0090] When the smartphone 1 receives a sticker addition operation from the user for the second thumbnail image SG, the smartphone 1 adds a sticker image FG that extends outside the second image plane of the second thumbnail image SG to the second thumbnail image SG.

[0091] According to this, the user can add a sticker image FG to a plurality of thumbnail images SG.

[0092] When the orientation of the image plane of the first thumbnail image SG is a first orientation different from the orientation of the display surface 12A, the smartphone 1 adds the sticker image FG to the first position I1, and when the orientation of the image plane of the first thumbnail image SG is a second orientation different from the orientation of the display surface 12A, the smartphone 1 adds the sticker image FG to the second position I2.

[0093] According to this, the smartphone 1 can vary the addition position of the sticker image FG according to two display states of the thumbnail image SG. The smartphone 1 can add the sticker image FG while suppressing the change in the appearance depending on the two display states of the thumbnail image SG, and the user can easily grasp which thumbnail image SG the thumbnail image SG with the sticker image FG added is.

[0094] The first orientation is a direction facing the left side of the virtual axis KJ. The second orientation is a direction facing the right side of the virtual axis KJ.

[0095] According to this, regardless of whether the image plane of the thumbnail image SG faces left or right of the virtual axis KJ, the user can easily grasp which thumbnail image SG is the thumbnail image SG with the sticker image FG added thereto.

[0096] The first position I1 is a position to the right of the central virtual axis CKJ within the image plane of the first thumbnail image SG with respect to the vertical virtual axis SKJ that extends within the image plane of the first thumbnail image SG and passes through the center of the image plane and is perpendicular to the central virtual axis CKJ within the image plane. The second position I2 is a position to the left of the central virtual axis CKJ with respect to the vertical virtual axis SKJ.

[0097] According to this, the smartphone 1 can add the sticker image FG in front of the thumbnail image SG facing the first orientation and the thumbnail image SG facing the second orientation. The user can more easily grasp which thumbnail image SG is the thumbnail image SG with the sticker image FG added thereto.

[0098] The second thumbnail image SG is displayed partially overlapping the first thumbnail image SG. The first position I1 and the second position I2 are positions within the area on the image plane of the first thumbnail image SG where the second thumbnail image SG does not overlap.

[0099] According to this, the smartphone 1 can add the sticker image FG to the thumbnail image SG while suppressing the sticker image FG from being hidden by other thumbnail images SG in a display where a part of the thumbnail images SG overlap each other. The user can easily grasp which thumbnail image SG is the thumbnail image SG with the sticker image FG added thereto in a display where a part of the thumbnail images SG overlap each other.

[0100] The first position I1 and the second position I2 are positions on the image plane of the first thumbnail image SG that are not included in the movement area IA of the second thumbnail image SG.

[0101] According to this, the smartphone 1 can suppress the case where the sticker image FG hides behind other thumbnail images SG that have moved upward, and can add the sticker image FG to the thumbnail image SG. When there is a thumbnail image SG that has moved upward, the user can easily grasp which thumbnail image SG is the thumbnail image SG to which the sticker image FG is added.

[0102] The display application 111 causes the processor 100 to display the first thumbnail image SG and the second thumbnail image SG corresponding to the pages constituting the document side by side on the virtual axis KJ of the display surface 12A. When a sticker addition operation is received from the user for the first thumbnail image SG, a sticker image FG that extends outside the image plane of the first thumbnail image SG is added to the first thumbnail image SG. When an upward movement operation is received from the user for the second thumbnail image SG, the second thumbnail image SG is moved upward.

[0103] According to the display application 111, it has the same effect as the effect of the above-described display control method.

[0104] The smartphone 1 includes a touch panel 12 operation unit that receives a user operation and has a display surface 12A, and a display control unit 101 that causes the touch panel 12 to display the first thumbnail image SG and the second thumbnail image SG corresponding to the pages constituting the document side by side on the virtual axis KJ of the display surface 12A. When the touch panel 12 receives a sticker addition operation from the user for the first thumbnail image SG, a sticker image FG that extends outside the image plane of the first thumbnail image SG is added to the first thumbnail image SG. When the touch panel 12 receives an upward movement operation from the user for the second thumbnail image SG, the second thumbnail image SG is moved upward.

[0105] According to the smartphone 1, it has the same effect as the effect of the above-described display control method.

[0106] Each of the above-described embodiments shows one aspect and can be arbitrarily modified and applied.

[0107] The display control unit 101 may add a sticker image FG with a different color to the thumbnail image SG according to the user's operation.

[0108] The object is not limited to the sticker image FG. The object may be any object added to the thumbnail image SG according to the user's application.

[0109] The printer 2 may have functions other than the printing function such as a scanning function and a facsimile function.

[0110] The display device is not limited to the smartphone 1. The display device may be a tablet PC, a desktop PC, a laptop PC, or other PCs.

[0111] The operation unit and the display unit are not limited to the touch panel 12. The display unit may be a display composed of an LED (Light Emitting Diode), an OLED (Organic Light Emitting Diode), or the like. The operation unit may be a device that connects to input means such as an operation switch, a mouse, and a keyboard, detects the user's operation, and outputs the detection result to the control unit 10.

[0112] The functions of the control unit 10 may be realized by a plurality of processors or semiconductor chips.

[0113] Each part shown in FIG. 1 is an example and is not particularly limited. It is not necessarily the case that hardware corresponding to each part is individually mounted. Of course, it is also possible to adopt a configuration in which one processor executes a program to realize the functions of each part. A part of the functions realized by software may be implemented as hardware, or a part of the functions realized by hardware may be realized by software. In addition, the specific detailed configuration of other parts of the smartphone 1 can be arbitrarily changed.

[0114] The step units of the operations shown in FIGS. 9 and 10 are divided according to the main processing contents in order to facilitate the understanding of the operations of the display control unit 101, and are not limited by the method of dividing the processing units or the names. Depending on the processing contents, it may be further divided into more step units. It may also be divided such that one step unit includes more processes. Further, the order of the steps may be appropriately changed.

Explanation of Signs

[0115] 1… Smartphone (display device), 2… Printer, 12… Touch panel (operation unit, display unit), 100… Processor, 110… Storage unit, 1000… Printing system, CKJ… Central virtual axis, CS… Center, FG… Sticker image (object), I1… First position, I2… Second position, IA… Movement area, KJ… Virtual axis, SG… Thumbnail image, SKJ… Vertical virtual axis.

Claims

1. A display control method for arranging and displaying a plurality of images corresponding to pages constituting a document on a virtual axis of a display surface, comprising: When a first operation is received from a user with respect to a first image among the plurality of images, if the orientation of the image plane of the first image is a first orientation different from the orientation of the display surface, an object extending outside the image plane of the first image is added at a first position; When a first operation is received from a user with respect to the first image, if the orientation of the image plane of the first image is a second orientation different from the orientation of the display surface, the object is added at a second position; When the orientation of the image plane of the first image switches from the first orientation to the second orientation, the addition position of the object is switched from the first position to the second position; When the orientation of the image plane of the first image switches from the second orientation to the first orientation, the addition position of the object is switched from the second position to the first position. A display control method.

2. The first orientation is a direction facing one side of the virtual axis, The second orientation is a direction facing the other side of the virtual axis, The display control method according to Claim 1.

3. The first position is a position on one side of the central virtual axis with respect to a vertical virtual axis perpendicular to the central virtual axis passing through the center of the image plane and extending within the image plane of the first image, The second position is a position on the other side of the central virtual axis with respect to the vertical virtual axis, The display control method according to Claim 1 or 2.

4. When a second operation is received from the user with respect to a second image among the plurality of images, the second image is moved in a predetermined direction. The display control method according to any one of Claims 1 to 3.

5. When the first operation is received from the user with respect to the second image, an object extending outside the second image plane of the second image is added to the second image. The display control method according to Claim 4.

6. The second image is displayed partially overlapping the first image, The first position and the second position are positions within a region on the image plane of the first image where the second image does not overlap, The display control method according to Claim 4 or 5.

7. The second image is displayed partially overlapping the first image, The first position and the second position are positions on the image plane of the first image that are not included in the moving area of the second image. The display control method according to any one of claims 4 to 6.

8. On a processor of a display device having a display surface, A plurality of images corresponding to pages constituting a document are arranged and displayed on a virtual axis of the display surface. When a first operation is received from a user with respect to a first image among the plurality of images, if the orientation of the image plane of the first image is a first orientation different from the orientation of the display surface with respect to the first image, an object extending outside the image plane of the first image is added to a first position. When a first operation is received from a user with respect to the first image, if the orientation of the image plane of the first image is a second orientation different from the orientation of the display surface with respect to the first image, the object is added to a second position. When the orientation of the image plane of the first image is switched from the first orientation to the second orientation, the addition position of the object is switched from the first position to the second position. When the orientation of the image plane of the first image is switched from the second orientation to the first orientation, the addition position of the object is switched from the second position to the first position. Program.

9. An operation unit that receives a user's operation, A display unit having a display surface, And a display control unit that causes the display unit to arrange and display a plurality of images corresponding to pages constituting a document on a virtual axis of the display surface. The display control unit is When the operation unit receives a first operation from a user with respect to a first image among the plurality of images, if the orientation of the image plane of the first image is a first orientation different from the orientation of the display surface with respect to the first image, an object extending outside the image plane of the first image is added to a first position. When the operation unit receives a first operation from a user with respect to the first image, if the orientation of the image plane of the first image is a second orientation different from the orientation of the display surface with respect to the first image, the object is added to a second position. When the operation unit receives a second operation from the user with respect to a second image among the plurality of images, the second image is moved in a predetermined direction. When the orientation of the image plane of the first image switches from the first orientation to the second orientation, switch the addition position of the object from the first position to the second position, When the orientation of the image plane of the first image switches from the second orientation to the first orientation, switch the addition position of the object from the second position to the first position, Display device.

Images