Information processing apparatus and control method

Abstract

The invention relates to an information processing apparatus and a control method, which improve operability when selecting a window to be displayed in each of a plurality of display areas. The information processing apparatus controls switching between a first display mode in which display is controlled using the entire screen area of the display as one display area and a second display mode in which display is controlled by dividing the screen area of the display into a plurality of display areas, and switches from the first display mode to the second display mode. Displaying one of windows of an application executed in a first display mode for a first display area among the plurality of display areas, and displaying a thumbnail image corresponding to a window other than the one of the windows in the first display mode for a second display area among the plurality of display areas, a predetermined operation by a user is detected, and a thumbnail image is displayed in a display area specified by the predetermined operation among the display areas within the screen area.

Description

Technical Field

[0001] The present invention relates to an information processing device and a control method. Background Art

[0002] In recent years, there are information processing devices with multiple screens (for example, dual screens). For example, an information processing device with a dual screen structure formed by mounting two displays (display units) on a first shell and a second shell that can be folded via a connecting portion (hinge mechanism) is disclosed (for example, Patent Document 1). In addition, there are also information processing devices in which a flexible display (display unit) such as an organic EL display is arranged to bend across the first shell and the second shell according to folding (for example, refer to Patent Document 2). In this way, in the case where a display (display unit) is arranged across the first shell and the second shell, not only a single screen mode in which one display is used as one screen, but also a display can be divided into a display area on the first shell side and a display area on the second shell side and used in a suspected dual screen mode. In addition, even an information processing device with a dual screen structure formed by the above-mentioned two displays can be used in a single screen mode in which the two displays are used as one screen, not only a dual screen mode.

[0003] For example, Patent Document 3 discloses an information processing device, which displays the window of an application being executed, and displays the active window in the single-screen mode on one screen of the dual-screen mode, and displays thumbnail images corresponding to windows other than the active window on the other screen. In this information processing device, when switching from the single-screen mode to the dual-screen mode, it is easy to continue to use the application used in the single-screen mode, and it is easy to check the list of other applications being executed through thumbnail images, so the convenience is good. By selecting a thumbnail image, the user can display the window of the application corresponding to the selected thumbnail image for use.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2015-233198

[0005] Patent Document 2: Japanese Patent Application Publication No. 2018-13850

[0006] Patent Document 3: Japanese Patent Application Publication No. 2022-70081

[0007] However, for example, in the technology disclosed in the above-mentioned patent document 3, although the user can display the window of the application he wants to use by selecting the thumbnail image, it is not easy to switch to another application when he wants to use it. In particular, in the dual-screen mode, when the display is divided into three or more display areas for use, it is preferable if the window displayed in each display area can be selected more freely. Summary of the invention

[0008] The present invention has been made in view of the above-mentioned circumstances, and one object of the present invention is to provide an information processing device and a control method that improve the operability when selecting a window displayed in each of a plurality of display areas.

[0009] The present invention is completed to solve the above-mentioned problems. The information processing device involved in the first mode of the present invention comprises: a display; a memory, storing an application program; and a processor, which controls the display to display the window of the application by executing the application program stored in the above-mentioned memory, and the above-mentioned processor performs display mode switching processing, first display control processing and second display control processing. In the above-mentioned display mode switching processing, the switching between the first display mode and the second display mode is controlled, wherein in the above-mentioned first display mode, the entire screen area of ​​the above-mentioned display is controlled to be displayed as a display area, and in the above-mentioned second display mode, the screen area of ​​the above-mentioned display is divided into a plurality of display areas domain to control the display, in the above-mentioned first display control processing, when switching from the above-mentioned first display mode to the above-mentioned second display mode through the above-mentioned display mode switching processing, a first display area in the multiple display areas displays one window among the above-mentioned windows of the above-mentioned application executed in the above-mentioned first display mode, and a second display area other than the above-mentioned first display area in the multiple display areas displays thumbnail images corresponding to windows other than the above-mentioned one window among the above-mentioned windows in the above-mentioned first display mode, and in the above-mentioned second display control processing, a prescribed operation performed by the user is detected, and the above-mentioned thumbnail image is displayed in the display area specified by the above-mentioned prescribed operation in the display area within the above-mentioned screen area.

[0010] The information processing device may be configured such that, in the second display control process, when the processor detects the prescribed operation and displays the thumbnail image, the processor also displays the thumbnail image corresponding to the one of the windows in the first display mode.

[0011] The information processing device may be configured such that, in the second display control process, after the processor controls the thumbnail image displayed in the second display area to be non-displayed, it detects the prescribed operation and displays the thumbnail image in the display area specified by the prescribed operation.

[0012] The above-mentioned information processing device can also be configured such that the above-mentioned processor causes the above-mentioned display to display a first icon for accepting user operation for switching from the above-mentioned first display mode to the above-mentioned second display mode, and when the user's operation on the above-mentioned first icon is detected in the above-mentioned first display mode, the above-mentioned display mode is switched to the above-mentioned second display mode, and the user's operation on the above-mentioned first icon is accepted as the above-mentioned prescribed operation in the above-mentioned second display mode, and when the operation on the above-mentioned first icon is detected, it is regarded as the above-mentioned prescribed operation that the above-mentioned thumbnail image is displayed.

[0013] The above-mentioned information processing device can also be configured such that the above-mentioned processor causes the above-mentioned display to display a first icon for accepting user operations for switching from the above-mentioned first display mode to the above-mentioned second display mode and a second icon for accepting the above-mentioned prescribed operation, and when an operation on the above-mentioned second icon is detected, it is regarded as detecting the above-mentioned prescribed operation and the above-mentioned thumbnail image is displayed.

[0014] The information processing device may be configured such that the second icon receives an operation for designating a display area for displaying the thumbnail image regardless of a plurality of display areas divided in the second display mode.

[0015] The information processing device may be configured such that the predetermined operation is a touch operation in a specific pattern by a user on a display area where the user desires to display the thumbnail images.

[0016] The above-mentioned information processing device can also be configured such that the above-mentioned prescribed operation is a touch operation of the above-mentioned specific mode on an area where no window is displayed in a display area in which at least one window is displayed in multiple display areas in the above-mentioned second display mode, and when the above-mentioned processor detects the above-mentioned prescribed operation, it displays the above-mentioned thumbnail image in the display area where the above-mentioned prescribed operation has been performed through the above-mentioned second display control processing.

[0017] The above-mentioned information processing device can also be configured so that when any one of the above-mentioned thumbnail images displayed in the above-mentioned second display area is selected through user operation, the above-mentioned processor makes all the above-mentioned thumbnail images displayed in the above-mentioned second display area invisible and displays the above-mentioned window corresponding to the selected thumbnail image.

[0018] The information processing device may be configured such that, when a user operation for hiding the thumbnail images displayed in the second display area is performed, the processor hides all the thumbnail images displayed in the second display area.

[0019] The above-mentioned information processing device can also be configured such that when the above-mentioned processor switches from the above-mentioned first display mode to the above-mentioned second display mode through the above-mentioned display mode switching process, in the above-mentioned first display control process, whether the above-mentioned thumbnail image is displayed in the above-mentioned second display area is controlled based on the number of the above-mentioned windows in the above-mentioned first display mode.

[0020] The above-mentioned information processing device can also be configured such that when the above-mentioned processor switches from the above-mentioned first display mode to the above-mentioned second display mode through the above-mentioned display mode switching process, in the above-mentioned first display control process, whether the above-mentioned thumbnail image is displayed in the above-mentioned second display area is controlled based on the number of display areas in the above-mentioned second display mode.

[0021] In addition, the control method involved in the second embodiment of the present invention is a control method in an information processing device, the information processing device includes a display, a memory and a processor, the memory stores an application program, the processor controls the display to display the window of the application by executing the application program stored in the memory, the control method includes a display mode switching step, a first display control step and a second display control step, in the display mode switching step, the processor controls the switching between the first display mode and the second display mode, wherein in the first display mode, the entire screen area of ​​the display is controlled to be displayed as a display area, and in the second display mode, the screen area of ​​the display is controlled to be displayed as a whole. The area is divided into multiple display areas to control the display. In the above-mentioned first display control step, when switching from the above-mentioned first display mode to the above-mentioned second display mode through the above-mentioned display mode switching step, a first display area in the multiple display areas displays one window among the above-mentioned windows of the above-mentioned application executed in the above-mentioned first display mode, and a second display area other than the above-mentioned first display area in the multiple display areas displays thumbnail images corresponding to windows other than the above-mentioned one window among the above-mentioned windows in the above-mentioned first display mode. In the above-mentioned second display control step, a prescribed operation performed by the user is detected, and the above-mentioned thumbnail image is displayed in the display area specified by the above-mentioned prescribed operation in the display area within the above-mentioned screen area.

[0022] According to the above aspect of the present invention, it is possible to improve the operability when selecting a window displayed in each of a plurality of display areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a perspective view showing the appearance of the information processing device according to the first embodiment.

[0024] Figure 2This is a side view showing an example of the information processing device in a folded state according to the first embodiment.

[0025] Figure 3 It is a side view showing an example of the information processing device in a planar state according to the first embodiment.

[0026] Figure 4 It is a diagram showing specific examples of various display modes of the information processing device according to the first embodiment.

[0027] Figure 5 This is a diagram showing an example of an operation specification of the display mode switching operation according to the first embodiment.

[0028] Figure 6 This is a diagram showing an example of a display example in the dual screen mode according to the first embodiment.

[0029] Figure 7 This is a diagram showing a first example of display control when switching from the single-screen mode to the dual-screen mode according to the first embodiment.

[0030] Figure 8 This is a diagram showing a second example of display control when switching from the single-screen mode to the dual-screen mode according to the first embodiment.

[0031] Fig. 9 It is a diagram showing a first example of the thumbnail display operation according to the first embodiment.

[0032] Fig.10 It is a diagram showing a first example of display control based on the thumbnail display operation according to the first embodiment.

[0033] Fig.11 It is a diagram showing a second example of the thumbnail display operation according to the first embodiment.

[0034] Fig.12 It is a diagram showing a second example of display control based on the thumbnail display operation according to the first embodiment.

[0035] Fig.13 It is a diagram showing a third example of display control based on the thumbnail display operation involved in the first embodiment.

[0036] Fig.14 This is a block diagram showing a hardware configuration example of the information processing device according to the first embodiment.

[0037] Fig.15 This is a block diagram showing a functional configuration example related to the display control process according to the first embodiment.

[0038] Fig.16 This is a flowchart showing an example of a display control process of the thumbnail window according to the first embodiment.

[0039] Fig.17 This is a flowchart showing an example of a display control process when a thumbnail image according to the first embodiment is selected.

[0040] Fig.18 This is a flowchart showing an example of a display control process of a thumbnail window based on a thumbnail display operation according to the first embodiment.

[0041] Fig.19 It is a diagram showing a first example of the thumbnail display operation according to the second embodiment.

[0042] Fig. 20 It is a diagram showing a first example of display control based on the thumbnail display operation according to the second embodiment.

[0043] Fig.21 It is a diagram showing a second example of the thumbnail display operation according to the second embodiment.

[0044] Fig. 22 It is a diagram showing a second example of display control based on the thumbnail display operation according to the second embodiment.

[0045] Fig.23 This is a diagram showing an example of an operation specification of a display mode switching operation according to the third embodiment.

[0046] Fig.24 1 is a diagram showing a first example of display control when switching from the single-screen mode to the three-screen mode according to the third embodiment.

[0047] Fig.25 This is a diagram showing a second example of display control when switching from the single-screen mode to the three-screen mode according to the third embodiment.

[0048] Fig.26 FIG. 3 is a diagram showing a third example of display control when switching from the single-screen mode to the three-screen mode according to the third embodiment.

[0049] Fig. 27 This is a flowchart showing an example of a display control process of a thumbnail window according to the third embodiment.

[0050] Fig.28 This is a diagram showing a fourth example of display control when switching from the single-screen mode to the three-screen mode according to the third embodiment.

[0051] Fig.29It is a diagram showing an example of the thumbnail display operation involved in the third embodiment.

[0052] Fig.30 It is a diagram showing a first example of display control based on a thumbnail display operation according to the third embodiment.

[0053] Fig.31 It is a diagram showing a second example of display control based on the thumbnail display operation according to the third embodiment.

[0054] Description of Reference Numerals

[0055] 10…information processing device; 101…first shell; 102…second shell; 103…hinge mechanism; 11…communication unit; 12…RAM; 13…storage unit; 14…speaker; 15…display unit; 16…camera; 150…display; 155…touch sensor; 161…first acceleration sensor; 162…second acceleration sensor; 17…Hall sensor; 18…control unit; 181…system processing unit; 1811…execution application information generation unit; 182…detection processing unit; 1821…opening and closing detection unit; 1822…posture detection unit; 1823…connection detection unit; 1824…operation detection unit; 183…display processing unit; 1831…display mode determination unit; 1832…display mode switching unit; 1833…thumbnail generation unit; 1834…display control unit. DETAILED DESCRIPTION

[0056] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0057] <First embodiment>

[0058] First, the outline of the first embodiment of the present invention will be described.

[0059] Figure 1: is a three-dimensional diagram showing the appearance of the information processing device 10 involved in the present embodiment. The information processing device 10 involved in the present embodiment is a clamshell (notebook) PC (personal computer). The information processing device 10 includes: a first shell 101, a second shell 102 and a hinge mechanism 103. The first shell 101 and the second shell 102 are approximately quadrilateral plate-shaped (for example, flat plate-shaped) shells. One of the side surfaces of the first shell 101 and one of the side surfaces of the second shell 102 are combined (connected) via the hinge mechanism 103, and the first shell 101 and the second shell 102 can rotate relative to each other around the rotation axis formed by the hinge mechanism 103. The state in which the opening angle θ of the first shell 101 and the second shell 102 around the rotation axis is approximately 0° is the state in which the first shell 101 and the second shell 102 overlap and close. The state in which the first shell 101 and the second shell 102 are closed is called the "closed state" (closed). In the closed state, the surfaces of the first shell 101 and the second shell 102 facing each other are respectively referred to as "inner surfaces", and the surfaces on the opposite side to the inner surfaces are referred to as "outer surfaces". The opening angle θ can also refer to the angle formed by the inner surface of the first shell 101 and the inner surface of the second shell 102. Relative to the closed state, the state in which the first shell 101 and the second shell 102 are opened is referred to as the "open state". The open state is a state in which the first shell 101 and the second shell 102 are relatively rotated until the opening angle θ becomes larger than a preset threshold value (for example, 10°).

[0060] In addition, the information processing device 10 includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided from the inner surface of the first housing 101 to the inner surface of the second housing 102. The camera 16 is provided, for example, on the inner surface of the first housing 101, outside the screen area of ​​the display 150, and can capture a user or the like who is on the side facing the display 150. The display 150 is a flexible display that can be bent according to the opening angle θ formed by the relative rotation of the first housing 101 and the second housing 102 (see FIG. 1 ). Figure 2 , 3). As a flexible display, an organic EL display or the like is used. The information processing device 10 can control the display by treating the entire screen area of ​​the display 150 as a display area DA as a screen structure, or can control the display by dividing the screen area of ​​the display 150 into two display areas, a first display area DA1 and a second display area DA2, to form a dual-screen structure. Here, the first display area DA1 and the second display area DA2 are display areas that do not overlap with each other. Here, the display area corresponding to the inner surface side of the first shell 101 in the screen area of ​​the display 150 is the first display area DA1, and the display area corresponding to the inner surface side of the second shell 102 is the second display area DA2. In the following, the display mode for controlling the display with one screen structure is referred to as a "single-screen mode", and the display mode for controlling the display with a dual-screen structure is referred to as a "dual-screen mode".

[0061] In addition, a touch sensor is provided on the screen area of ​​the display 150. The information processing device 10 can detect a touch operation on the screen area of ​​the display 150. By opening the information processing device 10, the user can visually check the display of the display 150 provided on the inner surface of each of the first housing 101 and the second housing 102, perform a touch operation on the display 150, and use the information processing device 10.

[0062] Next, the usage form and screen mode of the information processing device 10 are described in detail. First, as the usage form of the information processing device 10, according to the opening angle θ of the first shell 101 and the second shell 102, it is divided into a state (Bent form) in which the first shell 101 and the second shell 102 are bent, and a state (Flat form) in which the first shell 101 and the second shell 102 are not bent. In the following, the state (Bent form) in which the first shell 101 and the second shell 102 are bent is simply referred to as "the bent state (Bent form)", and the state (Flat form) in which the first shell 101 and the second shell 102 are not bent is simply referred to as "the flat state (Flat form)". In the bent state (Bent form), the display 150 arranged throughout the first shell 101 and the second shell 102 also becomes a bent state. In the flat state (Flat form), the display 150 also becomes a flat state.

[0063] Figure 2 1 is a side view showing an example of the information processing device 10 in a bent state. The display 150 is arranged across (across) the first housing 101 and the second housing 102. The screen area ( Figure 1The display area DA shown can be bent (curved) with the portion corresponding to the hinge mechanism 103 as a fold line, and with the fold line as a boundary, the display area on the first shell 101 side is represented as the first display area DA1, and the display area on the second shell 102 side is represented as the second display area DA2. The display 150 bends according to the rotation (opening angle θ) of the first shell 101 and the second shell 102. The information processing device 10 determines whether it is in a bent state (Bent form) based on the opening angle θ. As an example, when 10°<θ<170°, the information processing device 10 determines that it is in a bent state (Bent form). This state is equivalent to the so-called clamshell mode, book mode and other usage modes.

[0064] Figure 3 1 is a side view showing an example of the information processing device 10 in a flat state. Typically, when the opening angle θ is 180°, the information processing device 10 is determined to be in a flat state. However, as an example, when 170°≤θ≤180°, it can also be determined to be in a flat state. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat state. This state corresponds to the so-called tablet mode, which is a usage form.

[0065] Next, refer to Figure 4 , the display modes based on various usage modes of the information processing device 10 are described in detail.

[0066] Figure 4 1 is a diagram showing specific examples of various display modes of the information processing device 10 involved in this embodiment. The information processing device 10 has different display modes in different usage modes classified by the opening angle θ of the first housing 101 and the second housing 102, the posture (direction) of the information processing device 10, and whether it is a single-screen mode or a dual-screen mode. In addition, one screen is also called a single screen, and dual screens are also called split screens or dual screens.

[0067] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage mode. For example, in this closed state, the information processing device 10 is in a sleep, dormant, or standby state, and the display 150 is in a display-off state. This sleep, dormant, or standby state is, for example, equivalent to S3 or S4 of the system power state specified by ACPI (Advanced Configuration and Power Interface).

[0068] Display mode (b) is a display mode in a dual-screen mode in which the display is controlled by dividing the screen area of ​​the display 150 into two display areas, namely, the first display area DA1 and the second display area DA2, in a bent state as a usage form. In addition, the direction of the information processing device 10 is a direction in which the first display area DA1 and the second display area DA2 are arranged horizontally in the vertical direction. The display area being vertical means that the long side of the four sides of the rectangular display area is vertical and the short side is horizontal. When the display area is vertical, the display direction is also vertical, and the direction along the long side corresponds to the up-down direction and the direction along the short side becomes the left-right direction. This usage form is a usage form in which the left and right pages of a book when it is opened correspond to the left and right screens, which is equivalent to the so-called book mode. This usage form is a bent state (Bent form) and the first display area DA1 and the second display area DA2 are arranged horizontally, and the display area formed by merging the two is horizontally wide, so it is also called "Fold Landscape".

[0069] In the display mode (b), for example, in a normal operation state, the first display area DA1 on the left side of the information processing device 10 is used as a primary screen, and the second display area DA2 on the right side is used as a secondary screen, thereby achieving a dual-screen display mode. In addition, in the display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.

[0070] Display mode (c-1) is a display mode in a dual-screen mode in which the display is controlled by dividing the screen area of ​​the display 150 into two display areas, the first display area DA1 and the second display area DA2, in a bent state similar to display mode (b), but the direction of the information processing device 10 is different. The direction of the information processing device 10 is a direction in which the first display area DA1 and the second display area DA2 are arranged vertically in the horizontal direction. The horizontal display area means that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display direction is also horizontal, and the display is performed in a direction in which the direction along the short side corresponds to the up-down direction and the direction along the long side becomes the left-right direction. This usage form is one of the general usage forms of clamshell PCs.

[0071] In the display mode (c-1), the information processing device 10, for example, in a normal operation state, has the first display area DA1 as the primary screen and the second display area DA2 as the secondary screen, thereby achieving a dual-screen display mode. In addition, in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.

[0072] For example, the information processing device 10 automatically switches (Switch by Rotation) from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the posture (direction) of the information processing device 10. For example, relative to display mode (b), display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right in the figure. Therefore, if the information processing device 10 detects that the display 150 is rotated to the right by a predetermined angle (for example, 45 degrees) or more from the state of display mode (b), it switches to display mode (c-1). In addition, relative to display mode (c-1), display mode (b) is a state in which the display 150 is rotated 90 degrees to the left in the figure. Therefore, if the information processing device 10 detects that the display 150 is rotated to the left by a predetermined angle (for example, 45 degrees) or more from the state of display mode (c-1), it switches to display mode (b).

[0073] The display mode (c-2) is in the same bent state (Bent form) as the display mode (c-1) and the direction of the information processing device 10 is also the same, but the difference is that an external keyboard 30 (Dockable mini KBD: KeyBord) that can be connected to the information processing device 10 is connected. This usage mode is a state in which the physical keyboard 30 is connected in the general usage mode of the clamshell type PC. For example, the keyboard 30 is almost the same size as the second display area DA2, and is configured to be placed on the second display area DA2. As an example, the keyboard 30 is provided with a magnet inside (end) of the bottom surface, and if placed on the second display area DA2, it is adsorbed and fixed to the metal part of the inner surface end of the second shell 102. As a result, it becomes the same usage mode as a traditional clamshell type PC that originally has a physical keyboard. In addition, the information processing device 10 and the keyboard 30 are connected, for example, via Bluetooth (registered trademark). In this display mode (c-2), in the information processing device 10, the second display area DA2 cannot be visually confirmed due to the keyboard, so it is controlled to be displayed in black or turned off. That is, the display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as a “half screen mode”), and is a single screen mode using only the first display area DA1.

[0074] For example, when the information processing device 10 detects the connection of an external keyboard in the display mode (c-1), the information processing device 10 automatically switches from the display mode (c-1) to the display mode (c-2) (Switch by Dock).

[0075] Display mode (d) is in a bent state (Bent form) like display mode (b) and the direction of the information processing device 10 is also the same, but the difference is that the entire screen area of ​​the display 150 is used as a display area DA to control the display in a single-screen mode. This usage form is different from display mode (b), except that it is a single-screen mode, but it is in a bent state (Bent form) and the display area DA is horizontally wide, so it is also called "Fold Landscape". The display area DA is horizontal, and the display direction is also horizontal.

[0076] Here, the switching between the single screen mode and the dual screen mode in the bent state (Bent form) is performed, for example, by the operation of the user. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single screen mode and the dual screen mode at any location on the screen, and switches from the display mode (b) to the display mode (d) based on the operation of the operator (Switch by UI). A specific example of the display mode switching operation is described later.

[0077] Display mode (e) is in the same bent state (Bent form) as display mode (c-1), and the direction of the information processing device 10 is also the same, but the difference is that the entire screen area of ​​the display 150 is a single screen mode for controlling the display as a display area DA. This usage form is different from display mode (c-1) in that it is a single screen mode, but from the bent state (Bent form) and the direction of the information processing device 10, it is equivalent to the usage form of a clamshell PC. The display area DA is vertical, and the display direction is also vertical.

[0078] For example, the information processing device 10 automatically switches (Switch by Rotation) from display mode (d) to display mode (e), or from display mode (e) to display mode (d) by detecting a change in the posture (direction) of the information processing device 10. For example, relative to display mode (d), display mode (e) is a state in which the display 150 in the figure is rotated 90 degrees to the right, so if the information processing device 10 detects that it has rotated more than a specified angle (for example, 45 degrees) to the right from the state of display mode (d), it switches to display mode (e). In addition, relative to display mode (e), display mode (d) is a state in which the display 150 in the figure is rotated 90 degrees to the left, so if the information processing device 10 detects that it has rotated more than a specified angle (for example, 45 degrees) to the left from the state of display mode (e), it switches to display mode (d).

[0079] The display mode (d′) is a single-screen mode like the display mode (d), and the direction of the information processing device 10 is also the direction in which the display area DA is horizontally wide, but the difference is that it is in a flat state (Flat form). The flat state (Flat form) means that the opening angle θ of the first shell 101 and the second shell 102 is approximately 180°. This usage mode corresponds to the reference Figure 3 The so-called tablet mode described here is a flat state (Flat form), and the display area DA is horizontally wide, so it is also called "Flat Landscape". The display mode (d') is different from the display mode (d) only in the opening angle θ between the first shell 101 and the second shell 102. Similar to the display mode (d), the display area DA is horizontal and the display direction is also horizontal.

[0080] Display mode (e′) is a single-screen mode like display mode (e), and the direction of the information processing device 10 is also the direction in which the display area DA is vertically long, but the difference is that it is in a flat state (Flat form). This usage form is a flat state (Flat form), and the display area DA is vertically long, so it is also called "Flat Portrait". This display mode (e′) is different from display mode (e) only in the opening angle θ of the first shell 101 and the second shell 102. Like display mode (e), the display area DA is vertical, and the display direction is also vertical.

[0081] For example, the information processing device 10 automatically switches (Switch by Rotation) from the display mode (d′) to the display mode (e′), or from the display mode (e′) to the display mode (d′) by detecting a change in the posture (direction) of the information processing device 10. For example, relative to the display mode (d′), the display mode (e′) is a state in which the display 150 in the figure is rotated 90 degrees to the right, so if the information processing device 10 detects that the display mode (d′) is rotated to the right by a predetermined angle (for example, 45 degrees) or more, it switches to the display mode (e′). In addition, relative to the display mode (e′), the display mode (d′) is a state in which the display 150 in the figure is rotated 90 degrees to the left, so if the information processing device 10 detects that the display mode (e′) is rotated to the left by a predetermined angle (for example, 45 degrees) or more, it switches to the display mode (d′).

[0082] In the display mode (d') and the display mode (e'), the user can switch between the single-screen mode and the dual-screen mode by operating the operator (for example, see Figure 5 The display mode switching icon described later) can be operated to switch to the dual-screen mode while maintaining the flat state. For example, if the dual-screen mode is switched from the display mode (d′), the display state is the same as the display mode (b) in the flat state. In addition, if the dual-screen mode is switched from the display mode (e′), the display state is the same as the display mode (c-1) in the flat state.

[0083] In addition, if the information processing device 10 detects the connection with the keyboard 30 in the display mode (e′), it automatically switches (Switch by Dock) from the display mode (e′) to the display mode (c-2′). The display mode (c-2′) is a flat state (Flat form), and with respect to the display mode (c-2), only the opening angle θ of the first shell 101 and the second shell 102 is different. In this display mode (c-2′), in the information processing device 10, the second display area DA2 cannot be visually confirmed due to the keyboard, so it is controlled to be displayed in black or turned off. In other words, this display mode (c-2′) is the same as the display mode (c-2), that is, a half-screen mode in which only half of a screen is effectively displayed.

[0084] In addition, the information processing device 10 can also automatically switch from the single-screen mode to the dual-screen mode (Switch by Hingeangle) by detecting a change from a flat state (Flat form) to a bent state (Bent form). For example, when the information processing device 10 detects a change from the display mode (d′) to the bent state (Bent form) based on the opening angle θ of the first shell 101 and the second shell 102, the information processing device 10 automatically switches from the display mode (d′) to the display mode (b). In addition, when the information processing device 10 detects a change from the display mode (e′) to the bent state (Bent form) based on the opening angle θ of the first shell 101 and the second shell 102, the information processing device 10 automatically switches from the display mode (e′) to the display mode (c-1).

[0085] (Display mode switching operation)

[0086] Next, a specific example of the operation specification when the display mode is switched by the user's operation will be described.

[0087] Figure 5 is a diagram showing an example of an operation specification of a display mode switching operation according to the present embodiment. Figure 5 As shown in (A), the icon C1 for displaying the switching menu of the display mode is displayed in the task bar B2. The task bar B2 is displayed in any area in the screen area of ​​the display 150. For example, regardless of the single screen mode or the dual screen mode, the task bar B2 is displayed only in one place in the screen area of ​​the display 150 (for example, the bottom of the screen area). In addition, in the case of the dual screen mode, the task bar B2 can also be displayed in the first display area DA1 and the second display area DA2 (for example, the bottom of each area).

[0088] If the icon C1 for displaying the switching menu is operated, the switching menu of the display mode is displayed as a pop-up screen. In addition, the switching menu of the display mode may be displayed as a pop-up screen when the bent state (Bent form) is changed to the unbent flat state (Flat form). In addition, the switching menu of the display mode may be displayed as a pop-up screen when the flat state (Flat form) is changed to the bent state (Bent form).

[0089] The switching menu displays a display mode switching icon as a selection item of the display mode, and the display mode switching icon is used by the user to instruct the switching between the single-screen mode and the dual-screen mode, and the replacement of the display data of the first display area DA1 and the second display area DA2 respectively displayed in the dual-screen mode (replacement of the primary screen and the secondary screen). The switching menu displays the selection items of the display mode that the user can select according to the current usage form (the direction of the display 150).

[0090] Figure 5 (B) represents the switching menu M1 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.). In addition, "1" and "2" in the figure are added to distinguish the display areas. For example, in each display area, a number according to the priority of the area set in advance is used to represent it. For example, in dual-screen mode, "1" has a higher priority than "2", for example, it indicates the primary screen, and "2" indicates the secondary screen. Display mode switching icon C11, display mode switching icon C12 and display mode switching icon C13 are displayed in the switching menu M1. Display mode switching icon C11 is displayed as an operator for selecting display mode (d) and display mode (d') of single-screen mode (that is, an icon that accepts user operation for switching to single-screen mode). The display mode switching icon C12 and the display mode switching icon C13 are displayed as operators for selecting the display mode (b) of the dual-screen mode, and in the display mode switching icon C12 and the display mode switching icon C13, the arrangement of "1" (primary screen) and "2" (secondary screen) is different.

[0091] In addition, the display mode switching icon corresponding to the current display mode is displayed in a display manner that can be distinguished from other display mode switching icons. Here, the display mode switching icon C11 is highlighted relative to the other display mode switching icons C12 and C13 so that it can be known that the display mode switching icon C11 is the current display mode. In this figure, hatching is used as an emphasis display, but it can also be expressed by making the color, contrast, size, frame thickness, etc. different, and it can also be expressed by adding a mark, text, etc.

[0092] Figure 5(C) represents the switching menu M2 displayed when the usage form is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e′) etc.). Display mode switching icon C21, display mode switching icon C22 and display mode switching icon C23 are displayed in the switching menu M2. Display mode switching icon C21 is displayed as an operator for selecting the single screen mode (display mode (e) and display mode (e′)). Display mode switching icon C22 and display mode switching icon C23 are displayed as operators for selecting display mode (c-1) of the dual screen mode, and in display mode switching icon C22 and display mode switching icon C23, the arrangement of "1" (primary screen) and "2" (secondary screen) is different.

[0093] In addition, Figure 5 Similarly, in the switching menu M1 shown in (B), the display mode switching icon corresponding to the current display mode is displayed in a manner that can be distinguished from other display mode switching icons. Here, the display mode switching icon C21 is highlighted relative to the other display mode switching icons C22 and C23 so that it is known that the display mode switching icon C21 is the current display mode.

[0094] The user can arbitrarily select any one of the display mode switching icons displayed in the switching menu M1 or the switching menu M2. When the user selects any one of the display mode switching icons, the display of the switching menu ends. Alternatively, when a specified time (for example, 3 to 5 seconds) has passed after the switching menu M1 or the switching menu M2 is displayed and the user has not selected any of the display mode switching icons, the display of the switching menu ends. In addition, when the user operates the close button "×" on the upper right corner of the switching menu, when the user operates outside the screen of the pop-up switching menu, or when the direction of the information processing device 10 is changed, the display of the switching menu ends. In addition, when the keyboard 30 is connected, it is fixed to display only the valid half-screen mode (display mode (c-2)) in the first display area DA1, so the switching menu is not displayed.

[0095] In addition, the UI for switching between the single-picture mode and the dual-picture mode is not limited to Figure 5 In the example shown, any UI can be used. For example, an icon that alternately switches between the single-screen mode and the dual-screen mode each time an operation is performed, or an icon that sequentially switches between the single-screen mode, the dual-screen mode, and the inverted dual-screen mode each time an operation is performed can also be displayed on the taskbar B2. In addition, in the following description, when the dual-screen mode and the inverted dual-screen mode are not particularly distinguished, they are collectively referred to as the dual-screen mode.

[0096] In addition, Figure 5 In the example shown, the display mode switching menu is displayed as a pop-up screen by operating the icon C1 displayed on the taskbar B2, but the switching menu can also be displayed as a pop-up screen by dragging the application window. In addition, the display mode can also be switched by dragging the application window. In the case where the switching menu pops up by dragging the application window, it is also possible to drag on one of the divided areas of the screen area displayed on the switching menu, so that not only the screen mode can be selected, but also the screen area can be selected, and the dragged application can be arranged in the selected area. In addition, the switching menu can also be displayed as a pop-up screen by operating a specific place in the application window.

[0097] (Display control when switching from single-picture mode to dual-picture mode)

[0098] Next, the display control when switching from the single-screen mode to the dual-screen mode is described. When the information processing device 10 switches from the single-screen mode to the dual-screen mode, one of the windows of the application (hereinafter referred to as "application") executed in the single-screen mode is displayed in the first display area DA1 (for example, the primary screen). For example, the information processing device 10 displays the active window of the window of the application executed in the single-screen mode in the first display area DA1.

[0099] Here, when multiple windows are opened, the windows are arranged one by one in overlapping layers on the display 150. The active window refers to the window currently selected as the operation target of the user, for example, the window displayed in the frontmost layer (the uppermost layer) arranged on the display 150. The active window displayed in the first display area DA1 when the information processing device 10 switches from the single-screen mode to the dual-screen mode is the window displayed as the active window in the single-screen mode before switching to the dual-screen mode.

[0100] In addition, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, the active window in the single-screen mode is displayed in the first display area DA1, but if there is no active window, the window with the highest priority among the windows displayed in the display area DA in the single-screen mode is displayed in the first display area DA1.

[0101] The window with the highest priority is typically the active window, but when there is no active window, the window that becomes the last active window is displayed. For example, when an operation is performed on a part other than a window in the display area DA, there is no active window, and the window that becomes the last active window is displayed in the first display area DA1. That is, the later the window becomes the active window, the higher the display priority is, and the window with the highest priority is displayed in the first display area DA1. However, in order to facilitate the understanding of the description, in the following description, the window with the highest priority is recorded as the "active window" for description.

[0102] In addition, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, the second display area DA2 (for example, the secondary screen) displays thumbnail images corresponding to inactive windows other than the active window among the windows in the single-screen mode. Here, the inactive window is a window other than the active window in the single-screen mode before the transition to the dual-screen mode. In the following, the window displaying the thumbnail image of the inactive window is also referred to as a "thumbnail window".

[0103] Reference Figure 6 , a display example of the dual-picture mode in which a thumbnail window is displayed in the second display area DA2 when switching from the single-picture mode to the dual-picture mode is described.

[0104] Figure 6 is a diagram showing a display example of the dual screen mode according to the present embodiment. Figure 4 An example of a display in dual-screen mode under the display mode (c-1) shown. This is a general usage form of a clamshell PC in dual-screen mode, in which the first display area DA1 and the second display area DA2 are arranged horizontally in the vertical direction. The display area is a horizontally rectangular display area in which the long side is horizontal and the short side is vertical. The vertical direction corresponds to the vertical (up and down) direction, and the horizontal direction corresponds to the horizontal (left and right) direction. The vertical direction is typically the plumb direction. That is, the first display area DA1 and the second display area DA2 are configured so that the end side that becomes the lower side in the display direction of the first display area DA1 becomes the end side that becomes the upper side in the display direction of the second display area DA2.

[0105] When the information processing device 10 switches from the single-screen mode to the dual-screen mode, the active window of the application being executed in the single-screen mode is displayed in the first display area DA1. For example, when switching to the dual-screen mode, the information processing device 10 maximizes the active window displayed in the display area DA in the single-screen mode to the entire display area of ​​the first display area DA1 and displays it as the active window. In addition, when switching to the dual-screen mode, the information processing device 10 makes the window that is an inactive window in the single-screen mode correspond to the layer behind the frontmost active window displayed in the first display area DA1 in a state that maintains the layer relationship (overlapping order of windows) in the single-screen mode. As a result, in the first display area DA1, the active window is displayed in a maximized manner, and the inactive window is not displayed (not visible to the user) although it exists in the layer behind the active window.

[0106] In addition, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, it generates a thumbnail image of the window that is an inactive window in the single-screen mode and displays the thumbnail window in the second display area DA2 (secondary screen). When there are multiple inactive windows, the information processing device 10 displays a thumbnail window in which the thumbnail images of the multiple inactive windows are arranged in the second display area DA2.

[0107] For example, thumbnail images (reduced images) of a plurality of windows are displayed in a row in a thumbnail window. A title bar B1 is displayed at the upper end of the thumbnail window. A close button "X" at the right end of the title bar B1 is displayed as an operator for closing the thumbnail window. The user can also close all thumbnail images (make them invisible) by operating (e.g., tapping) the close button "X" of the title bar B1.

[0108] In addition, the inactive window (i.e., the main body (actual window) of the inactive window displaying the thumbnail image in the second display area DA2) existing in the layer behind the active window in the first display area DA1 can also be configured in an overlapping manner with the same size according to priority so as to be hidden behind the active window, or can be configured in an overlapping manner with a size smaller than the active window according to priority. In addition, the inactive window (i.e., the main body (actual window) of the inactive window displaying the thumbnail image in the second display area DA2) can also be temporarily minimized in its entirety (for example, in a state where only the icon of the application exists on the taskbar in Windows (registered trademark)), or, in the case where the thumbnail window is not displayed semi-transparently, it can also be configured on its back. In short, the main body (actual window) of the inactive window displaying the thumbnail image in the second display area DA2 only needs to be processed so as to be temporarily invisible to the user. Moreover, in the second display area DA2, the window of the application of the thumbnail image selected in the thumbnail window is then displayed in the front as the active window.

[0109] In addition, the task bar B2 displayed at the lower end of the second display area DA2 corresponds to Figure 5 The task bar B2 shown is displayed in one place as a task bar shared by the first display area DA1 and the second display area DA2. In addition, the position where the task bar B2 is displayed can also be set to the left end or right end of the first display area DA1 or the second display area DA2, or can be set to the upper end of the first display area DA1. In addition, as described above, the task bar can also be displayed in each area of ​​the first display area DA1 and the second display area DA2. Regardless of the position where the task bar is displayed, the application of the present invention is not limited.

[0110] In addition, Figure 6 , an example is shown in which a thumbnail window including a title bar B1 is displayed when a thumbnail image is displayed in the second display area DA2 , but the title bar B1 may not be displayed, or a plurality of thumbnail images may be displayed in a row.

[0111] When any thumbnail image is selected by a user operation (e.g., a tap operation), the information processing device 10 closes (does not display) the thumbnail window displayed in the second display area DA2, and displays the inactive window corresponding to the selected thumbnail image as the active window in the second display area DA2. Specifically, as an example, the information processing device 10 moves the inactive window corresponding to the selected thumbnail image from the first display area DA1 to the second display area DA2, and then maximizes and displays it as the active window in the second display area DA2.

[0112] Here, when there is only one window in the single-screen mode, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, the active window is displayed in the first display area DA1, but there is no thumbnail image displayed in the second display area DA2, so the thumbnail window is not displayed. For example, in the second display area DA2, there is no window displayed and the desktop screen is displayed.

[0113] In addition, when there are two windows in the single-screen mode, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, the active window is displayed in the first display area DA1, and the thumbnail window is not displayed in the second display area DA2, but an inactive window other than the active window is displayed. This is because, even if only a thumbnail image of an inactive window is displayed in the second display area DA2, in order to display the window of the thumbnail image, it is necessary to deliberately select the one thumbnail image, so as to avoid the operation becoming complicated. There is only one inactive window that does not accept the selection operation as a thumbnail image, and it is not necessary to deliberately select the thumbnail image when it is displayed as an inactive window in the second display area DA2, so the convenience is good.

[0114] That is, when the information processing device 10 switches from the single screen mode to the dual screen mode, the second display area DA2 controls whether to display thumbnail windows (thumbnail images) based on the number of windows of applications executed in the single screen mode.

[0115] Figure 7 1 is a diagram showing a first example of display control when switching from the single-screen mode to the dual-screen mode according to the present embodiment. Figure 7 (A) shows a display example of single-screen mode. Figure 7 (B) represents a display example after switching to dual-screen mode. In the illustrated example, the number of windows of the application executed in the single-screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA. Window W1 is an active window configured in the frontmost layer (the topmost layer). If switching from single-screen mode to dual-screen mode, window W1 is maximized and displayed as an active window in the first display area DA1, and thumbnail images SW2 and SW3 of windows W2 and W3 are displayed in the second display area DA2. Thumbnail windows. In addition, if the number of windows of the application executed in the single-screen mode is four or more, the number of thumbnail images displayed in the second display area DA2 when switching to dual-screen mode is also three or more.

[0116] Figure 8 2 is a diagram showing a second example of display control when switching from the single-screen mode to the dual-screen mode according to the present embodiment. Figure 8 (A) shows a display example of single-screen mode. Figure 8(B) shows a display example after switching to dual-screen mode. In the illustrated example, the number of windows of the application executed in the single-screen mode is two. Here, two windows W1 and W2 are shown in the display area DA. Window W1 is an active window configured in the frontmost layer (the topmost layer). If switching from single-screen mode to dual-screen mode, window W1 is maximized and displayed as an active window in the first display area DA1, and window W2 is maximized and displayed as an inactive window in the second display area DA2. In addition, if the number of windows of the application executed in the single-screen mode is one or less, when switching to dual-screen mode, neither the application window nor the thumbnail window (thumbnail image of the window) is displayed in the second display area DA2.

[0117] In this way, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, if the number of windows in the single-screen mode is more than two (the number of display areas in the dual-screen mode), the thumbnail window in which the thumbnail images of the windows in the single-screen mode other than the active window are arranged is displayed in the second display area DA2. On the other hand, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, if the number of windows in the single-screen mode is less than two (the number of display areas in the dual-screen mode), the thumbnail window is not displayed, and if the number of windows in the single-screen mode is two, the inactive window in the single-screen mode is displayed in the second display area DA2.

[0118] That is, when the information processing device 10 switches from the single screen mode to the dual screen mode, it controls whether to display thumbnail images in the second display area DA2 based on the number of display areas in the dual screen mode and the number of windows in the single screen mode.

[0119] In addition, the window of the application executed in the single screen mode may be minimized. In this case, the minimized window may not be included in the number of windows in the single screen mode.

[0120] For example, in Figure 7 In the case where the window W3 is minimized in the single-screen mode shown in (A), the number of windows in the single-screen mode is set to two windows W1 and W2. When switching to the dual-screen mode, the same can also be done as shown in FIG. Figure 8 As shown in (B) of FIG. 8 , the window W1 is maximized and displayed as an active window in the first display area DA1 , and the window W2 is maximized and displayed as an inactive window in the second display area DA2 .

[0121] Here, when the number of windows of the executing application is large, the user can display the window by selecting any thumbnail image, so the convenience is good. However, there are cases where the user wants to further switch to other windows for display, or wants to specify either the first display area DA1 or the second display area DA2 when displaying the window.

[0122] Therefore, the information processing device 10 according to the present embodiment can display (redisplay) thumbnail images of windows of executing applications by a user performing a predetermined operation. Hereinafter, the predetermined operation of displaying (redisplaying) the thumbnail images is referred to as a "thumbnail display operation".

[0123] Fig. 9 1 is a diagram showing a first example of thumbnail display operation according to the present embodiment. Figure 5 The switching menu M2 shown in (C) corresponds to the Fig. 9 The switching menu M2 shown is displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.), and the current display mode is the dual screen mode corresponding to the display mode switching icon C22.

[0124] The display mode switching icon C22 is the current display mode, and therefore is highlighted relative to the other display mode switching icons C21 and C23. Figure 5 As explained above, the display mode switching icon C22 functions as an operator for accepting user operations for switching to each display mode. On the other hand, the display mode switching icon C22 as the current display mode does not need to function as an operator for switching the display mode, and therefore functions as an operator for displaying thumbnail images (thumbnail windows). That is, the display mode switching icon C22 as the current display mode is displayed as an icon for accepting thumbnail display operations. For example, Fig.10 This shows an example of display control in which a thumbnail window is displayed in the second display area DA2 when the user performs an operation to select the display area indicated by "2" (the second display area DA2) in the display mode switching icon C22.

[0125] Fig.10 It is a diagram showing a first example of display control based on thumbnail display operation according to the present embodiment. Fig.10 (A) shows an example in which the window W1 is maximized in the first display area DA1 and the window W2 is maximized in the second display area DA2 in the dual-screen mode. Figure 7In the case where an operation of selecting the thumbnail image SW2 among the thumbnail images SW2 and SW3 displayed in the second display area DA2 is performed in (B), the control is performed as follows: Fig.10 The display state shown in (A) is shown in FIG. Fig.10 (A) is also Figure 8 The display state shown in (B).

[0126] In this Fig.10 In the display state shown in (A), if Fig. 9 As shown in FIG. 1 , the user performs an operation to select the display area (second display area DA2) indicated by “2” of the display mode switching icon C22. Fig.10 As shown in (B), a thumbnail window is displayed in the second display area DA2. At this time, all thumbnail images of the windows of the executing application are displayed in the thumbnail window of the second display area DA2. Figure 7 As shown in FIG. 1 , when the number of windows of the application being executed is three (windows W1, W2, and W3), if a thumbnail display operation is performed, Fig.10 As shown in (B) , three thumbnail images (thumbnail images SW1 , SW2 , and SW3 ) are displayed.

[0127] Reference Fig. 9 , 10 , the thumbnail display operation is explained when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e') etc.), but it can also be used when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d') etc.) Figure 5 The switching menu M1 shown in (B) performs the thumbnail display operation in the same manner.

[0128] In addition, refer to Fig. 9 , 10 , an example of displaying a thumbnail window by specifying the second display area DA2 through a thumbnail display operation is described, and then, referring to Fig.11 , 12 , an example of designating the first display area DA1 to display the thumbnail window is described.

[0129] Fig.11 2 is a diagram showing a second example of thumbnail display operation according to the present embodiment. Fig. 9 The example shown also indicates that the current display mode is the dual screen mode corresponding to the display mode switching icon C22. Fig.12This shows an example of display control in which a thumbnail window is displayed in the first display area DA1 by the user performing an operation of selecting the display area indicated by “1” (first display area DA1 ) in the display mode switching icon C22 .

[0130] Fig.12 It is a diagram showing a second example of display control based on the thumbnail display operation involved in this embodiment. Fig.12 (A) and Fig.10 Similarly, (A) shows an example in which the window W1 is maximized and displayed in the first display area DA1 and the window W2 is maximized and displayed in the second display area DA2 in the dual-screen mode. Fig.12 In the display state shown in (A), if Fig.11 As shown in FIG. 1 , the user performs an operation to select the display area (first display area DA1) indicated by “1” of the display mode switching icon C22. Fig.12 As shown in (B), a thumbnail window is displayed in the first display area DA1. At this time, in the thumbnail window of the first display area DA1, all thumbnail images of the windows of the running application are displayed. For example, when the number of windows of the running application is three (windows W1, W2, and W3), if a thumbnail display operation is performed, Fig.10 As shown in (B) , three thumbnail images (thumbnail images SW1 , SW2 , and SW3 ) are displayed.

[0131] Furthermore, the thumbnail display operation may be effective even when the thumbnail window is displayed. Fig.13 It is a diagram showing a third example of display control based on the thumbnail display operation involved in this embodiment. Fig.13 (A) means Figure 7 In the dual-screen mode, as shown in (B), the window W1 is displayed in the first display area DA1 and the thumbnail window is displayed in the second display area DA2. Fig.13 In the display state shown in (A), if Fig.11 As shown in FIG. 1 , the user performs an operation to select the display area (first display area DA1) indicated by “1” of the display mode switching icon C22. Fig.13 As shown in (B), a thumbnail window is displayed in the first display area DA1. At this time, unlike the thumbnail window in the second display area DA2, all thumbnail images of the windows of the running application are displayed in the thumbnail window in the first display area DA1. For example, when there are three windows of the running application (windows W1, W2, and W3), if a thumbnail display operation is performed, Fig.10 As shown in (B) , three thumbnail images (thumbnail images SW1 , SW2 , and SW3 ) are displayed.

[0132] In this way, when a display area is designated by a thumbnail display operation to display thumbnail windows, a window displayed in the designated display area can be selected from windows of an application being executed, regardless of whether it is an active window or an inactive window.

[0133] (Structure of Information Processing Device 10)

[0134] Hereinafter, the specific structure of the information processing device 10 will be described.

[0135] Fig.14 1 is a block diagram showing an example of the hardware structure of the information processing device 10 involved in this embodiment. The information processing device 10 includes: a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, and a control unit 18. These units are connected to each other via a bus or the like so as to be communicable.

[0136] The communication unit 11 is configured to include, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), Bluetooth (registered trademark), Wi-Fi (registered trademark) and other communication devices for wireless communication, etc. For example, the communication unit 11 can communicate with the external keyboard 30 described above using Bluetooth (registered trademark).

[0137] In RAM 12, the programs and data of the processing executed by the control unit 18 are expanded, and various data are appropriately saved or deleted. For example, RAM 12 also functions as a video memory (V-RAM) for displaying the display 150. As an example, RAM 12 functions as a video memory for data displayed in each display area when controlling the display 150 in single-screen mode or dual-screen mode. In addition, information of the application being executed, the application in use (the application of the active window) among the applications being executed, information of the application of the other inactive windows, which display area each window is displayed in, which layer it is configured in, the size of the window, whether it is minimized, and the like are stored in RAM 12. In addition, since RAM 12 is a volatile memory, if the power supply to RAM 12 is stopped, the data is not retained. The data that needs to be retained when the power supply to RAM 12 is stopped is migrated to the storage unit 13.

[0138] The storage unit 13 is configured to include any one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Read Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores a BIOS (Basic Input Output System) program, setting data, an OS (Operating System), a program of an application that operates on the OS, and various data used in the application.

[0139] The speaker 14 outputs electronic sounds, voices, and the like.

[0140] The display unit 15 includes a display 150 and a touch sensor 155. The display 150 is a flexible display that can be bent according to the opening angle θ formed by the relative rotation of the first housing 101 and the second housing 102 as described above. The display 150 is controlled by the control unit 18 to communicate with the reference Figure 4 The display corresponding to each display mode described is shown. The touch sensor 155 is provided on the screen of the display 150 to detect touch operations on the screen. For example, in the single-screen mode, the touch sensor 155 detects touch operations on the display area DA. In addition, in the dual-screen mode, the touch sensor 155 detects touch operations on one or both of the first display area DA1 and the second display area DA2. Touch operations include tapping operations, sliding operations, tapping operations, knocking operations, pinching operations, etc. The touch sensor 155 detects touch operations and outputs operation information based on the detected operations to the control unit 18.

[0141] The camera 16 is configured to include a lens, an imaging element, etc. The camera 16 captures an image (still image, moving image) under the control of the control unit 18 and outputs data of the captured image.

[0142] The first acceleration sensor 161 is disposed inside the first housing 101, and detects the direction and direction change of the first housing 101. For example, if the direction parallel to the long side direction of the first display area DA1 is set as the X1 direction, the direction parallel to the short side direction is set as the Y1 direction, and the direction perpendicular to the X1 direction and the Y1 direction is set as the Z1 direction, the first acceleration sensor 161 detects the acceleration in each direction of the X1 direction, the Y1 direction, and the Z1 direction, and outputs the detection result to the control unit 18.

[0143] The second acceleration sensor 162 is disposed inside the second housing 102, and detects the direction and direction change of the second housing 102. For example, if the direction parallel to the long side direction of the second display area DA2 is set as the X2 direction, the direction parallel to the short side direction is set as the Y2 direction, and the direction perpendicular to the X2 direction and the Y2 direction is set as the Z2 direction, the second acceleration sensor 162 detects the acceleration in each direction of the X2 direction, the Y2 direction, and the Z2 direction, and outputs the detection result to the control unit 18.

[0144] The Hall sensor 17 is provided to detect the connection of the keyboard 30. For example, if the keyboard 30 is placed on the second display area DA2 of the second housing 102, the magnetic field changes due to the proximity of the magnet provided inside the bottom surface of the keyboard 30, and the detection value (output value) of the Hall sensor 17 changes. In other words, the Hall sensor 17 outputs different detection results depending on whether the keyboard 30 is placed. In addition, the Hall sensor 17 is used here to detect whether the keyboard 30 is placed, but the detection method is not limited to this, and any detection method can be used.

[0145] The control unit 18 is configured to include a processor such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and implements various functions by executing programs (BIOS, OS, various programs such as applications running on the OS) stored in the storage unit 13, etc. For example, the control unit 18 detects the posture (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. In addition, the control unit 18 detects whether it is in an open state or a closed state, and whether it is in a bent state (Bent form) or a flat state (Flat form) in the case of an open state, etc. based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.

[0146] In addition, the control unit 18 detects a display mode switching operation (for example, Figure 5 In addition, the control unit 18 detects the connection with the keyboard 30 based on the detection result of the Hall sensor 17. In addition, the connection with the keyboard 30 refers to placing the keyboard 30 on the second display area DA2, and does not refer to the communication connection. For the communication connection with the keyboard 30, the control unit 18 uses the function of Bluetooth (registered trademark) and the like to detect it.

[0147] The control unit 18 detects the system status, the posture (orientation) of the information processing device 10, whether it is in the open state or the closed state, and whether it is in the bent state (Bent form) or the flat state (Flat form) in the open state, and the display mode switching operation based on the user (see Figure 5 ), and the connection with the keyboard 30, etc., for reference Figure 4 as well as Figures 6 to 13 The control of the display of the display 150 is described.

[0148] Next, among the processes executed by the control unit 18 , a functional configuration related to the display control process will be described.

[0149] Fig.15 1 is a block diagram showing an example of a functional structure related to display control processing involved in this embodiment. The control unit 18 includes a system processing unit 181, a detection processing unit 182, and a display processing unit 183. Here, the system processing unit 181 is, for example, a functional structure in which a CPU executes processing based on an OS or BIOS. In addition, the detection processing unit 182 is, for example, a functional structure in which a microcomputer different from a CPU that executes processing of an OS or BIOS executes various detection processing. The display processing unit 183 is, for example, a functional structure in which a CPU executes processing based on an OS or a program running on the OS.

[0150] The system processing unit 181 executes various programs such as the OS, drivers that operate on the OS, and applications. In addition, the system processing unit 181 includes, for example, an execution application information generation unit 1811. The execution application information generation unit 1811 generates application information, which includes identification information of the application being executed (for example, application ID) and information indicating the application being used by the user among the executing applications (that is, the application with active window). In addition, the execution application information generation unit 1811 generates window information indicating the state of the window of the executing application. The state of the window refers to whether it is an active window and the size of the window (minimized, maximized, etc.). The execution application information generation unit 1811 causes the RAM 12 to store and maintain the generated application information and window information.

[0151] The detection processing unit 182 includes an opening / closing detection unit 1821, a posture detection unit 1822, and a connection detection unit 1823 as functional components for detecting the state of the information processing device 10. The detection processing unit 182 outputs the detection results of the opening / closing detection unit 1821, the posture detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.

[0152] The opening and closing detection unit 1821 detects whether the information processing device 10 is in an open state or a closed state based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. In addition, when the information processing device 10 is in an open state, the opening and closing detection unit 1821 detects the opening angle θ of the first housing 101 and the second housing 102 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Moreover, the opening and closing detection unit 1821 detects whether the information processing device 10 is in a bent state (Bent form) or a flat state (Flat form) based on the detected opening angle θ.

[0153] The posture detection unit 1822 detects the posture (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162 .

[0154] The connection detection unit 1823 detects the connection with the keyboard 30. For example, the connection detection unit 1823 detects whether the keyboard 30 is placed on the second display area DA2 based on the detection result of the Hall sensor 17, thereby detecting the connection with the keyboard 30. The detection processing unit 182 outputs the detection results (the status of the information processing device 10) of the opening and closing detection unit 1821, the posture detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.

[0155] In addition, the detection processing unit 182 includes an operation detection unit 1824 as a functional structure for detecting an operation on the information processing device 10. The operation detection unit 1824 detects the user's operation based on the operation information output from the touch sensor 155 provided on the screen of the display 150. For example, the operation detection unit 1824 obtains the user's operation based on the user's operation on the switching menu screen (see Figure 5 , 9 , 11) and detects the display mode switching operation or thumbnail display operation of the user switching the display mode based on the acquired operation information. The detection processing unit 182 outputs the detected user operation information to the display processing unit 183.

[0156] The display processing unit 183 determines and switches the display mode based on the opening and closing state and posture (direction) of the information processing device 10 obtained from the detection processing unit 182, the user's operation, etc. In addition, the display processing unit 183 controls the display of the windows (active windows and inactive windows) of the executing application according to the display mode, etc. based on the application information obtained from the system processing unit 181. Specifically, the display processing unit 183 includes a display mode determination unit 1831, a display mode switching unit 1832, a thumbnail generation unit 1833, and a display control unit 1834.

[0157] The display mode determination unit 1831 performs a determination process for determining the display mode based on the state of the information processing device 10 detected by the detection processing unit 182 or the detection result regarding the user's operation. For example, the display mode determination unit 1831 obtains from the detection processing unit 182 the detection result of the open or closed state of the information processing device 10, the detection result of whether the information processing device 10 is in a bent state (Bent form) or a flat state (Flat form) in the open state, the detection result of the posture (direction) of the information processing device 10, and the user's operation information. Furthermore, the display mode determination unit 1831 determines the reference mode based on the detection results and operation information obtained from the detection processing unit 182. Figure 4 Display mode for explanation.

[0158] The display mode switching unit 1832 switches the display mode to the reference mode based on the display mode determined by the display mode determination unit 1831. Figure 4 For example, the display mode switching unit 1832 sets the display mode such as switching to a single screen mode, a dual screen mode (or an inverted dual screen mode), a half screen mode, the direction of each display area, the display content of each display area, etc. based on the display mode determined by the display mode determination unit 1831.

[0159] The thumbnail generation unit 1833 generates a thumbnail image corresponding to the window of the executing application. For example, when switching from the single-screen mode to the dual-screen mode, the thumbnail generation unit 1833 generates a thumbnail image corresponding to the inactive window of the executing application in the second display area DA2 as a thumbnail image for display as a thumbnail window. In addition, for example, the thumbnail generation unit 1833 generates a thumbnail image corresponding to the window of the executing application in the display area specified by the thumbnail display operation as a thumbnail image for display as a thumbnail window. In addition, the thumbnail generation unit 1833 basically generates thumbnail images including minimized windows as inactive windows.

[0160] The display control unit 1834 performs display control processing to output and display display data of application windows and thumbnail windows displayed in each display area in accordance with the display mode set by the display mode switching unit 1832 .

[0161] For example, when the display mode switching unit 1832 switches from the single screen mode to the dual screen mode, the display control unit 1834 displays the active window (active window displayed in the display area DA) among the windows of the application executed in the single screen mode in the first display area DA1.

[0162] In addition, when the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode, the display control unit 1834 controls whether to display thumbnail images corresponding to inactive windows other than the active window in the single-screen mode for the second display area DA2 based on the number of windows in the single-screen mode. For example, when the number of windows in the single-screen mode is more than two (the number of display areas in the dual-screen mode), the display control unit 1834 causes the thumbnail windows arranged with thumbnail images of inactive windows in the single-screen mode to be displayed in the second display area DA2 (see FIG. 1 ). Figure 7 ).

[0163] On the other hand, when the number of windows in the single-screen mode is two or less (the number of display areas in the dual-screen mode), the display control unit 1834 does not display the thumbnail window in the second display area DA2 when switching to the dual-screen mode. For example, when the number of windows in the single-screen mode is two, the display control unit 1834 causes the inactive window in the single-screen mode to be displayed in the second display area DA2 (see Figure 8 ). In addition, when the number of windows in the single-screen mode is one or less, the display control unit 1834 displays neither the application window nor the thumbnail window (thumbnail image of the window) in the second display area DA2 when switching to the dual-screen mode.

[0164] Furthermore, the display control unit 1834 may not include windows minimized when the single-screen mode is switched to the dual-screen mode by the display mode switching unit 1832 in the number of windows in the single-screen mode.

[0165] In addition, when any one of the thumbnail images displayed in the second display area DA2 in the dual screen mode is selected, the display control unit 1834 displays the inactive window corresponding to the selected thumbnail image as the active window in the second display area DA2. For example, the display control unit 1834 maximizes and displays the inactive window corresponding to the selected thumbnail image as the active window in the second display area DA2.

[0166] Furthermore, when the detection processing unit 182 detects a thumbnail display operation performed by the user, the display control unit 1834 displays a thumbnail window in the display area designated by the thumbnail display operation based on the operation information acquired from the detection processing unit 182 .

[0167] For example, when the display control unit 1834 switches from the single-screen mode to the dual-screen mode, the thumbnail images corresponding to the inactive windows in the single-screen mode other than the active window are displayed in the thumbnail window displayed, but in the case where the thumbnail window is displayed by detecting a thumbnail display operation, not only the thumbnail images corresponding to the inactive windows but also the thumbnail images corresponding to the active windows (for example, the active window in the single-screen mode) are displayed.

[0168] In addition, the display control unit 1834 controls the thumbnail window displayed in the second display area DA2 to be hidden when switching from the single-screen mode to the dual-screen mode, for example, and then detects the thumbnail display operation and displays the thumbnail window in the display area specified by the thumbnail display operation. That is, after the display control unit 1834 sets the thumbnail window to be hidden, it can be displayed again in any display area by the thumbnail display operation.

[0169] (Operation of the display control process of the thumbnail window)

[0170] Next, the operation of the display control process of the control unit 18 for controlling whether or not to display the thumbnail window when switching from the single-screen mode to the dual-screen mode will be described.

[0171] Fig.16 This is a flowchart showing an example of a display control process of a thumbnail window when the screen mode is switched according to the present embodiment.

[0172] (Step S101) The control unit 18 determines whether to switch from the single-screen mode to the dual-screen mode. For example, the control unit 18 determines whether to switch from the single-screen mode to the dual-screen mode based on the detected reference image. Figure 4 As explained above, the change from a flat state (Flat form) to a bent state (Bent form) or the reference Figure 5 The control unit 18 determines whether to switch from the single-screen mode to the dual-screen mode by performing the display mode switching operation described above. When the control unit 18 determines that the switch from the single-screen mode to the dual-screen mode has not been performed (No), the control unit 18 continues the single-screen mode and performs the processing of step S101 again. On the other hand, when the control unit 18 determines that the switch from the single-screen mode to the dual-screen mode has been performed (Yes), the control unit 18 switches to the dual-screen mode in which the display area DA is divided into two display areas, namely the first display area DA1 and the second display area DA2, and enters the processing of step S103.

[0173] (Step S103) The control unit 18 determines whether the number of windows in the single-screen mode before switching to the dual-screen mode is two or less. If the control unit 18 determines that the number of windows in the single-screen mode is two or less (Yes), the process proceeds to step S105. On the other hand, if the control unit 18 determines that the number of windows in the single-screen mode is more than two (No), the process proceeds to step S109.

[0174] (Step S105) The control unit 18 sets the display of the thumbnail window to be off when switching to the dual-screen mode, and proceeds to the process of step S107.

[0175] (Step S107) The control unit 18 displays the active window in the single-screen mode in the first display area DA1, and displays the inactive window in the single-screen mode in the second display area DA2 (see Figure 8 ) In addition, when the number of windows in the single screen mode is one, the control unit 18 displays neither the application window nor the thumbnail window in the second display area DA2.

[0176] (Step S109) The control unit 18 sets the display of the thumbnail window to be enabled when switching to the dual screen mode, and proceeds to the process of step S111.

[0177] (Step S111) The control unit 18 displays the active window in the single-screen mode in the first display area DA1, and displays the thumbnail windows in which the thumbnail images of the inactive windows in the single-screen mode are arranged in the second display area DA2 (see FIG. 11 ). Figure 7 ).

[0178] Next, through Fig.16 The following describes the actions of the display control processing when a thumbnail image is selected after the thumbnail window is displayed in the second display area DA2 in step S111. Fig.17 This is a flowchart showing an example of display control processing when a thumbnail image is selected according to the present embodiment.

[0179] (Step S201) The control unit 18 determines whether any one of the thumbnail images displayed in the second display area DA2 is selected. When the control unit 18 determines that no thumbnail image is selected (No), the process proceeds to step S203. On the other hand, when the control unit 18 determines that any one of the thumbnail images is selected (Yes), the process proceeds to step S207.

[0180] (Step S203) The control unit 18 determines whether to close the close button "X" (see Figure 6) was operated. When the control unit 18 determines that the close button "×" was operated (Yes), it proceeds to the process of step S205. On the other hand, when the control unit 18 determines that the close button "×" was not operated (No), it returns to the process of step S201.

[0181] (Step S205) When the control unit 18 determines in step S203 that the close button "X" has been operated, the control unit 18 closes the thumbnail window so as to hide it and ends the display of the thumbnail window.

[0182] (Step S207) When the control unit 18 determines in step S201 that any of the thumbnail images has been selected, the control unit 18 closes the thumbnail window and proceeds to the process of step S209.

[0183] (Step S209 ) The control unit 18 displays the window corresponding to the selected thumbnail image as an active window in the second display area DA2 (for example, maximizes and displays it in the second display area DA2 ).

[0184] Next, the operation of the display control process for displaying a thumbnail window in an arbitrary display area by a thumbnail display operation will be described.

[0185] Fig.18 This is a flowchart showing an example of a display control process of a thumbnail window based on a thumbnail display operation according to the present embodiment.

[0186] (Step S251) The control unit 18 determines whether a thumbnail display operation has been performed based on the operation information obtained from the detection processing unit 182 (see Fig. 9 , 11 ). When the control unit 18 determines that the thumbnail display operation has not been performed (No), the control unit 18 performs the process of step S251 again. On the other hand, when the control unit 18 determines that the thumbnail display operation has been performed (Yes), the control unit 18 proceeds to the process of step S253.

[0187] (Step S253) The control unit 18 displays a thumbnail window (see FIG. 254 ) in the display area designated by the thumbnail display operation. Fig.10 (B) Fig.12 (B) Fig.13 (B)). For example, the control unit 18 displays not only the thumbnail images corresponding to the inactive windows but also the thumbnail images corresponding to the active windows in a row in the thumbnail windows.

[0188] As described above, the information processing device 10 according to the present embodiment includes: the display 150, the storage unit 13 (an example of a memory) storing an application (application) program, and the control unit 18 (for example, an example of a processor such as a CPU, a GPU, or a microcomputer) for controlling the display 150 to display a window of the application by executing the application program stored in the storage unit 13. The control unit 18 performs a display mode switching process to control switching between a single screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled as one display area DA and a dual screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into two display areas (for example, a first display area DA1 and a second display area DA2) to control the display. In addition, the control unit 18 performs a first display control process and a second display control process. In the first display control process, when switching from the single-screen mode to the dual-screen mode through a display mode switching process, an active window (an example of a window) in a window of an application executed in the single-screen mode is displayed in the first display area DA1 among the multiple display areas, and thumbnail images corresponding to windows other than the active window (for example, inactive windows) in the windows in the single-screen mode are displayed in the second display area DA2. In the second display control process, a thumbnail display operation (an example of a prescribed operation) performed by the user is detected, and the thumbnail image is displayed in a display area specified by the thumbnail display operation in a display area within the screen area of ​​the display 150.

[0189] Thus, information processing device 10 can display thumbnail images of windows of executing applications in any display area according to user operations, thereby improving operability when selecting a window displayed in each of a plurality of display areas.

[0190] For example, in the second display control process, when the control unit 18 detects a thumbnail display operation and displays thumbnail images, the control unit 18 also displays a thumbnail image corresponding to the active window among the windows in the single screen mode.

[0191] Thus, when the information processing device 10 displays thumbnail images of windows of all running applications in response to user operations instead of switching screen modes, it displays not only thumbnail images of inactive windows but also thumbnail images of windows of all running applications, thereby making it easy to select the window of the application you want to display from all running applications.

[0192] For example, the control unit 18 causes the display 150 to display a display mode switching icon C22 (an example of a first icon) that accepts user operations for switching from the single-screen mode to the dual-screen mode. Furthermore, when the control unit 18 detects the user's operation on the display mode switching icon C22 in the single-screen mode, it switches from the single-screen mode to the dual-screen mode. On the other hand, the control unit 18 accepts the user's operation on the display mode switching icon C22 in the dual-screen mode as a thumbnail display operation, and when the operation on the display mode switching icon C22 is detected, the thumbnail image is displayed as having been detected as a thumbnail display operation. In addition, the display mode switching icons C12, C13, and C23 also accept the user's operation in the dual-screen mode as a thumbnail display operation, similar to the display mode switching icon C22.

[0193] Thus, in information processing device 10 , an icon operated for switching screen modes and an icon operated for displaying thumbnail images of windows of executing applications are used in common, thereby improving operability.

[0194] Furthermore, in the second display control process, the control unit 18 controls the thumbnail images displayed in the second display area DA2 to be hidden, and then detects the thumbnail display operation to display the thumbnail images in the display area designated by the thumbnail display operation.

[0195] Thus, information processing device 10 can redisplay the thumbnail image of the window of the executing application in any display area according to the user's operation, thereby improving operability when selecting a window displayed in each of the plurality of display areas.

[0196] For example, when any one of the thumbnail images displayed in the second display area DA2 is selected by the user's operation, the control unit 18 makes all thumbnail images displayed in the second display area DA2 invisible and displays a window corresponding to the selected thumbnail image. For example, the control unit 18 maximizes the window corresponding to the selected thumbnail image in the second display area DA2 and displays it as an active window.

[0197] Thus, when the user wants to change from a window currently being used to another window, information processing device 10 can easily select from thumbnail images, thus providing excellent convenience.

[0198] In addition, when a user operation for hiding the thumbnail images displayed in the second display area DA2 is performed, the control unit 18 hides all thumbnail images displayed in the second display area DA2. In addition, the user operation for hiding the thumbnail images is, for example, to close the close button "×" (see Figure 6 ) operation.

[0199] Thus, when the user wants to hide the thumbnail window (thumbnail image), the information processing device 10 can hide it with a simple operation. Alternatively, the thumbnail window can be closed and hidden by performing a user operation (e.g., tapping) on ​​an area of ​​the thumbnail window where no thumbnail image exists or an area where no thumbnail image is displayed (an area where an application window is already configured).

[0200] In addition, when the control unit 18 switches from single-screen mode to dual-screen mode through display mode switching processing, in the first display control processing, it can also control whether to display thumbnail windows (thumbnail images) in the second display area DA2 based on the number of windows in the single-screen mode.

[0201] Thus, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, it displays the active window in the single-screen mode before the switch, and controls whether to display a thumbnail image of the inactive window at a glance according to the number of windows in the single-screen mode, thereby being able to appropriately control the display when switching from the single-screen mode to the dual-screen mode.

[0202] For example, when the control unit 18 switches from the single-screen mode to the dual-screen mode through the display mode switching process, if the number of windows in the single-screen mode is less than two (the number of display areas in the dual-screen mode), the thumbnail window (thumbnail image) is not displayed, and the windows in the single-screen mode other than the active window are displayed in the second display area DA2. On the other hand, when the control unit 18 switches from the single-screen mode to the dual-screen mode through the display mode switching process, if the number of windows in the single-screen mode is greater than two (the number of display areas in the dual-screen mode), the thumbnail window (thumbnail image) is displayed in the second display area DA2.

[0203] Thus, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, if the number of windows in the single-screen mode before the switching is two or less, even if thumbnail images are not specifically displayed and the user performs a selection operation, the windows in the single-screen mode can be displayed using the two display areas of the dual-screen mode, thereby providing good convenience. Therefore, the information processing device 10 can appropriately control the display when switching from the single-screen mode to the dual-screen mode.

[0204] In addition, the control method in the information processing device 10 involved in the present embodiment includes: a display mode switching step, in which the control unit 18 controls the switching between a single-screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled as a display area DA and a dual-screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into two display areas (for example, a first display area DA1 and a second display area DA2) to control the display; a first display control step, in which, when switching from the single-screen mode to the dual-screen mode through the display mode switching process, an active window (an example of a window) among windows of an application executed in the single-screen mode is displayed in the first display area DA1 of multiple display areas, and thumbnail images corresponding to windows other than the active window (for example, an inactive window) among windows in the single-screen mode are displayed in the second display area DA2; and a second display control step, in which a thumbnail display operation (an example of a prescribed operation) performed by a user is detected, and a thumbnail image is displayed in a display area specified by the thumbnail display operation in a display area within the screen area of ​​the display 150.

[0205] Thus, information processing device 10 can display thumbnail images of windows of executing applications in any display area according to user operations, thereby improving operability when selecting a window displayed in each of a plurality of display areas.

[0206] <Second embodiment>

[0207] Next, the second embodiment of the present invention is described in general terms. In the first embodiment, an example of making the display mode switching icon also function as an operator for accepting thumbnail display operations is described, but in this embodiment, an example of an icon that is displayed separately from the display mode switching icon and becomes an operator for accepting thumbnail display operations is described.

[0208] Fig.19 1 is a diagram showing a first example of thumbnail display operation according to the present embodiment. Figure 5 The switching menu M2 shown in (C) corresponds to the switching menu M2 shown in (C), but the difference is that the thumbnail image display icon C20A is displayed. The thumbnail image display icon C20A functions as an operator for receiving thumbnail display operations. For example, if the thumbnail image display icon C20A is operated by the user, a thumbnail window is displayed in all display areas.

[0209] Fig. 20 It is a diagram showing a first example of display control based on thumbnail display operation according to the present embodiment. Fig. 20 (A) and Fig.10 (A) and Fig.12 Similarly, (A) shows an example in which window W1 is maximized and displayed in first display area DA1 and window W2 is maximized and displayed in second display area DA2 in dual-screen mode. Fig. 20 In the display state shown in (A) of Fig.19 The operation of the thumbnail image display icon C20A shown in FIG. Fig. 20 As shown in (B), thumbnail windows are displayed in the first display area DA1 and the second display area DA2. At this time, all thumbnail images of the windows of the running application are displayed in the thumbnail window. For example, when the number of windows of the running application is three (windows W1, W2, and W3), if a thumbnail display operation is performed, Fig. 20 As shown in (B) of FIG. 8 , three thumbnail images (thumbnail images SW1 , SW2 , and SW3 ) are displayed in the thumbnail windows of the first display area DA1 and the second display area DA2 .

[0210] In addition, here, an example is described in which thumbnail windows (thumbnail images) are respectively displayed in all display areas (the first display area DA1 and the second display area DA2) within the screen area of ​​the display 150 when a thumbnail display operation is performed on the thumbnail image display icon C20A, but the thumbnail window (thumbnail image) may also be displayed in a pre-set display area (for example, the second display area DA2).

[0211] Furthermore, when an icon serving as an operator for receiving thumbnail display operation is displayed separately from the display mode switching icon, an area for displaying thumbnail images may be designated (selected).

[0212] Fig.21 2B is a diagram showing a second example of thumbnail display operation according to the present embodiment. Figure 5 The switching menu M2 shown in (C) of FIG. 1 corresponds to the switching menu M2, but the difference is that a thumbnail image display icon C20B is displayed. The thumbnail image display icon C20B functions as an operator for receiving a thumbnail display operation.

[0213] In the thumbnail image display icon C20B, unlike the thumbnail image display icon C20A, the screen area of ​​the display 150 is divided into a plurality of divided areas. In the illustrated example, in the thumbnail image display icon C20B, the screen area of ​​the display 150 is divided into four divided areas, namely "1", "2", "3" and "4". The user can specify (select) an area for displaying thumbnail images from the four divided areas. In addition, the divided area is an area for specifying an area for displaying thumbnail images, and has nothing to do with the switching of the screen mode. That is, although four divided areas are shown, it does not mean a four-screen mode. For example, if it is a dual-screen mode, thumbnail images are displayed in the specified divided areas while maintaining the dual-screen mode. Fig. 22 10A and 10B show an example of display control in which thumbnail images are displayed in response to a user operation of selecting a divided area indicated by “4” in the thumbnail image display icon C20B.

[0214] Fig. 22 It is a diagram showing a second example of display control based on the thumbnail display operation involved in this embodiment. Fig. 22 (A) and Fig. 20 Similarly, (A) shows an example in which window W1 is maximized and displayed in first display area DA1 and window W2 is maximized and displayed in second display area DA2 in dual-screen mode. Fig. 22 In the display state shown in (A) of Fig.21 The operation of the divided area indicated by "4" of the thumbnail image display icon C20B shown in FIG. Fig. 22 As shown in (B), in the dual-screen mode, thumbnail images (thumbnail images SW1, SW2, SW3) are displayed in the area corresponding to the divided area shown by "4" in the second display area DA2. At this time, the thumbnail images are displayed overlapping with the window W2 (a layer above the window W2) displayed in the second display area DA2. In addition, the thumbnail images may be displayed overlappingly as thumbnail windows, or the thumbnail images themselves may be displayed overlappingly instead of in the form of thumbnail windows.

[0215] In addition, refer to Figures 19 to 22 , explains the thumbnail display operation when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e') etc.), and can also be used when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d') etc.) Figure 5The switching menu M1 shown displays an icon corresponding to the thumbnail image display icon C20A or the thumbnail image display icon C20B, and the thumbnail display operation is performed in the same manner. In addition, the thumbnail image display icon may be displayed separately from the switching menu.

[0216] In this way, in the information processing device 10 according to the present embodiment, the control unit 18 displays the thumbnail image display icons C20A and C20B (an example of a second icon) that accept a thumbnail display operation (an example of a predetermined operation) separately from the display mode switching icon (an example of a first icon) that accepts a user operation for switching from the single-screen mode to the dual-screen mode on the display 150. When the control unit 18 detects an operation on the thumbnail image display icons C20A and C20B, it displays the thumbnail images as if the thumbnail display operation has been detected.

[0217] Thus, information processing device 10 can display a thumbnail image of a window of an executing application in any of the plurality of display areas by a simple operation, thereby improving operability when selecting a window displayed in each of the plurality of display areas.

[0218] For example, the thumbnail image display icon C20B accepts an operation of designating a display area (eg, a divided area) for displaying thumbnail images regardless of a plurality of display areas (the first display area DA1 , the second display area DA2 ) divided in the dual screen mode.

[0219] Thus, information processing device 10 can display thumbnail images of windows of executing applications in any display area according to user operations, thereby improving operability when selecting a window displayed in each of a plurality of display areas.

[0220] In addition, Fig.21 , 22 In the description, an example is given in which the area for displaying thumbnail images can be specified from among four divided areas. However, the number of divided areas is not limited to four, and may be two, three, or five or more.

[0221] <Third Embodiment>

[0222] Next, an outline of a third embodiment of the present invention will be described.

[0223] In the first embodiment, the structure of the information processing device 10 is described as having a single-screen mode in which the entire screen area of ​​the display 150 is controlled as a single display area DA, and a dual-screen mode in which the screen area of ​​the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, to control the display. However, the screen area of ​​the display 150 may also be divided into three or more display areas to control the display.

[0224] In the present embodiment, the information processing device 10 has, in addition to the single-screen mode and the dual-screen mode, a triple-screen mode in which the screen area of ​​the display 150 is divided into three display areas to control display, and a quad-screen mode in which the screen area is divided into four display areas to control display. The following describes the display control when switching from the single-screen mode to the triple-screen mode and the display control when switching from the single-screen mode to the quad-screen mode.

[0225] Fig.23 is a diagram showing an example of an operation specification of a display mode switching operation according to the present embodiment. Figure 5 This is an example of a switching menu displayed by operating the icon C1 shown in (A). Fig.23 (B) indicates the switching menu M3 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.), Fig.23 (C) indicates the switching menu M4 displayed when the mode of use is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). The switching menus M3 and M4 are different in that they can switch to the three-screen mode and the four-screen mode. Figure 5 (B) Toggle menu M1 and Figure 5 The switch menu of (C) is different from M2.

[0226] Display mode switching icons C31, C32, C33, C34, and C35 are displayed in the switching menu M3. The display mode switching icon C31 is displayed as an operator for selecting the display mode (d) and the display mode (d′) of the single-picture mode. The display mode switching icon C32 is displayed as an operator for selecting the display mode (b) of the dual-picture mode. The display mode switching icon C33 and the display mode switching icon C34 are displayed as operators for selecting the display mode of the triple-picture mode. In the display mode switching icon C33 and the display mode switching icon C34, it is different which side of the first display area DA1 and the second display area DA2 in the dual-picture mode is divided into two display areas. The display mode switching icon C35 is displayed as an operator for selecting the display mode of the quad-picture mode.

[0227] The "1", "2", "3", and "4" in the figure are Figure 5 Similarly, it is added to distinguish the display areas, for example, in each display area, it is represented by a number according to the priority of the area set in advance. "1" means that the priority of the area is the highest, and the priority of the area decreases in the order of "2", "3", and "4".

[0228] If the user selects the display mode switching icon C33 or the display mode switching icon C34, the display of the switching menu ends and the control is changed to the three-screen mode under "Landscape". In addition, if the user selects the display mode switching icon C35, the display of the switching menu ends and the control is changed to the four-screen mode under "Landscape".

[0229] Display mode switching icons C41, C42, C43, C44, and C45 are displayed in the switching menu M4. The display mode switching icon C41 is displayed as an operator for selecting the display mode (e) or the display mode (e′) of the single-screen mode. The display mode switching icon C42 is displayed as an operator for selecting the display mode (c-1) of the dual-screen mode. The display mode switching icon C43 and the display mode switching icon C44 are displayed as operators for selecting the display mode of the triple-screen mode. In the display mode switching icon C43 and the display mode switching icon C44, it is different as to which side of the first display area DA1 and the second display area DA2 in the dual-screen mode is divided into two display areas. The display mode switching icon C45 is displayed as an operator for selecting the display mode of the quad-screen mode.

[0230] If the user selects the display mode switching icon C43 or the display mode switching icon C44, the display of the switching menu ends, and the control is changed to the three-screen mode under "Clamshell or Portrait". In addition, if the user selects the display mode switching icon C35, the display of the switching menu ends, and the control is changed to the four-screen mode under "Clamshell or Portrait".

[0231] (Display control when switching from single-picture mode to triple-picture mode)

[0232] Next, display control when switching from the single-screen mode to the triple-screen mode is described. Here, when the screen area of ​​the display 150 is divided into three display areas in the triple-screen mode, the areas are referred to as the first display area DA1, the second display area DA2, and the third display area DA3.

[0233] In the case of a three-screen mode in which the second display area DA2 side in the dual-screen mode is divided into two display areas, the first display area DA1 is equivalent to the first display area DA1 in the dual-screen mode, and the second display area DA2 and the third display area DA3 are equivalent to the respective display areas after the second display area DA2 in the dual-screen mode is divided into two. Here, the second display area DA2 and the third display area DA3 in the three-screen mode can be referred to as two second display areas after the display area other than the first display area DA1 (for example, the second display area DA2 in the dual-screen mode) is divided into two. In order to distinguish the two second display areas, the area with the highest priority is represented as the second display area DA2, and the other is represented as the third display area DA3. That is, the priorities of the areas in the three-screen mode are, from the highest, the first display area DA1, the second display area DA2, and the third display area DA3.

[0234] In addition, in the case of a three-screen mode in which the first display area DA1 side in the dual-screen mode is divided into two display areas, relative to the case of a three-screen mode in which the second display area DA2 side in the dual-screen mode is divided into two display areas, only the display area on one side that is divided into two display areas is different.

[0235] As described in the first embodiment, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, if the number of windows in the single-screen mode is more than two, the thumbnail window is displayed in the second display area DA2, and if the number of windows is less than two, the thumbnail window is not displayed. In contrast, when the information processing device 10 switches from the single-screen mode to the triple-screen mode, if the number of windows in the single-screen mode is more than three, the thumbnail window is displayed in the second display area DA2, and if the number of windows is less than three, the thumbnail window is not displayed.

[0236] In the following, refer to Figures 15 to 17 , in the single-screen mode (display mode (d) or display mode (d′)) in “Landscape”, for example, Fig.23 An example of display control in which the second display area DA2 side in the dual-screen mode is switched to the triple-screen mode in which the second display area DA2 is divided into two display areas will be described by operating the display mode switching icon C33 (B).

[0237] Fig.24 1 is a diagram showing a first example of display control when switching from the single-screen mode to the three-screen mode according to the present embodiment. Fig.24 (A) shows a display example of single-screen mode. Fig.24(B) shows a display example after switching to the three-screen mode. In the example shown in the figure, the number of windows of the application executed in the single-screen mode is two. Here, two windows W1 and W2 are shown in the display area DA. Window W1 is an active window configured in the frontmost layer (the uppermost layer).

[0238] If the single-screen mode is switched to the three-screen mode, the window W1 is maximized and displayed as an active window in the first display area DA1, and the window W2 is maximized and displayed as an inactive window in the second display area DA2 according to the priority of the area and the priority of the window. In addition, there is no window displayed in the third display area DA3 (the window with the third priority), so there is no window displayed and the desktop screen is displayed.

[0239] In addition, when the number of windows of the application executed in the single-screen mode is one (only window W1), window W1 is maximized and displayed as an active window in the first display area DA1, but there is no window displayed in the second display area DA2 and the third display area DA3, so that there is no window displayed and the desktop screen is displayed.

[0240] Fig.25 2 is a diagram showing a second example of display control when switching from the single-screen mode to the three-screen mode according to the present embodiment. Fig.25 (A) shows a display example of single-screen mode. Fig.25 (B) shows a display example after switching to the three-screen mode. In the example shown in the figure, the number of windows of the application executed in the single-screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA.

[0241] Window W1 is an active window arranged in the frontmost layer (the uppermost layer). Window W2 is a window that was an active window before window W1 became an active window. Window W3 is a window that was an active window before window W2 became an active window. That is, in terms of the priority of the windows, window W1 is the highest, and the priority is descending in the order of window W2 and window W3.

[0242] If the single-picture mode is switched to the three-picture mode, the window W1 is maximized and displayed as an active window in the first display area DA1 according to the priority of the area and the priority of the window. The window W2 is maximized and displayed as an inactive window in the second display area DA2. The window W3 is maximized and displayed as an inactive window in the third display area DA3.

[0243] Fig.26 3 is a diagram showing a third example of display control when switching from the single-screen mode to the three-screen mode according to the present embodiment. Fig.26(A) shows a display example of single-screen mode. Fig.26 (B) shows a display example after switching to the three-screen mode. In the example shown in the figure, the number of windows of the application executed in the single-screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA.

[0244] Window W1 is an active window arranged in the frontmost layer (the uppermost layer). Regarding the priority of the windows, window W1 is the highest, and the priorities are descending in the order of window W2, window W3, and window W4.

[0245] If the single-screen mode is switched to the three-screen mode, the window W1 is maximized and displayed as the active window in the first display area DA1 according to the priority of the area and the priority of the window. The thumbnail images SW2, SW3, and SW4 of the windows W2, W3, and W4 are displayed in the second display area DA2. In addition, in the third display area DA3, there is no window display and the desktop screen is displayed. When the number of windows of the application executed in the single-screen mode is five or more, the number of thumbnail images displayed in the second display area DA2 is four or more.

[0246] Here, when any one of the thumbnail images SW2, SW3, SW4 displayed in the second display area DA2 is selected, the inactive window corresponding to the selected thumbnail image is displayed as an active window in the second display area DA2, and the thumbnail windows in which the remaining thumbnail images are arranged are displayed in the third display area DA3.

[0247] In this way, when the information processing device 10 switches from the single-screen mode to the three-screen mode, if the number of windows in the single-screen mode is more than three (the number of display areas in the three-screen mode), the thumbnail windows in which the thumbnail images of the windows other than the active window in the single-screen mode are arranged are displayed in the second display area DA2. On the other hand, when the information processing device 10 switches from the single-screen mode to the three-screen mode, if the number of windows in the single-screen mode is less than three (the number of display areas in the three-screen mode), the thumbnail windows are not displayed, and the inactive windows in the single-screen mode are displayed in the second display area DA2, the third display area DA3, etc.

[0248] That is, when the information processing device 10 switches from the single-screen mode to the triple-screen mode, for the second display area DA2, the information processing device 10 controls whether to display thumbnail images based on the number of display areas in the triple-screen mode and the number of windows in the single-screen mode.

[0249] In addition, the window of the application executed in the single screen mode may be minimized. In this case, the minimized window may not be included in the number of windows in the single screen mode.

[0250] In addition, the same is true for the case of switching from single-screen mode to four-screen mode. In the following, the four display areas in the four-screen mode are set to the first display area DA1, the second display area DA2, the third display area DA3, and the fourth display area DA4 for explanation. For example, when the information processing device 10 switches from the single-screen mode to the four-screen mode, if the number of windows in the single-screen mode is more than four (the number of display areas in the four-screen mode), the thumbnail window in which the thumbnail images of the windows other than the active window are arranged in the windows in the single-screen mode is displayed in the second display area DA2. On the other hand, when the information processing device 10 switches from the single-screen mode to the four-screen mode, if the number of windows in the single-screen mode is less than four (the number of display areas in the four-screen mode), the thumbnail window is not displayed, and the inactive window in the single-screen mode is displayed in the second display area DA2, the third display area DA3, the fourth display area DA4, etc.

[0251] That is, when the information processing device 10 switches from the single-screen mode to the quad-screen mode, for the second display area DA2, the information processing device 10 controls whether to display thumbnail images based on the number of display areas in the quad-screen mode and the number of windows in the single-screen mode.

[0252] In addition, the window of the application executed in the single screen mode may be minimized. In this case, the minimized window may not be included in the number of windows in the single screen mode.

[0253] (Operation of the display control process of the thumbnail window)

[0254] Next, the operation of the display control process of the control unit 18 to control whether to display the thumbnail window when switching from the single-screen mode to the multi-screen mode is described. The multi-screen mode includes, for example, the dual-screen mode, the triple-screen mode, the quad-screen mode, and the like.

[0255] Fig. 27 This is a flowchart showing an example of a display control process of a thumbnail window according to the present embodiment.

[0256] (Step S301) The control unit 18 determines whether to switch from the single-screen mode to the multi-screen mode. For example, the control unit 18 determines whether to switch from the single-screen mode to the multi-screen mode based on the detected reference Figure 4 As explained above, the change from a flat state (Flat form) to a bent state (Bent form) or the reference Fig.23The control unit 18 determines whether to switch from the single-screen mode to the dual-screen mode by performing the display mode switching operation described above. When the control unit 18 determines that the switch from the single-screen mode to the multiple-screen mode has not been performed (No), the control unit 18 continues the single-screen mode and performs the processing of step S301 again. On the other hand, when the control unit 18 determines that the switch from the single-screen mode to the multiple-screen mode has been performed (Yes), the control unit 18 switches to the multiple-screen mode in which the display area DA is divided into two display areas, namely the first display area DA1 and the second display area DA2, and enters the processing of step S303.

[0257] (Step S303) The control unit 18 determines whether the number of display areas (screens) in the multiple screen mode after switching is greater than the number of windows in the single screen mode before switching to the multiple screen mode. If the control unit 18 determines that it is greater than the number of windows in the single screen mode (Yes), the process proceeds to step S305. On the other hand, if the control unit 18 determines that it is less than the number of windows in the single screen mode (No), the process proceeds to step S309.

[0258] (Step S305) The control unit 18 sets the display of the thumbnail window when switching to the multi-screen mode to non-display, and proceeds to the process of step S307.

[0259] (Step S307) The control unit 18 displays the active window in the single-screen mode in the first display area DA1, and displays the inactive windows in the single-screen mode in other display areas (see Figure 8 , 24 , 25). For example, the control unit 18 displays the inactive window in the single-screen mode in the display area outside the first display area DA1 according to the priority of the area and the priority of the window. In addition, when the number of windows in the single-screen mode is less than the number of display areas (screens) in the multiple screen mode after switching, the display area outside the first display area DA1 includes a display area where no window is displayed.

[0260] (Step S309) The control unit 18 sets the display of the thumbnail window when switching to the multi-screen mode to be on, and proceeds to the process of step S311.

[0261] (Step S311) The control unit 18 displays the active window in the single-screen mode in the first display area DA1, and displays the thumbnail windows in which the thumbnail images of the inactive windows in the single-screen mode are arranged in the second display area DA2 (see FIG. 1 ). Figure 7 , 17 , 19).

[0262] In addition, in the example of displaying a thumbnail image (for example, a thumbnail window) in the second display area DA2 whose priority is the highest among the plurality of second display areas other than the first display area DA1 according to the priority of the areas set in advance (the priority of the area is second only to the first display area DA1) (refer to Fig.26 ) is described, but is not limited thereto. For example, in the display control process, the control unit 18 may also display a thumbnail image (e.g., a thumbnail window) in a region with the last priority among the plurality of second display regions other than the first display region DA1. For example, the region with the last priority among the plurality of second display regions other than the first display region DA1 is the third display region DA3 in the case of the three-screen mode, and is the fourth display region DA4 in the case of the four-screen mode.

[0263] Here, Fig.28 This shows an example in which thumbnail images (eg, thumbnail windows) are displayed in the area with the lowest priority when switching from the single-screen mode to the triple-screen mode.

[0264] Fig.28 1 is a diagram showing a fourth example of display control when switching from the single-screen mode to the three-screen mode according to the present embodiment, and is an example of displaying a thumbnail window in the third display area DA3 having the last area priority in the three-screen mode. Fig.28 (A) shows a display example of single-screen mode. Fig.28 (B) shows a display example after switching to the three-screen mode. In the example shown in the figure, the number of windows of the application executed in the single-screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA.

[0265] Window W1 is an active window arranged in the frontmost layer (the uppermost layer). Regarding the priority of the windows, window W1 is the highest, and the priorities are descending in the order of window W2, window W3, and window W4.

[0266] If the single-screen mode is switched to the three-screen mode, the window W1 is maximized and displayed as an active window in the first display area DA1 according to the priority of the area and the priority of the window. The window W2 is maximized and displayed as an inactive window in the second display area DA2. In addition, in the third display area DA3, which has the last priority of the area, the thumbnail images SW3 and SW4 of the windows W3 and W4 are displayed as thumbnail windows arranged in a row. In addition, when the number of windows of the application executed in the single-screen mode is five or more, the number of thumbnail images displayed in the third display area DA3 is three or more.

[0267] In addition, the same applies to switching from single-screen mode to quad-screen mode. For example, if switching from single-screen mode to quad-screen mode, the windows are maximized in the first display area DA1, the second display area DA2, and the third display area DA3, respectively, and the thumbnail window is displayed in the fourth display area DA4, which has the last priority.

[0268] Next, refer to Figures 29 to 31 , an example of displaying a thumbnail window through a thumbnail display operation in the three-screen mode is described.

[0269] Fig.29 1 is a diagram showing an example of thumbnail display operation according to the present embodiment. Fig.23 The switching menu M3 shown in (B) corresponds to the Fig.29 The switching menu M3 shown is displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.), and the current display mode is the three-screen mode corresponding to the display mode switching icon C33.

[0270] The display mode switching icon C33 is the current display mode, so it is highlighted relative to the other display mode switching icons C31, C32, C34, and C35. Fig.23 As explained above, it functions as an operator for accepting user operations for switching to respective display modes. On the other hand, the display mode switching icon C33 as the current display mode does not need to function as an operator for switching the display mode, and therefore functions as an operator for displaying thumbnail images (thumbnail windows). That is, the display mode switching icon C33 as the current display mode is displayed as an icon for accepting thumbnail display operations. For example, Fig.30 This shows an example of display control in which a thumbnail window is displayed in the third display area DA3 when the user performs an operation to select the display area indicated by "3" (third display area DA3) in the display mode switching icon C33.

[0271] Fig.30 It is a diagram showing a first example of display control based on thumbnail display operation according to the present embodiment. Fig.30 (A) shows an example in which the window W1 is maximized in the first display area DA1, the window W2 is maximized in the second display area DA2, and the window W3 is maximized in the third display area DA3 in the three-screen mode. Fig.28In the case where an operation of selecting the thumbnail image SW3 among the thumbnail images SW3 and SW4 displayed in the third display area DA3 is performed in (B), the control is performed as follows: Fig.30 The display state shown in (A) is shown in FIG. Fig.30 (A) is also Fig.25 The display state shown in (B).

[0272] In this Fig.30 In the display state shown in (A), if Fig.29 As shown in FIG. 1 , the user performs an operation to select the display area (third display area DA3) indicated by “3” of the display mode switching icon C33. Fig.30 As shown in (B), a thumbnail window is displayed in the third display area DA3. At this time, all thumbnail images of the windows of the executing application are displayed in the thumbnail window of the third display area DA3. Fig.26 or Fig.28 As shown in FIG. 1 , when the number of windows of the executing application is four (windows W1, W2, W3, and W4), if a thumbnail display operation is performed, Fig.30 As shown in (B) of FIG. 8 , four thumbnail images (thumbnail images SW1 , SW2 , SW3 , and SW4 ) are displayed in the third display area DA3 .

[0273] Reference Fig.29 , 30 , the thumbnail display operation is explained when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d') and so on), but it can also be used when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e') and so on). Fig.23 The switching menu M4 shown in (C) performs the thumbnail display operation in the same manner.

[0274] In addition, refer to Fig.29 , 30 , an example of displaying a thumbnail window by specifying the third display area DA3 through a thumbnail display operation is described, but next, referring to Fig.31 An example in which the second display area DA2 is designated to display the thumbnail window will be described.

[0275] Fig.31 It is a diagram showing a second example of display control based on the thumbnail display operation involved in this embodiment. Fig.31(A) shows an example in which, in the three-screen mode, the window W1 is maximized in the first display area DA1, the window W2 is maximized in the second display area DA2, and the thumbnail window is displayed in the third display area DA3. Fig.28 The display state shown in (B).

[0276] In this Fig.31 In the display state shown in (A), if the user selects Fig.29 The operation of the display area (second display area DA2) indicated by "2" of the display mode switching icon C33 shown in FIG. Fig.31 As shown in (B), a thumbnail window is displayed in the second display area DA2. At this time, all thumbnail images of the windows of the executing application are displayed in the thumbnail window of the second display area DA2. Fig.26 or Fig.28 As shown in FIG. 1 , when the number of windows of the executing application is four (windows W1, W2, W3, and W4), if a thumbnail display operation is performed, Fig.31 As shown in (B) of FIG. 8 , four thumbnail images (thumbnail images SW1 , SW2 , SW3 , and SW4 ) are displayed in the second display area DA2 .

[0277] The thumbnail display operation in quad mode is also the same. Fig.29 When the display mode corresponding to the display mode switching icon C35 is the current display mode, the display mode switching icon C35 functions as an operator for displaying thumbnail images (thumbnail windows). In the display mode switching icon C35, the user selects any one of the display areas represented by "1", "2", "3" and "4", so that the thumbnail window is displayed in the display area selected from the first display area DA1, the second display area DA2, the third display area DA3 and the fourth display area DA4.

[0278] As described above, in the information processing device 10 involved in this embodiment, the control unit 18 performs display mode switching processing, and controls the switching between a single-screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled as a single display area DA and a multiple-screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into multiple (two, three, four, etc.) display areas to control the display. In addition, the control unit 18 performs a first display control process and a second display control process. In the first display control process, when switching from the single-screen mode to the multiple-screen mode through the display mode switching process, an active window (an example of a window) in the window of an application executed in the single-screen mode is displayed in the first display area DA1 among the multiple display areas, and thumbnail images corresponding to windows (for example, inactive windows) in the windows in the single-screen mode other than the active window are displayed in the second display area DA2 (for example, the second display area DA2) among the multiple display areas except the first display area DA1. In the second display control process, a thumbnail display operation (an example of a prescribed operation) performed by the user is detected, and the thumbnail image is displayed in the display area specified by the thumbnail display operation in the display area within the screen area of ​​the display 150.

[0279] Thus, information processing device 10 can display (redisplay) thumbnail images of windows of executing applications in any display area according to user operations, thereby improving operability when selecting a window displayed in each of a plurality of display areas.

[0280] In addition, when the control unit 18 switches from single-screen mode to multiple-screen mode through display mode switching processing, in the first display control processing, it can also control whether to display thumbnail windows (thumbnail images) in the second display area DA2 based on the number of windows in the single-screen mode.

[0281] Thus, when the information processing device 10 switches from the single-screen mode to the multiple-screen mode, it displays the active window in the single-screen mode before the switch, and controls whether to display a thumbnail image of the inactive window at a glance according to the number of windows in the single-screen mode, thereby being able to appropriately control the display when switching from the single-screen mode to the multiple-screen mode.

[0282] Furthermore, according to the present embodiment, when the number of windows in the single-screen mode is three, the control unit 18 displays thumbnail images (e.g., thumbnail windows) when switching from the single-screen mode to the dual-screen mode, but does not display thumbnail images (e.g., thumbnail windows) when switching to the triple-screen mode. Furthermore, when the number of windows in the single-screen mode is four, the control unit 18 displays thumbnail images (e.g., thumbnail windows) when switching from the single-screen mode to the dual-screen mode or the triple-screen mode, but does not display thumbnail images (e.g., thumbnail windows) when switching to the quad-screen mode. That is, it can be said that the control unit 18 controls whether to display thumbnail images based on the number of display areas in the multiple-screen mode when switching from the single-screen mode to the multiple-screen mode.

[0283] That is, when the control unit 18 switches from the single-screen mode to the multiple-screen mode through the display mode switching process, in the first display control process, it can also control whether to display thumbnail images (for example, thumbnail windows) in the second display area DA2 based on the number of display areas in the dual-screen mode.

[0284] Thus, when the information processing device 10 switches from the single-screen mode to the multiple-screen mode, it displays the active window in the single-screen mode before the switch, and controls whether to display a thumbnail image of the inactive window at a glance according to the number of display areas in the multiple-screen mode after the switch, thereby being able to appropriately control the display when switching from the single-screen mode to the multiple-screen mode.

[0285] The embodiments of the present invention are described in detail with reference to the drawings, but the specific structure is not limited to the above content, and various design changes can be made within the scope of the present invention. For example, the structures described in the above embodiments can also be combined arbitrarily.

[0286] In addition, in the above-mentioned embodiment, three examples are described as examples of thumbnail display operation, wherein the first example is: the display mode switching icon corresponding to the current display mode among the display mode switching icons (for example, Fig. 9 as well as Fig.11 Display mode switching icon C22, Fig.29 The display mode switching icon C33) functions as an operator for receiving thumbnail display operations. In the second example, an operator for displaying thumbnail images (for example, Fig.19 A third example: an operator capable of specifying (selecting) an area (divided area) for displaying thumbnail images is displayed separately from the display mode switching icon (for example, Fig.21 Thumbnail image display icon C20B), but these three thumbnail display operations can also be switched through settings.

[0287] In addition, the thumbnail display operation may also be a specific pattern of touch operation by the user on the display area where the thumbnail image is desired to be displayed. For example, a specific pattern of touch operation such as double-clicking, tapping or knocking based on multiple fingers on a blank area in the screen area of ​​the display 150 where the window is not displayed may be used as a trigger to display the thumbnail window (thumbnail image). For example, the information processing device 10 may also display the thumbnail window (thumbnail image) in the display area where the touch operation is performed by performing a specific pattern of touch operation on a blank area where the window is not displayed in any area of ​​the display area (for example, the first display area DA1, the second display area DA2, the third display area DA3, the fourth display area DA4, etc.) into which the screen area of ​​the display 150 is divided. In addition, the information processing device 10 may also perform a specific pattern of touch operation on a blank area where no window is displayed in a display area in which at least one window is displayed (configured) in the display areas divided within the screen area of ​​the display 150 (for example, the first display area DA1, the second display area DA2, the third display area DA3, the fourth display area DA4, etc.), thereby displaying a thumbnail window (thumbnail image) in the display area where the touch operation was performed.

[0288] In addition, in the above-mentioned embodiment, an example of using a foldable display 150 in a single-screen mode and a dual-screen mode is described, but two displays may be used. That is, the processing in the above-mentioned embodiment can also be applied to the switching between the single-screen mode in which the screen areas of the two displays are combined as one display area to control the display and the dual-screen mode in which the screen areas of the two displays are independently controlled as display areas. In addition, the processing in the above-mentioned embodiment can also be applied to the control of the display as a triple-screen mode or a quad-screen mode by dividing one or both of the screen areas of the two displays into two display areas.

[0289] In addition, in the above-mentioned embodiment, the information processing device 10 is described as having a dual-screen mode divided into two display areas to control the display, a triple-screen mode divided into three display areas to control the display, and a quad-screen mode divided into four display areas to control the display as a structure of multiple screen modes, but it can also be configured to have a screen mode divided into five or more display areas to control the display.

[0290] In addition, in the above-mentioned embodiment, an example of touch operation on a plurality of touch panel displays which are integrally formed with an input unit (touch sensor) and a display unit is described, but it is not limited to touch operation and may also be set as a mouse-based click operation, a gesture-based operation, etc.

[0291] In addition, the control unit 18 has a computer system inside. Moreover, the program for realizing the functions of each structure respectively possessed by the control unit 18 can also be recorded in a computer-readable recording medium, and the processing in each structure respectively possessed by the control unit 18 can be performed by making the computer system read the program recorded in the recording medium and execute it. Here, the so-called "making the computer system read the program recorded in the recording medium and execute it" is included in the computer system installation program. The so-called "computer system" here includes hardware such as OS and peripheral devices. In addition, the "computer system" can also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. In addition, the so-called "computer-readable recording medium" refers to portable media such as floppy disks, optical magnetic disks, ROMs, CD-ROMs, and storage devices such as hard disks built into computer systems. In this way, the recording medium storing the program can be a non-transient recording medium such as a CD-ROM.

[0292] In addition, the recording medium also includes an internal or external recording medium that can be accessed from a distribution server in order to distribute the program. In addition, the program can also be divided into multiple parts, and the structure formed by combining the various structures possessed by the control unit 18 after downloading at different time intervals, and the distribution server for distributing each of the divided programs is different. Moreover, the so-called "computer-readable recording medium" also includes a structure that keeps the program for a certain period of time, such as a server in the case of sending a program via a network, and a volatile memory (RAM) inside a computer system that becomes a client. In addition, the above-mentioned program can also be a structure for realizing a part of the above-mentioned functions. Furthermore, it can also be a so-called differential file (differential program) that can be realized by combining the above-mentioned functions with programs already recorded in the computer system.

[0293] In addition, part or all of the functions of the control unit 18 in the above-mentioned embodiment may be implemented as an integrated circuit such as LSI (Large Scale Integration). Each function may be processed individually, or part or all of it may be integrated for processing. In addition, the method of integrated circuitization is not limited to LSI, and it may also be implemented by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears with the advancement of semiconductor technology, an integrated circuit based on the technology may also be used.

Claims

1. An information processing device comprising: monitor; A memory for storing application programs; and a processor that controls the display to display a window of the application by executing a program of the application stored in the memory, The processor performs display mode switching processing, first display control processing and second display control processing, In the above display mode switching process, the switching between the first display mode and the second display mode is controlled, wherein: In the first display mode, the entire screen area of ​​the display is controlled as a display area, and in the second display mode, the screen area of ​​the display is divided into a plurality of display areas to control the display. In the first display control process, when the display mode is switched from the first display mode to the second display mode through the display mode switching process, one of the windows of the application executed in the first display mode is displayed in a first display area of ​​the plurality of display areas, and thumbnail images corresponding to windows other than the one of the windows in the first display mode are displayed in a second display area other than the first display area of ​​the plurality of display areas. In the second display control process, a predetermined operation performed by the user is detected, and the thumbnail image is displayed in a display area designated by the predetermined operation in a display area within the screen area.

2. The information processing device according to claim 1, wherein: In the second display control process, when the processor detects the predetermined operation and displays the thumbnail image, the processor also displays the thumbnail image corresponding to the one of the windows in the first display mode.

3. The information processing device according to claim 1, wherein: The processor controls the thumbnail image displayed in the second display area to be hidden in the second display control process, and then detects the predetermined operation to display the thumbnail image in the display area designated by the predetermined operation.

4. The information processing device according to claim 1, wherein: the processor causes the display to display a first icon for accepting a user's operation for switching from the first display mode to the second display mode, When a user operation on the first icon is detected in the first display mode, the first display mode is switched to the second display mode. In the second display mode, an operation of the first icon by the user is accepted as the predetermined operation, and when the operation of the first icon is detected, the thumbnail image is displayed as if the predetermined operation has been detected.

5. The information processing device according to claim 1, wherein: the processor causes the display to display a first icon for accepting a user operation for switching from the first display mode to the second display mode and a second icon for accepting the prescribed operation, When an operation on the second icon is detected, the thumbnail image is displayed as if the predetermined operation has been detected.

6. The information processing device according to claim 5, wherein: The second icon accepts an operation of designating a display area for displaying the thumbnail image regardless of a plurality of display areas divided in the second display mode.

7. The information processing device according to claim 1, wherein: The predetermined operation is a touch operation of a specific pattern performed by the user on a display area where the user wishes to display the thumbnail images.

8. The information processing device according to claim 7, wherein: The prescribed operation is a touch operation of the specific pattern on an area where no window is displayed in a display area where at least one window is displayed in a plurality of display areas in the second display mode. When the predetermined operation is detected, the processor displays the thumbnail image in the display area where the predetermined operation was performed through the second display control process.

9. The information processing device according to claim 3, wherein: When any one of the thumbnail images displayed in the second display area is selected by a user operation, the processor hides all the thumbnail images displayed in the second display area and displays the window corresponding to the selected thumbnail image.

10. The information processing device according to claim 3, wherein: The processor hides all of the thumbnail images displayed in the second display area when a user operation for hiding the thumbnail images displayed in the second display area is performed.

11. The information processing device according to claim 1, wherein: When the processor switches from the first display mode to the second display mode through the display mode switching process, in the first display control process, it controls whether to display the thumbnail image in the second display area based on the number of windows in the first display mode.

12. The information processing device according to claim 1, wherein: When the processor switches from the first display mode to the second display mode through the display mode switching process, in the first display control process, it controls whether to display the thumbnail image in the second display area based on the number of display areas in the second display mode.

13. A control method, which is a control method in an information processing device, the information processing device comprising a display, a memory, and a processor, the memory storing an application program, the processor controlling the display to display a window of the application by executing the application program stored in the memory, The control method comprises a display mode switching step, a first display control step and a second display control step. In the above display mode switching step, the above processor controls the switching between the first display mode and the second display mode, wherein: In the first display mode, the entire screen area of ​​the display is controlled as a display area, and in the second display mode, the screen area of ​​the display is divided into a plurality of display areas to control the display. In the first display control step, when the first display mode is switched to the second display mode through the display mode switching step, one of the windows of the application executed in the first display mode is displayed in a first display area of ​​the plurality of display areas, and thumbnail images corresponding to windows other than the one of the windows in the first display mode are displayed in a second display area other than the first display area of ​​the plurality of display areas. In the second display control step, a predetermined operation performed by the user is detected, and the thumbnail image is displayed in a display area designated by the predetermined operation in a display area within the screen area.

Images