Information processing apparatus and control method

Abstract

The invention relates to an information processing apparatus and a control method, which improve operability when selecting a window to be displayed in each of a plurality of display areas. The information processing apparatus includes a display that controls switching between a first display mode in which display is controlled by using the entire screen area of the display as a single display area and a second display mode in which display is controlled by dividing the screen area of the display into a plurality of display areas. In the second display mode, the window displayed in any one of the plurality of display areas is not displayed, and the thumbnail image corresponding to at least a part of the window of the application being executed is displayed in the display area in which the window is not displayed.

Description

Technical Field

[0001] The present invention relates to an information processing device and a control method. Background Art

[0002] In recent years, there is an information processing device with multiple screens (for example, dual screens). For example, an information processing device with a dual screen structure formed by mounting two displays (display units) on a first shell and a second shell that can be folded via a connecting portion (hinge mechanism) is disclosed (for example, Patent Document 1). In addition, there is also an information processing device in which a flexible display (display unit) such as an organic EL display is arranged to bend across the first shell and the second shell according to folding (for example, refer to Patent Document 2). In this way, in the case where a display (display unit) is arranged across the first shell and the second shell, not only a single screen mode in which one display is used as one screen, but also a display can be divided into a display area on the first shell side and a display area on the second shell side and used in a suspected dual screen mode. In addition, even if it is an information processing device with a dual screen structure formed by the above-mentioned two displays, not only a dual screen mode, but also two displays can be used as one screen in a single screen mode.

[0003] For example, Patent Document 3 discloses an information processing device, which displays the window of an application being executed, and displays the active window in the single-screen mode on one screen of the dual-screen mode, and displays thumbnail images corresponding to windows other than the active window on the other screen, according to switching from the single-screen mode to the dual-screen mode. In this information processing device, when switching from the single-screen mode to the dual-screen mode, it is easy to continue to use the application used in the single-screen mode, and it is easy to check the list of other executed applications through the thumbnail images, so the convenience is good. By selecting a thumbnail image, the user can display the window of the application corresponding to the selected thumbnail image for use.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2015-233198

[0005] Patent Document 2: Japanese Patent Application Publication No. 2018-13850

[0006] Patent Document 3: Japanese Patent Application Publication No. 2022-70081

[0007] However, for example, in the technology disclosed in the above-mentioned patent document 3, although the user can display the window of the application he wants to use by selecting the thumbnail image, it is not easy to close the window and switch to the window of another application. In the case where the display is divided into three or more display areas for use without being limited to the dual-screen mode, the number of windows displayed in each display area also increases, so it is desired to be able to more easily select the window displayed in each display area. Summary of the invention

[0008] The present invention has been made in view of the above-mentioned situation, and one object of the present invention is to provide an information processing device and a control method that improve the operability when selecting a window displayed in each of a plurality of display areas.

[0009] The present invention is completed to solve the above-mentioned problems. The information processing device involved in the first mode of the present invention comprises: a display; a memory, storing an application program; and a processor, which controls the display to display the window of the above-mentioned application by executing the program of the above-mentioned application stored in the above-mentioned memory, and the above-mentioned processor performs display mode switching processing and display control processing. In the above-mentioned display mode switching processing, the switching between the first display mode and the second display mode is controlled, wherein in the above-mentioned first display mode, the entire screen area of ​​the above-mentioned display is controlled to be displayed as a display area, and in the above-mentioned second display mode, the screen area of ​​the above-mentioned display is divided into multiple display areas to control the display. In the above-mentioned display control processing, since the above-mentioned window displayed in any display area of ​​the multiple display areas becomes non-displayed in the above-mentioned second display mode, a thumbnail image corresponding to at least a part of the above-mentioned window of the above-mentioned application being executed is displayed in the display area where the above-mentioned window becomes non-displayed.

[0010] The above-mentioned information processing device can also be configured such that, in the above-mentioned second display mode, when the above-mentioned window displayed in any one of the multiple display areas becomes hidden and there are no other windows displayed in the display area where the above-mentioned window becomes hidden, the above-mentioned processor displays the above-mentioned thumbnail image in the display area where the above-mentioned window becomes hidden through the above-mentioned display control processing.

[0011] The above-mentioned information processing device can also be configured such that when the above-mentioned processor switches from the above-mentioned first display mode to the above-mentioned second display mode through the above-mentioned display mode switching processing, the above-mentioned processor displays one window among the above-mentioned windows of the above-mentioned application executed in the above-mentioned first display mode in the first display area among the multiple display areas through the above-mentioned display control processing, and displays the above-mentioned thumbnail image corresponding to the window other than the above-mentioned one window among the above-mentioned windows in the above-mentioned first display mode in the second display area other than the above-mentioned first display area among the multiple display areas.

[0012] The information processing device may be configured such that, when the processor switches from the first display mode to the second display mode through the display mode switching process, the processor minimizes the windows other than the one window in the first display mode through the display control process.

[0013] The above-mentioned information processing device can also be configured such that when the above-mentioned processor switches from the above-mentioned first display mode to the above-mentioned second display mode through the above-mentioned display mode switching processing, the above-mentioned window other than the above-mentioned one window in the above-mentioned first display mode is configured in the above-mentioned first display area through the above-mentioned display control processing and then minimized.

[0014] The above-mentioned information processing device can also be configured so that when any one of the above-mentioned thumbnail images is selected through user operation, the above-mentioned processor makes all the above-mentioned thumbnail images displayed in the above-mentioned second display area invisible, and displays the above-mentioned window corresponding to the selected thumbnail image in the above-mentioned second display area.

[0015] The above-mentioned information processing device can also be configured so that the above-mentioned processor displays the above-mentioned thumbnail image corresponding to the above-mentioned windows of all the above-mentioned applications being executed, except for the window displayed as the top layer in any one of the multiple display areas, when the above-mentioned thumbnail image is displayed through the above-mentioned display control processing because the above-mentioned window displayed in any one of the multiple display areas in the above-mentioned second display mode becomes hidden.

[0016] The above-mentioned information processing device can also be configured such that, when the above-mentioned processor displays the above-mentioned thumbnail image through the above-mentioned display control processing because the above-mentioned window displayed in any one of the multiple display areas in the above-mentioned second display mode is closed and becomes hidden, the above-mentioned processor excludes the above-mentioned thumbnail image corresponding to the above-mentioned window that is closed and becomes hidden from the display object.

[0017] The above-mentioned information processing device can also be configured so that the above-mentioned processor displays the above-mentioned thumbnail images corresponding to the above-mentioned windows of all the above-mentioned applications being executed when the above-mentioned thumbnail images are displayed through the above-mentioned display control processing because the above-mentioned window displayed in any one of the multiple display areas in the above-mentioned second display mode becomes hidden.

[0018] In addition, the control method involved in the second mode of the present invention is a control method in an information processing device, which includes a display, a memory and a processor, the memory stores an application program, and the processor controls the display to display the window of the application by executing the program of the application stored in the memory. The control method includes a display mode switching step and a display control step. In the display mode switching step, the processor controls the switching between the first display mode and the second display mode, wherein in the first display mode, the entire screen area of ​​the display is controlled as a display area, and in the second display mode, the screen area of ​​the display is divided into multiple display areas to control the display. In the display control step, since the window displayed in any one of the multiple display areas becomes hidden in the second display mode, a thumbnail image corresponding to at least a part of the window of the executing application is displayed in the display area where the window becomes hidden.

[0019] According to the above aspect of the present invention, it is possible to improve the operability when selecting a window displayed in each of a plurality of display areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a perspective view showing the appearance of the information processing device according to the first embodiment.

[0021] Figure 2 This is a side view showing an example of the information processing device in a folded state according to the first embodiment.

[0022] Figure 3 It is a side view showing an example of the information processing device in a planar state according to the first embodiment.

[0023] Figure 4 It is a diagram showing specific examples of various display modes of the information processing device according to the first embodiment.

[0024] Figure 5 This is a diagram showing an example of an operation specification of the display mode switching operation according to the first embodiment.

[0025] Figure 6 This is a diagram showing an example of a display example in the dual screen mode according to the first embodiment.

[0026] Figure 7 It is a diagram showing a first example of display control of the thumbnail window according to the first embodiment.

[0027] Figure 8 It is a diagram showing a second example of display control of the thumbnail window according to the first embodiment.

[0028] Fig. 9 This is a block diagram showing a hardware configuration example of the information processing device according to the first embodiment.

[0029] Fig.10 This is a block diagram showing a functional configuration example related to the display control process according to the first embodiment.

[0030] Fig.11 This is a flowchart showing an example of a display control process when switching to the dual screen mode according to the first embodiment.

[0031] Fig.12 This is a flowchart showing an example of display control processing when a window according to the first embodiment is hidden.

[0032] Fig.13 This is a diagram showing an example of an operation specification of a display mode switching operation according to the second embodiment.

[0033] Fig.14 It is a diagram showing a first example of display control of thumbnail windows in the three-screen mode according to the second embodiment.

[0034] Fig.15 It is a diagram showing a second example of display control of thumbnail windows in the three-screen mode according to the second embodiment.

[0035] Fig.16 This is a diagram showing an example of display control of thumbnail windows in the quad-screen mode according to the second embodiment.

[0036] Description of Reference Numerals

[0037] 10…information processing device; 101…first shell; 102…second shell; 103…hinge mechanism; 11…communication unit; 12…RAM; 13…storage unit; 14…speaker; 15…display unit; 16…camera; 150…display; 155…touch sensor; 161…first acceleration sensor; 162…second acceleration sensor; 17…Hall sensor; 18…control unit; 181…system processing unit; 1811…execution application information generation unit; 182…detection processing unit; 1821…opening and closing detection unit; 1822…posture detection unit; 1823…connection detection unit; 1824…operation detection unit; 183…display processing unit; 1831…display mode determination unit; 1832…display mode switching unit; 1833…thumbnail generation unit; 1834…display control unit. DETAILED DESCRIPTION

[0038] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0039] <First embodiment>

[0040] First, the outline of the first embodiment of the present invention will be described.

[0041] Figure 1 : is a three-dimensional diagram showing the appearance of the information processing device 10 involved in the present embodiment. The information processing device 10 involved in the present embodiment is a clamshell (notebook) PC (personal computer). The information processing device 10 includes: a first shell 101, a second shell 102 and a hinge mechanism 103. The first shell 101 and the second shell 102 are approximately quadrilateral plate-shaped (for example, flat plate-shaped) shells. One of the side surfaces of the first shell 101 and one of the side surfaces of the second shell 102 are combined (connected) via the hinge mechanism 103, and the first shell 101 and the second shell 102 can rotate relative to each other around the rotation axis formed by the hinge mechanism 103. The state in which the opening angle θ of the first shell 101 and the second shell 102 around the rotation axis is approximately 0° is the state in which the first shell 101 and the second shell 102 overlap and close. The state in which the first shell 101 and the second shell 102 are closed is called the "closed state" (closed). In the closed state, the surfaces of the first shell 101 and the second shell 102 facing each other are respectively referred to as "inner surfaces", and the surfaces on the opposite side to the inner surfaces are referred to as "outer surfaces". The opening angle θ can also refer to the angle formed by the inner surface of the first shell 101 and the inner surface of the second shell 102. Relative to the closed state, the state in which the first shell 101 and the second shell 102 are opened is referred to as the "open state". The open state is a state in which the first shell 101 and the second shell 102 are relatively rotated until the opening angle θ becomes larger than a preset threshold value (for example, 10°).

[0042] In addition, the information processing device 10 includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided from the inner surface of the first housing 101 to the inner surface of the second housing 102. The camera 16 is provided, for example, on the inner surface of the first housing 101, outside the screen area of ​​the display 150, and can capture a user or the like who is on the side facing the display 150. The display 150 is a flexible display that can be bent according to the opening angle θ formed by the relative rotation of the first housing 101 and the second housing 102 (see FIG. 1 ). Figure 2 , 3). As a flexible display, an organic EL display or the like is used. The information processing device 10 can control the display by treating the entire screen area of ​​the display 150 as a display area DA as a screen structure, or can control the display by dividing the screen area of ​​the display 150 into two display areas, a first display area DA1 and a second display area DA2, to form a dual-screen structure. Here, the first display area DA1 and the second display area DA2 are display areas that do not overlap with each other. Here, the display area corresponding to the inner surface side of the first shell 101 in the screen area of ​​the display 150 is the first display area DA1, and the display area corresponding to the inner surface side of the second shell 102 is the second display area DA2. In the following, the display mode for controlling the display with one screen structure is referred to as a "single-screen mode", and the display mode for controlling the display with a dual-screen structure is referred to as a "dual-screen mode".

[0043] In addition, a touch sensor is provided on the screen area of ​​the display 150. The information processing device 10 can detect a touch operation on the screen area of ​​the display 150. By opening the information processing device 10, the user can visually check the display of the display 150 provided on the inner surface of each of the first housing 101 and the second housing 102, perform a touch operation on the display 150, and use the information processing device 10.

[0044] Next, the usage form and screen mode of the information processing device 10 are described in detail. First, as the usage form of the information processing device 10, according to the opening angle θ of the first shell 101 and the second shell 102, it is divided into a state (Bent form) in which the first shell 101 and the second shell 102 are bent, and a state (Flat form) in which the first shell 101 and the second shell 102 are not bent. In the following, the state (Bent form) in which the first shell 101 and the second shell 102 are bent is simply referred to as "the bent state (Bent form)", and the state (Flat form) in which the first shell 101 and the second shell 102 are not bent is simply referred to as "the flat state (Flat form)". In the bent state (Bent form), the display 150 arranged across the first shell 101 and the second shell 102 also becomes a bent state. In the flat state (Flat form), the display 150 also becomes a flat state.

[0045] Figure 2 1 is a side view showing an example of the information processing device 10 in a bent state. The display 150 is arranged to extend across (straddle) the first housing 101 and the second housing 102. The screen area ( Figure 1The display area DA shown can be bent (curved) with the portion corresponding to the hinge mechanism 103 as a fold line, and with the fold line as a boundary, the display area on the first shell 101 side is represented as the first display area DA1, and the display area on the second shell 102 side is represented as the second display area DA2. The display 150 bends according to the rotation (opening angle θ) of the first shell 101 and the second shell 102. The information processing device 10 determines whether it is in a bent state (Bent form) based on the opening angle θ. As an example, when 10°<θ<170°, the information processing device 10 determines that it is in a bent state (Bent form). This state is equivalent to the so-called clamshell mode, book mode and other usage modes.

[0046] Figure 3 1 is a side view showing an example of the information processing device 10 in a flat state. Typically, when the opening angle θ is 180°, the information processing device 10 is determined to be in a flat state. However, as an example, when 170°≤θ≤180°, it can also be determined to be in a flat state. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat state. This state corresponds to the so-called tablet mode, which is a usage form.

[0047] Next, refer to Figure 4 , the display modes based on various usage modes of the information processing device 10 are described in detail.

[0048] Figure 4 1 is a diagram showing specific examples of various display modes of the information processing device 10 involved in this embodiment. The information processing device 10 has different display modes in different usage modes classified by the opening angle θ of the first housing 101 and the second housing 102, the posture (direction) of the information processing device 10, and whether it is a single-screen mode or a dual-screen mode. In addition, a single screen is also called a single screen, and a dual screen is also called a split screen or a dual screen.

[0049] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage mode. For example, in this closed state, the information processing device 10 is in a sleep, dormant, or standby state, and the display 150 is in a display-off state. This sleep, dormant, or standby state is, for example, equivalent to S3 or S4 of the system power state specified by ACPI (Advanced Configuration and Power Interface).

[0050] Display mode (b) is a display mode in a dual-screen mode in which the display is controlled by dividing the screen area of ​​the display 150 into two display areas, namely, the first display area DA1 and the second display area DA2, in a bent state as a usage form. In addition, the direction of the information processing device 10 is a direction in which the first display area DA1 and the second display area DA2 are arranged horizontally in the vertical direction. The display area being vertical means that the long side of the four sides of the rectangular display area is vertical and the short side is horizontal. When the display area is vertical, the display direction is also vertical, and the direction along the long side corresponds to the up-down direction and the direction along the short side becomes the left-right direction. This usage form is a usage form in which the left and right pages of a book when it is opened correspond to the left and right screens, which is equivalent to the so-called book mode. This usage form is a bent state (Bent form) and the first display area DA1 and the second display area DA2 are arranged horizontally, and the display area formed by merging the two is horizontally wide, so it is also called "Fold Landscape".

[0051] In the display mode (b), the information processing device 10, for example, in a normal operation state, uses the first display area DA1 on the left as the primary screen and the second display area DA2 on the right as the secondary screen, thereby achieving a dual-screen display mode. In addition, in the display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.

[0052] Display mode (c-1) is a display mode in a dual-screen mode in which the display is controlled by dividing the screen area of ​​the display 150 into two display areas, namely, the first display area DA1 and the second display area DA2, in a bent state similar to display mode (b), but is a usage mode in which the direction of the information processing device 10 is different. The direction of the information processing device 10 is a direction in which the first display area DA1 and the second display area DA2 are arranged vertically in the horizontal direction. The horizontal display area means that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display direction is also horizontal, and the display is performed in a direction in which the direction along the short side corresponds to the up-down direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the general usage modes of a clamshell-type PC.

[0053] In the display mode (c-1), the information processing device 10, for example, in a normal operation state, has the first display area DA1 as the primary screen and the second display area DA2 as the secondary screen, thereby achieving a dual-screen display mode. In addition, in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.

[0054] For example, the information processing device 10 automatically switches (Switch by Rotation) from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the posture (direction) of the information processing device 10. For example, relative to display mode (b), display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right in the figure. Therefore, if the information processing device 10 detects that the display 150 is rotated to the right by a predetermined angle (for example, 45 degrees) or more from the state of display mode (b), it switches to display mode (c-1). In addition, relative to display mode (c-1), display mode (b) is a state in which the display 150 is rotated 90 degrees to the left in the figure. Therefore, if the information processing device 10 detects that the display 150 is rotated to the left by a predetermined angle (for example, 45 degrees) or more from the state of display mode (c-1), it switches to display mode (b).

[0055] The display mode (c-2) is in the same bent state (Bent form) as the display mode (c-1) and the direction of the information processing device 10 is also the same, but the difference is that an external keyboard 30 (Dockable mini KBD: KeyBord) that can be connected to the information processing device 10 is connected. This usage mode is a state in which the physical keyboard 30 is connected in the general usage mode of the clamshell type PC. For example, the keyboard 30 is almost the same size as the second display area DA2, and is configured to be placed on the second display area DA2. As an example, the keyboard 30 is provided with a magnet inside (end) of the bottom surface, and if placed on the second display area DA2, it is adsorbed and fixed to the metal part of the inner surface end of the second shell 102. As a result, it becomes the same usage mode as a traditional clamshell type PC that originally has a physical keyboard. In addition, the information processing device 10 and the keyboard 30 are connected, for example, via Bluetooth (registered trademark). In this display mode (c-2), in the information processing device 10, the second display area DA2 cannot be visually confirmed due to the keyboard, so it is controlled to be displayed in black or turned off. That is, the display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as a “half screen mode”), and is a single screen mode using only the first display area DA1.

[0056] For example, when the information processing device 10 detects the connection of an external keyboard in the display mode (c-1), the information processing device 10 automatically switches from the display mode (c-1) to the display mode (c-2) (Switch by Dock).

[0057] Display mode (d) is in a bent state (Bent form) like display mode (b) and the direction of the information processing device 10 is also the same, but the difference is that the entire screen area of ​​the display 150 is used as a display area DA to control the display in a single-screen mode. This usage form is different from display mode (b), except that it is a single-screen mode, but it is in a bent state (Bent form) and the display area DA is horizontally wide, so it is also called "Fold Landscape". The display area DA is horizontal, and the display direction is also horizontal.

[0058] Here, the switching between the single screen mode and the dual screen mode in the bent state (Bent form) is performed, for example, by the operation of the user. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single screen mode and the dual screen mode at any location on the screen, and switches from the display mode (b) to the display mode (d) based on the operation of the operator (Switch by UI). A specific example of the display mode switching operation is described later.

[0059] Display mode (e) is in the same bent state (Bent form) as display mode (c-1), and the direction of the information processing device 10 is also the same, but the difference is that the entire screen area of ​​the display 150 is a single screen mode for controlling the display as a display area DA. This usage form is different from display mode (c-1) in that it is a single screen mode, but from the bent state (Bent form) and the direction of the information processing device 10, it is equivalent to the usage form of a clamshell PC. The display area DA is vertical, and the display direction is also vertical.

[0060] For example, the information processing device 10 automatically switches (Switch by Rotation) from display mode (d) to display mode (e), or from display mode (e) to display mode (d) by detecting a change in the posture (direction) of the information processing device 10. For example, relative to display mode (d), display mode (e) is a state in which the display 150 is rotated 90 degrees to the right in the figure, so if the information processing device 10 detects that it has rotated more than a specified angle (for example, 45 degrees) to the right from the state of display mode (d), it switches to display mode (e). In addition, relative to display mode (e), display mode (d) is a state in which the display 150 is rotated 90 degrees to the left in the figure, so if the information processing device 10 detects that it has rotated more than a specified angle (for example, 45 degrees) to the left from the state of display mode (e), it switches to display mode (d).

[0061] The display mode (d′) is a single-screen mode like the display mode (d), and the direction of the information processing device 10 is also the direction in which the display area DA is horizontally wide, but the difference is that it is in a flat state (Flat form). The flat state (Flat form) means that the opening angle θ of the first shell 101 and the second shell 102 is approximately 180°. This usage mode corresponds to the reference Figure 3 The so-called tablet mode described here is a flat state (Flat form), and the display area DA is horizontally wide, so it is also called "Flat Landscape". The display mode (d') is different from the display mode (d) only in the opening angle θ between the first shell 101 and the second shell 102. Similar to the display mode (d), the display area DA is horizontal and the display direction is also horizontal.

[0062] Display mode (e′) is a single-screen mode like display mode (e), and the direction of the information processing device 10 is also the direction in which the display area DA is vertically long, but the difference is that it is in a flat state (Flat form). This usage form is a flat state (Flat form), and the display area DA is vertically long, so it is also called "Flat Portrait". This display mode (e′) is different from display mode (e) only in the opening angle θ of the first shell 101 and the second shell 102. Like display mode (e), the display area DA is vertical, and the display direction is also vertical.

[0063] For example, the information processing device 10 automatically switches (Switch by Rotation) from the display mode (d′) to the display mode (e′), or from the display mode (e′) to the display mode (d′) by detecting a change in the posture (direction) of the information processing device 10. For example, relative to the display mode (d′), the display mode (e′) is a state in which the display 150 in the figure is rotated 90 degrees to the right, so if the information processing device 10 detects that the display mode (d′) is rotated to the right by a predetermined angle (for example, 45 degrees) or more, it switches to the display mode (e′). In addition, relative to the display mode (e′), the display mode (d′) is a state in which the display 150 in the figure is rotated 90 degrees to the left, so if the information processing device 10 detects that the display mode (e′) is rotated to the left by a predetermined angle (for example, 45 degrees) or more, it switches to the display mode (d′).

[0064] In the display mode (d') and the display mode (e'), the user can switch between the single-screen mode and the dual-screen mode by operating the operator (for example, see Figure 5The display mode switching icon described later) can be operated to switch to the dual-screen mode while maintaining the flat state. For example, if the dual-screen mode is switched from the display mode (d′), the display state is the same as the display mode (b) in the flat state. In addition, if the dual-screen mode is switched from the display mode (e′), the display state is the same as the display mode (c-1) in the flat state.

[0065] In addition, if the information processing device 10 detects the connection with the keyboard 30 in the display mode (e′), it automatically switches (Switch by Dock) from the display mode (e′) to the display mode (c-2′). The display mode (c-2′) is a flat state (Flat form), and with respect to the display mode (c-2), only the opening angle θ of the first shell 101 and the second shell 102 is different. In this display mode (c-2′), in the information processing device 10, the second display area DA2 cannot be visually confirmed due to the keyboard, so it is controlled to be displayed in black or turned off. In other words, this display mode (c-2′) is the same as the display mode (c-2), that is, a half-screen mode in which only half of a screen is effectively displayed.

[0066] In addition, the information processing device 10 can also automatically switch from the single-screen mode to the dual-screen mode (Switch by Hinge angle) by detecting a change from a flat state (Flat form) to a bent state (Bent form). For example, when the information processing device 10 detects a change from the display mode (d′) to the bent state (Bent form) based on the opening angle θ of the first shell 101 and the second shell 102, the information processing device 10 automatically switches from the display mode (d′) to the display mode (b). In addition, when the information processing device 10 detects a change from the display mode (e′) to the bent state (Bent form) based on the opening angle θ of the first shell 101 and the second shell 102, the information processing device 10 automatically switches from the display mode (e′) to the display mode (c-1).

[0067] (Display mode switching operation)

[0068] Next, a specific example of the operation specification when the display mode is switched by the user's operation will be described. Figure 5 is a diagram showing an example of an operation specification of a display mode switching operation according to the present embodiment. Figure 5As shown in (A), the icon C1 for displaying the switching menu of the display mode is displayed in the task bar B2. The task bar B2 is displayed in any area within the screen area of ​​the display 150. For example, regardless of the single screen mode or the dual screen mode, the task bar B2 is displayed only at one place (for example, the bottom of the screen area) within the screen area of ​​the display 150. In addition, in the case of the dual screen mode, the task bar B2 may be displayed separately in the first display area DA1 and the second display area DA2 (for example, the bottom of each).

[0069] If the icon C1 for displaying the switching menu is operated, the switching menu of the display mode is displayed as a pop-up screen. In addition, the switching menu of the display mode may be displayed as a pop-up screen when the bent state (Bent form) is changed to the unbent flat state (Flat form). In addition, the switching menu of the display mode may be displayed as a pop-up screen when the flat state (Flat form) is changed to the bent state (Bent form).

[0070] The switching menu displays a display mode switching icon as a selection item of the display mode, and the display mode switching icon is used by the user to instruct the switching between the single-screen mode and the dual-screen mode, and the replacement of the display data respectively displayed in the first display area DA1 and the second display area DA2 in the dual-screen mode (replacement of the primary screen and the secondary screen). The switching menu displays the selection items of the display mode that the user can select according to the current usage form (the direction of the display 150).

[0071] Figure 5 (B) represents the switching menu M1 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.). In addition, "1" and "2" in the figure are added to distinguish the display areas. For example, in each display area, the priority of the area is represented by a number according to the preset priority of the area. For example, in the dual-screen mode, "1" has a higher priority than "2", for example, it indicates the primary screen, and "2" indicates the secondary screen. Display mode switching icon C11, display mode switching icon C12 and display mode switching icon C13 are displayed in the switching menu M1. Display mode switching icon C11 is displayed as an operator for selecting display mode (d) and display mode (d') of the single-screen mode. Display mode switching icon C12 and display mode switching icon C13 are displayed as operators for selecting display mode (b) of the dual-screen mode. In display mode switching icon C12 and display mode switching icon C13, the arrangement of "1" (primary screen) and "2" (secondary screen) is different.

[0072] In addition, the display mode switching icon corresponding to the current display mode is displayed in a manner that can be distinguished from other display mode switching icons. Here, the display mode switching icon C11 is highlighted relative to the other display mode switching icons C12 and C13 so that it is known that the display mode switching icon C11 is the current display mode.

[0073] Figure 5 (C) represents the switching menu M2 displayed when the usage form is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e′) etc.). Display mode switching icon C21, display mode switching icon C22 and display mode switching icon C23 are displayed in the switching menu M2. Display mode switching icon C21 is displayed as an operator for selecting the single screen mode (display mode (e) and display mode (e′)). Display mode switching icon C22 and display mode switching icon C23 are displayed as operators for selecting display mode (c-1) of the dual screen mode, and in display mode switching icon C22 and display mode switching icon C23, the arrangement of "1" (primary screen) and "2" (secondary screen) is different.

[0074] In addition, Figure 5 Similarly, in the switching menu M1 shown in (B), the display mode switching icon corresponding to the current display mode is displayed in a manner that can be distinguished from other display mode switching icons. Here, the display mode switching icon C21 is highlighted relative to the other display mode switching icons C22 and C23 so that it is known that the display mode switching icon C21 is the current display mode.

[0075] The user can arbitrarily select any one of the display mode switching icons displayed in the switching menu M1 or the switching menu M2. When the user selects any one of the display mode switching icons, the display of the switching menu ends. Alternatively, when a specified time (for example, 3 to 5 seconds) has passed after the switching menu M1 or the switching menu M2 is displayed and the user has not selected any of the display mode switching icons, the display of the switching menu ends. In addition, when the user operates the close button "×" on the upper right corner of the switching menu, when the user operates outside the screen of the pop-up switching menu, or when the direction of the information processing device 10 is changed, the display of the switching menu ends. In addition, when the keyboard 30 is connected, it is fixed to display only the valid half-screen mode (display mode (c-2)) in the first display area DA1, so the switching menu is not displayed.

[0076] In addition, the UI for switching between the single-picture mode and the dual-picture mode is not limited to Figure 5In the example shown, any UI can be used. For example, an icon that alternately switches between the single-screen mode and the dual-screen mode each time an operation is performed, or an icon that sequentially switches between the single-screen mode, the dual-screen mode, and the inverted dual-screen mode each time an operation is performed can also be displayed on the taskbar B2. In addition, in the following description, when the dual-screen mode and the inverted dual-screen mode are not particularly distinguished, they are collectively referred to as the dual-screen mode.

[0077] In addition, Figure 5 In the example shown, the display mode switching menu is displayed as a pop-up screen by operating the icon C1 displayed on the taskbar B2, but the switching menu can also be displayed as a pop-up screen by dragging the application window. In addition, the display mode can also be switched by dragging the application window. In the case where the switching menu pops up by dragging the application window, it is also possible to drag on one of the divided areas of the screen area displayed on the switching menu, so that not only the screen mode can be selected, but also the screen area can be selected, and the dragged application can be arranged in the selected area. In addition, the switching menu can also be displayed as a pop-up screen by operating a specific place in the application window.

[0078] (Display control when switching from single-picture mode to dual-picture mode)

[0079] Next, the display control when switching from the single-screen mode to the dual-screen mode is described. When the information processing device 10 switches from the single-screen mode to the dual-screen mode, one of the windows of the application (hereinafter referred to as "application") executed in the single-screen mode is displayed in the first display area DA1 (for example, the primary screen). For example, the information processing device 10 displays the active window of the window of the application executed in the single-screen mode in the first display area DA1.

[0080] Here, when multiple windows are opened, the windows are arranged one by one in overlapping layers on the display 150. The active window refers to the window currently selected as the user's operation target, for example, the window displayed in the frontmost layer (the uppermost layer) arranged on the display 150. The active window displayed in the first display area DA1 when the information processing device 10 switches from the single-screen mode to the dual-screen mode is the window displayed as the active window in the single-screen mode before switching to the dual-screen mode.

[0081] In addition, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, the active window in the single-screen mode is displayed in the first display area DA1, but if there is no active window, the window with the highest priority among the windows displayed in the display area DA in the single-screen mode is displayed in the first display area DA1.

[0082] The window with the highest priority is typically the active window, but when there is no active window, it is the window that becomes the last active window. For example, when an operation is performed on a part other than a window in the display area DA, there is no active window, and the window that becomes the last active window is displayed in the first display area DA1. That is, the later the window becomes the active window, the higher the display priority, and the window with the highest priority is displayed in the first display area DA1. However, in order to facilitate the understanding of the description, in the following description, the window with the highest priority is recorded as the "active window" for description.

[0083] In addition, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, the second display area DA2 (for example, the secondary screen) displays thumbnail images (reduced images) corresponding to inactive windows other than the active window among the windows in the single-screen mode. Here, the inactive window is a window other than the active window in the single-screen mode before the transition to the dual-screen mode. In the following, the window displaying the thumbnail image of the inactive window is also referred to as a "thumbnail window".

[0084] Reference Figure 6 , a display example of the dual-picture mode in which a thumbnail window is displayed in the second display area DA2 when switching from the single-picture mode to the dual-picture mode is described.

[0085] Figure 6 is a diagram showing a display example of the dual screen mode according to the present embodiment. Figure 4 An example of a display in dual-screen mode under the display mode (c-1) shown. This is a general usage form of a clamshell PC in dual-screen mode, in which the first display area DA1 and the second display area DA2 are arranged horizontally in the vertical direction. The display area is a horizontally rectangular display area in which the longer side is horizontal and the shorter side is vertical. The vertical direction corresponds to the vertical (up and down) direction, and the horizontal direction corresponds to the horizontal (left and right) direction. The vertical direction is typically the plumb direction. That is, the first display area DA1 and the second display area DA2 are configured in such a way that the lower end side in the display direction of the first display area DA1 becomes the upper end side in the display direction of the second display area DA2.

[0086] When the information processing device 10 switches from the single-screen mode to the dual-screen mode, the active window of the application executed in the single-screen mode is displayed in the first display area DA1. For example, when the information processing device 10 switches to the dual-screen mode, the information processing device 10 maximizes the active window displayed in the display area DA in the single-screen mode to the entire display area of ​​the first display area DA1 and displays it as the active window. In addition, when the information processing device 10 switches to the dual-screen mode, the information processing device 10 arranges the window that is an inactive window in the single-screen mode in the layer behind the frontmost layer (lower layer) of the active window displayed in the first display area DA1 in a state that maintains the layer relationship (overlapping order of windows) in the single-screen mode. For example, the information processing device 10 also maximizes the window that is an inactive window in the single-screen mode to the entire display area of ​​the first display area DA1 and arranges it in the layer behind the active window (lower layer). Therefore, in the first display area DA1, the active window is displayed as maximized, and the inactive window is not displayed (not visible to the user) although it exists in the layer behind the active window (lower layer).

[0087] In addition, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, it generates a thumbnail image of the window that is an inactive window in the single-screen mode and displays the thumbnail window in the second display area DA2 (secondary screen). When there are multiple inactive windows, the information processing device 10 displays a thumbnail window in which the thumbnail images of the multiple inactive windows are arranged in the second display area DA2.

[0088] For example, thumbnail images of a plurality of windows are displayed in a row in a thumbnail window. A title bar B1 is displayed at the upper end of the thumbnail window. A close button "×" at the right end of the title bar B1 is displayed as an operator for closing the thumbnail window. The user can close the thumbnail window and hide all thumbnail images by operating (e.g., tapping) the close button "×" of the title bar B1.

[0089] In addition, the inactive window of the layer existing behind the active window in the first display area DA1 (i.e., the main body (actual window) of the inactive window displayed as a thumbnail image in the second display area DA2) is configured in an overlapping manner with priority in the same size (maximized to the size of the entire display area of ​​the first display area DA1) so as to be hidden behind the active window, but may also be configured in an overlapping manner with priority in a size smaller than the active window.

[0090] In addition, the information processing device 10 may also temporarily minimize the main body (actual window) of the inactive window displayed as a thumbnail image in the second display area DA2 (for example, in Windows (registered trademark) only the icon of the application exists on the taskbar) so that it is not configured in the display area. In short, the main body (actual window) of the inactive window displayed as a thumbnail image in the second display area DA2 only needs to be processed so as not to be seen by the user temporarily. Moreover, in the second display area DA2, the window of the application of the thumbnail image selected in the thumbnail window is displayed in the front as the active window.

[0091] In addition, the task bar B2 displayed at the lower end of the second display area DA2 corresponds to Figure 5 The task bar B2 shown is displayed in one place as a task bar shared by the first display area DA1 and the second display area DA2. In addition, the position where the task bar B2 is displayed can also be set to the left end or right end of the first display area DA1 or the second display area DA2, or can be set to the upper end of the first display area DA1. In addition, as described above, the task bar can also be displayed in each area of ​​the first display area DA1 and the second display area DA2. Regardless of the position where the task bar is displayed, the application of the present invention is not limited.

[0092] In addition, Figure 6 , an example is shown in which a thumbnail window including a title bar B1 is displayed when a thumbnail image is displayed in the second display area DA2 , but the title bar B1 may not be displayed, or a plurality of thumbnail images may be displayed in a row.

[0093] When any thumbnail image is selected by a user operation (e.g., a tap operation), the information processing device 10 closes (does not display) the thumbnail window displayed in the second display area DA2, and displays the inactive window corresponding to the selected thumbnail image as the active window in the second display area DA2. Specifically, as an example, the information processing device 10 moves the inactive window corresponding to the selected thumbnail image from the first display area DA1 to the second display area DA2, and then maximizes and displays it as the active window in the second display area DA2.

[0094] In this way, the user can easily display the window of the application that he wants to use in the executing application by selecting the thumbnail image. Here, when the window displayed in the second display area DA2 is closed and not displayed, sometimes there is a state where no window is displayed (the window is empty). Figure 6As described above, when the main body (actual window) of the inactive window corresponding to the thumbnail image displayed in the second display area DA2 is placed in a lower layer of the first display area DA1 or minimized when switching from the single-screen mode to the dual-screen mode, when the window displayed in the second display area DA2 is closed and not displayed, the second display area DA2 becomes a state where no window is displayed (a state where the window is empty). In this state, the following operation cannot be easily performed: for example, the user selects an application from the taskbar and moves the window after displaying it in order to display the window of another application in the second display area DA2 that has become empty.

[0095] Therefore, when the information processing device 10 closes the window displayed in the second display area DA2 and makes it non-displayed, the information processing device 10 automatically displays the thumbnail window at the timing when there is no window displayed (window is empty). This makes it easy to display the window of the application that the user wants to display next.

[0096] (Thumbnail window display control)

[0097] Figure 7 It is a diagram showing a first example of display control of the thumbnail window according to the present embodiment. Figure 7 (A) shows a display example of single-screen mode. In the example shown in the figure, the number of application windows executed in single-screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA. Window W1 is the active window configured in the frontmost layer (the topmost layer). If switching from single-screen mode to dual-screen mode, Figure 7 As shown in (B), the window W1 is maximized and displayed as an active window in the first display area DA1, and a thumbnail window is displayed in the second display area DA2.

[0098] For example, in the second display area DA2, thumbnail images SW2, SW3, SW4 of windows W2, W3, W4 other than window W1 are displayed in the windows of the executing application. The main bodies (actual windows) of windows W2, W3, W4 are arranged in a lower layer of window W1 displayed in the first display area DA1 or minimized. In addition, if the number of windows of the application executed in the single-screen mode is five or more, the number of thumbnail images displayed in the second display area DA2 when switching to the dual-screen mode is also four or more.

[0099] If in Figure 7 In the dual-picture mode shown in (B) of FIG. 1 , the user selects the thumbnail image SW2, and the thumbnail window is closed. Figure 7As shown in (C), the window W2 corresponding to the thumbnail image SW2 is maximized in the second display area DA2 and displayed as the active window. Here, if the window W2 is closed by the user's operation (for example, the operation of the close button "×" of the window W2) and becomes non-displayed, since no window is configured in the lower layer of the window W2, the second display area DA2 becomes a state where no window is displayed (a state where the window is empty). Therefore, Figure 7 As shown in (D), a thumbnail window is automatically displayed in the second display area DA2. For example, a thumbnail window in which thumbnail images SW3 and SW4 of windows W3 and W4 other than window W1 are arranged among windows of the executing application is displayed in the second display area DA2.

[0100] In addition, Figure 7 In (C), even if the window W2 is not closed by the user's operation and becomes invisible, but is minimized by the user's operation and becomes invisible, the window W2 also exists in the minimized state. Figure 7 In (D), a thumbnail window in which thumbnail images SW2, SW3, and SW4 are arranged is displayed in the second display area DA2.

[0101] In addition, Figure 7 In (D), the thumbnail image of the window W1 displayed in the first display area DA1 may be included in the thumbnail window displayed in the second display area DA2. In addition, when the information processing device 10 is connected to multiple displays, the thumbnail image of the window displayed on other displays may be included in the thumbnail window displayed in the second display area DA2. In this case, when the thumbnail image of the window displayed on other displays is selected, the window is moved from the other displays to the second display area DA2.

[0102] Furthermore, when the information processing device 10 closes a window displayed in the first display area DA1 and makes it non-displayed, the information processing device 10 automatically displays a thumbnail window at a timing when a state where no window is displayed (a state where the window is empty) is reached.

[0103] Figure 8 It is a diagram showing a second example of display control of the thumbnail window according to the present embodiment. Figure 8 (A) and (B) correspond to Figure 7 (A) and (B), if from Figure 8 The single-screen mode shown in (A) switches to Figure 8In the dual-screen mode shown in (B), in the first display area DA1, the window W1 is maximized and displayed as the active window, and the thumbnail window is displayed in the second display area DA2. Here, the main bodies (actual windows) of the windows W2, W3, and W4 corresponding to the thumbnail images SW2, SW3, and SW4 displayed in the second display area DA2 are minimized.

[0104] In addition, if Figure 8 In the dual-screen mode shown in (B), the user selects the thumbnail image SW2, the thumbnail window is closed, and Figure 7 (C) Similarly, Figure 8 As shown in (C), the window W2 corresponding to the thumbnail image SW2 is maximized in the second display area DA2 and displayed as an active window.

[0105] Here, if the window W1 is closed by a user operation (for example, by pressing the close button “×” on the window W1) and becomes invisible, since no window is configured in the lower layer of the window W1, the first display area DA1 becomes a state where no window is displayed (a state where the window is empty). Figure 8 As shown in (D), a thumbnail window is automatically displayed in the first display area DA1. For example, a thumbnail window in which thumbnail images SW3 and SW4 of windows W3 and W4 other than window W2 are arranged among windows of the executing application is displayed in the first display area DA1.

[0106] In addition, Figure 8 In (C), even if the window W1 is not closed by the user's operation and becomes invisible, but is minimized by the user's operation and becomes invisible, the window W1 also exists in the minimized state. Figure 8 In (D), a thumbnail window in which thumbnail images SW3 and SW4 are arranged is displayed in the first display area DA1.

[0107] In addition, Figure 8 In (D), the thumbnail window displayed in the first display area DA1 may include a thumbnail image of the window W2 displayed in the second display area DA2.

[0108] (Structure of Information Processing Device 10)

[0109] Hereinafter, the specific structure of the information processing device 10 will be described.

[0110] Fig. 91 is a block diagram showing an example of the hardware structure of the information processing device 10 involved in this embodiment. The information processing device 10 includes: a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, and a control unit 18. These units are connected to each other via a bus or the like so as to be communicable.

[0111] The communication unit 11 is configured to include, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), Bluetooth (registered trademark), Wi-Fi (registered trademark) and other communication devices for wireless communication, etc. For example, the communication unit 11 can communicate with the external keyboard 30 described above using Bluetooth (registered trademark).

[0112] In RAM 12, the programs and data of the processing executed by the control unit 18 are expanded, and various data are appropriately saved or deleted. For example, RAM 12 also functions as a video memory (V-RAM) for displaying the display 150. As an example, RAM 12 functions as a video memory for data displayed in each display area when controlling the display 150 in single-screen mode or dual-screen mode. In addition, information of the application being executed, the application in use (the application of the active window) among the applications being executed, information of the application of the other inactive windows, which display area each window is displayed in, which layer it is configured in, the size of the window, whether it is minimized, and the like are stored in RAM 12. In addition, since RAM 12 is a volatile memory, if the power supply to RAM 12 is stopped, the data is not retained. The data that needs to be retained when the power supply to RAM 12 is stopped is migrated to the storage unit 13.

[0113] The storage unit 13 is configured to include any one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Read Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores a BIOS (Basic Input Output System) program, setting data, an OS (Operating System), a program of an application that operates on the OS, and various data used in the application.

[0114] The speaker 14 outputs electronic sounds, voices, and the like.

[0115] The display unit 15 includes a display 150 and a touch sensor 155. The display 150 is a flexible display that can be bent according to the opening angle θ formed by the relative rotation of the first housing 101 and the second housing 102 as described above. The display 150 is controlled by the control unit 18 to communicate with the reference Figure 4 The display corresponding to each display mode described is shown. The touch sensor 155 is provided on the screen of the display 150 to detect touch operations on the screen. For example, in the single-screen mode, the touch sensor 155 detects touch operations on the display area DA. In addition, in the dual-screen mode, the touch sensor 155 detects touch operations on one or both of the first display area DA1 and the second display area DA2. Touch operations include tapping operations, sliding operations, tapping operations, knocking operations, pinching operations, etc. The touch sensor 155 detects touch operations and outputs operation information based on the detected operations to the control unit 18.

[0116] The camera 16 is configured to include a lens, an imaging element, etc. The camera 16 captures an image (still image, moving image) under the control of the control unit 18 and outputs data of the captured image.

[0117] The first acceleration sensor 161 is disposed inside the first housing 101, and detects the direction and direction change of the first housing 101. For example, if the direction parallel to the long side direction of the first display area DA1 is set as the X1 direction, the direction parallel to the short side direction is set as the Y1 direction, and the direction perpendicular to the X1 direction and the Y1 direction is set as the Z1 direction, the first acceleration sensor 161 detects the acceleration in each direction of the X1 direction, the Y1 direction, and the Z1 direction, and outputs the detection result to the control unit 18.

[0118] The second acceleration sensor 162 is disposed inside the second housing 102, and detects the direction and direction change of the second housing 102. For example, if the direction parallel to the long side direction of the second display area DA2 is set as the X2 direction, the direction parallel to the short side direction is set as the Y2 direction, and the direction perpendicular to the X2 direction and the Y2 direction is set as the Z2 direction, the second acceleration sensor 162 detects the acceleration in each direction of the X2 direction, the Y2 direction, and the Z2 direction, and outputs the detection result to the control unit 18.

[0119] The Hall sensor 17 is provided to detect the connection of the keyboard 30. For example, if the keyboard 30 is placed on the second display area DA2 of the second housing 102, the magnetic field changes due to the proximity of the magnet provided inside the bottom surface of the keyboard 30, and the detection value (output value) of the Hall sensor 17 changes. In other words, the Hall sensor 17 outputs different detection results depending on whether the keyboard 30 is placed. In addition, the Hall sensor 17 is used here to detect whether the keyboard 30 is placed, but the detection method is not limited to this, and any detection method can be used.

[0120] The control unit 18 is configured to include a processor such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and implements various functions by executing programs (BIOS, OS, various programs such as applications running on the OS) stored in the storage unit 13, etc. For example, the control unit 18 detects the posture (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. In addition, the control unit 18 detects whether it is in an open state or a closed state, and whether it is in a bent state (Bent form) or a flat state (Flat form) in the case of an open state, etc. based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.

[0121] In addition, the control unit 18 detects a display mode switching operation (for example, Figure 5 In addition, the control unit 18 detects the connection with the keyboard 30 based on the detection result of the Hall sensor 17. In addition, the connection with the keyboard 30 refers to the placement of the keyboard 30 on the second display area DA2, and does not refer to the communication connection. For the communication connection with the keyboard 30, the control unit 18 uses the function of Bluetooth (registered trademark) and the like to detect it.

[0122] The control unit 18 detects the system status, the posture (orientation) of the information processing device 10, whether it is in the open state or the closed state, and whether it is in the bent state (Bent form) or the flat state (Flat form) in the open state, and the display mode switching operation based on the user (see Figure 5 ), and the connection with the keyboard 30, etc., for reference Figure 4 as well as Figures 6 to 9 The control of the display of the display 150 is described.

[0123] Next, among the processes executed by the control unit 18 , a functional configuration related to the display control process will be described.

[0124] Fig.10 1 is a block diagram showing an example of a functional structure related to display control processing involved in this embodiment. The control unit 18 includes a system processing unit 181, a detection processing unit 182, and a display processing unit 183. Here, the system processing unit 181 is, for example, a functional structure in which a CPU executes processing based on an OS or BIOS. In addition, the detection processing unit 182 is, for example, a functional structure in which a microcomputer different from a CPU that executes processing of an OS or BIOS executes various detection processing. The display processing unit 183 is, for example, a functional structure in which a CPU executes processing based on an OS or a program running on the OS.

[0125] The system processing unit 181 executes various programs such as the OS, drivers that operate on the OS, and applications. In addition, the system processing unit 181 includes, for example, an execution application information generation unit 1811. The execution application information generation unit 1811 generates application information, which includes identification information of the application being executed (for example, application ID) and information indicating the application being used by the user among the executing applications (that is, the application with active window). In addition, the execution application information generation unit 1811 generates window information indicating the state of the window of the executing application. The state of the window refers to whether it is an active window, and the size (minimized, maximized, etc.), position, configured layer, etc. of the window. The execution application information generation unit 1811 stores and maintains the generated application information and window information in the RAM 12.

[0126] The detection processing unit 182 includes an opening / closing detection unit 1821, a posture detection unit 1822, and a connection detection unit 1823 as functional components for detecting the state of the information processing device 10. The detection processing unit 182 outputs the detection results of the opening / closing detection unit 1821, the posture detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.

[0127] The opening and closing detection unit 1821 detects whether the information processing device 10 is in an open state or a closed state based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. In addition, when the information processing device 10 is in an open state, the opening and closing detection unit 1821 detects the opening angle θ of the first housing 101 and the second housing 102 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Moreover, the opening and closing detection unit 1821 detects whether the information processing device 10 is in a bent state (Bent form) or a flat state (Flat form) based on the detected opening angle θ.

[0128] The posture detection unit 1822 detects the posture (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162 .

[0129] The connection detection unit 1823 detects the connection with the keyboard 30. For example, the connection detection unit 1823 detects the connection with the keyboard 30 by detecting whether the keyboard 30 is placed on the second display area DA2 based on the detection result of the Hall sensor 17. The detection processing unit 182 outputs the detection results (the status of the information processing device 10) of the opening and closing detection unit 1821, the posture detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.

[0130] In addition, the detection processing unit 182 includes an operation detection unit 1824 as a functional structure for detecting an operation on the information processing device 10. The operation detection unit 1824 detects a user's operation based on operation information output from the touch sensor 155 provided on the screen of the display 150. For example, the operation detection unit 1824 obtains a user's operation based on a user's operation on a switching menu screen (see Figure 5 ) operation information, and based on the acquired operation information, detect the display mode switching operation of the user switching the display mode. The detection processing unit 182 outputs the detected user operation information to the display processing unit 183.

[0131] The display processing unit 183 determines and switches the display mode based on the opening and closing state and posture (direction) of the information processing device 10 acquired from the detection processing unit 182, the user's operation, etc. In addition, the display processing unit 183 controls the display of the windows (active windows and inactive windows) of the executing application according to the display mode, etc., based on the application information acquired from the system processing unit 181. Specifically, the display processing unit 183 includes a display mode determination unit 1831, a display mode switching unit 1832, a thumbnail generation unit 1833, and a display control unit 1834.

[0132] The display mode determination unit 1831 performs a determination process for determining the display mode based on the state of the information processing device 10 detected by the detection processing unit 182 or the detection result regarding the user's operation. For example, the display mode determination unit 1831 obtains from the detection processing unit 182 the detection result of the open or closed state of the information processing device 10, the detection result of whether the information processing device 10 is in a bent state (Bent form) or a flat state (Flat form) in the open state, the detection result of the posture (direction) of the information processing device 10, and the user's operation information. Furthermore, the display mode determination unit 1831 determines the reference mode based on the detection results and operation information obtained from the detection processing unit 182. Figure 4 Display mode for explanation.

[0133] The display mode switching unit 1832 switches the display mode to the reference mode based on the display mode determined by the display mode determination unit 1831. Figure 4 For example, the display mode switching unit 1832 sets the display mode such as switching to a single screen mode, a dual screen mode (or an inverted dual screen mode), a half screen mode, the direction of each display area, the display content of each display area, etc. based on the display mode determined by the display mode determination unit 1831.

[0134] The thumbnail generation unit 1833 generates a thumbnail image corresponding to the window of the executing application. For example, the thumbnail generation unit 1833 generates a thumbnail image corresponding to an inactive window of the executing application as a thumbnail image to be displayed as a thumbnail window in the second display area DA2 when switching from the single-screen mode to the dual-screen mode. In addition, the thumbnail generation unit 1833 generates a thumbnail image to be displayed as a thumbnail window in the first display area DA1 or the second display area DA2 because the first display area DA1 or the second display area DA2 becomes non-displayed. In addition, the thumbnail generation unit 1833 basically generates a thumbnail image including a minimized window as an inactive window.

[0135] The display control unit 1834 performs display control processing for outputting and displaying display data of application windows and thumbnail windows displayed in each display area, according to the display mode set by the display mode switching unit 1832 .

[0136] When the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode, the display control unit 1834 displays the active window (active window displayed in the display area DA) among the windows of the application executed in the single-screen mode on the first display area DA1. For example, the display control unit 1834 maximizes the active window in the single-screen mode and displays it as the active window on the first display area DA1.

[0137] In addition, when the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode, the display control unit 1834 displays thumbnail windows in the second display area DA2. For example, the display control unit 1834 displays thumbnail images corresponding to inactive windows other than the active window in the single-screen mode in the second display area DA2.

[0138] Here, when the display mode switching unit 1832 switches from the single screen mode to the dual screen mode, the display control unit 1834 arranges the inactive windows other than the active window in the single screen mode in a lower layer than the active window in the first display area DA1.

[0139] Furthermore, when the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode, the display control unit 1834 may minimize inactive windows other than the active window in the single-screen mode.

[0140] In addition, when the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode, the display control unit 1834 may temporarily place inactive windows other than the active window in the single-screen mode in the first display area DA1 and then minimize them.

[0141] In addition, when there is only an active window and no inactive window in the single-screen mode, the second display area DA2 does not display a thumbnail image when switching from the single-screen mode to the dual-screen mode, so the thumbnail window is not displayed, and the window becomes empty.

[0142] In addition, when any one of the thumbnail images displayed in the second display area DA2 in the dual-screen mode is selected by the user's operation, the display control unit 1834 sets all thumbnail images displayed in the second display area DA2 to be hidden, and displays the inactive window corresponding to the selected thumbnail image as the active window in the second display area DA2. For example, the display control unit 1834 displays the inactive window corresponding to the selected thumbnail image as the active window in the second display area DA2 in a maximized manner.

[0143] In addition, since the window displayed in any one of the first display area DA1 or the second display area DA2 is not displayed, the display control unit 1834 displays a thumbnail window in the display area where the window is not displayed. For example, the display control unit 1834 displays a thumbnail image (thumbnail window) corresponding to at least a part of the window of the application being executed in the display area where the window is not displayed. At this time, the display control unit 1834 displays a thumbnail image (thumbnail window) corresponding to a window other than the window displayed as the top layer in any one of the multiple display areas of the windows of all the applications being executed.

[0144] Here, when a thumbnail window is displayed because a window displayed in either the first display area DA1 or the second display area DA2 is closed and not displayed, the display control unit 1834 excludes the thumbnail image corresponding to the closed and not displayed window from the display object. On the other hand, when a thumbnail window is displayed because a window displayed in either the first display area DA1 or the second display area DA2 is minimized and not displayed, the display control unit 1834 also displays the thumbnail image corresponding to the minimized and not displayed window.

[0145] Furthermore, the display control unit 1834 may display thumbnail images corresponding to the windows of all the applications being executed.

[0146] In addition, when a window displayed in either the first display area DA1 or the second display area DA2 becomes hidden and there are no other windows displayed in the display area where the window becomes hidden (that is, when the window is empty), the display control unit 1834 displays a thumbnail window in the display area where the window becomes hidden.

[0147] For example, the display control unit 1834 checks the layer in which the window is arranged in each display area, and checks whether there is a window arranged in a lower layer of the non-displayed window in the display area where the window is not displayed. The display control unit 1834 may also obtain information about the layer in which the window is arranged in each display area from the system processing unit 181, or the display control unit 1834 itself may maintain the information according to the display control, or both may be used. Furthermore, when there is no window arranged in a lower layer in the display area where the window is not displayed, the display control unit 1834 determines that there is no other window to be displayed (that is, the window is in an empty state), and displays a thumbnail window.

[0148] (Operation of display control processing)

[0149] Next, the operation of the display control process of the control unit 18 will be described. Fig.11 The operation of the display control process of the control unit 18 for displaying the thumbnail window when switching from the single-screen mode to the dual-screen mode will be described.

[0150] Fig.11 This is a flowchart showing an example of a display control process when switching to the dual screen mode according to the present embodiment.

[0151] (Step S101) The control unit 18 determines whether to switch from the single-screen mode to the dual-screen mode. For example, the control unit 18 detects that the single-screen mode is switched to the dual-screen mode. Figure 4 As explained above, the change from a flat state (Flat form) to a bent state (Bent form) or the reference Figure 5 The control unit 18 performs the display mode switching operation described above to determine whether to switch from the single-screen mode to the dual-screen mode. When the control unit 18 determines that the single-screen mode is not to be switched to the dual-screen mode (No), the control unit 18 continues the single-screen mode and performs the processing of step S101 again. On the other hand, when the control unit 18 determines that the single-screen mode is to be switched to the dual-screen mode (Yes), the control unit 18 switches to the dual-screen mode in which the display area DA is divided into two display areas, namely the first display area DA1 and the second display area DA2, and enters the processing of step S103.

[0152] (Step S103) The control unit 18 displays the active window in the single-screen mode in the first display area DA1, and displays thumbnail windows arranged with thumbnail images of inactive windows in the single-screen mode in the second display area DA2 (for example, see Figure 6 , Figure 7 (B) Figure 8 Then, the process proceeds to step S105.

[0153] (Step S105) The control unit 18 determines whether any one of the thumbnail images displayed in the second display area DA2 is selected. If the control unit 18 determines that no thumbnail image is selected (No), the control unit 18 performs the process of step S105 again. On the other hand, if the control unit 18 determines that any one of the thumbnail images is selected (Yes), the process proceeds to step S107.

[0154] (Step S107) The control unit 18 closes the thumbnail window to hide it, and ends the display of the thumbnail window. Then, the process proceeds to step S109.

[0155] (Step S109) The control unit 18 displays the window corresponding to the selected thumbnail image as an active window in the second display area DA2 (for example, maximized in the second display area DA2) (for example, refer to Figure 7 (C) Figure 8 (C)).

[0156] Next, refer to Fig.12 The operation of the display control process in which the control unit 18 displays a thumbnail window because a window displayed in any one of the display areas in the dual screen mode is hidden will be described.

[0157] Fig.12 This is a flowchart showing an example of display control processing when a window according to the present embodiment is hidden.

[0158] (Step S201) The control unit 18 determines whether a window displayed in any one of the plurality of display areas is hidden. For example, in the dual-screen mode, the control unit 18 determines whether a window displayed in the first display area DA1 or the second display area DA2 is hidden. If the control unit 18 determines that the window is not hidden (No), the control unit 18 performs the process of step S201 again. On the other hand, if the control unit 18 determines that the window is hidden (Yes), the process proceeds to step S203.

[0159] (Step S203) The control unit 18 determines whether there is a window in the lower layer of the display area where the window becomes non-displayed (the lower layer of the window that becomes non-displayed). If the control unit 18 determines that there is a window in the lower layer (Yes), the process proceeds to step S205. On the other hand, if the control unit 18 determines that there is no window in the lower layer (No), the process proceeds to step S207.

[0160] (Step S205) Control unit 18 displays the lower layer window in the display area where the window is not displayed. For example, when a plurality of windows are arranged in the lower layer of the display area where the window is not displayed, control unit 18 displays the window arranged in the uppermost layer.

[0161] (Step S207) The control unit 18 displays a thumbnail window in the display area where the window is not displayed (for example, refer to Figure 7 (D) Figure 8 (D)).

[0162] As described above, the information processing device 10 according to the present embodiment includes: the display 150, the storage unit 13 (an example of a memory) storing an application (application) program, and the control unit 18 (for example, an example of a processor such as a CPU, a GPU, or a microcomputer) for controlling the display 150 to display the application window by executing the application program stored in the storage unit 13. The control unit 18 performs a display mode switching process to control the switching between a single screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled to be displayed as one display area DA and a dual screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into two display areas (for example, a first display area DA1 and a second display area DA2) to control the display. In addition, the control unit 18 performs a display control process in which a thumbnail image (for example, a thumbnail window) corresponding to at least a part of the window of the application being executed is displayed in the display area where the window is not displayed because the window displayed in any one of the two display areas is not displayed in the dual screen mode.

[0163] Thus, the information processing device 10 automatically displays thumbnail images of windows of other applications (e.g., thumbnail windows) in the display area that is not displayed by closing a window, for example, so that other applications being executed can be easily confirmed and the windows of other applications can be easily switched. Therefore, the information processing device 10 can improve the operability when selecting a window displayed in each of the plurality of display areas.

[0164] For example, in the dual-screen mode, when a window displayed in any one of the two display areas (for example, the first display area DA1 and the second display area DA2) becomes hidden and there are no other windows displayed in the display area where the window becomes hidden (when the window is empty), the control unit 18 displays the above-mentioned thumbnail image (for example, the thumbnail window) in the display area where the window becomes hidden through display control processing.

[0165] Thus, the information processing device 10 automatically displays thumbnail images of windows of other applications (e.g., thumbnail windows) in a display area where a window is closed and the window is empty, for example, so that other applications being executed can be easily confirmed and the windows of other applications can be easily switched. Therefore, the information processing device 10 can improve the operability when selecting a window displayed in each of the plurality of display areas.

[0166] In addition, when the control unit 18 switches from the single-screen mode to the dual-screen mode through the display mode switching processing, the control unit 18 displays the active window (an example of a window) in the window of the application executed in the single-screen mode in the first display area DA1 of the two display areas through the display control processing, and displays the thumbnail image (for example, a thumbnail window) corresponding to the window in the single-screen mode other than the active window (for example, an inactive window) in the second display area DA2 of the two display areas other than the first display area DA1.

[0167] Therefore, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, not only the active window is displayed on one screen, but also windows other than the active window can be displayed at a glance in the other screen through thumbnail images, so that other executing applications can be easily confirmed, which is convenient.

[0168] Furthermore, when switching from the single-screen mode to the dual-screen mode by the display mode switching process, the control unit 18 may minimize windows other than the active window (eg, inactive windows) in the single-screen mode by the display control process.

[0169] Thus, information processing device 10 can automatically display thumbnail images of windows of other applications (eg, thumbnail windows) in any display area, for example, when a window is closed, with the window being empty.

[0170] Furthermore, when the control unit 18 switches from the single-screen mode to the dual-screen mode through the display mode switching process, the control unit 18 may place windows other than the active window in the single-screen mode in the first display area DA1 and then minimize them through the display control process.

[0171] Thus, the information processing device 10 can display a minimized window on the first display area DA1 side, for example, when the minimized window is displayed by an operation on the task bar.

[0172] Furthermore, when any one of the thumbnail images displayed in the second display area DA is selected by the user's operation, the control unit 18 hides all thumbnail images displayed in the second display area DA and displays a window corresponding to the selected thumbnail image in the second display area DA.

[0173] Thus, information processing device 10 can easily display a window that the user wants to display simply by selecting a thumbnail image.

[0174] For example, when a thumbnail image is displayed through display control processing because a window displayed in either of the two display areas in dual-screen mode becomes hidden, the control unit 18 displays thumbnail images corresponding to windows of all executed applications except for the window displayed as the top layer in either of the two display areas.

[0175] Thus, information processing device 10 can easily check a window of an application that is not displayed in any display area, and can easily switch to a window of another application.

[0176] When displaying thumbnail images by display control processing because a window displayed in one of the two display areas in the dual screen mode is closed, control unit 18 excludes the thumbnail image corresponding to the closed window from display targets.

[0177] This allows information processing device 10 to avoid erroneously displaying thumbnail images of closed windows.

[0178] Furthermore, when displaying thumbnail images by display control processing because a window displayed in one of the two display areas is hidden in the dual screen mode, control unit 18 may display thumbnail images corresponding to windows of all applications being executed.

[0179] Thus, the information processing device 10 can display all windows of the running applications at a glance using thumbnail images, which is convenient. For example, the information processing device 10 can also easily display the window displayed in the first display area DA1 in the second display area DA2 for confirmation by the user.

[0180] In addition, the control method in the information processing device 10 involved in the present embodiment includes: a display mode switching step, in which the processor controls the switching between a single-screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled as a display area DA and a dual-screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into two display areas (for example, a first display area DA1 and a second display area DA2) to control the display; and a display control step, in which, since a window displayed in any one of the two display areas becomes hidden in the dual-screen mode, a thumbnail image (for example, a thumbnail window) corresponding to at least a part of the window of the executing application is displayed in the display area where the window becomes hidden.

[0181] Thus, the information processing device 10 automatically displays thumbnail images of windows of other applications (e.g., thumbnail windows) in the display area that is not displayed by closing a window, for example, so that other applications being executed can be easily confirmed and the windows of other applications can be easily switched. Therefore, the information processing device 10 can improve the operability when selecting a window displayed in each of the plurality of display areas.

[0182] <Second embodiment>

[0183] Next, an outline of a second embodiment of the present invention will be described.

[0184] In the first embodiment, the structure of the information processing device 10 is described as having a single-screen mode in which the entire screen area of ​​the display 150 is controlled as a single display area DA, and a dual-screen mode in which the screen area of ​​the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, to control the display. However, the screen area of ​​the display 150 may also be divided into three or more display areas to control the display.

[0185] In the present embodiment, the information processing device 10 has a triple-screen mode in which the screen area of ​​the display 150 is divided into three display areas to control display, and a quad-screen mode in which the screen area is divided into four display areas to control display, in addition to the single-screen mode and the dual-screen mode. In the triple-screen mode or the quad-screen mode, the information processing device 10 can perform display control processing for displaying a thumbnail window when a window displayed in any one of the plurality of display areas is hidden, similar to the dual-screen mode.

[0186] In addition, the basic configuration of the information processing device 10 is the same as that of the first embodiment, and here, an example of display control in the three-screen mode and the four-screen mode will be described.

[0187] Fig.13is a diagram showing an example of an operation specification of a display mode switching operation according to the present embodiment. Figure 5 This is an example of a switching menu displayed by operating the icon C1 shown in (A). Fig.13 (B) indicates the switching menu M3 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.), Fig.13 (C) indicates the switching menu M4 displayed when the mode of use is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). The switching menus M3 and M4 are different in that they can switch to the three-screen mode and the four-screen mode. Figure 5 (B) Toggle menu M1 and Figure 5 The switch menu of (C) is different from M2.

[0188] Display mode switching icons C31, C32, C33, C34, and C35 are displayed in the switching menu M3. The display mode switching icon C31 is displayed as an operator for selecting the display mode (d) and the display mode (d′) of the single-picture mode. The display mode switching icon C3 is displayed as an operator for selecting the display mode (b) of the dual-picture mode. The display mode switching icon C33 and the display mode switching icon C34 are displayed as operators for selecting the display mode of the triple-picture mode. In the display mode switching icon C33 and the display mode switching icon C34, it is different which side of the first display area DA1 and the second display area DA2 in the dual-picture mode is divided into two display areas. The display mode switching icon C35 is displayed as an operator for selecting the display mode of the quad-picture mode.

[0189] The "1", "2", "3", and "4" in the figure are Figure 5 Similarly, it is added to distinguish the display areas, for example, in each display area, it is represented by a number according to the priority of the area set in advance. "1" means that the priority of the area is the highest, and the priority of the area decreases in the order of "2", "3", and "4".

[0190] If the user selects the display mode switching icon C33 or the display mode switching icon C34, the display of the switching menu ends and the control is changed to the three-screen mode under "Landscape". In addition, if the user selects the display mode switching icon C35, the display of the switching menu ends and the control is changed to the four-screen mode under "Landscape".

[0191] Display mode switching icons C41, C42, C43, C44, and C45 are displayed in the switching menu M4. Display mode switching icon C41 is displayed as an operator for selecting the display mode (e) or the display mode (e′) of the single-screen mode. Display mode switching icon C42 is displayed as an operator for selecting the display mode (c-1) of the dual-screen mode. Display mode switching icon C43 and display mode switching icon C44 are displayed as operators for selecting the display mode of the triple-screen mode. In the display mode switching icon C43 and the display mode switching icon C44, it is different as to which side of the first display area DA1 and the second display area DA2 in the dual-screen mode is divided into two display areas. Display mode switching icon C45 is displayed as an operator for selecting the display mode of the quad-screen mode.

[0192] If the user selects the display mode switching icon C43 or the display mode switching icon C44, the display of the switching menu ends, and the control is changed to the three-screen mode under "Clamshell or Portrait". In addition, if the user selects the display mode switching icon C35, the display of the switching menu ends, and the control is changed to the four-screen mode under "Clamshell or Portrait".

[0193] (Display control of thumbnail window in triple-picture mode)

[0194] Next, the display control of the thumbnail window in the three-screen mode is described. Here, in the three-screen mode, the screen area of ​​the display 150 is divided into three display areas, each of which is referred to as a first display area DA1, a second display area DA2, and a third display area DA3.

[0195] In addition, the second display area DA2 and the third display area DA3 in the three-screen mode can be referred to as two second display areas after the display area other than the first display area DA1 is divided into two. In order to distinguish the two second display areas, they are sequentially represented as the second display area DA2 and the third display area DA3 from the one with the highest priority.

[0196] Fig.14 It is a diagram showing a first example of display control of thumbnail windows in the three-screen mode according to the present embodiment. Fig.14 (A) shows an example in which window W1 is displayed in the first display area DA1, window W2 is displayed in the second display area DA2, and window W3 is displayed in the third display area DA3 in the three-screen mode. Here, the number of windows of the executing application is six, namely, windows W1, W2, W3, W4, W5, and W6, and windows W4, W5, and W6 are arranged in a lower layer of window W1 in the first display area DA1 or are minimized.

[0197] exist Fig.14 In (A), if the window W2 is closed by the user's operation (for example, the operation of the close button "×" of the window W2) and becomes invisible, since no window is configured in the lower layer of the window W2, the second display area DA2 becomes a state where no window is displayed (a state where the window is empty). Fig.14 As shown in (B), thumbnail windows are automatically displayed in the second display area DA2. For example, thumbnail windows in which thumbnail images SW4, SW5, and SW6 of windows W4, W5, and W6 other than windows W1 and W3 of the executing application are arranged are displayed in the second display area DA2.

[0198] In addition, Fig.14 In (A), even if the window W2 is not hidden by closing it through the user's operation but is hidden by minimizing it through the user's operation, the window W2 still exists in the minimized state. Fig.14 In (B), a thumbnail window in which thumbnail images SW2, SW4, SW5, and SW6 are arranged is displayed in the second display area DA2.

[0199] In addition, Fig.14 In (B), the thumbnail window displayed in the second display area DA2 may also include a thumbnail image of the window W1 displayed in the first display area DA1 and a thumbnail image of the window W3 displayed in the third display area DA3.

[0200] Fig.15 It is a diagram showing a second example of display control of thumbnail windows in the three-screen mode according to the present embodiment. Fig.15 (A) is equivalent to Fig.14 The display example of (B) is shown in FIG. The window W1 is displayed in the first display area DA1, the window W3 is displayed in the third display area DA3, and the thumbnail window is displayed in the second display area DA2. Fig.15 In the illustrated example, the main bodies (actual windows) of the windows W4 , W5 , W6 corresponding to the thumbnail images SW4 , SW5 , SW6 displayed in the second display area DA2 are minimized.

[0201] In this Fig.15 In (A), if the window W1 is closed by a user operation (for example, by pressing the close button "×" on the window W1) and becomes invisible, since no window is configured in the lower layer of the window W1, the first display area DA1 becomes a state where no window is displayed (a state where the window is empty). Fig.15As shown in (B), thumbnail windows are automatically displayed in the first display area DA1. For example, thumbnail windows in which thumbnail images SW4, SW5, and SW6 of windows W4, W5, and W6 other than window W3 of the executing application are arranged are displayed in the first display area DA1.

[0202] In addition, Fig.15 In (A), even if the window W1 is not hidden by closing it through the user's operation but is hidden by minimizing it through the user's operation, the window W1 still exists in the minimized state. Fig.15 In (B), thumbnail windows in which thumbnail images SW1, SW2, SW4, SW5, and SW6 are arranged are displayed in the first display area DA1.

[0203] In addition, Fig.15 In (B), the thumbnail window displayed in the first display area DA1 may also include a thumbnail image of the window W3 displayed in the third display area DA3.

[0204] (Display control of thumbnail window in quad mode)

[0205] Here, when the screen area of ​​the display 150 is divided into four display areas in the quad-screen mode, the areas are referred to as the first display area DA1, the second display area DA2, the third display area DA3 and the fourth display area DA4.

[0206] In addition, the second display area DA2, the third display area DA3 and the fourth display area DA4 in the four-screen mode can be called three second display areas after the display area other than the first display area DA1 is divided into three. In order to distinguish the three second display areas, they are represented as the second display area DA2, the third display area DA3 and the fourth display area DA4 in order from the one with the highest priority.

[0207] Fig.16 This is a diagram showing an example of display control of thumbnail windows in the quad-screen mode according to the present embodiment. Fig.16 (A) shows an example in which window W1 is displayed in the first display area DA1, window W2 is displayed in the second display area DA2, window W3 is displayed in the third display area DA3, and window W4 is displayed in the fourth display area DA4 in the four-screen mode. Here, the number of windows of the executing application is eight, namely, windows W1, W2, W3, W4, W5, W6, W7, and W8, and windows W5, W6, W7, and W8 are arranged in a lower layer of window W1 in the first display area DA1 or are minimized.

[0208] exist Fig.16 In (A), if the window W2 is closed by the user's operation (for example, the operation of the close button "×" of the window W2) and becomes invisible, since no window is configured in the lower layer of the window W2, the second display area DA2 becomes a state where no window is displayed (a state where the window is empty). Fig.16 As shown in (B), thumbnail windows are automatically displayed in the second display area DA2. For example, thumbnail images SW5, SW6, SW7, SW8 of windows W5, W6, W7, W8 other than windows W1, W3, W4 are displayed in the second display area DA2.

[0209] In addition, Fig.16 In (A), even if the window W2 is not hidden by closing it through the user's operation but is hidden by minimizing it through the user's operation, the window W2 still exists in the minimized state. Fig.16 In (B), thumbnail windows in which thumbnail images SW2, SW5, SW6, SW7, and SW8 are arranged are displayed in the second display area DA2.

[0210] In addition, Fig.16 In (B), the thumbnail window displayed in the second display area DA2 may also include a thumbnail image of window W1 displayed in the first display area DA1, a thumbnail image of window W3 displayed in the third display area DA3, and a thumbnail image of window W4 displayed in the fourth display area DA4.

[0211] As described above, in the information processing device 10 according to the present embodiment, the control unit 18 performs display mode switching processing to control switching between a single screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled to be displayed as one display area DA and a multiple screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into a plurality of (two, three, four, etc.) display areas to control the display. In addition, the control unit 18 performs display control processing to display a thumbnail image (for example, a thumbnail window) corresponding to at least a part of the window of the application being executed in the display area in which the window is not displayed, because a window displayed in any one of the plurality of display areas is not displayed in the multiple screen mode.

[0212] Thus, the information processing device 10 automatically displays thumbnail images of windows of other applications (e.g., thumbnail windows) in the display area where the window is closed and not displayed, so that other applications being executed can be easily confirmed and the windows of other applications can be easily switched. Therefore, the information processing device 10 can improve the operability when selecting a window displayed in each of the multiple display areas.

[0213] For example, when a window displayed in any one of the multiple display areas becomes hidden in the multiple screen modes and there are no other windows displayed in the display area where the window becomes hidden, the control unit 18 displays a thumbnail image (for example, a thumbnail window) in the display area where the window becomes hidden through display control processing.

[0214] Thus, the information processing device 10 automatically displays thumbnail images of windows of other applications (e.g., thumbnail windows) in a display area where a window is closed and the window is empty, for example, so that other applications being executed can be easily confirmed and the windows of other applications can be easily switched. Therefore, the information processing device 10 can improve the operability when selecting a window displayed in each of the plurality of display areas.

[0215] For example, when a thumbnail image is displayed through display control processing because a window displayed in any one of the multiple display areas in the multiple screen mode becomes hidden, the control unit 18 displays thumbnail images corresponding to windows of all executed applications except for a window displayed as the top layer in any one of the multiple display areas.

[0216] Thus, information processing device 10 can easily check a window of an application that is not displayed in any display area, and can easily switch to a window of another application.

[0217] Furthermore, when displaying thumbnail images by display control processing because a window displayed in any of the plurality of display areas in the multi-screen mode is closed and not displayed, control unit 18 excludes thumbnail images corresponding to the closed and not displayed window from display targets.

[0218] This allows information processing device 10 to avoid erroneously displaying thumbnail images of closed windows.

[0219] Furthermore, when displaying thumbnail images by display control processing because a window displayed in any of the plurality of display areas is hidden in the multi-screen mode, control unit 18 may display thumbnail images corresponding to windows of all the applications being executed.

[0220] Thus, information processing device 10 can display all windows of running applications at a glance using thumbnail images, which is convenient. For example, information processing device 10 can also easily display a window displayed in one display area in another display area for confirmation by the user.

[0221] In addition, the control method in the information processing device 10 involved in this embodiment includes: a display mode switching step, in which the processor controls the switching between a single-screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled as a display area DA and a multiple-screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into multiple (two, three, four, etc.) display areas to control the display; and a display control step, in which, since a window displayed in any one of the multiple display areas becomes hidden in the multiple screen mode, a thumbnail image (for example, a thumbnail window) corresponding to at least a part of the window of the executing application is displayed in the display area where the window becomes hidden.

[0222] Thus, the information processing device 10 automatically displays thumbnail images of windows of other applications (e.g., thumbnail windows) in the display area that is not displayed by closing a window, for example, so that other applications being executed can be easily confirmed and the windows of other applications can be easily switched. Therefore, the information processing device 10 can improve the operability when selecting a window displayed in each of the plurality of display areas.

[0223] The embodiments of the present invention are described in detail with reference to the drawings, but the specific structure is not limited to the above content, and various design changes can be made within the scope of the present invention. For example, the structures described in the above embodiments can also be combined arbitrarily.

[0224] Furthermore, in the above-described embodiment, when a window displayed in any one of the display areas in multiple screen modes (e.g., dual-screen mode, triple-screen mode, quad-screen mode) is not displayed, an example is described in which a thumbnail window (thumbnail image) is displayed when the display area is in a state where no window is displayed (a state where the window is empty), but a thumbnail window (thumbnail image) may also be displayed when there is a window in a lower layer of the display area and the window is not empty. For example, in Fig.12 In the display control process shown, the control unit 18 may not perform the determination process of step S203. When it is determined in step S201 that the window is hidden (yes), the process proceeds to step S207 to display the thumbnail window in the display area where the window is hidden.

[0225] In addition, in the above-mentioned embodiment, an example of using a foldable display 150 in the single-screen mode and the dual-screen mode is described, but two displays may also be used. That is, the processing in the above-mentioned embodiment can also be applied to the switching between the single-screen mode in which the screen areas of the two displays are combined as one display area to control the display and the dual-screen mode in which the screen areas of the two displays are independently controlled as display areas. In addition, the processing in the above-mentioned embodiment can also be applied to the control of the display as a triple-screen mode or a quad-screen mode by dividing one or both of the screen areas of the two displays into two display areas.

[0226] In addition, in the above-mentioned embodiment, the information processing device 10 is described as having a dual-screen mode divided into two display areas to control the display, a triple-screen mode divided into three display areas to control the display, and a quad-screen mode divided into four display areas to control the display as a structure of multiple screen modes, but it can also be configured to have a screen mode divided into five or more display areas to control the display.

[0227] In addition, in the above-mentioned embodiment, an example of touch operation on multiple touch-panel displays that are integrally formed with an input unit (touch sensor) and a display unit is described, but it is not limited to touch operation and can also be set as a mouse-based click operation, a gesture-based operation, etc.

[0228] In addition, the control unit 18 has a computer system inside. Moreover, the program for realizing the functions of each structure respectively possessed by the control unit 18 can also be recorded in a computer-readable recording medium, and the processing in each structure respectively possessed by the control unit 18 can be performed by making the computer system read the program recorded in the recording medium and execute it. Here, the so-called "making the computer system read the program recorded in the recording medium and execute it" is included in the computer system installation program. The so-called "computer system" here includes hardware such as OS and peripheral devices. In addition, the "computer system" can also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. In addition, the so-called "computer-readable recording medium" refers to a portable medium such as a floppy disk, a magneto-optical disk, a ROM, a CD-ROM, and a storage device such as a hard disk built into the computer system. In this way, the recording medium storing the program can be a non-temporary recording medium such as a CD-ROM.

[0229] In addition, the recording medium also includes an internal or external recording medium that can be accessed from a distribution server in order to distribute the program. In addition, the program can also be divided into multiple parts, and the structure formed by combining the various structures possessed by the control unit 18 after downloading at different time intervals, and the distribution server for distributing each of the divided programs is different. Moreover, the so-called "computer-readable recording medium" also includes a structure that keeps the program for a certain period of time, such as a server in the case of sending a program via a network, and a volatile memory (RAM) inside a computer system that becomes a client. In addition, the above-mentioned program can also be a structure for realizing a part of the above-mentioned functions. Furthermore, it can also be a so-called differential file (differential program) that can be realized by combining the above-mentioned functions with programs already recorded in the computer system.

[0230] In addition, part or all of the functions of the control unit 18 in the above-mentioned embodiment may be implemented as an integrated circuit such as LSI (Large Scale Integration). Each function may be processed individually, or part or all of it may be integrated for processing. In addition, the method of integrated circuitization is not limited to LSI, and it may also be implemented by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears with the advancement of semiconductor technology, an integrated circuit based on the technology may also be used.

Claims

1. An information processing device comprising: monitor; A memory for storing application programs; and a processor that controls the display to display a window of the application by executing a program of the application stored in the memory, The processor performs display mode switching processing and display control processing. In the above display mode switching process, the switching between the first display mode and the second display mode is controlled, wherein: In the first display mode, the entire screen area of ​​the display is controlled as a display area, and in the second display mode, the screen area of ​​the display is divided into a plurality of display areas to control the display. In the above-mentioned display control processing, since the above-mentioned window displayed in any one of the multiple display areas becomes hidden in the above-mentioned second display mode, a thumbnail image corresponding to at least a part of the above-mentioned window of the above-mentioned application being executed is displayed in the display area where the above-mentioned window becomes hidden.

2. The information processing device according to claim 1, wherein: In the above-mentioned second display mode, when the above-mentioned window displayed in any one of the multiple display areas becomes hidden and there is no other window displayed in the display area where the above-mentioned window becomes hidden, the above-mentioned processor displays the above-mentioned thumbnail image in the display area where the above-mentioned window becomes hidden through the above-mentioned display control processing.

3. The information processing device according to claim 1, wherein: When the processor switches from the first display mode to the second display mode through the display mode switching process, the processor displays one window of the windows of the application executed in the first display mode in a first display area among the multiple display areas through the display control process, and displays the thumbnail image corresponding to the window other than the one window among the windows in the first display mode in a second display area other than the first display area among the multiple display areas.

4. The information processing device according to claim 3, wherein: When the processor switches from the first display mode to the second display mode through the display mode switching process, the processor minimizes windows other than the one window among the windows in the first display mode through the display control process.

5. The information processing device according to claim 4, wherein: When the processor switches from the first display mode to the second display mode through the display mode switching process, the processor minimizes the windows other than the one window in the first display mode in the first display area through the display control process.

6. The information processing device according to claim 3, wherein: When any one of the thumbnail images is selected by a user operation, the processor hides all the thumbnail images displayed in the second display area and displays the window corresponding to the selected thumbnail image in the second display area.

7. The information processing device according to claim 1, wherein: The processor displays the thumbnail image corresponding to the windows of all the applications being executed except the window displayed as the topmost layer in any one of the multiple display areas, when the thumbnail image is displayed through the display control processing because the window displayed in any one of the multiple display areas in the second display mode becomes hidden.

8. The information processing device according to claim 1, wherein: When the above-mentioned processor displays the above-mentioned thumbnail image through the above-mentioned display control processing because the above-mentioned window displayed in any one of the multiple display areas in the above-mentioned second display mode is closed and becomes hidden, the above-mentioned processor excludes the above-mentioned thumbnail image corresponding to the above-mentioned window that is closed and becomes hidden from the display object.

9. The information processing device according to claim 1, wherein: When the thumbnail image is displayed by the display control processing because the window displayed in any one of the plurality of display areas in the second display mode is hidden, the processor displays the thumbnail images corresponding to the windows of all the applications being executed.

10. A control method, which is a control method in an information processing device, the information processing device comprising a display, a memory, and a processor, the memory storing an application program, the processor controlling the display to display a window of the application by executing the application program stored in the memory, The above control method includes a display mode switching step and a display control step. In the above display mode switching step, the above processor controls the switching between the first display mode and the second display mode, wherein: In the first display mode, the entire screen area of ​​the display is controlled as a display area, and in the second display mode, the screen area of ​​the display is divided into a plurality of display areas to control the display. In the display control step, since the window displayed in any one of the plurality of display areas is hidden in the second display mode, a thumbnail image corresponding to at least a portion of the window of the executing application is displayed in the display area where the window is hidden.

Images