Information processing apparatus and control method

Abstract

To improve operability in selecting windows to be displayed in multiple display areas, respectively.SOLUTION: An information processing apparatus includes a display, performs control switching between a first display mode in which the entire screen area of the display is treated as one display area to control display, and a second display mode in which the screen area of the display is divided into multiple display areas to control display, and displays thumbnail images corresponding to at least some of windows of running applications in a display area with a hidden window which has been displayed in any of the display regions and is hidden in the second display mode.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] In recent years, there are information processing devices having a plurality of screens (for example, two screens). For example, a two-screen information processing device has been disclosed in which a display (display unit) is mounted on each of a first housing and a second housing that can be folded via a connecting unit (hinge mechanism) (for example, Patent Document 1). There is also an information processing device in which a flexible display (display unit) such as an organic EL display is provided across the first housing and the second housing so as to be bendable according to folding (for example, see Patent Document 2). Even when one display (display unit) is provided across the first housing and the second housing in this way, it is possible to use not only a single-screen mode in which one display is used as one screen, but also a pseudo-two-screen mode in which one display is divided into a display area on the first housing side and a display area on the second housing side. Also, even in the above-mentioned information processing device with a two-screen configuration using two displays, it is possible to use not only a two-screen mode but also a single-screen mode in which the two displays are used as one screen.

[0003] For example, Patent Document 3 discloses an information processing device that, in response to switching from single-screen mode to dual-screen mode, displays an active window in single-screen mode on one of two screens and displays thumbnail images corresponding to windows other than the active window on the other screen, in relation to the display of a window of an application being executed. With this information processing device, when switching from single-screen mode to dual-screen mode, it is easy to continue using the application that was being used in single-screen mode, and it is convenient because a list of other applications being executed can be easily confirmed by thumbnail images. By performing an operation to select a thumbnail image, a user can display and use the window of the application corresponding to the selected thumbnail image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-233198 A [Patent Document 2] JP 2018-13850 A [Patent Document 3] Patent Publication No. 2022-70081 Summary of the Invention [Problem to be solved by the invention]

[0005] However, for example, in the technology disclosed in the above-mentioned Patent Document 3, although a user can display the window of a desired application by selecting a thumbnail image, it is not easy to close that window and switch to a window of another application. When using a display divided into three or more display areas, not limited to the two-screen mode, the number of windows to be displayed in each display area increases, so it is desirable to be able to more easily select the windows to be displayed in each display area.

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an information processing device and a control method that improve operability when selecting a window to be displayed in each of multiple display areas. [Means for solving the problem]

[0007] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a display, a memory for storing an application program, and a processor for controlling the display of a window of the application on the display by executing the program of the application stored in the memory, wherein the processor performs a display mode switching process for controlling switching between a first display mode in which the entire screen area of ​​the display is controlled as a single display area, and a second display mode in which the screen area of ​​the display is divided into a plurality of display areas and controlled for display, and a display control process for displaying a thumbnail image corresponding to at least a portion of the window of the running application in the display area in which the window is hidden due to the window being hidden when the window displayed in one of the plurality of display areas in the second display mode becomes hidden.

[0008] In the above-mentioned information processing device, when the window displayed in any of a plurality of display areas in the second display mode becomes hidden and there is no other window to display in the display area in which the window is hidden, the processor may cause the thumbnail image to be displayed in the display area in which the window is hidden by the display control process.

[0009] In the above-mentioned information processing device, when the processor switches from the first display mode to the second display mode by the display mode switching process, the processor may, by the display control process, cause a first display area of ​​the multiple display areas to display one of the windows of the application that was executed in the first display mode, and cause a second display area of ​​the multiple display areas excluding the first display area to display the thumbnail image corresponding to the windows excluding the one window among the windows in the first display mode.

[0010] In the above information processing device, when the processor switches from the first display mode to the second display mode by the display mode switching process, the processor may minimize all of the windows in the first display mode except for the one window by the display control process.

[0011] In the above information processing device, when the processor switches from the first display mode to the second display mode by the display mode switching process, the processor may place all of the windows in the first display mode except for the one window in the first display area and then minimize them by the display control process.

[0012] In the above-mentioned information processing device, when any of the thumbnail images is selected by a user operation, the processor may hide all of the thumbnail images that were displayed in the second display area, and display the window corresponding to the selected thumbnail image in the second display area.

[0013] In the above information processing device, when the processor causes the thumbnail images to be displayed through the display control process due to the window being hidden in any of a plurality of display areas in the second display mode, the processor may cause the thumbnail images corresponding to windows of all of the running applications excluding a window that is displayed as a top layer in any of the plurality of display areas.

[0014] In the above-mentioned information processing device, when the processor causes the thumbnail image to be displayed by the display control process due to the window being closed and hidden in any of a plurality of display areas in the second display mode, the processor may exclude the thumbnail image corresponding to the closed and hidden window from the display targets.

[0015] In the above-mentioned information processing device, when the processor causes the thumbnail images to be displayed through the display control process due to a window being hidden in any of a plurality of display areas in the second display mode, the processor may cause the thumbnail images corresponding to the windows of all of the applications that are currently running to be displayed.

[0016] Furthermore, according to a second aspect of the present invention, a control method in an information processing device having a display, a memory for storing an application program, and a processor for controlling the display of a window of the application on the display by executing the program of the application stored in the memory includes a display mode switching step in which the processor controls switching between a first display mode in which the entire screen area of ​​the display is controlled as a single display area, and a second display mode in which the screen area of ​​the display is divided into a plurality of display areas and controlled for display, and a display control step in which, due to a window displayed in one of the plurality of display areas in the second display mode becoming hidden, a thumbnail image corresponding to at least a portion of the window of the running application is displayed in the display area in which the window has become hidden. Effect of the Invention

[0017] According to the above aspects of the present invention, it is possible to improve operability when selecting a window to be displayed in each of a plurality of display areas. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a perspective view showing the appearance of an information processing apparatus according to a first embodiment. [Diagram 2] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a bent state. [Diagram 3] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a flat state. [Figure 4]3A to 3C are views showing specific examples of various display modes of the information processing device according to the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of operation specifications for a display mode switching operation according to the first embodiment. [Figure 6] FIG. 2 is a view showing an example of a display in a dual screen mode according to the first embodiment. [Figure 7] 5A to 5C are views showing a first example of display control of a thumbnail window according to the first embodiment. [Figure 8] 6A to 6C are views showing a second example of display control of a thumbnail window according to the first embodiment. [Figure 9] FIG. 2 is a block diagram showing an example of the hardware arrangement of an information processing apparatus according to the first embodiment. [Figure 10] FIG. 2 is a block diagram showing an example of a functional arrangement related to a display control process according to the first embodiment. [Figure 11] 6 is a flowchart showing an example of a display control process when switching to a dual-screen mode according to the first embodiment. [Figure 12] 6 is a flowchart showing an example of a display control process when a window is hidden according to the first embodiment. [Figure 13] FIG. 11 is a diagram showing an example of operation specifications for a display mode switching operation according to the second embodiment. [Figure 14] 13A to 13C are views showing a first example of display control of a thumbnail window in a triple-screen mode according to the second embodiment. [Figure 15] 13A and 13B are views showing a second example of display control of the thumbnail window in the triple-screen mode according to the second embodiment. [Figure 16] 13A to 13C are views showing an example of display control of thumbnail windows in a quad-screen mode according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <First embodiment> First, an overview of the first embodiment of the present invention will be described. FIG. 1 is a perspective view showing the appearance of an information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is a clamshell type (notebook type) PC (personal computer). The information processing device 10 includes a first housing 101, a second housing 102, and a hinge mechanism 103. The first housing 101 and the second housing 102 are substantially rectangular plate-shaped (for example, flat) housings. One side surface of the first housing 101 and one side surface of the second housing 102 are coupled (connected) via the hinge mechanism 103, and the first housing 101 and the second housing 102 can rotate relatively around a rotation axis formed by the hinge mechanism 103. A state in which the opening angle θ of the first housing 101 and the second housing 102 around the rotation axis is substantially 0° is a state in which the first housing 101 and the second housing 102 overlap and are closed. A state in which the first housing 101 and the second housing 102 are closed is referred to as a "closed state." In the closed state, the surfaces of the first housing 101 and the second housing 102 that face each other are referred to as the "inner surface," and the surface opposite to the inner surface is referred to as the "outer surface." The opening angle θ can also be said to be an angle formed by the inner surface of the first housing 101 and the inner surface of the second housing 102. A state in which the first housing 101 and the second housing 102 are open relative to the closed state is referred to as an "open state." The open state is a state in which the first housing 101 and the second housing 102 are rotated relatively until the opening angle θ becomes larger than a preset threshold value (for example, 10°).

[0020] The information processing device 10 also includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided from the inner surface of the first housing 101 to the inner surface of the second housing 102. The camera 16 is provided, for example, on the outer side of the screen area of ​​the display 150 on the inner surface of the first housing 101, and can capture an image of a user or the like present on the side facing the display 150. The display 150 is a flexible display that can be bent according to an opening angle θ due to relative rotation between the first housing 101 and the second housing 102 (see FIGS. 2 and 3). As the flexible display, an organic EL display or the like is used. The information processing device 10 can control the display of the entire screen area of ​​the display 150 as one display area DA as a single screen configuration, or can control the display of the screen area of ​​the display 150 as a two-screen configuration by dividing the screen area into two display areas, a first display area DA1 and a second display area DA2. Here, the first display area DA1 and the second display area DA2 are display areas that do not overlap with each other. Here, the display area of ​​the screen area of ​​the display 150 that corresponds to the inner surface side of the first housing 101 is the first display area DA1, and the display area that corresponds to the inner surface side of the second housing 102 is the second display area DA2. Hereinafter, the display mode that controls the display in a single screen configuration is referred to as the "single screen mode," and the display mode that controls the display in a dual screen configuration is referred to as the "dual screen mode."

[0021] A touch sensor is provided above the screen area of ​​the display 150. The information processing device 10 can detect a touch operation on the screen area of ​​the display 150. By opening the information processing device 10, the user can view the display 150 provided on the inner surface of each of the first housing 101 and the second housing 102 and can perform a touch operation on the display 150, thereby enabling the user to use the information processing device 10.

[0022] Next, the use form and the screen mode of the information processing device 10 will be described in detail. First, the use form of the information processing device 10 is divided into a state in which the first housing 101 and the second housing 102 are bent (Bent form) and a state in which the first housing 101 and the second housing 102 are not bent (Flat form) depending on the opening angle θ between the first housing 101 and the second housing 102. Hereinafter, the state in which the first housing 101 and the second housing 102 are bent (Bent form) is simply referred to as the "Bent form", and the state in which the first housing 101 and the second housing 102 are not bent (Flat form) is simply referred to as the "Flat form". In the bent form, the display 150 provided across the first housing 101 and the second housing 102 is also bent. In the flat form, the display 150 is also flat.

[0023] FIG. 2 is a side view showing an example of the information processing device 10 in a bent state (bent form). The display 150 is arranged across (straddling) the first housing 101 and the second housing 102. The screen area of ​​the display 150 (display area DA shown in FIG. 1) can be bent (bent) at a crease at a portion corresponding to the hinge mechanism 103, and the display area on the first housing 101 side and the second housing 102 side of the crease are shown as a first display area DA1 and a second display area DA2, respectively. The display 150 bends according to the rotation (opening angle θ) of the first housing 101 and the second housing 102. The information processing device 10 determines whether or not it is in a bent state (bent form) according to the opening angle θ. For example, when 10°<θ<170°, the information processing device 10 determines that it is in a bent state (bent form). This state corresponds to a usage form called a clamshell mode or a book mode.

[0024] 3 is a side view showing an example of the information processing device 10 in a flat form. The information processing device 10 typically determines that it is in a flat form when the opening angle θ is 180°, but as an example, it may determine that it is in a flat form when 170°≦θ≦180°. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat form. This state corresponds to a usage form called a tablet mode.

[0025] Next, display modes according to various usage patterns of the information processing device 10 will be described in detail with reference to FIG. 4 is a diagram showing specific examples of various display modes of the information processing device 10 according to this embodiment. The information processing device 10 has different display modes depending on the usage form classified by the opening angle θ between the first housing 101 and the second housing 102, the attitude (direction) of the information processing device 10, whether it is a single-screen mode or a dual-screen mode, etc. Note that one screen is also called a single screen, and two screens are also called a split screen or dual screen.

[0026] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage form. For example, in this closed state, the information processing device 10 is in a standby state such as a sleep state or a hibernation state, and the display 150 is in a display-off state. This standby state such as a sleep state or a hibernation state corresponds to, for example, a system power state S3 or S4 defined by ACPI (Advanced Configuration and Power Interface).

[0027] The display mode (b) is a display mode in which the display 150 is in a bent state (bent form) and in a dual screen mode in which the screen area of ​​the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled. The orientation of the information processing device 10 is such that the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. The display area is vertically oriented when the long side of the four sides of the rectangular display area is vertical and the short side is horizontal. When the display area is vertically oriented, the display orientation is also vertical, and the direction along the long side corresponds to the up-down direction and the direction along the short side corresponds to the left-right direction. This usage mode is such that the left and right pages of a book when it is opened correspond to the left and right screens, and corresponds to a so-called book mode. This usage form is also called "Fold Landscape" because the display is bent, the first display area DA1 and the second display area DA2 are arranged side by side, and the combined display area is long horizontally.

[0028] In this display mode (b), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode, with the first display area DA1 on the left side as the primary screen and the second display area DA2 on the right side as the secondary screen. Note that in the display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.

[0029] The display mode (c-1), like the display mode (b), is a display mode in a bent state (bent form) and in a dual-screen mode in which the screen area of ​​the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, for display control, but the orientation of the information processing device 10 is different. The orientation of the information processing device 10 is an orientation in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically above and below. The display area being horizontal means that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display orientation is also horizontal, and the direction along the short side corresponds to the vertical direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the general usage modes of a clamshell type PC.

[0030] In this display mode (c-1), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode in which the first display area DA1 is the primary screen and the second display area DA2 is the secondary screen. Note that in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.

[0031] For example, the information processing device 10 automatically switches from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure with respect to the display mode (b), the information processing device 10 switches to display mode (c-1) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (b) state. Also, since the display mode (b) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure with respect to the display mode (c-1), the information processing device 10 switches to display mode (b) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (c-1) state.

[0032] The display mode (c-2) is the same as the display mode (c-1) in that the information processing device 10 is in the bent form and the orientation is the same, but it is different in that an external keyboard 30 (Dockable mini KBD: Keyboard) connectable to the information processing device 10 is connected. This usage mode is a state in which a physical keyboard 30 is connected to a general usage mode of a clamshell type PC. For example, the keyboard 30 is almost the same size as the second display area DA2 and is configured to be able to be placed on the second display area DA2. As an example, the keyboard 30 has a magnet provided inside (end) of the bottom surface, and when placed on the second display area DA2, it is attracted to and fixed to a metal part at the end of the inner surface of the second housing 102. This results in a usage mode similar to that of a conventional clamshell type PC that is originally provided with a physical keyboard. In addition, the information processing device 10 and the keyboard 30 are connected by, for example, Bluetooth (registered trademark). In this display mode (c-2), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because the second display area DA2 cannot be seen due to the keyboard. In other words, this display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as "half screen mode"), and is a one-screen mode that uses only the first display area DA1.

[0033] For example, when the information processing device 10 detects a connection to an external keyboard in the display mode (c-1), the display mode is automatically switched from the display mode (c-1) to the display mode (c-2) (Switch by Dock).

[0034] Display mode (d) is in a bent state (Bent form) like display mode (b), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the entire screen area of ​​the display 150 is controlled as a single display area DA. This usage form is different from display mode (b) in that it is a single screen mode, but since it is in a bent state (Bent form) and the display area DA is horizontally long, it is also called "Fold Landscape". The display area DA is horizontal, and the display orientation is also horizontal.

[0035] Here, switching between the single screen mode and the dual screen mode in the bent state (Bent form) is performed, for example, by a user operation. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single screen mode and the dual screen mode at any location on the screen, and switches from display mode (b) to display mode (d) based on an operation on the operator (Switch by UI). A specific example of this display mode switching operation will be described later.

[0036] Display mode (e) is in a bent state (bent form) like display mode (c-1), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the display is controlled with the entire screen area of ​​the display 150 as a single display area DA. This usage mode differs from display mode (c-1) in that it is a single screen mode, but it corresponds to the usage mode of a clamshell type PC from the bent state (bent form) and the orientation of the information processing device 10. The display area DA is vertical, and the display orientation is also vertical.

[0037] For example, the information processing device 10 automatically switches from display mode (d) to display mode (e) or from display mode (e) to display mode (d) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d), the information processing device 10 switches to display mode (e) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d) state. Also, since the display mode (d) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e), the information processing device 10 switches to display mode (d) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e) state.

[0038] The display mode (d') is a single screen mode similar to the display mode (d), and the orientation of the information processing device 10 is also a landscape orientation with the display area DA, but is different in that it is in a flat state (Flat form). The flat state (Flat form) is a state in which the opening angle θ between the first housing 101 and the second housing 102 is approximately 180°. This usage form corresponds to the so-called tablet mode described with reference to FIG. 3, and is also called "Flat Landscape" because it is in a flat state (Flat form) and the display area DA is landscape. This display mode (d') is different from the display mode (d) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to the display mode (d), the display area DA is landscape, and the display orientation is also landscape.

[0039] Display mode (e') is a single screen mode similar to display mode (e), and the orientation of the information processing device 10 is also vertically long in the display area DA, but it is different in that it is in a flat state (Flat form). This usage form is also called "Flat Portrait" because it is in a flat state (Flat form) and the display area DA is vertically long. This display mode (e') differs from display mode (e) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to display mode (e), the display area DA is vertically long, and the display orientation is also vertical.

[0040] For example, the information processing device 10 automatically switches from display mode (d') to display mode (e') or from display mode (e') to display mode (d') by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e') is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d'), the information processing device 10 switches to display mode (e') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d'). Also, since the display mode (d') is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e'), the information processing device 10 switches to display mode (d') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e').

[0041] In display mode (d') and display mode (e'), it is also possible to switch to dual screen mode while remaining in flat form by the user operating an operator (for example, a display mode switching icon, described later with reference to FIG. 5) as a UI capable of switching between the single screen mode and dual screen mode. For example, when switching from display mode (d') to dual screen mode, the display state in flat form becomes the same as display mode (b). Also, when switching from display mode (e') to dual screen mode, the display state in flat form becomes the same as display mode (c-1).

[0042] Furthermore, when the information processing device 10 detects a connection to the keyboard 30 in the display mode (e'), it automatically switches from the display mode (e') to the display mode (c-2') (Switch by Dock). The display mode (c-2') is a flat state (Flat form), and differs from the display mode (c-2) only in the opening angle θ between the first housing 101 and the second housing 102. In this display mode (c-2'), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off, since it cannot be seen by the keyboard. In other words, this display mode (c-2') is a half screen mode in which only half of the screen is effective for display, similar to the display mode (c-2).

[0043] Furthermore, the information processing device 10 can automatically switch from the single screen mode to the dual screen mode by detecting a change from a flat state (Flat form) to a bent state (Bent form) (Switch by Hinge angle). For example, when the information processing device 10 detects a change to a bent state (Bent form) in the display mode (d') based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (d') to the display mode (b). Furthermore, when the information processing device 10 detects a change to a bent state (Bent form) in the display mode (e') based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (e') to the display mode (c-1).

[0044] (Display mode switching operation) Next, a specific example of operation specifications when the display mode is switched by a user operation will be described. FIG. 5 is a diagram showing an example of the operation specifications of the display mode switching operation according to the present embodiment. For example, as shown in FIG. 5(A), an icon C1 for displaying a display mode switching menu is displayed in a task bar B2. The task bar B2 is displayed somewhere within the screen area of ​​the display 150. For example, whether in the single screen mode or the dual screen mode, the task bar B2 is displayed only in one place (for example, at the bottom of the screen area) within the screen area of ​​the display 150. Note that in the dual screen mode, the task bar B2 may be displayed in each of the first display area DA1 and the second display area DA2 (for example, at the bottom of each).

[0045] When an operation is performed on the icon C1 that displays the switching menu, the display mode switching menu is displayed as a pop-up screen. The display mode switching menu may be displayed as a pop-up screen when the display mode changes from a bent form to a flat form. The display mode switching menu may be displayed as a pop-up screen when the display mode changes from a flat form to a bent form.

[0046] In the switching menu, display mode switching icons are displayed as display mode options, allowing the user to instruct switching between single screen mode and dual screen mode, and switching between display data to be displayed in the first display area DA1 and the second display area DA2 in the dual screen mode (switching between the primary screen and the secondary screen). In the switching menu, options of display modes that the user can select depending on the usage mode (the orientation of the display 150) at that time are displayed.

[0047] FIG. 5(B) shows a switching menu M1 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.). Note that "1" and "2" in the figure are added to distinguish the display areas, and are expressed by numbers according to the area priority previously set for each display area. For example, in the dual screen mode, "1" has a higher area priority than "2", and indicates, for example, the primary screen, and "2" indicates the secondary screen. The switching menu M1 displays a display mode switching icon C11, a display mode switching icon C12, and a display mode switching icon C13. The display mode switching icon C11 is displayed as an operator for selecting the display mode (d) and the display mode (d') in the single screen mode. The display mode switching icon C12 and the display mode switching icon C13 are displayed as controls for selecting the display mode (b) of the dual-screen mode, and the order of "1" (primary screen) and "2" (secondary screen) is different between the display mode switching icon C12 and the display mode switching icon C13.

[0048] The display mode switching icon corresponding to the current display mode is displayed in a manner that allows it to be distinguished from the other display mode switching icons. Here, the display mode switching icon C11 is highlighted relative to the other display mode switching icons C12 and C13 so that it can be seen that the display mode switching icon C11 is the current display mode.

[0049] FIG. 5(C) shows a switching menu M2 that is displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). In the switching menu M2, a display mode switching icon C21, a display mode switching icon C22, and a display mode switching icon C23 are displayed. The display mode switching icon C21 is displayed as an operator for selecting the single screen mode (display mode (e) and display mode (e')). The display mode switching icon C22 and the display mode switching icon C23 are displayed as operators for selecting the display mode (c-1) of the dual screen mode, and the order of "1" (primary screen) and "2" (secondary screen) is different in the display mode switching icon C22 and the display mode switching icon C23.

[0050] 5B, the display mode switching icon corresponding to the current display mode is displayed in a manner that allows it to be distinguished from the other display mode switching icons. Here, the display mode switching icon C21 is highlighted relative to the other display mode switching icons C22 and C23 so that it can be seen that the display mode switching icon C21 is the current display mode.

[0051] The user can arbitrarily select any one of the display mode switching icons displayed in the switching menu M1 or the switching menu M2. When the user selects any one of the display mode switching icons, the display of the switching menu is terminated. Alternatively, when the user does not select any of the display mode switching icons even after a predetermined time (e.g., 3 to 5 seconds) has elapsed since the switching menu M1 or the switching menu M2 was displayed, the display of the switching menu is terminated. Also, when the user operates the close button "x" in the upper right of the switching menu, when the user operates outside the screen of the popped-up switching menu, or when the orientation of the information processing device 10 is changed, the display of the switching menu is terminated. Note that, when the keyboard 30 is connected, the display is fixed to the half screen mode (display mode (c-2)) in which only the first display area DA1 is enabled, and therefore the switching menu is not displayed.

[0052] The UI for switching between the single-screen mode and the dual-screen mode is not limited to the example shown in Fig. 5, and any UI can be used. For example, an icon that alternates between the single-screen mode and the dual-screen mode each time it is operated, or an icon that alternates between the single-screen mode, the dual-screen mode, and the inverted dual-screen mode each time it is operated may be displayed on the task bar B2. In the following description, when there is no particular distinction between the dual-screen mode and the inverted dual-screen mode, they are collectively referred to as the dual-screen mode.

[0053] 5, the display mode switching menu is displayed as a pop-up screen by an operation on the icon C1 displayed on the taskbar B2, but the switching menu may be displayed as a pop-up screen by a drag operation on the application window, etc. Also, the display mode may be switched by a drag operation on the application window, etc. When the switching menu is popped up by a drag operation on the application window, it is possible to select not only the screen mode but also the screen area by dragging onto one of the divided areas of the screen area displayed in the switching menu, and to place the dragged application in the selected area. Also, the switching menu may be displayed as a pop-up screen by an operation on a specific location of the application window.

[0054] (Display control when switching from single screen mode to dual screen mode) Next, display control when switching from single screen mode to dual screen mode will be described. When switching from single screen mode to dual screen mode, the information processing device 10 displays one of the windows of an application (hereinafter simply referred to as an "app") that was executed in the single screen mode in the first display area DA1 (e.g., the primary screen). For example, the information processing device 10 displays an active window of the windows of the app that was executed in the single screen mode in the first display area DA1.

[0055] Here, when multiple windows are open, the individual windows are arranged in multiple layers on display 150. The active window is a window that is currently selected and is the object of the user's operation, and is, for example, a window that is arranged and displayed in the foreground layer (top layer) of display 150. The active window that information processing device 10 displays in first display area DA1 when switching from single-screen mode to dual-screen mode is the window that was displayed as the active window in the single-screen mode immediately before switching to the dual-screen mode.

[0056] When information processing device 10 switches from single screen mode to dual screen mode, it displays the active window in single screen mode in first display area DA1, but if there is no active window, it displays in first display area DA1 the window with the highest priority among the windows displayed in display area DA in single screen mode.

[0057] The window with the highest priority is typically the active window, but if there is no active window, it is the window that was last to become active. For example, when an operation is performed on a part other than a window in the display area DA, there is no active window, but the window that was last to become active is displayed in the first display area DA1. In other words, the later the window is in the active window, the higher its display priority, and the window with the highest priority is displayed in the first display area DA1. However, for ease of understanding, in the following explanation, the window with the highest priority will be described as the "active window."

[0058] Furthermore, when the information processing device 10 switches from the single screen mode to the dual screen mode, it displays in the second display area DA2 (e.g., the secondary screen) thumbnail images (reduced images) corresponding to inactive windows excluding the active window among the windows in the single screen mode. Here, the inactive windows are windows other than the active window in the single screen mode immediately before transitioning to the dual screen mode. Hereinafter, the window in which the thumbnail images of the inactive windows are displayed is also referred to as the "thumbnail window."

[0059] With reference to FIG. 6, a display example in the dual-screen mode in which a thumbnail window is displayed in the second display area DA2 when the single-screen mode is switched to the dual-screen mode will be described. FIG. 6 is a diagram showing a display example of the dual screen mode according to this embodiment. Here, a display example of the dual screen mode in the display mode (c-1) shown in FIG. 4 is shown. This is a typical dual screen mode usage form of a clamshell type PC, in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. The display area is horizontally oriented, meaning that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. The vertical direction corresponds to the vertical (up and down) direction, and the horizontal direction corresponds to the horizontal (left and right) direction. The vertical direction is typically the vertical direction. That is, the first display area DA1 and the second display area DA2 are arranged so that the edge on the lower side in the display orientation of the first display area DA1 is the edge on the upper side in the display orientation of the second display area DA2.

[0060] When the information processing device 10 switches from the single screen mode to the dual screen mode, the information processing device 10 displays an active window of an application running in the single screen mode in the first display area DA1. For example, when the information processing device 10 transitions to the dual screen mode, the information processing device 10 maximizes an active window that was displayed in the display area DA in the single screen mode to the entire display area of ​​the first display area DA1 and displays it as an active window. Furthermore, when the information processing device 10 transitions to the dual screen mode, the information processing device 10 arranges a window that was an inactive window in the single screen mode in a layer (lower layer) behind the foreground where the active window is displayed in the first display area DA1, while maintaining the layer relationship (window overlap order) in the single screen mode. For example, the information processing device 10 also maximizes a window that was an inactive window in the single screen mode to the entire display area of ​​the first display area DA1, and arranges it in a layer (lower layer) behind the active window. Thus, in the first display area DA1, the active window is maximized and displayed, and the inactive window is not displayed (is not visible to the user) although it exists in the layer (lower layer) behind the active window.

[0061] Furthermore, when switching from single screen mode to dual screen mode, information processing device 10 generates thumbnail images of windows that were inactive in single screen mode and displays the thumbnail windows in second display area DA2 (secondary screen). When there are multiple inactive windows, information processing device 10 displays a thumbnail window in which thumbnail images of the multiple inactive windows are arranged in second display area DA2.

[0062] For example, a thumbnail window displays thumbnail images of multiple windows side by side. A title bar B1 is displayed at the top of the thumbnail window. A close button "X" at the right end of the title bar B1 is displayed as an operator for closing the thumbnail window. A user can close the thumbnail window and hide all of the thumbnail images by operating (for example, tapping) the close button "X" on the title bar B1.

[0063] In addition, inactive windows that exist in a layer behind the active window in the first display area DA1 (i.e., the main body (actual window) of an inactive window displayed as a thumbnail image in the second display area DA2) are arranged in a layer behind the active window according to priority at the same size (maximized size to fill the entire display area of ​​the first display area DA1) so as to be hidden behind the active window, but they may also be arranged in a size smaller than the active window according to priority.

[0064] Furthermore, the information processing device 10 may temporarily minimize the main body (actual window) of an inactive window displayed as a thumbnail image in the second display area DA2 (for example, a state in which only the application icon is present on the taskbar in Windows (registered trademark)) so that it is not arranged in the display area. In short, the main body (actual window) of an inactive window displayed as a thumbnail image in the second display area DA2 may be temporarily processed so as not to be visible to the user. Then, in the second display area DA2, the window of the application whose thumbnail image was selected in the thumbnail window is displayed in the foreground as the active window.

[0065] Furthermore, the task bar B2 displayed at the bottom end of the second display area DA2 corresponds to the task bar B2 shown in Fig. 5, and is displayed in one place as a task bar common to the first display area DA1 and the second display area DA2. The position at which the task bar B2 is displayed may be the left or right end of the first display area DA1 or the second display area DA2, or may be the top end of the first display area DA1. As described above, a task bar may be displayed in each of the first display area DA1 and the second display area DA2. The position at which the task bar is displayed does not limit the application of the present invention.

[0066] In addition, in FIG. 6, an example is shown in which when a thumbnail image is displayed in the second display area DA2, it is displayed as a thumbnail window including a title bar B1, but the title bar B1 does not have to be displayed and multiple thumbnail images may simply be displayed side by side.

[0067] When any thumbnail image is selected by a user operation (e.g., a tap operation), the information processing device 10 closes (hides) the thumbnail window that was displayed in the second display area DA2, and displays an inactive window corresponding to the selected thumbnail image as an active window in the second display area DA2. Specifically, as an example, the information processing device 10 moves the inactive window corresponding to the selected thumbnail image from the first display area DA1 to the second display area DA2, and then maximizes it in the second display area DA2 to display it as the active window.

[0068] In this way, the user can easily display the window of the application that the user wants to use among the running applications by selecting the thumbnail image. Here, when the window displayed in the second display area DA2 is closed and hidden, the window may not be displayed (the window may be empty). For example, as described with reference to FIG. 6, if the main body (actual window) of the inactive window corresponding to the thumbnail image displayed in the second display area DA2 when switching from the single screen mode to the dual screen mode is placed or minimized in the lower layer of the first display area DA1, when the window displayed in the second display area DA2 is closed and hidden, the second display area DA2 will be in a state where the window is not displayed (the window may be empty). In this state, the user cannot easily display the window of another application in the empty second display area DA2 by, for example, selecting the application from the taskbar, displaying the window, and then moving it.

[0069] Therefore, when the window displayed in the second display area DA2 is closed and hidden, the information processing device 10 automatically displays a thumbnail window at the timing when the window is no longer displayed (the window is empty). This allows the user to easily display the window of the application that he or she wants to display next.

[0070] (Thumbnail window display control) FIG. 7 is a diagram showing a first example of display control of a thumbnail window according to this embodiment. FIG. 7(A) shows a display example in single screen mode. In the illustrated example, the number of application windows executed in single screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA. Window W1 is an active window arranged in the foreground layer (top layer). When switching from single screen mode to dual screen mode, as shown in FIG. 7(B), window W1 is maximized and displayed as the active window in the first display area DA1, and a thumbnail window is displayed in the second display area DA2.

[0071] For example, the second display area DA2 displays a thumbnail window in which thumbnail images SW2, SW3, and SW4 of windows W2, W3, and W4 of the running application except for window W1 are arranged. The main bodies (actual windows) of windows W2, W3, and W4 are arranged or minimized in a lower layer of window W1 displayed in the first display area DA1. Note that if the number of application windows running in single-screen mode is five or more, the number of thumbnail images displayed in the second display area DA2 when switching to dual-screen mode will also be four or more.

[0072] When the user performs an operation to select thumbnail image SW2 in the dual screen mode shown in FIG. 7(B), the thumbnail window closes, and window W2 corresponding to thumbnail image SW2 is maximized and displayed as an active window in the second display area DA2 as shown in FIG. 7(C). Here, when window W2 is closed and hidden by a user operation (for example, an operation on the close button "x" of window W2), the second display area DA2 becomes a state in which no window is displayed (the window is empty) since no window is arranged in the lower layer of window W2. Therefore, a thumbnail window is automatically displayed in the second display area DA2 as shown in FIG. 7(D). For example, a thumbnail window in which thumbnail images SW3 and SW4 of windows W3 and W4, excluding window W1, of the windows of the running application, are arranged is displayed in the second display area DA2.

[0073] In addition, in Fig. 7(C), if the user's operation is not to close and hide the window W2, but to minimize and hide the window W2, the window W2 also exists in a minimized state. Therefore, in Fig. 7(D), a thumbnail window in which thumbnail images SW2, SW3, and SW4 are arranged is displayed in the second display area DA2.

[0074] 7(D), the thumbnail window displayed in the second display area DA2 may also include a thumbnail image of the window W1 displayed in the first display area DA1. If multiple displays are connected to the information processing device 10, the thumbnail window displayed in the second display area DA2 may also include thumbnail images of windows displayed on the other displays. In this case, when a thumbnail image of a window displayed on the other display is selected, that window is moved from the other display to the second display area DA2.

[0075] In addition, even when a window displayed in the first display area DA1 is closed and hidden, the information processing device 10 automatically displays a thumbnail window at the timing when the window is no longer displayed (the window becomes empty).

[0076] Fig. 8 is a diagram showing a second example of display control of a thumbnail window according to this embodiment. Fig. 8(A) and (B) correspond to Fig. 7(A) and (B), and when the single screen mode shown in Fig. 8(A) is switched to the dual screen mode shown in Fig. 8(B), the window W1 is maximized and displayed as the active window in the first display area DA1, and the thumbnail window is displayed in the second display area DA2. Here, it is assumed that the main bodies (actual windows) of the windows W2, W3, and W4 corresponding to the thumbnail images SW2, SW3, and SW4 displayed in the second display area DA2 are minimized.

[0077] Furthermore, when the user performs an operation to select thumbnail image SW2 in the dual screen mode shown in Figure 8(B), the thumbnail window closes, and, similar to Figure 7(C), the window W2 corresponding to thumbnail image SW2 is maximized in the second display area DA2 and displayed as the active window, as shown in Figure 8(C).

[0078] Here, when window W1 is closed and hidden by a user operation (for example, an operation on the "X" close button of window W1), the first display area DA1 is in a state where no window is displayed (the window is empty) because no windows are arranged in the layer below window W1. Therefore, a thumbnail window is automatically displayed in the first display area DA1 as shown in FIG. 8(D). For example, a thumbnail window is displayed in the first display area DA1, in which thumbnail images SW3 and SW4 of windows W3 and W4, excluding window W2, of the windows of the running application, are arranged.

[0079] In Fig. 8(C), if the user's operation is not to close and hide the window W1, but to minimize and hide the window W1, the window W1 also exists in a minimized state. Therefore, in Fig. 8(D), a thumbnail window in which thumbnail images SW2, SW3, and SW4 are arranged is displayed in the first display area DA1.

[0080] Furthermore, the thumbnail window displayed in the first display area DA1 in FIG. 8(D) may also include a thumbnail image of the window W2 displayed in the second display area DA2.

[0081] (Configuration of information processing device 10) The specific configuration of the information processing device 10 will be described below. 9 is a block diagram showing an example of a hardware configuration of an information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, and a control unit 18. These units are connected to each other so as to be able to communicate with each other via a bus or the like.

[0082] The communication unit 11 includes, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), and a communication device that performs wireless communication such as Bluetooth (registered trademark) and Wi-Fi (registered trademark). For example, the communication unit 11 can communicate with the above-mentioned external keyboard 30, etc., using Bluetooth (registered trademark).

[0083] In the RAM 12, programs and data for processing executed by the control unit 18 are deployed, and various data are appropriately saved or erased. For example, the RAM 12 also functions as a video memory (V-RAM) for display of the display 150. As an example, the RAM 12 functions as a video memory for data displayed in each display area when the display 150 is controlled in a single screen mode or a dual screen mode. The RAM 12 also stores information on running apps, apps in use (active window apps) among the running apps, information on other inactive window apps, in which display area each window is displayed, in which layer each window is arranged, the size of the window, whether it is minimized, and the like. Note that the RAM 12 is a volatile memory, and therefore does not hold data when power supply to the RAM 12 is stopped. Data that needs to be held when power supply to the RAM 12 is stopped is transferred to the storage unit 13.

[0084] The storage unit 13 is configured to include one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Residual Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores programs and setting data for a BIOS (Basic Input Output System), an OS (Operating System), programs for applications that run on the OS, and various data used by the applications. The speaker 14 outputs electronic sounds, voices, and the like.

[0085] The display unit 15 includes a display 150 and a touch sensor 155. As described above, the display 150 is a flexible display that can be bent according to the opening angle θ caused by the relative rotation of the first housing 101 and the second housing 102. The display 150 performs display corresponding to each display mode described with reference to FIG. 4 according to the control of the control unit 18. The touch sensor 155 is provided on the screen of the display 150 and detects a touch operation on the screen. For example, the touch sensor 155 detects a touch operation on the display area DA in the single screen mode. Also, the touch sensor 155 detects a touch operation on one or both of the first display area DA1 and the second display area DA2 in the dual screen mode. The touch operation includes a tap operation, a slide operation, a flick operation, a swipe operation, a pinch operation, and the like. The touch sensor 155 detects the touch operation and outputs operation information based on the detected operation to the control unit 18.

[0086] Camera 16 includes a lens, an imaging element, etc. Camera 16 captures an image (still image or video) according to the control of control unit 18, and outputs data of the captured image.

[0087] First acceleration sensor 161 is provided inside first housing 101, and detects the orientation and changes in orientation of first housing 101. For example, if a direction parallel to the longitudinal direction of first display area DA1 is defined as an X1 direction, a direction parallel to the lateral direction is defined as a Y1 direction, and a direction perpendicular to the X1 and Y1 directions is defined as a Z1 direction, first acceleration sensor 161 detects acceleration in each of the X1, Y1, and Z1 directions, and outputs the detection results to control unit 18.

[0088] The second acceleration sensor 162 is provided inside the second housing 102, and detects the orientation and changes in orientation of the second housing 102. For example, if the direction parallel to the longitudinal direction of the second display area DA2 is the X2 direction, the direction parallel to the lateral direction is the Y2 direction, and the direction perpendicular to the X2 and Y2 directions is the Z2 direction, the second acceleration sensor 162 detects acceleration in each of the X2, Y2, and Z2 directions, and outputs the detection results to the control unit 18.

[0089] The hall sensor 17 is provided to detect the connection of the keyboard 30. For example, when the keyboard 30 is placed on the second display area DA2 of the second housing 102, a magnet provided inside the bottom surface of the keyboard 30 approaches, changing the magnetic field, and the detection value (output value) of the hall sensor 17 changes. In other words, the hall sensor 17 outputs a different detection result depending on whether the keyboard 30 is placed. Note that, although the hall sensor 17 is used here to detect whether the keyboard 30 is placed, the detection method is not limited to this, and any detection method can be used.

[0090] The control unit 18 includes a processor such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and realizes various functions by executing programs (various programs such as a BIOS, an OS, and applications that run on the OS) stored in the storage unit 13, etc. For example, the control unit 18 detects the attitude (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Furthermore, the control unit 18 detects whether the information processing device 10 is in an open state or a closed state, and if in an open state, whether the information processing device 10 is in a bent form or a flat form, based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.

[0091] Furthermore, the control unit 18 detects a display mode switching operation by the user (for example, an operation on a display mode switching icon shown in FIG. 5). Furthermore, the control unit 18 detects a connection with the keyboard 30 based on the detection result of the hall sensor 17. Note that this connection with the keyboard 30 refers to placing the keyboard 30 on the second display area DA2, and does not refer to a communication connection. The control unit 18 detects the communication connection with the keyboard 30 using a function such as Bluetooth (registered trademark).

[0092] In addition, the control unit 18 controls the display of the display 150 described with reference to FIG. 4 and FIGS. 6 to 9 by detecting the state of the system, the attitude (orientation) of the information processing device 10, whether it is in an open or closed state, and if in an open state, whether it is in a bent form or a flat form, a display mode switching operation by the user (see FIG. 5), connection to the keyboard 30, etc.

[0093] Next, a functional configuration related to the display control process among the processes executed by the control unit 18 will be described. 10 is a block diagram showing an example of a functional configuration related to the display control process according to the present embodiment. The control unit 18 includes a system processing unit 181, a detection processing unit 182, and a display processing unit 183. Here, the system processing unit 181 is a functional configuration in which a CPU executes processing based on, for example, an OS or a BIOS. The detection processing unit 182 is a functional configuration in which a microcomputer other than the CPU that executes processing such as an OS or a BIOS executes various detection processes. The display processing unit 183 is a functional configuration in which a CPU executes processing based on, for example, an OS or a program that runs on the OS.

[0094] The system processing unit 181 executes various programs such as an OS and drivers and applications that run on the OS. The system processing unit 181 also includes, for example, an active application information generating unit 1811. The active application information generating unit 1811 generates application information including identification information (for example, an application ID) of an active application and information indicating an application being used by a user among the active applications (i.e., an application whose window is active). The active application information generating unit 1811 also generates window information indicating a window state of the active application. The window state indicates whether or not the window is an active window, the size (minimized, maximized, etc.) of the window, the position, the layer in which the window is located, etc. The active application information generating unit 1811 stores and holds the generated application information and window information in the RAM 12.

[0095] The detection processing unit 182 includes an open / close detection unit 1821, a posture detection unit 1822, and a connection detection unit 1823 as functional configurations for detecting the state of the information processing device 10. The detection processing unit 182 outputs detection results by the open / close detection unit 1821, the posture detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.

[0096] The open / close detection unit 1821 detects whether the information processing device 10 is in an open state or a closed state based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. When the information processing device 10 is in an open state, the open / close detection unit 1821 detects an open angle θ between the first housing 101 and the second housing 102 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Then, the open / close detection unit 1821 detects whether the information processing device 10 is in a bent form or a flat form based on the detected open angle θ.

[0097] The attitude detection unit 1822 detects the attitude (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.

[0098] The connection detection unit 1823 detects a connection with the keyboard 30. For example, the connection detection unit 1823 detects whether or not the keyboard 30 is placed on the second display area DA2 based on the detection result of the hall sensor 17, thereby detecting the connection with the keyboard 30. The detection processing unit 182 outputs the detection results (states of the information processing device 10) by the open / close detection unit 1821, the attitude detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.

[0099] The detection processing unit 182 also includes an operation detection unit 1824 as a functional configuration for detecting an operation on the information processing device 10. The operation detection unit 1824 detects a user's operation based on operation information output from a touch sensor 155 provided on the screen of the display 150. For example, the operation detection unit 1824 acquires operation information based on a user's operation on a switching menu screen (see FIG. 5) that allows switching of the display mode, and detects a display mode switching operation by the user to switch the display mode based on the acquired operation information. The detection processing unit 182 outputs the detected user's operation information to the display processing unit 183.

[0100] The display processing unit 183 determines and switches the display mode based on the open / closed state and attitude (direction) of the information processing device 10 acquired from the detection processing unit 182, a user operation, and the like. Furthermore, the display processing unit 183 controls the display of windows (active windows and inactive windows) of the running application according to the display mode and the like, based on application information acquired from the system processing unit 181. Specifically, the display processing unit 183 includes a display mode determination unit 1831, a display mode switching unit 1832, a thumbnail generation unit 1833, and a display control unit 1834.

[0101] The display mode determination unit 1831 performs a determination process for determining a display mode based on a detection result of the state of the information processing device 10 or a user's operation detected by the detection processing unit 182. For example, the display mode determination unit 1831 acquires a detection result of the open / closed state of the information processing device 10, a detection result of whether the information processing device 10 is in a bent form or a flat form when in an open state, a detection result of the attitude (direction) of the information processing device 10, and user operation information from the detection processing unit 182. Then, the display mode determination unit 1831 determines the display mode described with reference to FIG. 4 based on each detection result and operation information acquired from the detection processing unit 182.

[0102] 4 based on the display mode determined by the display mode determination unit 1831. For example, the display mode switching unit 1832 sets a display mode such as switching to a single screen mode, a dual screen mode (or an inverted dual screen mode), a half screen mode, etc., the orientation of each display area, and the display contents of each display area, based on the display mode determined by the display mode determination unit 1831.

[0103] The thumbnail generating unit 1833 generates thumbnail images corresponding to windows of running applications. For example, the thumbnail generating unit 1833 generates thumbnail images corresponding to inactive windows of the running applications as thumbnail images to be displayed as thumbnail windows in the second display area DA2 when switching from the single screen mode to the dual screen mode. The thumbnail generating unit 1833 also generates thumbnail images to be displayed as thumbnail windows in the first display area DA1 or the second display area DA2 due to the first display area DA1 or the second display area DA2 being hidden. The thumbnail generating unit 1833 basically generates thumbnail images including minimized windows as inactive windows.

[0104] A display control unit 1834 performs display control processing to output and display display data of application windows and thumbnail windows to be displayed in each display area according to the display mode set by the display mode switching unit 1832 .

[0105] When the single-screen mode is switched to the dual-screen mode by the display mode switching unit 1832, the display control unit 1834 causes the first display area DA1 to display an active window (the active window displayed in the display area DA) among the windows of the application executed in the single-screen mode. For example, the display control unit 1834 causes the first display area DA1 to maximize the active window in the single-screen mode and display it as the active window.

[0106] Furthermore, the display control unit 1834 displays thumbnail windows in the second display area DA2 when the single-screen mode is switched to the dual-screen mode by the display mode switching unit 1832. For example, the display control unit 1834 displays thumbnail images corresponding to inactive windows other than the active window in the single-screen mode in the second display area DA2.

[0107] Here, when the display mode switching unit 1832 switches from the single screen mode to the dual screen mode, the display control unit 1834 arranges inactive windows other than the active window in the single screen mode in a layer below the active window in the first display area DA1.

[0108] When the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode, the display control unit 1834 may minimize inactive windows other than the active window in the single-screen mode.

[0109] Furthermore, when the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode, the display control unit 1834 may temporarily arrange inactive windows other than the active window in the single-screen mode in the first display area DA1 and then minimize them.

[0110] In addition, if there is only an active window and no inactive windows in single-screen mode, when switching from single-screen mode to dual-screen mode, the second display area DA2 will not display a thumbnail window because there are no thumbnail images to display, and the window will remain empty.

[0111] Furthermore, when any of the thumbnail images displayed in the second display area DA2 in the dual screen mode is selected by a user operation, the display control unit 1834 makes all thumbnail images displayed in the second display area DA2 invisible, and displays an inactive window corresponding to the selected thumbnail image as an active window in the second display area DA2. For example, the display control unit 1834 maximizes and displays the inactive window corresponding to the selected thumbnail image as the active window in the second display area DA2.

[0112] Furthermore, when a window displayed in either the first display area DA1 or the second display area DA2 becomes hidden, the display control unit 1834 displays a thumbnail window in the display area where the window is hidden. For example, the display control unit 1834 displays thumbnail images (thumbnail windows) corresponding to at least a part of the windows of the running application in the display area where the window is hidden. At this time, the display control unit 1834 displays thumbnail images (thumbnail windows) corresponding to windows of all the running applications excluding a window displayed as the top layer in any of the multiple display areas, for example.

[0113] Here, when the display control unit 1834 displays a thumbnail window because a window displayed in either the first display area DA1 or the second display area DA2 has been closed and hidden, the display control unit 1834 excludes the thumbnail image corresponding to the closed and hidden window from the display targets. On the other hand, when the display control unit 1834 displays a thumbnail window because a window displayed in either the first display area DA1 or the second display area DA2 has been minimized and hidden, the display control unit 1834 also displays the thumbnail image corresponding to the minimized and hidden window.

[0114] The display control unit 1834 may display thumbnail images corresponding to the windows of all running applications.

[0115] In addition, when a window displayed in either the first display area DA1 or the second display area DA2 becomes hidden and there are no other windows to display in the display area where the window is hidden (i.e., when the window is empty), the display control unit 1834 displays a thumbnail window in the display area where the window is hidden.

[0116] For example, the display control unit 1834 checks the layer in which the window is arranged in each display area, and checks whether or not there is a window arranged in a lower layer of the window that has been hidden in the display area in which the window has been hidden. The display control unit 1834 may obtain information on the layer in which the window is arranged in each display area from the system processing unit 181, or the display control unit 1834 itself may hold the information according to display control, or both may be used in combination. Then, when there is no window arranged in a lower layer in the display area in which the window has been hidden, the display control unit 1834 determines that there is no other window to display (i.e., the window is empty), and displays a thumbnail window.

[0117] (Display control process operation) Next, a description will be given of the operation of the display control process by the control unit 18. First, a description will be given of the operation of the display control process for displaying a thumbnail window when the control unit 18 switches from the single-screen mode to the dual-screen mode with reference to FIG. FIG. 11 is a flowchart showing an example of a display control process when switching to the dual-screen mode according to this embodiment.

[0118] (Step S101) The control unit 18 judges whether or not to switch from the single screen mode to the dual screen mode. For example, the control unit 18 judges whether or not to switch from the single screen mode to the dual screen mode based on detecting a change from a flat form to a bent form as described with reference to FIG. 4, or on a display mode switching operation as described with reference to FIG. 5. When the control unit 18 judges that the single screen mode is not to be switched to the dual screen mode (NO), the control unit 18 continues the single screen mode and performs the process of step S101 again. On the other hand, when the control unit 18 judges that the single screen mode is to be switched to the dual screen mode (YES), the control unit 18 switches to the dual screen mode in which the display area DA is divided into two display areas, a first display area DA1 and a second display area DA2, and proceeds to the process of step S103.

[0119] (Step S103) The control unit 18 causes the first display area DA1 to display an active window in the single screen mode, and causes the second display area DA2 to display a thumbnail window in which thumbnail images of inactive windows in the single screen mode are arranged (see, for example, FIG. 6, FIG. 7(B), and FIG. 8(B)). Then, the process proceeds to step S105.

[0120] (Step S105) The control unit 18 determines whether or not any of the thumbnail images displayed in the second display area DA2 has been selected. If the control unit 18 determines that no thumbnail image has been selected (NO), it performs the process of step S105 again. On the other hand, if the control unit 18 determines that any of the thumbnail images has been selected (YES), it proceeds to the process of step S107.

[0121] (Step S107) The control unit 18 closes the thumbnail window to make it invisible, and ends the display of the thumbnail window. Then, the process proceeds to step S108.

[0122] (Step S108) The control unit 18 causes the window corresponding to the selected thumbnail image to be displayed in the second display area DA2 as the active window (for example, maximized and displayed in the second display area DA2) (for example, see FIG. 7(C) and FIG. 8(C)).

[0123] Next, the operation of the display control process in which the control unit 18 displays a thumbnail window when a window displayed in one of the display areas in the dual screen mode becomes hidden will be described with reference to FIG. FIG. 12 is a flowchart showing an example of a display control process when a window according to this embodiment is hidden.

[0124] (Step S201) The control unit 18 determines whether or not a window displayed in any of the multiple display areas has become hidden. For example, in the case of dual screen mode, the control unit 18 determines whether or not a window displayed in the first display area DA1 or the second display area DA2 has become hidden. If the control unit 18 determines that the window has not become hidden (NO), it performs the process of step S201 again. On the other hand, if the control unit 18 determines that the window has become hidden (YES), it proceeds to the process of step S203.

[0125] (Step S203) Control unit 18 determines whether or not there is a window in the lower layer of the display area in which the window has been hidden (the lower layer of the hidden window). If control unit 18 determines that there is a window in the lower layer (YES), the process proceeds to step S205. On the other hand, if control unit 18 determines that there is no window in the lower layer (NO), the process proceeds to step S207.

[0126] (Step S205) Control unit 18 displays a window in a lower layer in the display area where the window is hidden. For example, when multiple windows are arranged in the lower layer of the display area where the window is hidden, control unit 18 displays the window arranged in the highest layer among them.

[0127] (Step S207) Control unit 18 displays a thumbnail window in the display area where the window was hidden (see, for example, FIG. 7(D) and FIG. 8(D)).

[0128] As described above, the information processing device 10 according to the present embodiment includes the display 150, the storage unit 13 (an example of a memory) that stores an application program, and the control unit 18 (for example, an example of a processor such as a CPU, a GPU, or a microcomputer) that executes the application program stored in the storage unit 13 to control displaying the application window on the display 150. The control unit 18 performs a display mode switching process that controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled as one display area DA, and a dual screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into two display areas (for example, a first display area DA1 and a second display area DA2) and controlled to display. In addition, the control unit 18 performs a display control process that displays a thumbnail image (for example, a thumbnail window) corresponding to at least a part of the window of the running application in the display area in which the window is hidden due to the window being hidden in one of the two display areas in the dual screen mode.

[0129] As a result, information processing device 10 automatically displays thumbnail images (e.g., thumbnail windows) of windows of other applications in display areas that have been hidden by closing a window, for example, so that other applications that are being executed can be easily confirmed and it becomes easy to switch to the window of the other application. Therefore, information processing device 10 can improve operability when selecting a window to be displayed in each of a plurality of display areas.

[0130] For example, when a window displayed in one of two display areas (e.g., the first display area DA1 and the second display area DA2) in the dual screen mode becomes hidden and there is no other window to display in the display area where the window is hidden (when the window is empty), the control unit 18 uses a display control process to display the thumbnail image (e.g., a thumbnail window) in the display area where the window is hidden.

[0131] As a result, information processing device 10 automatically displays thumbnail images (e.g., thumbnail windows) of windows of other applications in a display area where a window is closed and the window is left empty, making it easy to check other applications being executed and to switch to the window of the other application. Thus, information processing device 10 can improve operability when selecting a window to be displayed in each of a plurality of display areas.

[0132] In addition, when the control unit 18 switches from single screen mode to dual screen mode through the display mode switching process, the control unit 18 causes the first display area DA1 of the two display areas to display an active window (an example of one window) of the windows of the application that was executed in the single screen mode, and causes the second display area DA2 of the two display areas excluding the first display area DA1 to display thumbnail images (e.g., thumbnail windows) corresponding to the windows in the single screen mode excluding the active window (e.g., an inactive window) in the second display area DA2 of the two display areas excluding the first display area DA1.

[0133] As a result, when information processing device 10 switches from single-screen mode to dual-screen mode, it not only displays the active window on one screen, but also displays windows other than the active window as thumbnail images on the other screen, making it easy to check other running apps, which is convenient.

[0134] Furthermore, when the control unit 18 switches from the single screen mode to the dual screen mode by the display mode switching process, the control unit 18 may minimize windows (for example, inactive windows) other than the active window among the windows in the single screen mode by the display control process.

[0135] This allows information processing device 10 to automatically display thumbnail images (e.g., thumbnail windows) of windows of other applications in any display area when the window is closed, for example, so that the window becomes empty.

[0136] In addition, when the control unit 18 switches from single screen mode to dual screen mode by the display mode switching process, the control unit 18 may use the display control process to arrange windows in the single screen mode, excluding the active window, in the first display area DA1 and then minimize them.

[0137] This allows information processing device 10 to display, for example, a minimized window in first display area DA1 when the window is displayed by an operation on the taskbar.

[0138] Furthermore, when any of the thumbnail images displayed in the second display area DA is selected by a user operation, the control unit 18 makes all thumbnail images displayed in the second display area DA invisible, and displays a window corresponding to the selected thumbnail image in the second display area DA.

[0139] This allows the information processing device 10 to easily display a window that the user desires to display simply by selecting a thumbnail image.

[0140] For example, when the control unit 18 causes thumbnail images to be displayed through the display control process because a window displayed in one of the two display areas in dual screen mode has become hidden, the control unit 18 causes thumbnail images corresponding to windows of all running apps excluding the window displayed as the top layer in one of the two display areas.

[0141] This allows information processing device 10 to easily check the window of an application that is not displayed in any display area, and makes it easy to switch to the window of another application.

[0142] In addition, when the control unit 18 displays thumbnail images through the display control process because a window displayed in one of the two display areas in the dual-screen mode has been closed and hidden, the control unit 18 excludes the thumbnail image corresponding to the closed and hidden window from the display targets.

[0143] This enables the information processing device 10 to prevent erroneous display of a thumbnail image of a closed window.

[0144] In addition, when control unit 18 displays thumbnail images through a display control process due to a window being hidden in one of the two display areas in dual-screen mode, control unit 18 may display thumbnail images corresponding to the windows of all running apps.

[0145] This allows the information processing device 10 to display a list of all running application windows as thumbnail images, which is convenient. For example, the information processing device 10 allows the user to easily display a window displayed in the first display area DA1 in the second display area DA2 for confirmation.

[0146] Furthermore, the control method in the information processing device 10 according to this embodiment includes a display mode switching step in which the processor controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled to be displayed as a single display area DA, and a dual screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into two display areas (e.g., a first display area DA1 and a second display area DA2) and the display is controlled; and a display control step in which, when a window displayed in one of the two display areas in the dual screen mode becomes hidden, a thumbnail image (e.g., a thumbnail window) corresponding to at least a part of the window of the running app is displayed in the display area in which the window has become hidden.

[0147] As a result, information processing device 10 automatically displays thumbnail images (e.g., thumbnail windows) of windows of other applications in display areas that have been hidden by closing a window, for example, so that other applications that are being executed can be easily confirmed and it becomes easy to switch to the window of the other application. Therefore, information processing device 10 can improve operability when selecting a window to be displayed in each of a plurality of display areas.

[0148] <Second embodiment> Next, an overview of a second embodiment of the present invention will be described. In the first embodiment, the information processing device 10 has been described as having a single screen mode in which the entire screen area of ​​the display 150 is treated as a single display area DA and the dual screen mode in which the screen area of ​​the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled. However, the screen area of ​​the display 150 may also be divided into three or more display areas to control the display.

[0149] In this embodiment, in addition to the single-screen mode and dual-screen mode, the information processing device 10 has a triple-screen mode in which the screen area of ​​the display 150 is divided into three display areas for display control, and a quadruple-screen mode in which the screen area is divided into four display areas for display control. In the triple-screen mode or quadruple-screen mode, the information processing device 10 can perform display control processing for displaying a thumbnail window when a window displayed in any of the multiple display areas becomes hidden, just like the dual-screen mode.

[0150] The basic configuration of the information processing device 10 is the same as that of the first embodiment, and an example of display control in the triple screen mode and the quadruple screen mode will be described here.

[0151] FIG. 13 is a diagram showing an example of the operation specifications of the display mode switching operation according to this embodiment. This diagram shows an example of a switching menu displayed by operating the icon C1 shown in FIG. 5(A), for example. FIG. 13(B) shows a switching menu M3 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.), and FIG. 13(C) shows a switching menu M4 displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). The switching menus M3 and M4 are different from the switching menus M1 in FIG. 5(B) and the switching menus M2 in FIG. 5(C) in that they can be switched to a triple-screen mode and a quadruple-screen mode.

[0152] Display mode switching icons C31, C32, C33, C34, and C35 are displayed in the switching menu M3. The display mode switching icon C31 is displayed as an operator for selecting the display mode (d) and display mode (d') of the single-screen mode. The display mode switching icon C32 is displayed as an operator for selecting the display mode (b) of the dual-screen mode. The display mode switching icon C33 and the display mode switching icon C34 are displayed as operators for selecting the display mode of the triple-screen mode. The display mode switching icon C33 and the display mode switching icon C34 differ in which side of the first display area DA1 and the second display area DA2 in the dual-screen mode is divided into two display areas. The display mode switching icon C35 is displayed as an operator for selecting the display mode of the quadruple-screen mode.

[0153] The numbers "1", "2", "3", and "4" in the figure are used to distinguish the display areas, as in Figure 5, and are expressed, for example, by numbers according to the priority order of the areas that has been preset for each display area. "1" has the highest priority, and the priority order of areas decreases in the order of "2", "3", and "4".

[0154] When the user performs an operation to select the display mode switching icon C33 or the display mode switching icon C34, the display of the switching menu ends and the display is controlled to the triple-screen mode in "Landscape." When the user performs an operation to select the display mode switching icon C35, the display of the switching menu ends and the display is controlled to the quadruple-screen mode in "Landscape."

[0155] Display mode switching icons C41, C42, C43, C44, and C45 are displayed in the switching menu M4. The display mode switching icon C41 is displayed as an operator for selecting the display mode (e) or display mode (e') of the single screen mode. The display mode switching icon C42 is displayed as an operator for selecting the display mode (c-1) of the dual screen mode. The display mode switching icon C43 and the display mode switching icon C44 are displayed as operators for selecting the display mode of the triple screen mode. The display mode switching icon C43 and the display mode switching icon C44 differ in which side of the first display area DA1 and the second display area DA2 in the dual screen mode is divided into two display areas. The display mode switching icon C45 is displayed as an operator for selecting the display mode of the quadruple screen mode.

[0156] When the user performs an operation to select the display mode switching icon C43 or the display mode switching icon C44, the display of the switching menu ends and the display is controlled to triple-screen mode in "Clamshell or Portrait." Also, when the user performs an operation to select the display mode switching icon C35, the display of the switching menu ends and the display is controlled to quadruple-screen mode in "Clamshell or Portrait."

[0157] (Thumbnail window display control in triple screen mode) Next, display control of the thumbnail window in triple screen mode will be described. Here, when the screen area of ​​the display 150 in triple screen mode is divided into three display areas, each area will be referred to as a first display area DA1, a second display area DA2, and a third display area DA3.

[0158] In addition, the second display area DA2 and the third display area DA3 in the triple screen mode can be said to be two second display areas obtained by dividing the display area excluding the first display area DA1 into two. In order to distinguish between these two second display areas, they are shown as the second display area DA2 and the third display area DA3 in descending order of area priority.

[0159] Fig. 14 is a diagram showing a first example of thumbnail window display control in triple screen mode according to this embodiment. Fig. 14(A) shows an example in triple screen mode where window W1 is displayed in first display area DA1, window W2 is displayed in second display area DA2, and window W3 is displayed in third display area DA3. Here, it is assumed that there are six windows of running applications: windows W1, W2, W3, W4, W5, and W6, and windows W4, W5, and W6 are arranged or minimized in a lower layer of window W1 in first display area DA1.

[0160] In Fig. 14(A), when window W2 is closed and hidden by a user operation (for example, an operation on the "X" close button of window W2), the second display area DA2 is in a state where no window is displayed (the window is empty) because no windows are arranged in the layer below window W2. Therefore, a thumbnail window is automatically displayed in the second display area DA2 as shown in Fig. 14(B). For example, the second display area DA2 displays a thumbnail window in which thumbnail images SW4, SW5, and SW6 of windows W4, W5, and W6 of the windows of the running application, excluding windows W1 and W3, are arranged.

[0161] In Fig. 14(A), if the user's operation is not to close and hide the window W2, but to minimize and hide the window W2, the window W2 also exists in a minimized state. Therefore, in Fig. 14(B), a thumbnail window in which thumbnail images SW2, SW4, SW5, and SW6 are arranged is displayed in the second display area DA2.

[0162] In addition, the thumbnail window displayed in the second display area DA2 in Figure 14 (B) may also include a thumbnail image of the window W1 displayed in the first display area DA1 and a thumbnail image of the window W3 displayed in the third display area DA3.

[0163] Fig. 15 is a diagram showing a second example of thumbnail window display control in triple screen mode according to this embodiment. Fig. 15(A) corresponds to the display example of Fig. 14(B). Window W1 is displayed in the first display area DA1, window W3 is displayed in the third display area DA3, and a thumbnail window is displayed in the second display area DA2. In the example shown in Fig. 15, it is assumed that the main bodies (actual windows) of windows W4, W5, and W6 corresponding to thumbnail images SW4, SW5, and SW6 displayed in the second display area DA2 are minimized.

[0164] In Fig. 15(A), when window W1 is closed and hidden by a user operation (for example, an operation on the "X" close button of window W1), the first display area DA1 is in a state where no window is displayed (the window is empty) because no windows are arranged in the layer below window W1. Therefore, a thumbnail window is automatically displayed in the first display area DA1 as shown in Fig. 15(B). For example, the first display area DA1 displays a thumbnail window in which thumbnail images SW4, SW5, and SW6 of windows W4, W5, and W6, excluding window W3, of the windows of the running application are arranged.

[0165] In Fig. 15(A), if the user's operation is not to close and hide the window W1, but to minimize and hide the window W1, the window W1 also exists in a minimized state. Therefore, in Fig. 15(B), a thumbnail window in which thumbnail images SW1, SW2, SW4, SW5, and SW6 are arranged is displayed in the first display area DA1.

[0166] Furthermore, the thumbnail window displayed in the first display area DA1 in FIG. 15(B) may also include a thumbnail image of the window W3 displayed in the third display area DA3.

[0167] (Thumbnail window display control in 4-screen mode) Next, the display control of the thumbnail window in the quad-screen mode will be described. Here, when the screen area of ​​the display 150 in the quad-screen mode is divided into four display areas, the areas are referred to as a first display area DA1, a second display area DA2, a third display area DA3, and a fourth display area DA4.

[0168] In addition, the second display area DA2, the third display area DA3, and the fourth display area DA4 in the 4-screen mode can be said to be three second display areas obtained by dividing the display area excluding the first display area DA1 into three. In order to distinguish between these three second display areas, they are shown as the second display area DA2, the third display area DA3, and the fourth display area DA4 in descending order of area priority.

[0169] Fig. 16 is a diagram showing an example of display control of thumbnail windows in the 4-screen mode according to this embodiment. Fig. 16(A) shows an example in which a window W1 is displayed in the first display area DA1, a window W2 in the second display area DA2, a window W3 in the third display area DA3, and a window W4 in the fourth display area DA4 in the 4-screen mode. Here, the number of windows of running applications is eight, namely, windows W1, W2, W3, W4, W5, W6, W7, and W8, and windows W5, W6, W7, and W8 are arranged or minimized in a lower layer of window W1 in the first display area DA1.

[0170] In Fig. 16(A), when window W2 is closed and hidden by a user operation (for example, an operation on the "X" close button of window W2), the second display area DA2 is in a state where no window is displayed (the window is empty) because no windows are arranged in the layer below window W2. Therefore, a thumbnail window is automatically displayed in the second display area DA2 as shown in Fig. 16(B). For example, the second display area DA2 displays a thumbnail window in which thumbnail images SW5, SW6, SW7, and SW8 of windows W5, W6, W7, and W8 of the windows of the running application, excluding windows W1, W3, and W4, are arranged.

[0171] In Fig. 16(A), if the user's operation is not to close and hide the window W2, but to minimize and hide the window W2, the window W2 also exists in a minimized state. Therefore, in Fig. 16(B), a thumbnail window in which thumbnail images SW2, SW5, SW6, SW7, and SW8 are arranged is displayed in the second display area DA2.

[0172] In addition, the thumbnail window displayed in the second display area DA2 in Figure 16 (B) may also include a thumbnail image of window W1 displayed in the first display area DA1, a thumbnail image of window W3 displayed in the third display area DA3, and a thumbnail image of window W4 displayed in the fourth display area DA4.

[0173] As described above, in the information processing device 10 according to the present embodiment, the control unit 18 performs a display mode switching process that controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled to be displayed as a single display area DA, and a multiple screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into a plurality of (two, three, four, etc.) display areas and the display is controlled. In addition, when a window displayed in one of the multiple display areas in the multiple screen mode becomes hidden, the control unit 18 performs a display control process that displays a thumbnail image (for example, a thumbnail window) corresponding to at least a part of the window of the running application in the display area in which the window is hidden.

[0174] As a result, information processing device 10 automatically displays thumbnail images (e.g., thumbnail windows) of windows of other applications in display areas that have been hidden by closing a window, for example, so that other applications that are being executed can be easily confirmed and it becomes easy to switch to the window of the other application. Therefore, information processing device 10 can improve operability when selecting a window to be displayed in each of a plurality of display areas.

[0175] For example, when a window displayed in one of multiple display areas in multiple screen mode becomes hidden and there is no other window to display in the display area where the window is hidden, control unit 18 uses display control processing to display a thumbnail image (e.g., a thumbnail window) in the display area where the window is hidden.

[0176] As a result, information processing device 10 automatically displays thumbnail images (e.g., thumbnail windows) of windows of other applications in a display area where a window is closed and the window is left empty, making it easy to check other applications being executed and to switch to the window of the other application. Thus, information processing device 10 can improve operability when selecting a window to be displayed in each of a plurality of display areas.

[0177] For example, when control unit 18 displays thumbnail images through display control processing due to a window displayed in one of multiple display areas becoming hidden in multiple screen mode, control unit 18 displays thumbnail images corresponding to windows of all running apps excluding the window displayed as the top layer in one of the multiple display areas.

[0178] This allows information processing device 10 to easily check the window of an application that is not displayed in any display area, and makes it easy to switch to the window of another application.

[0179] In addition, when control unit 18 displays thumbnail images through display control processing due to a window displayed in one of multiple display areas being closed and hidden in multiple screen mode, control unit 18 excludes the thumbnail image corresponding to the closed and hidden window from the display targets.

[0180] This enables the information processing device 10 to prevent erroneous display of a thumbnail image of a closed window.

[0181] In addition, when control unit 18 displays thumbnail images through display control processing due to a window being hidden in one of multiple display areas in multiple screen mode, control unit 18 may display thumbnail images corresponding to the windows of all running apps.

[0182] This allows the information processing device 10 to display a list of all running application windows as thumbnail images, which is convenient. For example, the information processing device 10 allows the user to easily display a window displayed in one display area in another display area and check the window.

[0183] Furthermore, the control method in the information processing device 10 according to this embodiment includes a display mode switching step in which the processor controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of ​​the display 150 is controlled to be displayed as a single display area DA, and a multiple screen mode (an example of a second display mode) in which the screen area of ​​the display 150 is divided into multiple (two, three, four, etc.) display areas and controlled to be displayed, and a display control step in which, when a window displayed in one of the multiple display areas in the multiple screen mode becomes hidden, a thumbnail image (e.g., a thumbnail window) corresponding to at least a part of the window of the running app is displayed in the display area in which the window has become hidden.

[0184] As a result, information processing device 10 automatically displays thumbnail images (e.g., thumbnail windows) of windows of other applications in display areas that have been hidden by closing a window, for example, so that other applications that are being executed can be easily confirmed and it becomes easy to switch to the window of the other application. Therefore, information processing device 10 can improve operability when selecting a window to be displayed in each of a plurality of display areas.

[0185] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configurations are not limited to those described above, and various design changes and the like are possible within the scope of the gist of the present invention. For example, the configurations described in the above embodiments may be combined in any desired manner.

[0186] In the above embodiment, an example was described in which a thumbnail window (thumbnail image) is displayed when a window displayed in any display area in a multi-screen mode (e.g., dual-screen mode, triple-screen mode, or quadruple-screen mode) becomes invisible and the display area becomes a state in which no window is displayed (the window is empty), but the thumbnail window (thumbnail image) may also be displayed when there is a window in a lower layer of the display area and the window is not empty. For example, in the display control process shown in Fig. 12, if the control unit 18 determines in step S201 that the window has become invisible (YES) without performing the determination process in step S203, the control unit 18 may proceed to the process in step S207 and display the thumbnail window in the display area in which the window has become invisible.

[0187] In the above-described embodiment, an example in which one foldable display 150 is used in a single screen mode and a dual screen mode has been described, but two displays may be used. That is, the processing in the above-described embodiment can be applied to switching between a single screen mode in which the screen areas of the two displays are combined into one display area and the dual screen mode in which the screen areas of the two displays are individually combined into display areas and the display is controlled. In addition, the processing in the above-described embodiment can be applied to a triple screen mode or a quadruple screen mode in which one or both of the screen areas of the two displays are divided into two display areas and the display is controlled.

[0188] In addition, in the above-described embodiment, the information processing device 10 has been described as having, as multiple screen modes, a dual screen mode in which the display is controlled by dividing it into two display areas, a triple screen mode in which the display is controlled by dividing it into three display areas, and a quadruple screen mode in which the display is controlled by dividing it into four display areas, but it may also be configured to have a screen mode in which the display is controlled by dividing it into five or more display areas.

[0189] In addition, in the above-described embodiment, an example of touch operation on a plurality of touch panel type displays in which the input unit (touch sensor) and the display unit are integrally configured has been described, but this is not limited to touch operation, and may also be a click operation using a mouse, an operation using a gesture, or the like.

[0190] The above-mentioned control unit 18 has a computer system inside. A program for realizing the function of each of the components of the above-mentioned control unit 18 may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform processing in each of the components of the above-mentioned control unit 18. Here, "reading the program recorded in the recording medium into a computer system and executing it" includes installing the program in a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include a plurality of computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

[0191] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by the respective components of the control unit 18, or each of the divided programs may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for realizing a part of the above-mentioned functions. Furthermore, the program may be a recording medium that can realize the above-mentioned functions in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program).

[0192] In addition, some or all of the functions of the control unit 18 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]

[0193] 10 information processing device, 101 first housing, 102 second housing, 103 hinge mechanism, 11 communication unit, 12 RAM, 13 storage unit, 14 speaker, 15 display unit, 16 camera, 150 display, 155 touch sensor, 161 first acceleration sensor, 162 second acceleration sensor, 17 hall sensor, 18 control unit, 181 system processing unit, 1811 execution application information generation unit, 182 detection processing unit, 1821 opening / closing detection unit, 1822 attitude detection unit, 1823 connection detection unit, 1824 operation detection unit, 183 display processing unit, 1831 display mode determination unit, 1832 display mode switching unit, 1833 thumbnail generation unit, 1834 display control unit

Claims

1. A display and A memory for storing application programs; a processor that controls displaying a window of the application on the display by executing a program of the application stored in the memory; Equipped with The processor, a display mode switching process for controlling switching between a first display mode in which the entire screen area of ​​the display is treated as a single display area and a second display mode in which the screen area of ​​the display is divided into a plurality of display areas and the display mode is controlled; a display control process for displaying a thumbnail image corresponding to at least a part of the window of the application being executed in a display area in which the window is hidden due to the window being hidden in any of a plurality of display areas in the second display mode; An information processing device that performs the above.

2. The processor, when the window displayed in any one of a plurality of display areas in the second display mode becomes hidden and there is no other window to be displayed in the display area in which the window is hidden, the display control process displays the thumbnail image in the display area in which the window is hidden. The information processing device according to claim 1 .

3. The processor, When the display mode is switched from the first display mode to the second display mode by the display mode switching process, one of the windows of the application executed in the first display mode is displayed in a first display area of ​​the plurality of display areas, and the thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode are displayed in a second display area of ​​the plurality of display areas excluding the first display area. The information processing device according to claim 1 .

4. The processor, when the display mode is switched from the first display mode to the second display mode by the display mode switching process, the windows in the first display mode except for the one window are minimized by the display control process. The information processing device according to claim 3 .

5. The processor, When the display mode is switched from the first display mode to the second display mode by the display mode switching process, the windows in the first display mode except for the one window are arranged in the first display area and then minimized by the display control process. The information processing device according to claim 4.

6. The processor, when any one of the thumbnail images is selected by a user operation, all of the thumbnail images that have been displayed in the second display area are made non-displayable, and the window corresponding to the selected thumbnail image is displayed in the second display area. The information processing device according to claim 3 .

7. The processor, When the thumbnail images are to be displayed by the display control process due to the window being hidden in any one of a plurality of display areas in the second display mode, the thumbnail images corresponding to windows excluding a window being displayed as a top layer in any one of a plurality of display areas among the windows of all the running applications are displayed. The information processing device according to claim 1 .

8. The processor, when the thumbnail images are to be displayed by the display control process due to the window being closed and hidden in any of the plurality of display areas in the second display mode, the thumbnail images corresponding to the closed and hidden window are excluded from the display targets. The information processing device according to claim 1 .

9. The processor, When the thumbnail images are to be displayed by the display control process due to the window being hidden in any of a plurality of display areas in the second display mode, the thumbnail images corresponding to the windows of all of the applications being executed are displayed. The information processing device according to claim 1 .

10. 1. A control method for an information processing device including a display, a memory that stores an application program, and a processor that performs control to display a window of the application on the display by executing the application program stored in the memory, comprising: The processor, a display mode switching step of controlling switching between a first display mode in which the entire screen area of ​​the display is treated as a single display area and a second display mode in which the screen area of ​​the display is divided into a plurality of display areas and the display mode is controlled; a display control step of, when the window displayed in any one of a plurality of display areas in the second display mode becomes hidden, displaying a thumbnail image corresponding to at least a part of the window of the application being executed in the display area in which the window is hidden; A control method comprising:

Images