Information processing apparatus and control method
Patent Information
- Application Number
- JP2023128774
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-08-07
- Publication Date
- 2025-02-20
- Estimated Expiration
- 2043-08-07
AI Technical Summary
【0020】 本発明の上記態様によれば、複数の表示領域のそれぞれに表示させるウィンドウを選択する際の操作性を向上することができる。
Smart Images

Figure 2025024571000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device and a control method. [Background technology]
[0002] In recent years, there are information processing devices having a plurality of screens (for example, two screens). For example, a two-screen information processing device has been disclosed in which a display (display unit) is mounted on each of a first housing and a second housing that can be folded via a connecting unit (hinge mechanism) (for example, Patent Document 1). There is also an information processing device in which a flexible display (display unit) such as an organic EL display is provided across the first housing and the second housing so as to be bendable according to folding (for example, see Patent Document 2). Even when one display (display unit) is provided across the first housing and the second housing in this way, it is possible to use not only a single-screen mode in which one display is used as one screen, but also a pseudo-two-screen mode in which one display is divided into a display area on the first housing side and a display area on the second housing side. Also, even in the above-mentioned information processing device with a two-screen configuration using two displays, it is possible to use not only a two-screen mode but also a single-screen mode in which the two displays are used as one screen.
[0003] For example, Patent Document 3 discloses an information processing device that, in response to switching from single-screen mode to dual-screen mode, displays an active window in single-screen mode on one of two screens and displays thumbnail images corresponding to windows other than the active window on the other screen, in relation to the display of a window of an application being executed. With this information processing device, when switching from single-screen mode to dual-screen mode, it is easy to continue using the application that was being used in single-screen mode, and it is convenient because a list of other applications being executed can be easily confirmed by thumbnail images. By performing an operation to select a thumbnail image, a user can display and use the window of the application corresponding to the selected thumbnail image. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-233198 A [Patent Document 2] JP 2018-13850 A [Patent Document 3] Patent Publication No. 2022-70081 Summary of the Invention [Problem to be solved by the invention]
[0005] However, for example, in the technology disclosed in the above-mentioned Patent Document 3, although the user can display the window of the application he / she wants to use by selecting a thumbnail image, it is not easy to switch to another application when he / she wants to use another application. In particular, when using a dual-screen mode or when using a display divided into three or more display areas, it is preferable to be able to more freely select the window to be displayed in each display area.
[0006] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an information processing device and a control method that improve operability when selecting a window to be displayed in each of multiple display areas. [Means for solving the problem]
[0007] The present invention has been made to solve the above-mentioned problems. An information processing device according to a first aspect of the present invention includes a display, a memory that stores a program of an application, and a processor that controls displaying a window of the application on the display by executing the program of the application stored in the memory. The processor performs a display mode switching process that controls switching between a first display mode in which the entire screen area of the display is controlled as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and controls display. When the first display mode is switched to the second display mode by the display mode switching process, a first display control process is performed to display one of the windows of the application that was executed in the first display mode in a first display area of the plurality of display areas, and to display thumbnail images corresponding to the windows excluding the one window of the windows in the first display mode in a second display area of the plurality of display areas excluding the first display area. The information processing device according to a first aspect of the present invention includes a display
[0008] In the above-mentioned information processing device, when the processor displays the thumbnail image in the second display control process due to the detection of the specified operation, the processor may also display the thumbnail image corresponding to the one of the windows in the first display mode.
[0009] In the above-mentioned information processing device, in the second display control process, the processor may control the thumbnail image displayed in the second display area to be hidden, and then, upon detection of the specified operation, display the thumbnail image in a display area specified by the specified operation.
[0010] In the above information processing device, the processor may display a first icon on the display that accepts a user operation to switch from the first display mode to the second display mode, and when a user operation on the first icon is detected in the first display mode, switch from the first display mode to the second display mode, and in the second display mode, accept the user operation on the first icon as the specified operation, and when an operation on the first icon is detected, display the thumbnail image as if the specified operation has been detected.
[0011] In the above information processing device, the processor may cause a first icon that accepts a user operation for switching from the first display mode to the second display mode and a second icon that accepts the predetermined operation to be displayed on the display, and when an operation on the second icon is detected, cause the processor to display the thumbnail image as if the predetermined operation had been detected.
[0012] In the information processing device, the second icon may receive an operation for designating a display area in which the thumbnail images are to be displayed regardless of the plurality of display areas divided in the second display mode.
[0013] In the information processing device, the predetermined operation may be a touch operation of a specific pattern on a display area in which a user desires to display the thumbnail image.
[0014] In the above information processing device, the specified operation is a touch operation of the specific pattern on an area in a display area in which at least one window is displayed among a plurality of display areas in the second display mode, where no window is displayed, and when the specified operation is detected, the processor may cause the second display control process to display the thumbnail image in the display area in which the specified operation was performed.
[0015] In the above-mentioned information processing device, when any of the thumbnail images displayed in the second display area is selected by a user operation, the processor may make all of the thumbnail images displayed in the second display area invisible and display the window corresponding to the selected thumbnail image.
[0016] In the above-mentioned information processing device, when a user performs an operation to hide the thumbnail images displayed in the second display area, the processor may hide all of the thumbnail images that were displayed in the second display area.
[0017] In the above-mentioned information processing device, when the display mode switching process switches from the first display mode to the second display mode, the processor may control, in the first display control process, whether or not to display the thumbnail images in the second display area based on the number of windows in the first display mode.
[0018] In the above-mentioned information processing device, when the display mode switching process switches from the first display mode to the second display mode, the processor may control, in the first display control process, whether or not to display the thumbnail images in the second display area based on the number of display areas in the second display mode.
[0019] Furthermore, according to a second aspect of the present invention, a control method in an information processing device including a display, a memory for storing a program of an application, and a processor for controlling display of a window of the application on the display by executing the program of the application stored in the memory includes a display mode switching step in which the processor controls switching between a first display mode in which the entire screen area of the display is controlled as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and controlled to display; a first display control step in which, when switching from the first display mode to the second display mode by the display mode switching step, one of the windows of the application executed in the first display mode is displayed in the first display area of the plurality of display areas, and a thumbnail image corresponding to the windows excluding the one window of the windows in the first display mode is displayed in the second display area of the plurality of display areas excluding the first display area; and a second display control step in which, upon detection of a predetermined operation by a user, the thumbnail image is displayed in a display area within the screen area specified by the predetermined operation. Effect of the Invention
[0020] According to the above aspects of the present invention, it is possible to improve operability when selecting a window to be displayed in each of a plurality of display areas. [Brief description of the drawings]
[0021] [Figure 1] FIG. 1 is a perspective view showing the appearance of an information processing apparatus according to a first embodiment. [Diagram 2] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a bent state. [Diagram 3] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a flat state. [Figure 4]3A to 3C are views showing specific examples of various display modes of the information processing device according to the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of operation specifications for a display mode switching operation according to the first embodiment. [Figure 6] FIG. 2 is a view showing an example of a display in a dual screen mode according to the first embodiment. [Figure 7] 5A to 5C are views showing a first example of display control when switching from a single-screen mode to a dual-screen mode according to the first embodiment. [Figure 8] 6A to 6C are diagrams showing a second example of display control when switching from the single-screen mode to the dual-screen mode according to the first embodiment. [Figure 9] FIG. 4 is a view showing a first example of a thumbnail display operation according to the first embodiment. [Figure 10] 5A to 5C are views showing a first example of display control by a thumbnail display operation according to the first embodiment. [Figure 11] 6A to 6C are views showing a second example of a thumbnail display operation according to the first embodiment. [Figure 12] 6A to 6C are views showing a second example of display control by a thumbnail display operation according to the first embodiment. [Figure 13] 13A to 13C are views showing a third example of display control by a thumbnail display operation according to the first embodiment. [Figure 14] FIG. 2 is a block diagram showing an example of the hardware arrangement of the information processing apparatus according to the first embodiment. [Figure 15] FIG. 2 is a block diagram showing an example of a functional arrangement related to a display control process according to the first embodiment. [Figure 16] 6 is a flowchart showing an example of a display control process of a thumbnail window according to the first embodiment. [Figure 17] 10 is a flowchart showing an example of a display control process when a thumbnail image is selected according to the first embodiment. [Figure 18] 10 is a flowchart showing an example of a display control process of a thumbnail window by a thumbnail display operation according to the first embodiment. [Figure 19] 13A to 13C are views showing a first example of a thumbnail display operation according to the second embodiment. [Figure 20]13A to 13C are views showing a first example of display control by a thumbnail display operation according to the second embodiment. [Figure 21] 13A to 13C are views showing a second example of a thumbnail display operation according to the second embodiment. [Figure 22] 13A to 13C are views showing a second example of display control by a thumbnail display operation according to the second embodiment. [Diagram 23] 13A to 13C are diagrams showing an example of operation specifications for a display mode switching operation according to the third embodiment. [Figure 24] 13A and 13B are diagrams showing a first example of display control when switching from a single-screen mode to a triple-screen mode according to the third embodiment. [Diagram 25] 13A and 13B are diagrams showing a second example of display control when switching from the single-screen mode to the triple-screen mode according to the third embodiment. [Figure 26] 13A and 13B are diagrams showing a third example of display control when switching from the single-screen mode to the triple-screen mode according to the third embodiment. [Figure 27] 13 is a flowchart showing an example of a display control process of a thumbnail window according to the third embodiment. [Figure 28] 13A and 13B are diagrams showing a fourth example of display control when switching from the single-screen mode to the triple-screen mode according to the third embodiment. [Figure 29] 13A to 13C are views showing an example of a thumbnail display operation according to the third embodiment. [Diagram 30] 13A to 13C are views showing a first example of display control by a thumbnail display operation according to the third embodiment. [Diagram 31] 13A to 13C are views showing a second example of display control by a thumbnail display operation according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0022] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <First embodiment> First, an overview of the first embodiment of the present invention will be described. FIG. 1 is a perspective view showing the appearance of an information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is a clamshell type (notebook type) PC (personal computer). The information processing device 10 includes a first housing 101, a second housing 102, and a hinge mechanism 103. The first housing 101 and the second housing 102 are substantially rectangular plate-shaped (for example, flat) housings. One side surface of the first housing 101 and one side surface of the second housing 102 are coupled (connected) via the hinge mechanism 103, and the first housing 101 and the second housing 102 can rotate relatively around a rotation axis formed by the hinge mechanism 103. A state in which the opening angle θ of the first housing 101 and the second housing 102 around the rotation axis is substantially 0° is a state in which the first housing 101 and the second housing 102 overlap and are closed. A state in which the first housing 101 and the second housing 102 are closed is referred to as a "closed state." In the closed state, the surfaces of the first housing 101 and the second housing 102 that face each other are referred to as the "inner surface," and the surface opposite to the inner surface is referred to as the "outer surface." The opening angle θ can also be said to be an angle formed by the inner surface of the first housing 101 and the inner surface of the second housing 102. A state in which the first housing 101 and the second housing 102 are open relative to the closed state is referred to as an "open state." The open state is a state in which the first housing 101 and the second housing 102 are rotated relatively until the opening angle θ becomes larger than a preset threshold value (for example, 10°).
[0023] The information processing device 10 also includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided from the inner surface of the first housing 101 to the inner surface of the second housing 102. The camera 16 is provided, for example, on the outer side of the screen area of the display 150 on the inner surface of the first housing 101, and can capture an image of a user or the like present on the side facing the display 150. The display 150 is a flexible display that can be bent according to an opening angle θ due to relative rotation between the first housing 101 and the second housing 102 (see FIGS. 2 and 3). As the flexible display, an organic EL display or the like is used. The information processing device 10 can control the display of the entire screen area of the display 150 as one display area DA as a single screen configuration, or can control the display of the screen area of the display 150 as a two-screen configuration by dividing the screen area into two display areas, a first display area DA1 and a second display area DA2. Here, the first display area DA1 and the second display area DA2 are display areas that do not overlap with each other. Here, the display area of the screen area of the display 150 that corresponds to the inner surface side of the first housing 101 is the first display area DA1, and the display area that corresponds to the inner surface side of the second housing 102 is the second display area DA2. Hereinafter, the display mode that controls the display in a single screen configuration is referred to as the "single screen mode," and the display mode that controls the display in a dual screen configuration is referred to as the "dual screen mode."
[0024] A touch sensor is provided above the screen area of the display 150. The information processing device 10 can detect a touch operation on the screen area of the display 150. By opening the information processing device 10, the user can view the display 150 provided on the inner surface of each of the first housing 101 and the second housing 102 and can perform a touch operation on the display 150, thereby enabling the user to use the information processing device 10.
[0025] Next, the use form and the screen mode of the information processing device 10 will be described in detail. First, the use form of the information processing device 10 is divided into a state in which the first housing 101 and the second housing 102 are bent (Bent form) and a state in which the first housing 101 and the second housing 102 are not bent (Flat form) depending on the opening angle θ between the first housing 101 and the second housing 102. Hereinafter, the state in which the first housing 101 and the second housing 102 are bent (Bent form) is simply referred to as the "Bent form", and the state in which the first housing 101 and the second housing 102 are not bent (Flat form) is simply referred to as the "Flat form". In the bent form, the display 150 provided across the first housing 101 and the second housing 102 is also bent. In the flat form, the display 150 is also flat.
[0026] FIG. 2 is a side view showing an example of the information processing device 10 in a bent state (bent form). The display 150 is arranged across (straddling) the first housing 101 and the second housing 102. The screen area of the display 150 (display area DA shown in FIG. 1) can be bent (bent) at a crease at a portion corresponding to the hinge mechanism 103, and the display area on the first housing 101 side and the second housing 102 side of the crease are shown as a first display area DA1 and a second display area DA2, respectively. The display 150 bends according to the rotation (opening angle θ) of the first housing 101 and the second housing 102. The information processing device 10 determines whether or not it is in a bent state (bent form) according to the opening angle θ. For example, when 10°<θ<170°, the information processing device 10 determines that it is in a bent state (bent form). This state corresponds to a usage form called a clamshell mode or a book mode.
[0027] 3 is a side view showing an example of the information processing device 10 in a flat form. The information processing device 10 typically determines that it is in a flat form when the opening angle θ is 180°, but as an example, it may determine that it is in a flat form when 170°≦θ≦180°. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat form. This state corresponds to a usage form called a tablet mode.
[0028] Next, display modes according to various usage patterns of the information processing device 10 will be described in detail with reference to FIG. 4 is a diagram showing specific examples of various display modes of the information processing device 10 according to this embodiment. The information processing device 10 has different display modes depending on the usage form classified by the opening angle θ between the first housing 101 and the second housing 102, the attitude (direction) of the information processing device 10, whether it is a single-screen mode or a dual-screen mode, etc. Note that one screen is also called a single screen, and two screens are also called a split screen or dual screen.
[0029] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage form. For example, in this closed state, the information processing device 10 is in a standby state such as a sleep state or a hibernation state, and the display 150 is in a display-off state. This standby state such as a sleep state or a hibernation state corresponds to, for example, a system power state S3 or S4 defined by ACPI (Advanced Configuration and Power Interface).
[0030] The display mode (b) is a display mode in which the display 150 is in a bent state (bent form) and in a dual screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled. The orientation of the information processing device 10 is such that the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. The display area is vertically oriented when the long side of the four sides of the rectangular display area is vertical and the short side is horizontal. When the display area is vertically oriented, the display orientation is also vertical, and the direction along the long side corresponds to the up-down direction and the direction along the short side corresponds to the left-right direction. This usage mode is such that the left and right pages of a book when it is opened correspond to the left and right screens, and corresponds to a so-called book mode. This usage form is also called "Fold Landscape" because the display is bent, the first display area DA1 and the second display area DA2 are arranged side by side, and the combined display area is long horizontally.
[0031] In this display mode (b), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode, with the first display area DA1 on the left side as the primary screen and the second display area DA2 on the right side as the secondary screen. Note that in the display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.
[0032] The display mode (c-1), like the display mode (b), is a display mode in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, for display control, but the orientation of the information processing device 10 is different. The orientation of the information processing device 10 is an orientation in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically above and below. The display area being horizontal means that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display orientation is also horizontal, and the direction along the short side corresponds to the vertical direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the general usage modes of a clamshell type PC.
[0033] In this display mode (c-1), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode in which the first display area DA1 is the primary screen and the second display area DA2 is the secondary screen. Note that in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.
[0034] For example, the information processing device 10 automatically switches from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure with respect to the display mode (b), the information processing device 10 switches to display mode (c-1) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (b) state. Also, since the display mode (b) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure with respect to the display mode (c-1), the information processing device 10 switches to display mode (b) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (c-1) state.
[0035] The display mode (c-2) is the same as the display mode (c-1) in that the information processing device 10 is in the bent form and the orientation is the same, but it is different in that an external keyboard 30 (Dockable mini KBD: Keyboard) connectable to the information processing device 10 is connected. This usage mode is a state in which a physical keyboard 30 is connected to a general usage mode of a clamshell type PC. For example, the keyboard 30 is almost the same size as the second display area DA2 and is configured to be able to be placed on the second display area DA2. As an example, the keyboard 30 has a magnet provided inside (end) of the bottom surface, and when placed on the second display area DA2, it is attracted to and fixed to a metal part at the end of the inner surface of the second housing 102. This results in a usage mode similar to that of a conventional clamshell type PC that is originally provided with a physical keyboard. In addition, the information processing device 10 and the keyboard 30 are connected by, for example, Bluetooth (registered trademark). In this display mode (c-2), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because the second display area DA2 cannot be seen due to the keyboard. In other words, this display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as "half screen mode"), and is a one-screen mode that uses only the first display area DA1.
[0036] For example, when the information processing device 10 detects a connection to an external keyboard in the display mode (c-1), the display mode is automatically switched from the display mode (c-1) to the display mode (c-2) (Switch by Dock).
[0037] Display mode (d) is in a bent state (Bent form) like display mode (b), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the entire screen area of the display 150 is controlled as a single display area DA. This usage form is different from display mode (b) in that it is a single screen mode, but since it is in a bent state (Bent form) and the display area DA is horizontally long, it is also called "Fold Landscape". The display area DA is horizontal, and the display orientation is also horizontal.
[0038] Here, switching between the single screen mode and the dual screen mode in the bent state (Bent form) is performed, for example, by a user operation. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single screen mode and the dual screen mode at any location on the screen, and switches from display mode (b) to display mode (d) based on an operation on the operator (Switch by UI). A specific example of this display mode switching operation will be described later.
[0039] Display mode (e) is in a bent state (bent form) like display mode (c-1), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the display is controlled with the entire screen area of the display 150 as a single display area DA. This usage mode differs from display mode (c-1) in that it is a single screen mode, but it corresponds to the usage mode of a clamshell type PC from the bent state (bent form) and the orientation of the information processing device 10. The display area DA is vertical, and the display orientation is also vertical.
[0040] For example, the information processing device 10 automatically switches from display mode (d) to display mode (e) or from display mode (e) to display mode (d) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d), the information processing device 10 switches to display mode (e) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d) state. Also, since the display mode (d) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e), the information processing device 10 switches to display mode (d) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e) state.
[0041] The display mode (d') is a single screen mode similar to the display mode (d), and the orientation of the information processing device 10 is also a landscape orientation with the display area DA, but is different in that it is in a flat state (Flat form). The flat state (Flat form) is a state in which the opening angle θ between the first housing 101 and the second housing 102 is approximately 180°. This usage form corresponds to the so-called tablet mode described with reference to FIG. 3, and is also called "Flat Landscape" because it is in a flat state (Flat form) and the display area DA is landscape. This display mode (d') is different from the display mode (d) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to the display mode (d), the display area DA is landscape, and the display orientation is also landscape.
[0042] Display mode (e') is a single screen mode similar to display mode (e), and the orientation of the information processing device 10 is also vertically long in the display area DA, but it is different in that it is in a flat state (Flat form). This usage form is also called "Flat Portrait" because it is in a flat state (Flat form) and the display area DA is vertically long. This display mode (e') differs from display mode (e) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to display mode (e), the display area DA is vertically long, and the display orientation is also vertical.
[0043] For example, the information processing device 10 automatically switches from display mode (d') to display mode (e') or from display mode (e') to display mode (d') by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e') is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d'), the information processing device 10 switches to display mode (e') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d'). Also, since the display mode (d') is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e'), the information processing device 10 switches to display mode (d') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e').
[0044] In display mode (d') and display mode (e'), it is also possible to switch to dual screen mode while remaining in flat form by the user operating an operator (for example, a display mode switching icon, described later with reference to FIG. 5) as a UI capable of switching between the single screen mode and dual screen mode. For example, when switching from display mode (d') to dual screen mode, the display state in flat form becomes the same as display mode (b). Also, when switching from display mode (e') to dual screen mode, the display state in flat form becomes the same as display mode (c-1).
[0045] Furthermore, when the information processing device 10 detects a connection to the keyboard 30 in the display mode (e'), it automatically switches from the display mode (e') to the display mode (c-2') (Switch by Dock). The display mode (c-2') is a flat state (Flat form), and differs from the display mode (c-2) only in the opening angle θ between the first housing 101 and the second housing 102. In this display mode (c-2'), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off, since it cannot be seen by the keyboard. In other words, this display mode (c-2') is a half screen mode in which only half of the screen is effective for display, similar to the display mode (c-2).
[0046] Furthermore, the information processing device 10 can automatically switch from the single screen mode to the dual screen mode by detecting a change from a flat state (Flat form) to a bent state (Bent form) (Switch by Hinge angle). For example, when the information processing device 10 detects a change to a bent state (Bent form) in the display mode (d') based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (d') to the display mode (b). Furthermore, when the information processing device 10 detects a change to a bent state (Bent form) in the display mode (e') based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (e') to the display mode (c-1).
[0047] (Display mode switching operation) Next, a specific example of operation specifications when the display mode is switched by a user operation will be described. FIG. 5 is a diagram showing an example of the operation specifications of the display mode switching operation according to the present embodiment. For example, as shown in FIG. 5(A), an icon C1 for displaying a display mode switching menu is displayed in a task bar B2. The task bar B2 is displayed somewhere within the screen area of the display 150. For example, whether in the single screen mode or the dual screen mode, the task bar B2 is displayed only in one place (for example, at the bottom of the screen area) within the screen area of the display 150. Note that in the dual screen mode, the task bar B2 may be displayed in each of the first display area DA1 and the second display area DA2 (for example, at the bottom of each).
[0048] When an operation is performed on the icon C1 that displays the switching menu, the display mode switching menu is displayed as a pop-up screen. The display mode switching menu may be displayed as a pop-up screen when the display mode changes from a bent form to a flat form. The display mode switching menu may be displayed as a pop-up screen when the display mode changes from a flat form to a bent form.
[0049] In the switching menu, display mode switching icons are displayed as display mode options, allowing the user to instruct switching between single screen mode and dual screen mode, and switching between display data to be displayed in the first display area DA1 and the second display area DA2 in the dual screen mode (switching between the primary screen and the secondary screen). In the switching menu, options of display modes that the user can select depending on the usage mode (the orientation of the display 150) at that time are displayed.
[0050] FIG. 5B shows a switching menu M1 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.). Note that "1" and "2" in the figure are added to distinguish the display areas, and are expressed by numbers according to the priority order of the areas preset for each display area. For example, in the dual screen mode, "1" has a higher priority order than "2", and indicates, for example, the primary screen, and "2" indicates the secondary screen. The switching menu M1 displays a display mode switching icon C11, a display mode switching icon C12, and a display mode switching icon C13. The display mode switching icon C11 is displayed as an operator for selecting the display mode (d) and the display mode (d') of the single screen mode (i.e., an icon that accepts a user's operation for switching to the single screen mode). The display mode switching icon C12 and the display mode switching icon C13 are displayed as controls for selecting the display mode (b) of the dual-screen mode, and the order of "1" (primary screen) and "2" (secondary screen) is different between the display mode switching icon C12 and the display mode switching icon C13.
[0051] The display mode switching icon corresponding to the current display mode is displayed in a manner that allows it to be distinguished from other display mode switching icons. Here, the display mode switching icon C11 is highlighted relative to the other display mode switching icons C12 and C13 so that it can be seen that it is the current display mode. In this figure, the highlighting is shown by hatching, but it may be shown by using different colors, contrast, size, frame thickness, etc., or by adding marks, text, etc.
[0052] FIG. 5(C) shows a switching menu M2 that is displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). In the switching menu M2, a display mode switching icon C21, a display mode switching icon C22, and a display mode switching icon C23 are displayed. The display mode switching icon C21 is displayed as an operator for selecting the single screen mode (display mode (e) and display mode (e')). The display mode switching icon C22 and the display mode switching icon C23 are displayed as operators for selecting the display mode (c-1) of the dual screen mode, and the order of "1" (primary screen) and "2" (secondary screen) is different in the display mode switching icon C22 and the display mode switching icon C23.
[0053] 5B, the display mode switching icon corresponding to the current display mode is displayed in a manner that allows it to be distinguished from the other display mode switching icons. Here, the display mode switching icon C21 is highlighted relative to the other display mode switching icons C22 and C23 so that it can be seen that the display mode switching icon C21 is the current display mode.
[0054] The user can arbitrarily select any one of the display mode switching icons displayed in the switching menu M1 or the switching menu M2. When the user selects any one of the display mode switching icons, the display of the switching menu is terminated. Alternatively, when the user does not select any of the display mode switching icons even after a predetermined time (e.g., 3 to 5 seconds) has elapsed since the switching menu M1 or the switching menu M2 was displayed, the display of the switching menu is terminated. Also, when the user operates the close button "x" in the upper right of the switching menu, when the user operates outside the screen of the popped-up switching menu, or when the orientation of the information processing device 10 is changed, the display of the switching menu is terminated. Note that, when the keyboard 30 is connected, the display is fixed to the half screen mode (display mode (c-2)) in which only the first display area DA1 is enabled, and therefore the switching menu is not displayed.
[0055] The UI for switching between the single-screen mode and the dual-screen mode is not limited to the example shown in Fig. 5, and any UI can be used. For example, an icon that alternates between the single-screen mode and the dual-screen mode each time it is operated, or an icon that alternates between the single-screen mode, the dual-screen mode, and the inverted dual-screen mode each time it is operated may be displayed on the task bar B2. In the following description, when there is no particular distinction between the dual-screen mode and the inverted dual-screen mode, they are collectively referred to as the dual-screen mode.
[0056] In the example shown in Fig. 5, the display mode switching menu is displayed as a pop-up screen by an operation on the icon C1 displayed on the taskbar B2, but the switching menu may be displayed as a pop-up screen by a drag operation on the application window, etc. Also, the display mode may be switched by a drag operation on the application window, etc. When the switching menu is popped up by a drag operation on the application window, it is possible to select not only the screen mode but also the screen area by dragging onto one of the divided areas of the screen area displayed in the switching menu, and the dragged application may be placed in the selected area. Also, the switching menu may be displayed as a pop-up screen by an operation on a specific location of the application window.
[0057] (Display control when switching from single screen mode to dual screen mode) Next, display control when switching from single screen mode to dual screen mode will be described. When switching from single screen mode to dual screen mode, the information processing device 10 displays one of the windows of an application (hereinafter simply referred to as an "app") that was executed in the single screen mode in the first display area DA1 (e.g., the primary screen). For example, the information processing device 10 displays an active window of the windows of the app that was executed in the single screen mode in the first display area DA1.
[0058] Here, when multiple windows are open, the individual windows are arranged in multiple layers on display 150. The active window is a window that is currently selected and is the object of the user's operation, and is, for example, a window that is arranged and displayed in the foreground layer (top layer) of display 150. The active window that information processing device 10 displays in first display area DA1 when switching from single-screen mode to dual-screen mode is the window that was displayed as the active window in the single-screen mode immediately before switching to the dual-screen mode.
[0059] When information processing device 10 switches from single screen mode to dual screen mode, it displays the active window in single screen mode in first display area DA1, but if there is no active window, it displays in first display area DA1 the window with the highest priority among the windows displayed in display area DA in single screen mode.
[0060] The window with the highest priority is typically the active window, but if there is no active window, it is the window that was last to become active. For example, when an operation is performed on a part other than a window in the display area DA, there is no active window, but the window that was last to become active is displayed in the first display area DA1. In other words, the later the window is in the active window, the higher its display priority, and the window with the highest priority is displayed in the first display area DA1. However, for ease of understanding, in the following explanation, the window with the highest priority will be described as the "active window."
[0061] Furthermore, when the information processing device 10 switches from the single screen mode to the dual screen mode, it displays in the second display area DA2 (e.g., the secondary screen) thumbnail images corresponding to inactive windows excluding the active window among the windows in the single screen mode. Here, the inactive windows are windows other than the active window in the single screen mode immediately before transitioning to the dual screen mode. Hereinafter, the window in which the thumbnail images of the inactive windows are displayed is also referred to as the "thumbnail window."
[0062] With reference to FIG. 6, a display example in the dual-screen mode in which a thumbnail window is displayed in the second display area DA2 when the single-screen mode is switched to the dual-screen mode will be described. FIG. 6 is a diagram showing a display example of the dual screen mode according to this embodiment. Here, a display example of the dual screen mode in the display mode (c-1) shown in FIG. 4 is shown. This is a typical dual screen mode usage form of a clamshell type PC, in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. The display area is horizontally oriented, meaning that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. The vertical direction corresponds to the vertical (up and down) direction, and the horizontal direction corresponds to the horizontal (left and right) direction. The vertical direction is typically the vertical direction. That is, the first display area DA1 and the second display area DA2 are arranged so that the edge on the lower side in the display orientation of the first display area DA1 is the edge on the upper side in the display orientation of the second display area DA2.
[0063] When the information processing device 10 switches from the single screen mode to the dual screen mode, the information processing device 10 displays the active window of the application running in the single screen mode in the first display area DA1. For example, when the information processing device 10 transitions to the dual screen mode, the information processing device 10 maximizes the active window that was displayed in the display area DA in the single screen mode to the entire display area of the first display area DA1 and displays it as the active window. Also, when the information processing device 10 transitions to the dual screen mode, the information processing device 10 causes a window that was an inactive window in the single screen mode to correspond to a layer behind the foreground where the active window in the first display area DA1 is displayed, while maintaining the layer relationship (window overlap order) in the single screen mode. Therefore, in the first display area DA1, the active window is maximized and displayed, and the inactive window is not displayed (is not visible to the user) although it exists in a layer behind the active window.
[0064] Furthermore, when switching from single screen mode to dual screen mode, information processing device 10 generates thumbnail images of windows that were inactive in single screen mode and displays the thumbnail windows in second display area DA2 (secondary screen). When there are multiple inactive windows, information processing device 10 displays a thumbnail window in which thumbnail images of the multiple inactive windows are arranged in second display area DA2.
[0065] For example, a thumbnail window displays thumbnail images (reduced images) of multiple windows side by side. A title bar B1 is displayed at the top of the thumbnail window. A close button "X" at the right end of the title bar B1 is displayed as an operator for closing the thumbnail window. A user can close (hide) all of the thumbnail images by operating (for example, tapping) the close button "X" of the title bar B1.
[0066] In addition, an inactive window (i.e., the main body (real window) of an inactive window whose thumbnail image is displayed in the second display area DA2) existing in a layer behind an active window in the first display area DA1 may be arranged in the same size as the active window so as to be hidden behind the active window in accordance with the priority order, or may be arranged in a size smaller than the active window so as to be arranged in the same size as the active window in accordance with the priority order. In addition, an inactive window (i.e., the main body (real window) of an inactive window whose thumbnail image is displayed in the second display area DA2) may be once minimized (for example, in Windows (registered trademark), a state in which only the icon of the application exists on the taskbar), or may be arranged behind the thumbnail window if it is not semi-transparent (see-through) display. In short, the main body (real window) of an inactive window whose thumbnail image is displayed in the second display area DA2 may be once processed so as not to be visible to the user. Then, in the second display area DA2, the window of the application whose thumbnail image is selected in the thumbnail window is displayed in the foreground as the active window.
[0067] Furthermore, the task bar B2 displayed at the bottom end of the second display area DA2 corresponds to the task bar B2 shown in Fig. 5, and is displayed in one place as a task bar common to the first display area DA1 and the second display area DA2. The position at which the task bar B2 is displayed may be the left or right end of the first display area DA1 or the second display area DA2, or may be the top end of the first display area DA1. As described above, a task bar may be displayed in each of the first display area DA1 and the second display area DA2. The position at which the task bar is displayed does not limit the application of the present invention.
[0068] In addition, in FIG. 6, an example is shown in which when a thumbnail image is displayed in the second display area DA2, it is displayed as a thumbnail window including a title bar B1, but the title bar B1 does not have to be displayed, and multiple thumbnail images may simply be displayed side by side.
[0069] When any thumbnail image is selected by a user operation (e.g., a tap operation), the information processing device 10 closes (hides) the thumbnail window that was displayed in the second display area DA2, and displays an inactive window corresponding to the selected thumbnail image as an active window in the second display area DA2. Specifically, as an example, the information processing device 10 moves the inactive window corresponding to the selected thumbnail image from the first display area DA1 to the second display area DA2, and then maximizes it in the second display area DA2 to display it as the active window.
[0070] Here, in the case where there is one window in the single screen mode, when the information processing device 10 switches from the single screen mode to the dual screen mode, it displays the active window in the first display area DA1, but does not display a thumbnail window in the second display area DA2 because there is no thumbnail image to display in the second display area DA2. For example, in the second display area DA2, no window is displayed and only the desktop screen is displayed.
[0071] Also, in the case where there are two windows in the single screen mode, when the information processing device 10 switches from the single screen mode to the dual screen mode, it displays the active window in the first display area DA1, and displays an inactive window other than the active window in the second display area DA2, rather than displaying a thumbnail window. This is to avoid the need to take the trouble of selecting one thumbnail image for displaying the window of the thumbnail image, even if a thumbnail image of the only inactive window is displayed in the second display area DA2, which would make the operation complicated. It is more convenient to display the only inactive window as an inactive window in the second display area DA2, rather than displaying it as a thumbnail image and accepting a selection operation, since it is not necessary to take the trouble of selecting a thumbnail image.
[0072] In other words, when the information processing device 10 switches from single screen mode to dual screen mode, it controls whether or not to display thumbnail windows (thumbnail images) in the second display area DA2 based on the number of windows of the application that were running in the single screen mode.
[0073] FIG. 7 is a diagram showing a first example of display control when switching from single screen mode to dual screen mode according to this embodiment. FIG. 7(A) shows a display example in single screen mode, and FIG. 7(B) shows a display example after switching to dual screen mode. In the illustrated example, the number of windows of an application executed in single screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA. The window W1 is an active window arranged in the foreground layer (top layer). When switching from single screen mode to dual screen mode, the window W1 is maximized and displayed as an active window in the first display area DA1, and a thumbnail window in which thumbnail images SW2 and SW3 of the windows W2 and W3 are arranged is displayed in the second display area DA2. Note that if the number of windows of an application executed in single screen mode is four or more, the number of thumbnail images displayed in the second display area DA2 when switching to dual screen mode will also be three or more.
[0074] FIG. 8 is a diagram showing a second example of display control when switching from the single screen mode to the dual screen mode according to the present embodiment. FIG. 8(A) shows a display example in the single screen mode, and FIG. 8(B) shows a display example after switching to the dual screen mode. In the illustrated example, the number of windows of an application executed in the single screen mode is two. Here, two windows W1 and W2 are shown in the display area DA. The window W1 is an active window arranged in the foreground layer (top layer). When switching from the single screen mode to the dual screen mode, the window W1 is maximized and displayed as an active window in the first display area DA1, and the window W2 is maximized and displayed as an inactive window in the second display area DA2. Note that if the number of windows of an application executed in the single screen mode is one or less, neither the window of the application nor the thumbnail window (thumbnail image of the window) is displayed in the second display area DA2 when switching to the dual screen mode.
[0075] In this way, when information processing device 10 switches from single screen mode to dual screen mode, if the number of windows in single screen mode is more than two (the number of display areas in dual screen mode), it displays in second display area DA2 a thumbnail window in which thumbnail images of windows in single screen mode excluding the active window are arranged. On the other hand, when information processing device 10 switches from single screen mode to dual screen mode, if the number of windows in single screen mode is two or less (the number of display areas in dual screen mode), it does not display a thumbnail window, and if the number of windows in single screen mode is two, it displays inactive windows in single screen mode in second display area DA2.
[0076] In other words, when the information processing device 10 switches from single-screen mode to dual-screen mode, it controls whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the dual-screen mode and the number of windows in the single-screen mode.
[0077] Note that the window of an application running in single-screen mode may be minimized. In that case, the minimized window does not need to be included in the number of windows in single-screen mode.
[0078] For example, if window W3 is minimized in the single-screen mode shown in FIG. 7(A), the number of windows in the single-screen mode may be two, windows W1 and W2, and when switching to the dual-screen mode, window W1 may be maximized and displayed as the active window in the first display area DA1, and window W2 may be maximized and displayed as the inactive window in the second display area DA2, as shown in FIG. 8(B).
[0079] Here, when there are many windows of running apps, the user can conveniently display the window by selecting any thumbnail image, but there may be cases where the user wants to switch to another window or specify either the first display area DA1 or the second display area DA2 when displaying a window.
[0080] Therefore, the information processing device 10 according to the present embodiment can display (re-display) a thumbnail image of a window of a running application by a user performing a predetermined operation. Hereinafter, the predetermined operation for displaying (re-displaying) this thumbnail image is referred to as a "thumbnail display operation."
[0081] Fig. 9 is a diagram showing a first example of thumbnail display operation according to this embodiment. The switching menu M2 shown in this figure corresponds to the switching menu M2 shown in Fig. 5(C). The switching menu M2 shown in Fig. 9 is displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.), and indicates that the current display mode is the dual-screen mode corresponding to the display mode switching icon C22.
[0082] The display mode switching icon C22 is the current display mode, and is therefore highlighted relative to the other display mode switching icons C21 and C23. As described with reference to FIG. 5, the display mode switching icons C21 and C23 function as controls that accept a user's operation for switching to the respective display modes. On the other hand, the display mode switching icon C22, which is the current display mode, does not need to function as an operator for switching the display mode, and therefore functions as an operator for displaying thumbnail images (thumbnail window). That is, the display mode switching icon C22, which is the current display mode, is displayed as an icon that accepts a thumbnail display operation. For example, FIG. 10 shows an example of display control in which a user performs an operation to select the display area indicated by "2" (second display area DA2) in this display mode switching icon C22 to display a thumbnail window in the second display area DA2.
[0083] Fig. 10 is a diagram showing a first example of display control by thumbnail display operation according to this embodiment. Fig. 10(A) shows an example in which a window W1 is maximized and displayed in the first display area DA1, and a window W2 is maximized and displayed in the second display area DA2 in the dual screen mode. For example, when an operation is performed to select the thumbnail image SW2 of the thumbnail images SW2 and SW3 displayed in the second display area DA2 in Fig. 7(B), the display state shown in Fig. 10(A) is controlled. Note that Fig. 10(A) is also the display state shown in Fig. 8(B).
[0084] In the display state shown in Fig. 10(A), when the user performs an operation to select the display area (second display area DA2) indicated by "2" of the display mode switching icon C22 as shown in Fig. 9, a thumbnail window is displayed in the second display area DA2 as shown in Fig. 10(B). At this time, all thumbnail images of the windows of the running application are displayed in the thumbnail window in the second display area DA2. For example, as shown in Fig. 7, when the number of windows of the running application is three (windows W1, W2, W3), when a thumbnail display operation is performed, three thumbnail images (thumbnail images SW1, SW2, SW3) are displayed as shown in Fig. 10(B).
[0085] With reference to Figures 9 and 10, thumbnail display operations when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e´), etc.) have been described. However, thumbnail display operations can also be performed in a similar manner using the switching menu M1 shown in Figure 5 (B) when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d´), etc.).
[0086] Also, with reference to Figures 9 and 10, an example of specifying the second display area DA2 by a thumbnail display operation to display a thumbnail window has been explained. Next, with reference to Figures 11 and 12, an example of specifying the first display area DA1 to display a thumbnail window will be explained.
[0087] Fig. 11 is a diagram showing a second example of thumbnail display operation according to this embodiment. The switching menu M2 shown in this figure is similar to the example shown in Fig. 9, and indicates that the current display mode is the dual-screen mode corresponding to the display mode switching icon C22. Fig. 12 shows an example of display control in which a thumbnail window is displayed in the first display area DA1 by the user performing an operation to select the display area indicated by "1" (first display area DA1) in this display mode switching icon C22.
[0088] FIG. 12 is a diagram showing a second example of display control by thumbnail display operation according to this embodiment. FIG. 12(A) shows an example in which a window W1 is maximized and displayed in the first display area DA1 and a window W2 is maximized and displayed in the second display area DA2 in the dual screen mode, similarly to FIG. 10(A). In the display state shown in FIG. 12(A), when the user performs an operation to select the display area (first display area DA1) indicated by "1" of the display mode switching icon C22 as shown in FIG. 11, a thumbnail window is displayed in the first display area DA1 as shown in FIG. 12(B). At this time, all thumbnail images of the windows of the running application are displayed in the thumbnail window in the first display area DA1. For example, when the number of windows of the running application is three (windows W1, W2, W3), when a thumbnail display operation is performed, three thumbnail images (thumbnail images SW1, SW2, SW3) are displayed as shown in FIG. 10(B).
[0089] The thumbnail display operation may be effective even when the thumbnail window is displayed. FIG. 13 is a diagram showing a third example of display control by the thumbnail display operation according to this embodiment. FIG. 13(A) shows an example in which the window W1 is displayed in the first display area DA1 and the thumbnail window is displayed in the second display area DA2 in the dual screen mode as shown in FIG. 7(B). In the display state shown in FIG. 13(A), when the user performs an operation to select the display area (first display area DA1) indicated by "1" of the display mode switching icon C22 as shown in FIG. 11, the thumbnail window is displayed in the first display area DA1 as shown in FIG. 13(B). At this time, unlike the thumbnail window in the second display area DA2, all thumbnail images of the windows of the running application are displayed in the thumbnail window in the first display area DA1. For example, when the number of windows of the running application is three (windows W1, W2, W3), when the thumbnail display operation is performed, three thumbnail images (thumbnail images SW1, SW2, SW3) are displayed as shown in FIG. 10(B).
[0090] In this way, when a display area is specified by a thumbnail display operation to display a thumbnail window, a window to be displayed in the specified display area can be selected from among the windows of a running application, regardless of whether the window is an active window or an inactive window.
[0091] (Configuration of information processing device 10) The specific configuration of the information processing device 10 will be described below. 14 is a block diagram showing an example of a hardware configuration of an information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, and a control unit 18. These units are connected to each other so as to be able to communicate with each other via a bus or the like.
[0092] The communication unit 11 includes, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), and a communication device that performs wireless communication such as Bluetooth (registered trademark) and Wi-Fi (registered trademark). For example, the communication unit 11 can communicate with the above-mentioned external keyboard 30, etc., using Bluetooth (registered trademark).
[0093] In the RAM 12, programs and data for processing executed by the control unit 18 are deployed, and various data are appropriately saved or erased. For example, the RAM 12 also functions as a video memory (V-RAM) for display of the display 150. As an example, the RAM 12 functions as a video memory for data displayed in each display area when the display 150 is controlled in a single screen mode or a dual screen mode. The RAM 12 also stores information on running apps, apps in use (active window apps) among the running apps, information on other inactive window apps, in which display area each window is displayed, in which layer each window is arranged, the size of the window, whether it is minimized, and the like. Note that the RAM 12 is a volatile memory, and therefore does not hold data when power supply to the RAM 12 is stopped. Data that needs to be held when power supply to the RAM 12 is stopped is transferred to the storage unit 13.
[0094] The storage unit 13 is configured to include one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Residual Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores programs and setting data for a BIOS (Basic Input Output System), an OS (Operating System), programs for applications that run on the OS, and various data used by the applications. The speaker 14 outputs electronic sounds, voices, and the like.
[0095] The display unit 15 includes a display 150 and a touch sensor 155. As described above, the display 150 is a flexible display that can be bent according to the opening angle θ caused by the relative rotation of the first housing 101 and the second housing 102. The display 150 performs display corresponding to each display mode described with reference to FIG. 4 according to the control of the control unit 18. The touch sensor 155 is provided on the screen of the display 150 and detects a touch operation on the screen. For example, the touch sensor 155 detects a touch operation on the display area DA in the single screen mode. Also, the touch sensor 155 detects a touch operation on one or both of the first display area DA1 and the second display area DA2 in the dual screen mode. The touch operation includes a tap operation, a slide operation, a flick operation, a swipe operation, a pinch operation, and the like. The touch sensor 155 detects the touch operation and outputs operation information based on the detected operation to the control unit 18.
[0096] Camera 16 includes a lens, an imaging element, etc. Camera 16 captures an image (a still image or a video) according to the control of control unit 18, and outputs data of the captured image.
[0097] First acceleration sensor 161 is provided inside first housing 101, and detects the orientation and changes in orientation of first housing 101. For example, if a direction parallel to the longitudinal direction of first display area DA1 is defined as an X1 direction, a direction parallel to the lateral direction is defined as a Y1 direction, and a direction perpendicular to the X1 and Y1 directions is defined as a Z1 direction, first acceleration sensor 161 detects acceleration in each of the X1, Y1, and Z1 directions, and outputs the detection results to control unit 18.
[0098] The second acceleration sensor 162 is provided inside the second housing 102, and detects the orientation and changes in orientation of the second housing 102. For example, if the direction parallel to the longitudinal direction of the second display area DA2 is the X2 direction, the direction parallel to the lateral direction is the Y2 direction, and the direction perpendicular to the X2 and Y2 directions is the Z2 direction, the second acceleration sensor 162 detects acceleration in each of the X2, Y2, and Z2 directions, and outputs the detection results to the control unit 18.
[0099] The hall sensor 17 is provided to detect the connection of the keyboard 30. For example, when the keyboard 30 is placed on the second display area DA2 of the second housing 102, a magnet provided inside the bottom surface of the keyboard 30 approaches, changing the magnetic field, and the detection value (output value) of the hall sensor 17 changes. In other words, the hall sensor 17 outputs a different detection result depending on whether the keyboard 30 is placed. Note that, although the hall sensor 17 is used here to detect whether the keyboard 30 is placed, the detection method is not limited to this, and any detection method can be used.
[0100] The control unit 18 includes a processor such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and realizes various functions by executing programs (various programs such as a BIOS, an OS, and applications that run on the OS) stored in the storage unit 13, etc. For example, the control unit 18 detects the attitude (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Furthermore, the control unit 18 detects whether the information processing device 10 is in an open state or a closed state, and if in an open state, whether the information processing device 10 is in a bent form or a flat form, based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.
[0101] Furthermore, the control unit 18 detects a display mode switching operation by the user (for example, an operation on a display mode switching icon shown in FIG. 5). Furthermore, the control unit 18 detects a connection with the keyboard 30 based on the detection result of the hall sensor 17. Note that this connection with the keyboard 30 refers to placing the keyboard 30 on the second display area DA2, and does not refer to a communication connection. The control unit 18 detects the communication connection with the keyboard 30 using a function such as Bluetooth (registered trademark).
[0102] In addition, the control unit 18 controls the display of the display 150 described with reference to FIG. 4 and FIGS. 6 to 13 by detecting the state of the system, the attitude (orientation) of the information processing device 10, whether it is in an open or closed state, and if in an open state, whether it is in a bent form or a flat form, a display mode switching operation by the user (see FIG. 5), connection to the keyboard 30, etc.
[0103] Next, a functional configuration related to the display control process among the processes executed by the control unit 18 will be described. 15 is a block diagram showing an example of a functional configuration related to the display control process according to the present embodiment. The control unit 18 includes a system processing unit 181, a detection processing unit 182, and a display processing unit 183. Here, the system processing unit 181 is a functional configuration in which a CPU executes processing based on, for example, an OS or a BIOS. The detection processing unit 182 is a functional configuration in which a microcomputer other than the CPU that executes processing such as an OS or a BIOS executes various detection processes. The display processing unit 183 is a functional configuration in which a CPU executes processing based on, for example, an OS or a program that runs on the OS.
[0104] The system processing unit 181 executes various programs such as an OS and drivers and applications that run on the OS. The system processing unit 181 also includes, for example, an active application information generating unit 1811. The active application information generating unit 1811 generates application information including identification information (for example, an application ID) of an active application and information indicating an application being used by a user among the active applications (i.e., an application whose window is active). The active application information generating unit 1811 also generates window information indicating the window state of the active application. The window state indicates whether or not the window is an active window, the window size (minimized, maximized, etc.), etc. The active application information generating unit 1811 stores and holds the generated application information and window information in the RAM 12.
[0105] The detection processing unit 182 includes an open / close detection unit 1821, a posture detection unit 1822, and a connection detection unit 1823 as functional configurations for detecting the state of the information processing device 10. The detection processing unit 182 outputs detection results by the open / close detection unit 1821, the posture detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.
[0106] The open / close detection unit 1821 detects whether the information processing device 10 is in an open state or a closed state based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. When the information processing device 10 is in an open state, the open / close detection unit 1821 detects an open angle θ between the first housing 101 and the second housing 102 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Then, the open / close detection unit 1821 detects whether the information processing device 10 is in a bent form or a flat form based on the detected open angle θ.
[0107] The attitude detection unit 1822 detects the attitude (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.
[0108] The connection detection unit 1823 detects a connection with the keyboard 30. For example, the connection detection unit 1823 detects whether or not the keyboard 30 is placed on the second display area DA2 based on the detection result of the hall sensor 17, thereby detecting the connection with the keyboard 30. The detection processing unit 182 outputs the detection results (states of the information processing device 10) by the open / close detection unit 1821, the attitude detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.
[0109] The detection processing unit 182 also includes an operation detection unit 1824 as a functional configuration for detecting an operation on the information processing device 10. The operation detection unit 1824 detects a user's operation based on operation information output from a touch sensor 155 provided on the screen of the display 150. For example, the operation detection unit 1824 acquires operation information based on a user's operation on a switching menu screen (see FIGS. 5, 9, and 11) on which an operation for switching a display mode or a thumbnail display operation is possible, and detects a display mode switching operation or a thumbnail display operation by the user to switch the display mode based on the acquired operation information. The detection processing unit 182 outputs the detected user's operation information to the display processing unit 183.
[0110] The display processing unit 183 determines and switches the display mode based on the open / closed state and attitude (direction) of the information processing device 10 acquired from the detection processing unit 182, a user operation, and the like. Furthermore, the display processing unit 183 controls the display of windows (active windows and inactive windows) of the running application according to the display mode and the like, based on application information acquired from the system processing unit 181. Specifically, the display processing unit 183 includes a display mode determination unit 1831, a display mode switching unit 1832, a thumbnail generation unit 1833, and a display control unit 1834.
[0111] The display mode determination unit 1831 performs a determination process for determining a display mode based on a detection result of the state of the information processing device 10 or a user's operation detected by the detection processing unit 182. For example, the display mode determination unit 1831 acquires a detection result of the open / closed state of the information processing device 10, a detection result of whether the information processing device 10 is in a bent form or a flat form when in an open state, a detection result of the attitude (direction) of the information processing device 10, and user operation information from the detection processing unit 182. Then, the display mode determination unit 1831 determines the display mode described with reference to FIG. 4 based on each detection result and operation information acquired from the detection processing unit 182.
[0112] 4 based on the display mode determined by the display mode determination unit 1831. For example, the display mode switching unit 1832 sets a display mode such as switching to a single screen mode, a dual screen mode (or an inverted dual screen mode), a half screen mode, etc., the orientation of each display area, and the display contents of each display area, based on the display mode determined by the display mode determination unit 1831.
[0113] The thumbnail generating unit 1833 generates thumbnail images corresponding to windows of running applications. For example, the thumbnail generating unit 1833 generates thumbnail images corresponding to inactive windows of the running applications as thumbnail images to be displayed as thumbnail windows in the second display area DA2 when switching from the single screen mode to the dual screen mode. Also, for example, the thumbnail generating unit 1833 generates thumbnail images corresponding to windows of running applications as thumbnail images to be displayed as thumbnail windows in a display area specified by a thumbnail display operation. Note that the thumbnail generating unit 1833 basically generates thumbnail images including minimized windows as inactive windows.
[0114] A display control unit 1834 performs display control processing to output and display display data of application windows and thumbnail windows to be displayed in each display area in accordance with the display mode set by the display mode switching unit 1832 .
[0115] For example, when the display mode switching unit 1832 switches from single screen mode to dual screen mode, the display control unit 1834 causes the first display area DA1 to display the active window (the active window displayed in the display area DA) of the application window that was executed in the single screen mode.
[0116] Furthermore, when the single screen mode is switched to the dual screen mode by the display mode switching unit 1832, the display control unit 1834 controls whether or not to display thumbnail images corresponding to inactive windows excluding the active window in the single screen mode in the second display area DA2, based on the number of windows in the single screen mode. For example, when the number of windows in the single screen mode is more than two (the number of display areas in the dual screen mode), the display control unit 1834 displays a thumbnail window in which thumbnail images of inactive windows in the single screen mode are arranged in the second display area DA2 when the mode is switched to the dual screen mode (see FIG. 7).
[0117] On the other hand, when the number of windows in the single screen mode is two or less (the number of display areas in the dual screen mode), the display control unit 1834 does not display a thumbnail window in the second display area DA2 when switching to the dual screen mode. For example, when the number of windows in the single screen mode is two, the display control unit 1834 displays an inactive window in the single screen mode in the second display area DA2 (see FIG. 8). Note that when the number of windows in the single screen mode is one or less, the display control unit 1834 does not display either the application window or the thumbnail window (thumbnail image of the window) in the second display area DA2 when switching to the dual screen mode.
[0118] Note that the display control unit 1834 does not need to include a window that has been minimized when the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode in the number of windows in the single-screen mode.
[0119] Furthermore, when any of the thumbnail images displayed in the second display area DA2 in the dual screen mode is selected, the display control unit 1834 displays an inactive window corresponding to the selected thumbnail image as an active window in the second display area DA2. For example, the display control unit 1834 displays the inactive window corresponding to the selected thumbnail image in the second display area DA2 in a maximized state as the active window.
[0120] Furthermore, when the detection processing unit 182 detects a thumbnail display operation by the user, the display control unit 1834 displays a thumbnail window in the display area specified by the thumbnail display operation, based on the operation information acquired from the detection processing unit 182.
[0121] For example, when switching from single-screen mode to dual-screen mode, the display control unit 1834 displays thumbnail images corresponding to inactive windows excluding the active window in single-screen mode in the thumbnail window that is displayed, but when the thumbnail window is displayed because a thumbnail display operation is detected, not only the thumbnail images corresponding to the inactive windows but also the thumbnail image corresponding to the active window (for example, the active window in single-screen mode) are displayed.
[0122] Furthermore, for example, when switching from single-screen mode to dual-screen mode, the display control unit 1834 controls the thumbnail window displayed in the second display area DA2 to be hidden, and then, upon detection of the thumbnail display operation, displays the thumbnail window in a display area specified by the thumbnail display operation. In other words, after hiding the thumbnail window, the display control unit 1834 can redisplay it in any display area by the thumbnail display operation.
[0123] (Thumbnail window display control process operation) Next, the operation of the display control process for controlling whether or not to display the thumbnail window when the control unit 18 switches from the single screen mode to the dual screen mode will be described. FIG. 16 is a flowchart showing an example of thumbnail window display control processing when switching screen modes according to this embodiment.
[0124] (Step S101) The control unit 18 judges whether or not to switch from the single screen mode to the dual screen mode. For example, the control unit 18 judges whether or not to switch from the single screen mode to the dual screen mode based on detecting a change from a flat form to a bent form as described with reference to FIG. 4, or on a display mode switching operation as described with reference to FIG. 5. When the control unit 18 judges that the single screen mode is not to be switched to the dual screen mode (NO), the control unit 18 continues the single screen mode and performs the process of step S101 again. On the other hand, when the control unit 18 judges that the single screen mode is to be switched to the dual screen mode (YES), the control unit 18 switches to the dual screen mode in which the display area DA is divided into two display areas, a first display area DA1 and a second display area DA2, and proceeds to the process of step S103.
[0125] (Step S103) Control unit 18 determines whether the number of windows in single screen mode before switching to dual screen mode is two or less. If control unit 18 determines that the number of windows in single screen mode is two or less (YES), control unit 18 proceeds to the process of step S105. On the other hand, if control unit 18 determines that the number of windows in single screen mode is more than two (NO), control unit 18 proceeds to the process of step S109.
[0126] (Step S105) The control unit 18 sets the display of the thumbnail window when switching to the dual screen mode to off, and proceeds to the process of step S107.
[0127] (Step S107) Control unit 18 displays an active window in the single screen mode in first display area DA1, and displays an inactive window in the single screen mode in second display area DA2 (see FIG. 8). Note that, if there is one window in the single screen mode, control unit 18 does not display either an application window or a thumbnail window in second display area DA2.
[0128] (Step S109) The control unit 18 sets the display of the thumbnail window when switching to the dual screen mode to ON, and proceeds to the process of step S111.
[0129] (Step S111) Control unit 18 causes first display area DA1 to display an active window in the single screen mode, and causes second display area DA2 to display a thumbnail window in which thumbnail images of inactive windows in the single screen mode are arranged (see FIG. 7).
[0130] Next, a description will be given of the operation of the display control process when a thumbnail image is selected after the thumbnail window is displayed in the second display area DA2 in step S111 of Fig. 16. Fig. 17 is a flowchart showing an example of the display control process when a thumbnail image according to the present embodiment is selected.
[0131] (Step S201) The control unit 18 determines whether or not any of the thumbnail images displayed in the second display area DA2 has been selected. If the control unit 18 determines that no thumbnail image has been selected (NO), the control unit 18 proceeds to processing of step S203. On the other hand, if the control unit 18 determines that any of the thumbnail images has been selected (YES), the control unit 18 proceeds to processing of step S207.
[0132] (Step S203) The control unit 18 determines whether or not an operation has been performed on the close button "X" (see FIG. 6) displayed in the title bar B1 of the thumbnail window displayed in the second display area DA2 (secondary screen). If the control unit 18 determines that an operation has been performed on the close button "X" (YES), the control unit 18 proceeds to the process of step S205. On the other hand, if the control unit 18 determines that an operation has not been performed on the close button "X" (NO), the control unit 18 returns to the process of step S201.
[0133] (Step S205) If it is determined in step S203 that the close button "X" has been operated, the control unit 18 closes and hides the thumbnail window, and ends the display of the thumbnail window.
[0134] (Step S207) If the control unit 18 determines in step S201 that any of the thumbnail images has been selected, it closes the thumbnail window and proceeds to the process of step S209.
[0135] (Step S209) The control unit 18 causes a window corresponding to the selected thumbnail image to be displayed in the second display area DA2 as an active window (for example, maximized and displayed in the second display area DA2).
[0136] Next, the operation of the display control process for displaying a thumbnail window in an arbitrary display area by a thumbnail display operation will be described. FIG. 18 is a flowchart showing an example of a display control process of a thumbnail window by a thumbnail display operation according to this embodiment.
[0137] (Step S251) The control unit 18 determines whether or not a thumbnail display operation (see FIGS. 9 and 11) has been performed, based on the operation information acquired from the detection processing unit 182. If the control unit 18 determines that a thumbnail display operation has not been performed (NO), the control unit 18 performs the process of step S251 again. On the other hand, if the control unit 18 determines that a thumbnail display operation has been performed (YES), the control unit 18 proceeds to the process of step S253.
[0138] (Step S253) Control unit 18 displays a thumbnail window in the display area specified by the thumbnail display operation (see Fig. 10(B), Fig. 12(B), Fig. 13(B)). For example, control unit 18 displays not only thumbnail images corresponding to inactive windows, but also thumbnail images corresponding to active windows side by side in the thumbnail window.
[0139] As described above, the information processing device 10 according to the present embodiment includes the display 150, the storage unit 13 (an example of a memory) that stores an application program, and the control unit 18 (for example, an example of a processor such as a CPU, GPU, or microcomputer) that performs control to display a window of the application on the display 150 by executing the application program stored in the storage unit 13. The control unit 18 performs a display mode switching process that controls switching between a one-screen mode (an example of a first display mode) in which the entire screen area of the display 150 is controlled as a single display area DA, and a two-screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into two display areas (for example, a first display area DA1 and a second display area DA2) and the display is controlled. In addition, when the control unit 18 switches from single screen mode to dual screen mode by the display mode switching process, it performs a first display control process of displaying, in the first display area DA1 of the multiple display areas, an active window (an example of one window) of the windows of the application executed in the single screen mode, and in the second display area DA2, thumbnail images corresponding to windows excluding the active window (for example, inactive windows) of the windows in the single screen mode, and a second display control process of displaying thumbnail images in a display area within the screen area of the display 150 that is specified by the thumbnail display operation upon detection of a thumbnail display operation by the user (an example of a predetermined operation).
[0140] This enables information processing device 10 to display thumbnail images of windows of running apps in any display area in response to user operation, thereby improving operability when selecting windows to be displayed in each of multiple display areas.
[0141] For example, when control unit 18 displays thumbnail images as a result of detecting a thumbnail display operation in the second display control process, control unit 18 also displays a thumbnail image corresponding to an active window among the windows in the single screen mode.
[0142] As a result, when information processing device 10 displays thumbnail images of the windows of all running apps in response to a user operation rather than switching screen modes, it displays thumbnail images of all running app windows as well as thumbnail images of inactive windows, making it easy to select the window of an app that you want to display from among all running apps.
[0143] For example, the control unit 18 displays on the display 150 a display mode switching icon C22 (an example of a first icon) that accepts a user operation for switching from the single screen mode to the dual screen mode. Then, when the control unit 18 detects a user operation on the display mode switching icon C22 in the single screen mode, it switches from the single screen mode to the dual screen mode. On the other hand, in the dual screen mode, the control unit 18 accepts a user operation on the display mode switching icon C22 as a thumbnail display operation, and when an operation on the display mode switching icon C22 is detected, it displays a thumbnail image as a thumbnail display operation has been detected. Note that, like the display mode switching icon C22, the control unit 18 also accepts a user operation on the display mode switching icons C12, C13, and C23 as a thumbnail display operation in the dual screen mode.
[0144] This allows the information processing device 10 to improve operability because the icon operated to switch screen modes and the icon operated to display thumbnail images of windows of running applications are the same.
[0145] Furthermore, in the second display control process, the control unit 18 controls the thumbnail image displayed in the second display area DA2 to be hidden, and then, upon detection of the thumbnail display operation, displays the thumbnail image in the display area specified by the thumbnail display operation.
[0146] This enables the information processing device 10 to re-display thumbnail images of windows of running apps in any display area in response to user operation, thereby improving operability when selecting windows to be displayed in each of multiple display areas.
[0147] For example, when any of the thumbnail images displayed in the second display area DA2 is selected by a user operation, the control unit 18 makes all thumbnail images displayed in the second display area DA2 invisible and displays a window corresponding to the selected thumbnail image. For example, the control unit 18 maximizes the window corresponding to the selected thumbnail image in the second display area DA2 and displays it as the active window.
[0148] This makes it possible for the user to easily select from among the thumbnail images when he or she wishes to change from the currently used window to another window, which is convenient.
[0149] Furthermore, when a user performs an operation to hide the thumbnail images displayed in the second display area DA2, the control unit 18 hides all the thumbnail images displayed in the second display area DA2. Note that a user operation to hide the thumbnail images is, for example, an operation on the close button "X" displayed in the title bar B1 of the thumbnail window (see FIG. 6).
[0150] This allows the user to hide the thumbnail window (thumbnail image) with a simple operation when he or she wishes to hide the thumbnail window in the information processing device 10. Alternatively, the thumbnail window may be closed and hidden by a user operation (for example, a tap operation) on an area of the thumbnail window where no thumbnail image exists or an area where no thumbnail image is displayed (an area where an app window is already located).
[0151] In addition, when the display mode switching process switches from single screen mode to dual screen mode, the control unit 18 may control, in the first display control process, whether or not to display a thumbnail window (thumbnail image) in the second display area DA2 based on the number of windows in the single screen mode.
[0152] As a result, when switching from single-screen mode to dual-screen mode, information processing device 10 displays the active windows in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of windows in single-screen mode, thereby enabling appropriate control of the display when switching from single-screen mode to dual-screen mode.
[0153] For example, when the display mode is switched from single screen mode to dual screen mode by the display mode switching process, if the number of windows in the single screen mode is two or less (the number of display areas in the dual screen mode), the control unit 18 does not display a thumbnail window (thumbnail image) and displays windows in the single screen mode excluding the active window in the second display area DA2. On the other hand, when the display mode is switched from single screen mode to dual screen mode by the display mode switching process, the control unit 18 displays a thumbnail window (thumbnail image) in the second display area DA2 if the number of windows in the single screen mode is more than two (the number of display areas in the dual screen mode).
[0154] As a result, when the information processing device 10 switches from the single screen mode to the dual screen mode, if the number of windows in the single screen mode before the switch is two or less, the windows in the single screen mode can be displayed using the two display areas of the dual screen mode, respectively, without the user having to take the trouble of displaying thumbnail images and selecting one, which is convenient. Therefore, the information processing device 10 can appropriately control the display when switching from the single screen mode to the dual screen mode.
[0155] Furthermore, the control method in the information processing device 10 according to the present embodiment includes a display mode switching step in which the control unit 18 controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of the display 150 is displayed as a single display area DA, and a dual screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into two display areas (e.g., a first display area DA1 and a second display area DA2) and displayed; a first display control step in which, when switching from the single screen mode to the dual screen mode by the display mode switching process, an active window (an example of one window) of an application executed in the single screen mode is displayed in the first display area DA1 of the multiple display areas, and thumbnail images corresponding to windows excluding the active window (e.g., an inactive window) of the windows in the single screen mode are displayed in the second display area DA2; and a second display control step in which, upon detection of a thumbnail display operation (an example of a predetermined operation) by the user, the thumbnail image is displayed in a display area within the screen area of the display 150 that is specified by the thumbnail display operation.
[0156] This enables the information processing device 10 to display thumbnail images of windows of running apps in any display area in response to user operation, thereby improving operability when selecting windows to be displayed in each of multiple display areas.
[0157] <Second embodiment> Next, an overview of the second embodiment of the present invention will be described. In the first embodiment, an example was described in which the display mode switching icon also functions as an operator that accepts a thumbnail display operation, but in this embodiment, an example will be described in which an icon that serves as an operator that accepts a thumbnail display operation is displayed separately from the display mode switching icon.
[0158] Fig. 19 is a diagram showing a first example of a thumbnail display operation according to this embodiment. The switching menu M2A shown in this figure corresponds to the switching menu M2 shown in Fig. 5(C), and is different in that a thumbnail display icon C20A is displayed. The thumbnail display icon C20A functions as an operator that accepts a thumbnail display operation. For example, when a user operates the thumbnail display icon C20A, a thumbnail window is displayed in all display areas.
[0159] FIG. 20 is a diagram showing a first example of display control by thumbnail display operation according to this embodiment. FIG. 20(A) shows an example in which a window W1 is maximized and displayed in the first display area DA1 and a window W2 is maximized and displayed in the second display area DA2 in the dual screen mode, similarly to FIG. 10(A) and FIG. 12(A). In the display state shown in FIG. 20(A), when a user operates the thumbnail display icon C20A shown in FIG. 19, thumbnail windows are displayed in the first display area DA1 and the second display area DA2 as shown in FIG. 20(B). At this time, all thumbnail images of the windows of the running application are displayed in the thumbnail windows. For example, when the number of windows of the running application is three (windows W1, W2, and W3), when a thumbnail display operation is performed, three thumbnail images (thumbnail images SW1, SW2, and SW3) are displayed in the thumbnail windows of the first display area DA1 and the second display area DA2 as shown in FIG. 20(B).
[0160] Note that, here, an example has been described in which when a thumbnail display operation is performed on the thumbnail display icon C20A, a thumbnail window (thumbnail image) is displayed in each of all display areas (first display area DA1 and second display area DA2) within the screen area of the display 150, but the thumbnail window (thumbnail image) may also be displayed in one pre-set display area (for example, the second display area DA2).
[0161] Furthermore, when an icon serving as an operator for accepting thumbnail display operations is displayed separately from the display mode switching icon, the area in which the thumbnail images are to be displayed may be made specifiable (selectable).
[0162] Fig. 21 is a diagram showing a second example of a thumbnail display operation according to this embodiment. The switching menu M2B shown in this figure corresponds to the switching menu M2 shown in Fig. 5(C), and differs in that a thumbnail display icon C20B is displayed. The thumbnail display icon C20B functions as an operator that accepts a thumbnail display operation.
[0163] Unlike the thumbnail display icon C20A, the thumbnail display icon C20B displays a split area obtained by splitting the screen area of the display 150 into a plurality of areas. In the illustrated example, the thumbnail display icon C20B displays a split area obtained by splitting the screen area of the display 150 into four areas, namely, "1", "2", "3", and "4". The user can specify (select) an area in which to display thumbnail images from among these four split areas. Note that these split areas are areas for specifying an area in which to display thumbnail images, and are not related to switching of screen modes. In other words, although four split areas are shown, this does not mean a four-screen mode; for example, in a dual-screen mode, thumbnail images are displayed in the specified split area while remaining in the dual-screen mode. FIG. 22 shows an example of display control in which thumbnail images are displayed by the user selecting the split area indicated by "4" in the thumbnail display icon C20B.
[0164] FIG. 22 is a diagram showing a second example of display control by thumbnail display operation according to this embodiment. FIG. 22(A) shows an example in which a window W1 is maximized and displayed in the first display area DA1 and a window W2 is maximized and displayed in the second display area DA2 in the dual screen mode, similarly to FIG. 20(A). In the display state shown in FIG. 22(A), when a user performs an operation on the divided area indicated by "4" of the thumbnail display icon C20B shown in FIG. 21, thumbnail images (thumbnail images SW1, SW2, SW3) are displayed in the area corresponding to the divided area indicated by "4" in the second display area DA2 while remaining in the dual screen mode, as shown in FIG. 22(B). At this time, the thumbnail images are displayed superimposed on the window W2 displayed in the second display area DA2 (in a layer higher than the window W2). The thumbnail images may be displayed superimposed as thumbnail windows, or the thumbnail images themselves may be displayed superimposed instead of in the form of thumbnail windows.
[0165] 19 to 22, thumbnail display operations when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.) have been described, but thumbnail display operations can also be performed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.) by displaying an icon equivalent to thumbnail display icon C20A or thumbnail display icon C20B in switching menu M1 shown in Fig. 5. Also, the thumbnail display icon may be displayed separately from the switching menu.
[0166] Thus, in the information processing device 10 according to this embodiment, the control unit 18 causes the display 150 to display thumbnail display icons C20A, C20B (an example of a second icon) that accept a thumbnail display operation (an example of a predetermined operation) in addition to a display mode switching icon (an example of a first icon) that accepts a user operation for switching from the single screen mode to the dual screen mode. Then, when the control unit 18 detects an operation on the thumbnail display icons C20A, C20B, it determines that a thumbnail display operation has been detected and causes thumbnail images to be displayed.
[0167] This enables the information processing device 10 to display a thumbnail image of a window of a running application in any one of the multiple display areas with a simple operation, thereby improving operability when selecting a window to be displayed in each of the multiple display areas.
[0168] For example, the thumbnail display icon C20B accepts an operation to specify a display area (e.g., a split area) in which thumbnail images are to be displayed regardless of the multiple display areas (first display area DA1, second display area DA2) divided in the dual screen mode.
[0169] This enables the information processing device 10 to display thumbnail images of windows of running apps in any display area in response to user operation, thereby improving operability when selecting windows to be displayed in each of multiple display areas.
[0170] Note that in Figures 21 and 22, an example is described in which the area in which to display thumbnail images can be specified from among four divided areas, but the number of divided areas is not limited to four and may be two, three, or five or more.
[0171] <Third embodiment> Next, an overview of a third embodiment of the present invention will be described. In the first embodiment, the information processing device 10 has been described as having a single screen mode in which the entire screen area of the display 150 is treated as a single display area DA and the dual screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled. However, the screen area of the display 150 may also be divided into three or more display areas to control the display.
[0172] In this embodiment, in addition to the single-screen mode and dual-screen mode, the information processing device 10 has a triple-screen mode in which the screen area of the display 150 is divided into three display areas and the display is controlled by dividing it into four display areas, and a quadruple-screen mode in which the display is controlled by dividing it into four display areas. Display control when switching from the single-screen mode to the triple-screen mode and display control when switching from the single-screen mode to the quadruple-screen mode will be described below.
[0173] FIG. 23 is a diagram showing an example of the operation specifications of the display mode switching operation according to this embodiment. This diagram shows an example of a switching menu displayed by operating the icon C1 shown in FIG. 5(A), for example. FIG. 23(B) shows a switching menu M3 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.), and FIG. 23(C) shows a switching menu M4 displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). The switching menus M3 and M4 are different from the switching menus M1 in FIG. 5(B) and the switching menus M2 in FIG. 5(C) in that they can be switched to a triple-screen mode and a quadruple-screen mode.
[0174] Display mode switching icons C31, C32, C33, C34, and C35 are displayed in the switching menu M3. The display mode switching icon C31 is displayed as an operator for selecting the display mode (d) and display mode (d') of the single-screen mode. The display mode switching icon C32 is displayed as an operator for selecting the display mode (b) of the dual-screen mode. The display mode switching icon C33 and the display mode switching icon C34 are displayed as operators for selecting the display mode of the triple-screen mode. The display mode switching icon C33 and the display mode switching icon C34 differ in which side of the first display area DA1 and the second display area DA2 in the dual-screen mode is divided into two display areas. The display mode switching icon C35 is displayed as an operator for selecting the display mode of the quadruple-screen mode.
[0175] The numbers "1", "2", "3", and "4" in the figure are used to distinguish the display areas, as in Figure 5, and are expressed, for example, by numbers according to the priority order of the areas that has been preset for each display area. "1" has the highest priority, and the priority order of areas decreases in the order of "2", "3", and "4".
[0176] When the user performs an operation to select the display mode switching icon C33 or the display mode switching icon C34, the display of the switching menu ends and the display is controlled to the triple-screen mode in "Landscape." When the user performs an operation to select the display mode switching icon C35, the display of the switching menu ends and the display is controlled to the quadruple-screen mode in "Landscape."
[0177] Display mode switching icons C41, C42, C43, C44, and C45 are displayed in the switching menu M4. The display mode switching icon C41 is displayed as an operator for selecting the display mode (e) or display mode (e') of the single screen mode. The display mode switching icon C42 is displayed as an operator for selecting the display mode (c-1) of the dual screen mode. The display mode switching icon C43 and the display mode switching icon C44 are displayed as operators for selecting the display mode of the triple screen mode. The display mode switching icon C43 and the display mode switching icon C44 differ in which side of the first display area DA1 and the second display area DA2 in the dual screen mode is divided into two display areas. The display mode switching icon C45 is displayed as an operator for selecting the display mode of the quadruple screen mode.
[0178] When the user performs an operation to select the display mode switching icon C43 or the display mode switching icon C44, the display of the switching menu ends and the display is controlled to triple-screen mode in "Clamshell or Portrait." Also, when the user performs an operation to select the display mode switching icon C35, the display of the switching menu ends and the display is controlled to quadruple-screen mode in "Clamshell or Portrait."
[0179] (Display control when switching from single screen mode to triple screen mode) Next, the display control when switching from the single screen mode to the triple screen mode will be described. Here, when the screen area of the display 150 is divided into three display areas in the triple screen mode, the areas are referred to as a first display area DA1, a second display area DA2, and a third display area DA3.
[0180] In the case of a triple screen mode in which the second display area DA2 side in the dual screen mode is divided into two display areas, the first display area DA1 corresponds to the first display area DA1 in the dual screen mode, and the second display area DA2 and the third display area DA3 correspond to the display areas obtained by dividing the second display area DA2 in the dual screen mode into two. Here, the second display area DA2 and the third display area DA3 in the triple screen mode can be said to be two second display areas obtained by dividing the display area excluding the first display area DA1 (for example, the second display area DA2 in the dual screen mode) into two. In order to distinguish between these two second display areas, the one with the higher priority of the area is indicated as the second display area DA2, and the other is indicated as the third display area DA3. In other words, the priority of the areas in the triple screen mode is, from the top, the first display area DA1, the second display area DA2, and the third display area DA3.
[0181] In addition, in the case of a triple screen mode in which the first display area DA1 side in the dual screen mode is divided into two display areas, the only difference is the display area on the side divided into two display areas compared to a triple screen mode in which the second display area DA2 side in the dual screen mode is divided into two display areas.
[0182] As described in the first embodiment, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, it displays a thumbnail window in the second display area DA2 if the number of windows in the single-screen mode is more than two, and does not display a thumbnail window if the number of windows is two or less. In contrast, when the information processing device 10 switches from the single-screen mode to the triple-screen mode, it displays a thumbnail window in the second display area DA2 if the number of windows in the single-screen mode is more than three, and does not display a thumbnail window if the number of windows is three or less.
[0183] Below, we will explain, with reference to Figures 15 to 17, an example of display control when, in single-screen mode (display mode (d) or display mode (d')) in "Landscape," an operation is performed to select the display mode switching icon C33 in Figure 23 (B), for example, and the dual-screen mode switches to a triple-screen mode in which the second display area DA2 side is divided into two display areas.
[0184] Fig. 24 is a diagram showing a first example of display control when switching from single screen mode to triple screen mode according to this embodiment. Fig. 24(A) shows a display example in single screen mode, and Fig. 24(B) shows a display example after switching to triple screen mode. In the illustrated example, the number of application windows running in single screen mode is two. Here, two windows W1 and W2 are shown in the display area DA. Window W1 is the active window located in the foreground layer (top layer).
[0185] When switching from single-screen mode to triple-screen mode, in accordance with the area priority and window priority, window W1 is maximized and displayed as the active window in the first display area DA1, and window W2 is maximized and displayed as the inactive window in the second display area DA2. Also, since there is no window to be displayed in the third display area DA3 (the window with the third priority), no window is displayed and only the desktop screen is displayed.
[0186] In addition, when the number of windows of an application running in single screen mode is one (only window W1), window W1 is maximized and displayed as the active window in the first display area DA1, but since there are no windows to be displayed in the second display area DA2 and the third display area DA3, no windows are displayed and only the desktop screen is displayed.
[0187] Fig. 25 is a diagram showing a second example of display control when switching from single screen mode to triple screen mode according to this embodiment. Fig. 25(A) shows a display example in single screen mode, and Fig. 25(B) shows a display example after switching to triple screen mode. In the illustrated example, the number of application windows running in single screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA.
[0188] Window W1 is the active window that is located in the foreground layer (topmost layer). Window W2 is the window that was the active window before window W1 became the active window. Window W3 is the window that was the active window before window W2 became the active window. In other words, the priority of windows is given to window W1 at the top, followed by window W2 and window W3 in that order.
[0189] When switching from single-screen mode to triple-screen mode, in accordance with the area priority and window priority, window W1 is maximized and displayed as the active window in the first display area DA1, window W2 is maximized and displayed as the inactive window in the second display area DA2, and window W3 is maximized and displayed as the inactive window in the third display area DA3.
[0190] Fig. 26 is a diagram showing a third example of display control when switching from single screen mode to triple screen mode according to this embodiment. Fig. 26(A) shows a display example in single screen mode, and Fig. 26(B) shows a display example after switching to triple screen mode. In the illustrated example, the number of application windows running in single screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA.
[0191] Window W1 is the active window that is located in the foreground layer (the top layer). The priority order of windows is as follows: window W1 has the highest priority, followed by window W2, window W3, and window W4.
[0192] When switching from single-screen mode to triple-screen mode, window W1 is maximized and displayed as the active window in the first display area DA1 according to the area priority and window priority. A thumbnail window in which thumbnail images SW2, SW3, and SW4 of windows W2, W3, and W4 are arranged is displayed in the second display area DA2. Note that no windows are displayed in the third display area DA3, and the desktop screen is displayed. When the number of windows of an application running in single-screen mode is five or more, four or more thumbnail images are displayed in the second display area DA2.
[0193] Here, when any of the thumbnail images SW2, SW3, or SW4 displayed in the second display area DA2 is selected, an inactive window corresponding to the selected thumbnail image is displayed as an active window in the second display area DA2, and thumbnail windows in which the remaining thumbnail images are arranged are displayed in the third display area DA3.
[0194] In this way, when the information processing device 10 switches from the single screen mode to the triple screen mode, if the number of windows in the single screen mode is more than three (the number of display areas in the triple screen mode), it displays in the second display area DA2 a thumbnail window in which thumbnail images of windows in the single screen mode excluding the active window are arranged. On the other hand, when the information processing device 10 switches from the single screen mode to the triple screen mode, if the number of windows in the single screen mode is three or less (the number of display areas in the triple screen mode), it does not display a thumbnail window and displays inactive windows in the single screen mode in the second display area DA2, the third display area DA3, etc.
[0195] In other words, when the information processing device 10 switches from single-screen mode to triple-screen mode, it controls whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the triple-screen mode and the number of windows in the single-screen mode.
[0196] Note that the window of an application running in single-screen mode may be minimized. In that case, the minimized window does not need to be included in the number of windows in single-screen mode.
[0197] The same applies when switching from single screen mode to quad screen mode. In the following, the four display areas in the quad screen mode will be described as a first display area DA1, a second display area DA2, a third display area DA3, and a fourth display area DA4. For example, when switching from single screen mode to quad screen mode, if the number of windows in the single screen mode is more than four (the number of display areas in the quad screen mode), the information processing device 10 displays a thumbnail window in which thumbnail images of windows excluding an active window among the windows in the single screen mode are arranged in the second display area DA2. On the other hand, when switching from single screen mode to quad screen mode, if the number of windows in the single screen mode is four or less (the number of display areas in the quad screen mode), the information processing device 10 does not display a thumbnail window, and displays inactive windows in the single screen mode in the second display area DA2, the third display area DA3, the fourth display area DA4, etc.
[0198] In other words, when the information processing device 10 switches from single-screen mode to quadruple-screen mode, it controls whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the quadruple-screen mode and the number of windows in the single-screen mode.
[0199] Note that the window of an application running in single-screen mode may be minimized. In that case, the minimized window does not need to be included in the number of windows in single-screen mode.
[0200] (Thumbnail window display control process operation) Next, a description will be given of the operation of the display control process that controls whether or not to display the thumbnail window when the control unit 18 switches from the single screen mode to the multiple screen mode. The multiple screen mode includes, for example, the dual screen mode, triple screen mode, and quadruple screen mode.
[0201] FIG. 27 is a flowchart showing an example of thumbnail window display control processing according to this embodiment. (Step S301) The control unit 18 judges whether or not to switch from the single screen mode to the multiple screen mode. For example, the control unit 18 judges whether or not to switch from the single screen mode to the multiple screen mode based on detecting a change from a flat state (Flat form) to a bent state (Bent form) as described with reference to FIG. 4, or on the basis of a display mode switching operation described with reference to FIG. 23. When the control unit 18 judges that the single screen mode is not to be switched to the multiple screen mode (NO), the control unit 18 continues the single screen mode and performs the process of step S301 again. On the other hand, when the control unit 18 judges that the single screen mode is to be switched to the multiple screen mode (YES), the control unit 18 switches to the multiple screen mode in which the display area DA is divided into two display areas, a first display area DA1 and a second display area DA2, and proceeds to the process of step S303.
[0202] (Step S303) Control unit 18 judges whether the number of display areas (screens) in the multiple screen mode after switching is equal to or greater than the number of windows in the single screen mode before switching to the multiple screen mode. If control unit 18 judges that the number of windows is equal to or greater than the number of windows in the single screen mode (YES), control unit 18 proceeds to the process of step S305. On the other hand, if control unit 18 judges that the number of windows is less than the number of windows in the single screen mode (NO), control unit 18 proceeds to the process of step S309.
[0203] (Step S305) The control unit 18 sets the display of the thumbnail window when switching to the multiple screen mode to be off, and proceeds to the process of step S307.
[0204] (Step S307) The control unit 18 displays an active window in the single screen mode in the first display area DA1, and displays inactive windows in the single screen mode in the other display areas (see Figs. 8, 24, and 25). For example, the control unit 18 displays inactive windows in the single screen mode in display areas other than the first display area DA1 according to the area priority and the window priority. Note that if the number of windows in the single screen mode is less than the number of display areas (screens) in the multiple screen mode after switching, the display areas other than the first display area DA1 include display areas in which no windows are displayed.
[0205] (Step S309) The control unit 18 sets the display of the thumbnail window when switching to the multi-screen mode to ON, and proceeds to the process of step S311.
[0206] (Step S311) Control unit 18 causes first display area DA1 to display an active window in the single screen mode, and causes second display area DA2 to display a thumbnail window in which thumbnail images of inactive windows in the single screen mode are arranged (see FIGS. 7, 17, and 19).
[0207] In addition, in accordance with a preset priority order of areas, an example (see FIG. 26) has been described in which a thumbnail image (e.g., a thumbnail window) is displayed in the second display area DA2, which has the highest priority order of areas (next to the first display area DA1) among the plurality of second display areas excluding the first display area DA1, but the present invention is not limited to this. For example, in the display control process, the control unit 18 may display a thumbnail image (e.g., a thumbnail window) in the area with the lowest priority order of areas among the plurality of second display areas excluding the first display area DA1. For example, the area with the lowest priority order of areas among the plurality of second display areas excluding the first display area DA1 is the third display area DA3 in the triple screen mode, and is the fourth display area DA4 in the quadruple screen mode.
[0208] FIG. 28 shows an example in which a thumbnail image (for example, a thumbnail window) is displayed in the area with the lowest area priority when switching from the single screen mode to the triple screen mode.
[0209] Fig. 28 is a diagram showing a fourth example of display control when switching from single screen mode to triple screen mode according to this embodiment, and shows an example of displaying a thumbnail window in the third display area DA3, which has the lowest area priority in triple screen mode. Fig. 28(A) shows a display example in single screen mode, and Fig. 28(B) shows a display example after switching to triple screen mode. In the example shown, the number of application windows running in single screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA.
[0210] Window W1 is the active window that is located in the foreground layer (the top layer). The priority order of windows is as follows: window W1 has the highest priority, followed by window W2, window W3, and window W4.
[0211] When switching from single-screen mode to triple-screen mode, in accordance with the area priority and window priority, window W1 is maximized and displayed as the active window in the first display area DA1. Window W2 is maximized and displayed as an inactive window in the second display area DA2. Also, in the third display area DA3, which has the last area priority, a thumbnail window in which thumbnail images SW3 and SW4 of windows W3 and W4 are displayed side by side is displayed. Note that when the number of windows of an application running in single-screen mode is five or more, three or more thumbnail images are displayed in the third display area DA3.
[0212] The same is true when switching from single-screen mode to quad-screen mode. For example, when switching from single-screen mode to quad-screen mode, windows are maximized and displayed in the first display area DA1, second display area DA2, and third display area DA3, and a thumbnail window is displayed in the fourth display area DA4, which has the lowest area priority.
[0213] Next, an example of displaying a thumbnail window by a thumbnail display operation in triple screen mode will be described with reference to FIGS.
[0214] Fig. 29 is a diagram showing an example of a thumbnail display operation according to this embodiment. The switching menu M3 shown in this figure corresponds to the switching menu M3 shown in Fig. 23(B). The switching menu M3 shown in Fig. 29 is displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.), and indicates that the current display mode is the triple-screen mode corresponding to the display mode switching icon C33.
[0215] The display mode switching icon C33 is the current display mode, and is therefore highlighted relative to the other display mode switching icons C31, C32, C34, and C35. As described with reference to FIG. 23, the display mode switching icons C31, C32, C34, and C35 function as controls that accept a user's operation for switching to the respective display modes. On the other hand, the display mode switching icon C33, which is the current display mode, does not need to function as an operator for switching the display mode, and therefore functions as an operator for displaying thumbnail images (thumbnail window). That is, the display mode switching icon C33, which is the current display mode, is displayed as an icon that accepts a thumbnail display operation. For example, FIG. 30 shows an example of display control in which a user performs an operation to select a display area indicated by "3" (third display area DA3) in this display mode switching icon C33 to display a thumbnail window in the third display area DA3.
[0216] Fig. 30 is a diagram showing a first example of display control by thumbnail display operation according to this embodiment. Fig. 30(A) shows an example in which a window W1 is maximized and displayed in the first display area DA1, a window W2 is maximized and displayed in the second display area DA2, and a window W3 is maximized and displayed in the third display area DA3 in the triple screen mode. For example, when an operation is performed to select the thumbnail image SW3 out of the thumbnail images SW3 and SW4 displayed in the third display area DA3 in Fig. 28(B), the display state shown in Fig. 30(A) is controlled. Note that Fig. 30(A) is also the display state shown in Fig. 25(B).
[0217] In the display state shown in Fig. 30(A), when the user performs an operation to select the display area (third display area DA3) indicated by "3" of the display mode switching icon C33 as shown in Fig. 29, a thumbnail window is displayed in the third display area DA3 as shown in Fig. 30(B). At this time, all thumbnail images of the windows of the running application are displayed in the thumbnail window of the third display area DA3. For example, as shown in Fig. 26 or 28, when the number of windows of the running application is four (windows W1, W2, W3, W4), when a thumbnail display operation is performed, four thumbnail images (thumbnail images SW1, SW2, SW3, SW4) are displayed in the third display area DA3 as shown in Fig. 30(B).
[0218] With reference to Figures 29 and 30, thumbnail display operations when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.) have been described. However, thumbnail display operations can also be performed in a similar manner using the switching menu M4 shown in Figure 23 (C) when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.).
[0219] Also, with reference to Figures 29 and 30, an example of specifying the third display area DA3 by a thumbnail display operation to display a thumbnail window has been explained. Next, with reference to Figure 31, an example of specifying the second display area DA2 to display a thumbnail window will be explained.
[0220] Fig. 31 is a diagram showing a second example of display control by thumbnail display operation according to this embodiment. Fig. 31(A) shows an example in which a window W1 is maximized and displayed in the first display area DA1, a window W2 is maximized and displayed in the second display area DA2, and a thumbnail window is displayed in the third display area DA3 in triple screen mode. For example, this is the display state shown in Fig. 28(B).
[0221] In the display state shown in Fig. 31(A), when the user performs an operation to select the display area (second display area DA2) indicated by "2" of the display mode switching icon C33 shown in Fig. 29, a thumbnail window is displayed in the second display area DA2 as shown in Fig. 31(B). At this time, all thumbnail images of the windows of the running application are displayed in the thumbnail window in the second display area DA2. For example, as shown in Fig. 26 or Fig. 28, when the number of windows of the running application is four (windows W1, W2, W3, W4), when a thumbnail display operation is performed, four thumbnail images (thumbnail images SW1, SW2, SW3, SW4) are displayed in the second display area DA2 as shown in Fig. 31(B).
[0222] The thumbnail display operation in the 4-screen mode is similar. For example, when the display mode corresponding to the display mode switching icon C35 shown in FIG. 29 is the current display mode, the display mode switching icon C35 functions as an operator for displaying thumbnail images (thumbnail window). In the display mode switching icon C33, "1", "2", "3", and "4" respectively When the user performs an operation to select one of the display areas shown, a thumbnail window is displayed in the selected display area among the first display area DA1, the second display area DA2, the third display area DA3, and the fourth display area DA4.
[0223] As described above, in the information processing device 10 according to this embodiment, the control unit 18 performs a display mode switching process that controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of the display 150 is controlled as a single display area DA, and a multiple screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into multiple (two, three, four, etc.) display areas and the display is controlled. In addition, when the control unit 18 switches from the single screen mode to the multiple screen mode by the display mode switching process, the control unit 18 performs a first display control process of displaying, in a first display area DA1 of the multiple display areas, an active window (an example of one window) of the windows of the application executed in the single screen mode, and displaying, in a second display area (e.g., second display area DA2) of the multiple display areas excluding the first display area DA1, thumbnail images corresponding to windows (e.g., inactive windows) excluding the active window of the windows in the single screen mode; and a second display control process of displaying, upon detection of a thumbnail display operation (an example of a predetermined operation) by the user, a thumbnail image in a display area within the screen area of the display 150 that is specified by the thumbnail display operation.
[0224] This enables the information processing device 10 to display (re-display) thumbnail images of windows of running apps in any display area in response to user operation, thereby improving operability when selecting windows to be displayed in each of multiple display areas.
[0225] In addition, when the display mode switching process switches from single screen mode to multiple screen mode, the control unit 18 may control, in the first display control process, whether or not to display a thumbnail window (thumbnail image) in the second display area DA2 based on the number of windows in the single screen mode.
[0226] As a result, when switching from single-screen mode to multiple-screen mode, information-processing device 10 displays the active windows in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of windows in the single-screen mode, thereby enabling appropriate control of the display when switching from single-screen mode to multiple-screen mode.
[0227] According to this embodiment, when the number of windows in the single screen mode is three, the control unit 18 displays thumbnail images (for example, thumbnail windows) when switching from the single screen mode to the dual screen mode, but does not display thumbnail images (for example, thumbnail windows) when switching to the triple screen mode. Also, when the number of windows in the single screen mode is four, the control unit 18 displays thumbnail images (for example, thumbnail windows) when switching from the single screen mode to the dual screen mode or triple screen mode, but does not display thumbnail images (for example, thumbnail windows) when switching to the quadruple screen mode. In other words, it can be said that the control unit 18 controls whether or not to display thumbnail images based on the number of display areas in the multiple screen mode when switching from the single screen mode to the multiple screen mode.
[0228] That is, when the display mode switching process switches from single screen mode to multiple screen mode, the control unit 18 may control, in the first display control process, whether or not to display thumbnail images (e.g., thumbnail windows) in the second display area DA2 based on the number of display areas in the dual screen mode.
[0229] As a result, when switching from single-screen mode to multiple-screen mode, information-processing device 10 displays the active window in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of display areas in the multiple-screen mode after the switch, thereby enabling appropriate control of the display when switching from single-screen mode to multiple-screen mode.
[0230] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configurations are not limited to those described above, and various design changes and the like are possible within the scope of the gist of the present invention. For example, the configurations described in the above embodiments may be combined in any desired manner.
[0231] In addition, in the above-described embodiment, three types of examples of thumbnail display operations have been described: a first example in which a display mode switching icon corresponding to the current display mode among the display mode switching icons (e.g., display mode switching icon C22 in FIGS. 9 and 11, and display mode switching icon C33 in FIG. 29) functions as an operator that accepts a thumbnail display operation; a second example in which an operator (e.g., thumbnail display icon C20A in FIG. 19) that displays thumbnail images in all display areas (or a pre-set display area) separately from the display mode switching icon is displayed; and a third example in which an operator (e.g., thumbnail display icon C20B in FIG. 21) that can specify (select) an area (divided area) in which thumbnail images are to be displayed separately from the display mode switching icon is displayed. However, these three types of thumbnail display operations may be switchable by settings.
[0232] The thumbnail display operation may be a touch operation of a specific pattern on a display area where the user wants to display a thumbnail image. For example, a touch operation of a specific pattern, such as a double tap, a tap with multiple fingers, or a swipe, on an empty area in the screen area of the display 150 where no window is displayed may be used as a trigger to display a thumbnail window (thumbnail image). For example, the information processing device 10 may display a thumbnail window (thumbnail image) in a display area where a touch operation of a specific pattern has been performed on an empty area in which no window is displayed in any of the display areas (e.g., the first display area DA1, the second display area DA2, the third display area DA3, the fourth display area DA4, etc.) divided in the screen area of the display 150. In addition, when a touch operation of a specific pattern is performed on an empty area in which no window is displayed within a display area (e.g., first display area DA1, second display area DA2, third display area DA3, fourth display area DA4, etc.) in which at least one window is already displayed (arranged) among the display areas divided within the screen area of display 150, information processing device 10 may display a thumbnail window (thumbnail image) in the display area where the touch operation was performed.
[0233] In the above-described embodiment, an example in which one foldable display 150 is used in a single screen mode and a dual screen mode has been described, but two displays may be used. That is, the processing in the above-described embodiment can be applied to switching between a single screen mode in which the screen areas of the two displays are combined into one display area and the dual screen mode in which the screen areas of the two displays are individually combined into display areas and the display is controlled. In addition, the processing in the above-described embodiment can be applied to a triple screen mode or a quadruple screen mode in which one or both of the screen areas of the two displays are divided into two display areas and the display is controlled.
[0234] In addition, in the above-described embodiment, the information processing device 10 has been described as having, as multiple screen modes, a dual screen mode in which the display is controlled by dividing it into two display areas, a triple screen mode in which the display is controlled by dividing it into three display areas, and a quadruple screen mode in which the display is controlled by dividing it into four display areas, but it may also be configured to have a screen mode in which the display is controlled by dividing it into five or more display areas.
[0235] In addition, in the above-described embodiment, an example of touch operation on a plurality of touch panel type displays in which the input unit (touch sensor) and the display unit are integrally configured has been described, but this is not limited to touch operation, and may also be a click operation using a mouse, an operation using a gesture, or the like.
[0236] The above-mentioned control unit 18 has a computer system inside. A program for realizing the function of each of the components of the above-mentioned control unit 18 may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform processing in each of the components of the above-mentioned control unit 18. Here, "reading the program recorded in the recording medium into a computer system and executing it" includes installing the program in a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include a plurality of computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.
[0237] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by the respective components of the control unit 18, or each of the divided programs may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for realizing a part of the above-mentioned functions. Furthermore, the program may be a recording medium that can realize the above-mentioned functions in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program).
[0238] In addition, some or all of the functions of the control unit 18 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]
[0239] 10 information processing device, 101 first housing, 102 second housing, 103 hinge mechanism, 11 communication unit, 12 RAM, 13 storage unit, 14 speaker, 15 display unit, 16 camera, 150 display, 155 touch sensor, 161 first acceleration sensor, 162 second acceleration sensor, 17 hall sensor, 18 control unit, 181 system processing unit, 1811 execution application information generation unit, 182 detection processing unit, 1821 opening / closing detection unit, 1822 attitude detection unit, 1823 connection detection unit, 1824 operation detection unit, 183 display processing unit, 1831 display mode determination unit, 1832 display mode switching unit, 1833 thumbnail generation unit, 1834 display control unit
Claims
1. A display and A memory for storing application programs; a processor that controls displaying a window of the application on the display by executing a program of the application stored in the memory; Equipped with The processor, a display mode switching process for controlling switching between a first display mode in which the entire screen area of the display is treated as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and the display mode is controlled; a first display control process for, when switching from the first display mode to the second display mode by the display mode switching process, displaying one of the windows of the application executed in the first display mode in a first display area of the plurality of display areas, and displaying thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode in a second display area of the plurality of display areas excluding the first display area; a second display control process for displaying the thumbnail image in a display area within the screen area that is designated by a predetermined operation of a user upon detection of the predetermined operation of the user; An information processing device that performs the above.
2. The processor, In the second display control process, when the thumbnail image is to be displayed in response to the detection of the predetermined operation, the thumbnail image corresponding to the one of the windows in the first display mode is also displayed. The information processing device according to claim 1 .
3. The processor, In the second display control process, after controlling the thumbnail image displayed in the second display area to be hidden, when the predetermined operation is detected, the thumbnail image is displayed in a display area designated by the predetermined operation. The information processing device according to claim 1 .
4. The processor, displaying, on the display, a first icon for receiving a user's operation for switching from the first display mode to the second display mode; switching from the first display mode to the second display mode when a user operation on the first icon is detected in the first display mode; In the second display mode, a user operation on the first icon is accepted as the predetermined operation, and when an operation on the first icon is detected, the predetermined operation is detected and the thumbnail image is displayed. The information processing device according to claim 1 .
5. The processor, displaying, on the display, a first icon for accepting a user's operation for switching from the first display mode to the second display mode and a second icon for accepting the predetermined operation; When an operation on the second icon is detected, it is determined that the predetermined operation has been detected, and the thumbnail image is displayed. The information processing device according to claim 1 .
6. the second icon accepts an operation for designating a display area in which the thumbnail images are to be displayed, regardless of the plurality of display areas divided in the second display mode; The information processing device according to claim 5 .
7. the predetermined operation is a touch operation of a specific pattern on a display area in which the user wants to display the thumbnail image; The information processing device according to claim 1 .
8. the predetermined operation is a touch operation of the specific pattern on an area in which no window is displayed within a display area in which at least one window is displayed among the plurality of display areas in the second display mode, The processor, When the predetermined operation is detected, the second display control process displays the thumbnail image in the display area where the predetermined operation is performed. The information processing device according to claim 7.
9. The processor, when any one of the thumbnail images displayed in the second display area is selected by a user operation, all the thumbnail images displayed in the second display area are made non-displayable, and the window corresponding to the selected thumbnail image is displayed. The information processing device according to claim 3 .
10. The processor, When a user performs an operation to hide the thumbnail images displayed in the second display area, all of the thumbnail images displayed in the second display area are hidden. The information processing device according to claim 3 .
11. The processor, when the display mode is switched from the first display mode to the second display mode by the display mode switching process, in the first display control process, whether or not to display the thumbnail images in the second display area is controlled based on the number of the windows in the first display mode. The information processing device according to claim 1 .
12. The processor, When the display mode is switched from the first display mode to the second display mode by the display mode switching process, in the first display control process, based on the number of display areas in the second display mode, control is performed as to whether or not to display the thumbnail images in the second display area. The information processing device according to claim 1 .
13. 1. A control method for an information processing device including a display, a memory that stores an application program, and a processor that performs control to display a window of the application on the display by executing the application program stored in the memory, comprising: The processor, a display mode switching step of controlling switching between a first display mode in which the entire screen area of the display is treated as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and the display mode is controlled; a first display control step of, when switching from the first display mode to the second display mode by the display mode switching step, displaying, in a first display area of the plurality of display areas, one of the windows of the application executed in the first display mode, and displaying, in a second display area of the plurality of display areas excluding the first display area, thumbnail images corresponding to the windows excluding the one window of the windows in the first display mode; a second display control step of displaying the thumbnail image in a display area within the screen area that is designated by a predetermined operation performed by a user upon detection of the predetermined operation; A control method comprising:
Citation Information
Patent Citations
Portable information processing device, speech method thereof, and computer executable program
JP2015233198A
Portable information device
JP2018013850A
Information processing device and control method
JP2022070081A