Information processing apparatus and control method
Patent Information
- Application Number
- JP2023128773
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-08-07
- Publication Date
- 2025-02-20
- Estimated Expiration
- 2043-08-07
AI Technical Summary
【0026】 本発明の上記態様によれば、1画面モードから複数画面モードへの切り替えの際の表示を適切に制御することができる。
Smart Images

Figure 2025024570000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device and a control method. [Background technology]
[0002] In recent years, there are information processing devices having a plurality of screens (for example, two screens). For example, a two-screen information processing device has been disclosed in which a display (display unit) is mounted on each of a first housing and a second housing that can be folded via a connecting unit (hinge mechanism) (for example, Patent Document 1). There is also an information processing device in which a flexible display (display unit) such as an organic EL display is provided across the first housing and the second housing so as to be bendable according to folding (for example, see Patent Document 2). Even when one display (display unit) is provided across the first housing and the second housing in this way, it is possible to use not only a single-screen mode in which one display is used as one screen, but also a pseudo-two-screen mode in which one display is divided into a display area on the first housing side and a display area on the second housing side. Also, even in the above-mentioned information processing device with a two-screen configuration using two displays, it is possible to use not only a two-screen mode but also a single-screen mode in which the two displays are used as one screen.
[0003] For example, Patent Document 3 discloses an information processing device that, in response to switching from single-screen mode to dual-screen mode, displays an active window in single-screen mode on one of two screens and displays thumbnail images corresponding to windows other than the active window on the other screen, in relation to the display of a window of an application being executed. With this information processing device, when switching from single-screen mode to dual-screen mode, it is easy to continue using the application that was being used in single-screen mode, and it is convenient because a list of other applications being executed can be easily confirmed by thumbnail images. By performing an operation to select a thumbnail image, a user can display and use the window of the application corresponding to the selected thumbnail image. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-233198 A [Patent Document 2] JP 2018-13850 A [Patent Document 3] Patent Publication No. 2022-70081 Summary of the Invention [Problem to be solved by the invention]
[0005] However, for example, in the technology disclosed in the above-mentioned Patent Document 3, when the number of applications running in single-screen mode is two, only one thumbnail image is displayed when switching to dual-screen mode. In order to display the window of the application of that thumbnail image, it is necessary to take the trouble of selecting that one thumbnail image. In addition, it is assumed that the display will be used by dividing it into three or more display areas, and depending on how many display areas are divided, it may be better to display thumbnail images, but it may also be the case that displaying thumbnail images will make the operation more complicated.
[0006] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objects is to provide an information processing device and a control method that appropriately control the display when switching from single-screen mode to multiple-screen mode. [Means for solving the problem]
[0007] The present invention has been made to solve the above-mentioned problems. An information processing device according to a first aspect of the present invention includes a display, a memory that stores a program of an application, and a processor that controls displaying a window of the application on the display by executing the program of the application stored in the memory. The processor performs a display mode switching process that controls switching between a first display mode in which the entire screen area of the display is controlled as a single display area, and a second display mode in which the screen area of the display is divided into a plurality of display areas and controls display, and a display control process that, when switching from the first display mode to the second display mode by the display mode switching process, displays one of the windows of the application that was executed in the first display mode in a first display area of the plurality of display areas, and controls whether or not to display thumbnail images corresponding to the windows excluding the one window of the windows in the first display mode in a second display area of the plurality of display areas excluding the first display area, based on the number of display areas in the second display mode.
[0008] In addition, an information processing device according to a second aspect of the present invention includes a display, a memory that stores a program of an application, and a processor that controls the display of a window of the application on the display by executing the program of the application stored in the memory, wherein the processor performs a display mode switching process that controls switching between a first display mode in which the entire screen area of the display is controlled as a single display area and a second display mode in which the screen area of the display is divided into multiple display areas and controls the display, and a display control process that, when switching from the first display mode to the second display mode by the display mode switching process, displays one of the windows of the application that was executed in the first display mode in the first display area of the multiple display areas, and controls whether or not to display thumbnail images corresponding to the windows excluding the one window of the windows in the first display mode in the second display area of the multiple display areas excluding the first display area, based on the number of windows in the first display mode.
[0009] In the above-mentioned information processing device, when the display mode switching process switches from the first display mode to the second display mode, in the display control process, the processor may control whether or not to display the thumbnail images in the second display area based on the number of display areas in the second display mode and the number of windows in the first display mode.
[0010] In the above information processing device, when the processor switches from the first display mode to the second display mode by the display mode switching process, in the display control process, if the number of display areas in the second display mode is equal to or greater than the number of windows in the first display mode, the processor may not display the thumbnail images, and may display all of the windows in the first display mode except for the one window in the second display area.
[0011] In the above-mentioned information processing device, when the processor switches from the first display mode to the second display mode by the display mode switching process, in the display control process, if the number of display areas in the second display mode is smaller than the number of windows in the first display mode, the processor may display the thumbnail images in the second display areas.
[0012] In the above-mentioned information processing device, when there are multiple second display areas in the second display mode, in the display control process, the processor may display each of the windows in the first display mode except for the one window in one of the multiple second display areas.
[0013] In the above-mentioned information processing device, when the processor, in the display control process, displays the windows in the first display mode in each of the first display area and one or more second display areas, the processor may display the windows one by one in accordance with a predetermined area priority and a predetermined window priority in the first display area and one or more second display areas.
[0014] In the information processing device, in the display control process, the processor may increase a priority order of a window that became an active window later among the windows in the first display mode.
[0015] In the above information processing device, the processor may, in the display control process, lower the priority of the window that was minimized in the first display mode below the priority of the window that is not minimized.
[0016] In the above information processing device, when there are multiple second display areas in the second display mode, the processor may, in the display control process, cause the thumbnail image to be displayed in any one of the multiple second display areas.
[0017] In the above-mentioned information processing device, in the display control process, the processor may display the thumbnail image in any one of the second display areas in accordance with a priority order of the second display areas that is preset in advance.
[0018] In the above-mentioned information processing device, when one of the thumbnail images displayed in one of the plurality of second display areas is selected in the display control process, the processor may cause the window corresponding to the selected thumbnail image to be displayed in the second display area in which the thumbnail image was displayed, and may cause the unselected thumbnail images to be displayed in other of the second display areas in accordance with the priority order of the areas.
[0019] In the information processing device, the processor may, in the display control process, cause the thumbnail image to be displayed in an area that has the lowest priority among the plurality of second display areas.
[0020] In the information processing device, the window that was minimized when switching from the first display mode to the second display mode may not be included in the number of windows in the first display mode.
[0021] In the above information processing device, when an operation of dragging the one window in the first display mode is performed, the processor displays operation display information as an operator for receiving an operation to switch to the second display mode by the display control process, and the operation display information includes display information that allows selection of the number of multiple divided display areas in the second display mode and a display area among the multiple divided display areas in which to display the one dragged window, as options for the second display mode when switching from the first display mode to the second display mode, and when switching from the first display mode to the second display mode by the display mode switching process in response to the operation being performed on the operation display information, the processor may display the one window as the first display area in the display control process, and control whether or not to display thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode, based on the number of display areas in the second display mode selected by the operation on the operation display information.
[0022] In the above information processing device, when an operation of dragging the one window in the first display mode is performed, the processor displays operation display information as an operator for receiving an operation to switch to the second display mode by the display control process, and the operation display information includes display information that allows selection of the number of display areas divided into multiple display areas in the second display mode and a display area among the multiple display areas in which the dragged one window is to be displayed, as options for the second display mode when switching from the first display mode to the second display mode, and when switching from the first display mode to the second display mode by the display mode switching process in response to an operation being performed on the operation display information, the processor displays the one window as the first display area in the display control process, and controls whether or not to display thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode, based on the number of windows in the first display mode, in the second display area excluding the first display area among the multiple display areas.
[0023] In the above-mentioned information processing device, when the processor switches from the first display mode to the second display mode by the display mode switching process in response to an operation being performed on the operation display information, in the display control process, the processor may control whether or not to display the thumbnail images in the second display area based on the number of display areas in the second display mode selected by an operation on the operation display information and the number of windows in the first display mode.
[0024] Furthermore, according to a third aspect of the present invention, a control method in an information processing device having a display, a memory for storing an application program, and a processor for controlling display of a window of the application on the display by executing the program of the application stored in the memory includes a display mode switching step in which the processor controls switching between a first display mode in which the entire screen area of the display is controlled as a single display area, and a second display mode in which the screen area of the display is divided into a plurality of display areas and controlled to display, and a display control step in which, when switching from the first display mode to the second display mode by the display mode switching step, one of the windows of the application that was executed in the first display mode is displayed in a first display area of the plurality of display areas, and, in a second display area of the plurality of display areas excluding the first display area, whether or not to display thumbnail images corresponding to the windows excluding the one window of the windows in the first display mode, based on the number of display areas in the second display mode.
[0025] Furthermore, according to a fourth aspect of the present invention, a control method in an information processing device having a display, a memory for storing an application program, and a processor for controlling display of a window of the application on the display by executing the program of the application stored in the memory includes a display mode switching step in which the processor controls switching between a first display mode in which the entire screen area of the display is controlled as a single display area, and a second display mode in which the screen area of the display is divided into a plurality of display areas and controlled to display, and a display control step in which, when switching from the first display mode to the second display mode by the display mode switching step, one of the windows of the application that was executed in the first display mode is displayed in the first display area of the plurality of display areas, and, in the second display area of the plurality of display areas excluding the first display area, whether or not to display thumbnail images corresponding to the windows excluding the one window of the windows in the first display mode, based on the number of windows in the first display mode. Effect of the Invention
[0026] According to the above-described aspects of the present invention, it is possible to appropriately control the display when switching from the single-screen mode to the multiple-screen mode. [Brief description of the drawings]
[0027] [Figure 1] FIG. 1 is a perspective view showing the appearance of an information processing apparatus according to a first embodiment. [Diagram 2] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a bent state. [Diagram 3] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a flat state. [Figure 4] 3A to 3C are views showing specific examples of various display modes of the information processing device according to the first embodiment. [Diagram 5]FIG. 4 is a diagram showing an example of operation specifications for a display mode switching operation according to the first embodiment. [Figure 6] FIG. 2 is a view showing an example of a display in a dual screen mode according to the first embodiment. [Figure 7] 5A to 5C are views showing a first example of display control when switching from a single-screen mode to a dual-screen mode according to the first embodiment. [Figure 8] 6A to 6C are diagrams showing a second example of display control when switching from the single-screen mode to the dual-screen mode according to the first embodiment. [Figure 9] 11A to 11C are views showing a third example of display control when switching from the single-screen mode to the dual-screen mode according to the first embodiment. [Figure 10] FIG. 2 is a block diagram showing an example of the hardware arrangement of the information processing apparatus according to the first embodiment. [Figure 11] FIG. 2 is a block diagram showing an example of a functional arrangement related to a display control process according to the first embodiment. [Figure 12] 6 is a flowchart showing an example of a display control process of a thumbnail window according to the first embodiment. [Figure 13] 10 is a flowchart showing an example of a display control process when a thumbnail image is selected according to the first embodiment. [Figure 14] FIG. 11 is a diagram showing an example of operation specifications for a display mode switching operation according to the second embodiment. [Figure 15] 13A and 13B are diagrams showing a first example of display control when switching from a single-screen mode to a triple-screen mode according to the second embodiment. [Figure 16] 13A and 13B are diagrams showing a second example of display control when switching from the single-screen mode to the triple-screen mode according to the second embodiment. [Figure 17] 13A and 13B are diagrams showing a third example of display control when switching from the single-screen mode to the triple-screen mode according to the second embodiment. [Figure 18] 13A and 13B are diagrams showing a first example of display control when switching from a single-screen mode to a quad-screen mode according to the second embodiment. [Figure 19] 13A and 13B are diagrams showing a second example of display control when switching from the single-screen mode to the quad-screen mode according to the second embodiment. [Figure 20]10 is a flowchart showing an example of a display control process of a thumbnail window according to the second embodiment. [Figure 21] 13A and 13B are diagrams showing a fourth example of display control when switching from the single-screen mode to the triple-screen mode according to the second embodiment. [Figure 22] 13A and 13B are diagrams showing a third example of display control when switching from the single-screen mode to the quad-screen mode according to the second embodiment. [Figure 23] 13A to 13C are diagrams showing an example of operation specifications for a display mode switching operation according to the third embodiment. [Figure 24] FIG. 13 is a view showing a display example of a switching menu according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0028] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <First embodiment> First, an overview of the first embodiment of the present invention will be described. FIG. 1 is a perspective view showing the appearance of an information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is a clamshell type (notebook type) PC (personal computer). The information processing device 10 includes a first housing 101, a second housing 102, and a hinge mechanism 103. The first housing 101 and the second housing 102 are substantially rectangular plate-shaped (for example, flat) housings. One side surface of the first housing 101 and one side surface of the second housing 102 are coupled (connected) via the hinge mechanism 103, and the first housing 101 and the second housing 102 can rotate relatively around a rotation axis formed by the hinge mechanism 103. A state in which the opening angle θ of the first housing 101 and the second housing 102 around the rotation axis is substantially 0° is a state in which the first housing 101 and the second housing 102 overlap and are closed. A state in which the first housing 101 and the second housing 102 are closed is referred to as a "closed state." In the closed state, the surfaces of the first housing 101 and the second housing 102 that face each other are referred to as the "inner surface," and the surface opposite to the inner surface is referred to as the "outer surface." The opening angle θ can also be said to be an angle formed by the inner surface of the first housing 101 and the inner surface of the second housing 102. A state in which the first housing 101 and the second housing 102 are open relative to the closed state is referred to as an "open state." The open state is a state in which the first housing 101 and the second housing 102 are rotated relatively until the opening angle θ becomes larger than a preset threshold value (for example, 10°).
[0029] The information processing device 10 also includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided from the inner surface of the first housing 101 to the inner surface of the second housing 102. The camera 16 is provided, for example, on the outer side of the screen area of the display 150 on the inner surface of the first housing 101, and can capture an image of a user or the like present on the side facing the display 150. The display 150 is a flexible display that can be bent according to an opening angle θ due to relative rotation between the first housing 101 and the second housing 102 (see FIGS. 2 and 3). As the flexible display, an organic EL display or the like is used. The information processing device 10 can control the display of the entire screen area of the display 150 as one display area DA as a single screen configuration, or can control the display of the screen area of the display 150 as a two-screen configuration by dividing the screen area into two display areas, a first display area DA1 and a second display area DA2. Here, the first display area DA1 and the second display area DA2 are display areas that do not overlap with each other. Here, the display area of the screen area of the display 150 that corresponds to the inner surface side of the first housing 101 is the first display area DA1, and the display area that corresponds to the inner surface side of the second housing 102 is the second display area DA2. Hereinafter, the display mode that controls the display in a single screen configuration is referred to as the "single screen mode," and the display mode that controls the display in a dual screen configuration is referred to as the "dual screen mode."
[0030] A touch sensor is provided above the screen area of the display 150. The information processing device 10 can detect a touch operation on the screen area of the display 150. By opening the information processing device 10, the user can view the display 150 provided on the inner surface of each of the first housing 101 and the second housing 102 and can perform a touch operation on the display 150, thereby enabling the user to use the information processing device 10.
[0031] Next, the use form and the screen mode of the information processing device 10 will be described in detail. First, the use form of the information processing device 10 is divided into a state in which the first housing 101 and the second housing 102 are bent (Bent form) and a state in which the first housing 101 and the second housing 102 are not bent (Flat form) depending on the opening angle θ between the first housing 101 and the second housing 102. Hereinafter, the state in which the first housing 101 and the second housing 102 are bent (Bent form) is simply referred to as the "Bent form", and the state in which the first housing 101 and the second housing 102 are not bent (Flat form) is simply referred to as the "Flat form". In the bent form, the display 150 provided across the first housing 101 and the second housing 102 is also bent. In the flat form, the display 150 is also flat.
[0032] FIG. 2 is a side view showing an example of the information processing device 10 in a bent state (bent form). The display 150 is arranged across (straddling) the first housing 101 and the second housing 102. The screen area of the display 150 (display area DA shown in FIG. 1) can be bent (bent) at a crease at a portion corresponding to the hinge mechanism 103, and the display area on the first housing 101 side and the second housing 102 side of the crease are shown as a first display area DA1 and a second display area DA2, respectively. The display 150 bends according to the rotation (opening angle θ) of the first housing 101 and the second housing 102. The information processing device 10 determines whether or not it is in a bent state (bent form) according to the opening angle θ. For example, when 10°<θ<170°, the information processing device 10 determines that it is in a bent state (bent form). This state corresponds to a usage form called a clamshell mode or a book mode.
[0033] 3 is a side view showing an example of the information processing device 10 in a flat form. The information processing device 10 typically determines that it is in a flat form when the opening angle θ is 180°, but as an example, it may determine that it is in a flat form when 170°≦θ≦180°. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat form. This state corresponds to a usage form called a tablet mode.
[0034] Next, display modes according to various usage patterns of the information processing device 10 will be described in detail with reference to FIG. 4 is a diagram showing specific examples of various display modes of the information processing device 10 according to this embodiment. The information processing device 10 has different display modes depending on the usage form classified by the opening angle θ between the first housing 101 and the second housing 102, the attitude (direction) of the information processing device 10, whether it is a single-screen mode or a dual-screen mode, etc. Note that one screen is also called a single screen, and two screens are also called a split screen or dual screen.
[0035] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage form. For example, in this closed state, the information processing device 10 is in a standby state such as a sleep state or a hibernation state, and the display 150 is in a display-off state. This standby state such as a sleep state or a hibernation state corresponds to, for example, a system power state S3 or S4 defined by ACPI (Advanced Configuration and Power Interface).
[0036] The display mode (b) is a display mode in which the display 150 is in a bent state (bent form) and in a dual screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled. The orientation of the information processing device 10 is such that the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. The display area is vertically oriented when the long side of the four sides of the rectangular display area is vertical and the short side is horizontal. When the display area is vertically oriented, the display orientation is also vertical, and the direction along the long side corresponds to the up-down direction and the direction along the short side corresponds to the left-right direction. This usage mode is such that the left and right pages of a book when it is opened correspond to the left and right screens, and corresponds to a so-called book mode. This usage form is also called "Fold Landscape" because the display is bent, the first display area DA1 and the second display area DA2 are arranged side by side, and the combined display area is long horizontally.
[0037] In this display mode (b), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode, with the first display area DA1 on the left side as the primary screen and the second display area DA2 on the right side as the secondary screen. Note that in the display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.
[0038] The display mode (c-1), like the display mode (b), is a display mode in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, for display control, but the orientation of the information processing device 10 is different. The orientation of the information processing device 10 is an orientation in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically above and below. The display area being horizontal means that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display orientation is also horizontal, and the direction along the short side corresponds to the vertical direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the general usage modes of a clamshell type PC.
[0039] In this display mode (c-1), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode in which the first display area DA1 is the primary screen and the second display area DA2 is the secondary screen. Note that in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.
[0040] For example, the information processing device 10 automatically switches from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure with respect to the display mode (b), the information processing device 10 switches to display mode (c-1) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (b) state. Also, since the display mode (b) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure with respect to the display mode (c-1), the information processing device 10 switches to display mode (b) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (c-1) state.
[0041] The display mode (c-2) is the same as the display mode (c-1) in that the information processing device 10 is in the bent form and the orientation is the same, but it is different in that an external keyboard 30 (Dockable mini KBD: Keyboard) connectable to the information processing device 10 is connected. This usage mode is a state in which a physical keyboard 30 is connected to a general usage mode of a clamshell type PC. For example, the keyboard 30 is almost the same size as the second display area DA2 and is configured to be able to be placed on the second display area DA2. As an example, the keyboard 30 has a magnet provided inside (end) of the bottom surface, and when placed on the second display area DA2, it is attracted to and fixed to a metal part at the end of the inner surface of the second housing 102. This results in a usage mode similar to that of a conventional clamshell type PC that is originally provided with a physical keyboard. In addition, the information processing device 10 and the keyboard 30 are connected by, for example, Bluetooth (registered trademark). In this display mode (c-2), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because the second display area DA2 cannot be seen due to the keyboard. In other words, this display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as "half screen mode"), and is a one-screen mode that uses only the first display area DA1.
[0042] For example, when the information processing device 10 detects a connection to an external keyboard in the display mode (c-1), the display mode is automatically switched from the display mode (c-1) to the display mode (c-2) (Switch by Dock).
[0043] Display mode (d) is in a bent state (Bent form) like display mode (b), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the entire screen area of the display 150 is controlled as a single display area DA. This usage form is different from display mode (b) in that it is a single screen mode, but since it is in a bent state (Bent form) and the display area DA is horizontally long, it is also called "Fold Landscape". The display area DA is horizontal, and the display orientation is also horizontal.
[0044] Here, switching between the single screen mode and the dual screen mode in the bent state (Bent form) is performed, for example, by a user operation. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single screen mode and the dual screen mode at any location on the screen, and switches from display mode (b) to display mode (d) based on an operation on the operator (Switch by UI). A specific example of this display mode switching operation will be described later.
[0045] Display mode (e) is in a bent state (bent form) like display mode (c-1), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the display is controlled with the entire screen area of the display 150 as a single display area DA. This usage mode differs from display mode (c-1) in that it is a single screen mode, but it corresponds to the usage mode of a clamshell type PC from the bent state (bent form) and the orientation of the information processing device 10. The display area DA is vertical, and the display orientation is also vertical.
[0046] For example, the information processing device 10 automatically switches from display mode (d) to display mode (e) or from display mode (e) to display mode (d) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d), the information processing device 10 switches to display mode (e) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d) state. Also, since the display mode (d) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e), the information processing device 10 switches to display mode (d) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e) state.
[0047] The display mode (d') is a single screen mode similar to the display mode (d), and the orientation of the information processing device 10 is also a landscape orientation with the display area DA, but is different in that it is in a flat state (Flat form). The flat state (Flat form) is a state in which the opening angle θ between the first housing 101 and the second housing 102 is approximately 180°. This usage form corresponds to the so-called tablet mode described with reference to FIG. 3, and is also called "Flat Landscape" because it is in a flat state (Flat form) and the display area DA is landscape. This display mode (d') is different from the display mode (d) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to the display mode (d), the display area DA is landscape, and the display orientation is also landscape.
[0048] Display mode (e') is a single screen mode similar to display mode (e), and the orientation of the information processing device 10 is also vertically long in the display area DA, but it is different in that it is in a flat state (Flat form). This usage form is also called "Flat Portrait" because it is in a flat state (Flat form) and the display area DA is vertically long. This display mode (e') differs from display mode (e) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to display mode (e), the display area DA is vertically long, and the display orientation is also vertical.
[0049] For example, the information processing device 10 automatically switches from display mode (d') to display mode (e') or from display mode (e') to display mode (d') by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e') is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d'), the information processing device 10 switches to display mode (e') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d'). Also, since the display mode (d') is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e'), the information processing device 10 switches to display mode (d') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e').
[0050] In display mode (d') and display mode (e'), it is also possible to switch to dual screen mode while remaining in flat form by the user operating an operator (for example, a display mode switching icon, described later with reference to FIG. 5) as a UI capable of switching between the single screen mode and dual screen mode. For example, when switching from display mode (d') to dual screen mode, the display state in flat form becomes the same as display mode (b). Also, when switching from display mode (e') to dual screen mode, the display state in flat form becomes the same as display mode (c-1).
[0051] Furthermore, when the information processing device 10 detects a connection to the keyboard 30 in the display mode (e'), it automatically switches from the display mode (e') to the display mode (c-2') (Switch by Dock). The display mode (c-2') is a flat state (Flat form), and differs from the display mode (c-2) only in the opening angle θ between the first housing 101 and the second housing 102. In this display mode (c-2'), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off, since it cannot be seen by the keyboard. In other words, this display mode (c-2') is a half screen mode in which only half of the screen is effective for display, similar to the display mode (c-2).
[0052] Furthermore, the information processing device 10 can automatically switch from the single screen mode to the dual screen mode by detecting a change from a flat state (Flat form) to a bent state (Bent form) (Switch by Hinge angle). For example, when the information processing device 10 detects a change to a bent state (Bent form) in the display mode (d') based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (d') to the display mode (b). Furthermore, when the information processing device 10 detects a change to a bent state (Bent form) in the display mode (e') based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (e') to the display mode (c-1).
[0053] (Display mode switching operation) Next, a specific example of operation specifications when the display mode is switched by a user operation will be described. FIG. 5 is a diagram showing an example of the operation specifications of the display mode switching operation according to the present embodiment. For example, as shown in FIG. 5(A), an icon C1 for displaying a display mode switching menu is displayed in a task bar B2. The task bar B2 is displayed somewhere within the screen area of the display 150. For example, whether in the single screen mode or the dual screen mode, the task bar B2 is displayed only in one place (for example, at the bottom of the screen area) within the screen area of the display 150. Note that in the dual screen mode, the task bar B2 may be displayed in each of the first display area DA1 and the second display area DA2 (for example, at the bottom of each).
[0054] When an operation is performed on the icon C1 that displays the switching menu, the display mode switching menu is displayed as a pop-up screen. The display mode switching menu may be displayed as a pop-up screen when the display mode changes from a bent form to a flat form. The display mode switching menu may be displayed as a pop-up screen when the display mode changes from a flat form to a bent form.
[0055] In the switching menu, display mode switching icons are displayed as display mode options, allowing the user to instruct switching between single screen mode and dual screen mode, and switching between display data to be displayed in the first display area DA1 and the second display area DA2 in the dual screen mode (switching between the primary screen and the secondary screen). In the switching menu, options of display modes that the user can select depending on the usage mode (the orientation of the display 150) at that time are displayed.
[0056] FIG. 5(B) shows a switching menu M1 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.). Note that "1" and "2" in the figure are added to distinguish the display areas, and are expressed by numbers according to the area priority previously set for each display area. For example, in the dual screen mode, "1" has a higher area priority than "2", and indicates, for example, the primary screen, and "2" indicates the secondary screen. The switching menu M1 displays a display mode switching icon C11, a display mode switching icon C12, and a display mode switching icon C13. The display mode switching icon C11 is displayed as an operator for selecting the display mode (d) and the display mode (d') in the single screen mode. The display mode switching icon C12 and the display mode switching icon C13 are displayed as controls for selecting the display mode (b) of the dual-screen mode, and the order of "1" (primary screen) and "2" (secondary screen) is different between the display mode switching icon C12 and the display mode switching icon C13.
[0057] The display mode switching icon corresponding to the current display mode is displayed in a manner that allows it to be distinguished from the other display mode switching icons. Here, the display mode switching icon C11 is highlighted relative to the other display mode switching icons C12 and C13 so that it can be seen that the display mode switching icon C11 is the current display mode.
[0058] FIG. 5(C) shows a switching menu M2 that is displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). In the switching menu M2, a display mode switching icon C21, a display mode switching icon C22, and a display mode switching icon C23 are displayed. The display mode switching icon C21 is displayed as an operator for selecting the single screen mode (display mode (e) and display mode (e')). The display mode switching icon C22 and the display mode switching icon C23 are displayed as operators for selecting the display mode (c-1) of the dual screen mode, and the order of "1" (primary screen) and "2" (secondary screen) is different in the display mode switching icon C22 and the display mode switching icon C23.
[0059] 5B, the display mode switching icon corresponding to the current display mode is displayed in a manner that allows it to be distinguished from the other display mode switching icons. Here, the display mode switching icon C21 is highlighted relative to the other display mode switching icons C22 and C23 so that it can be seen that the display mode switching icon C21 is the current display mode.
[0060] The user can arbitrarily select any one of the display mode switching icons displayed in the switching menu M1 or the switching menu M2. When the user selects any one of the display mode switching icons, the display of the switching menu is terminated. Alternatively, when the user does not select any of the display mode switching icons even after a predetermined time (e.g., 3 to 5 seconds) has elapsed since the switching menu M1 or the switching menu M2 was displayed, the display of the switching menu is terminated. Also, when the user operates the close button "x" in the upper right of the switching menu, when the user operates outside the screen of the popped-up switching menu, or when the orientation of the information processing device 10 is changed, the display of the switching menu is terminated. Note that, when the keyboard 30 is connected, the display is fixed to the half screen mode (display mode (c-2)) in which only the first display area DA1 is enabled, and therefore the switching menu is not displayed.
[0061] The UI for switching between the single-screen mode and the dual-screen mode is not limited to the example shown in Fig. 5, and any UI can be used. For example, an icon that alternates between the single-screen mode and the dual-screen mode each time it is operated, or an icon that alternates between the single-screen mode, the dual-screen mode, and the inverted dual-screen mode each time it is operated may be displayed on the task bar B2. In the following description, when there is no particular distinction between the dual-screen mode and the inverted dual-screen mode, they are collectively referred to as the dual-screen mode.
[0062] 5, the display mode switching menu is displayed as a pop-up screen by an operation on the icon C1 displayed on the taskbar B2, but the switching menu may be displayed as a pop-up screen by a drag operation on the application window, etc. Also, the display mode may be switched by a drag operation on the application window, etc. When the switching menu is popped up by a drag operation on the application window, it is possible to select not only the screen mode but also the screen area by dragging onto one of the divided areas of the screen area displayed in the switching menu, and to place the dragged application in the selected area. Also, the switching menu may be displayed as a pop-up screen by an operation on a specific location of the application window.
[0063] (Display control when switching from single screen mode to dual screen mode) Next, display control when switching from single screen mode to dual screen mode will be described. When switching from single screen mode to dual screen mode, the information processing device 10 displays one of the windows of an application (hereinafter simply referred to as an "app") that was executed in the single screen mode in the first display area DA1 (e.g., the primary screen). For example, the information processing device 10 displays an active window of the windows of the app that was executed in the single screen mode in the first display area DA1.
[0064] Here, when multiple windows are open, the individual windows are arranged in multiple layers on display 150. The active window is a window that is currently selected and is the object of the user's operation, and is, for example, a window that is arranged and displayed in the foreground layer (top layer) of display 150. The active window that information processing device 10 displays in first display area DA1 when switching from single-screen mode to dual-screen mode is the window that was displayed as the active window in the single-screen mode immediately before switching to the dual-screen mode.
[0065] When information processing device 10 switches from single screen mode to dual screen mode, it displays the active window in single screen mode in first display area DA1, but if there is no active window, it displays in first display area DA1 the window with the highest priority among the windows displayed in display area DA in single screen mode.
[0066] The window with the highest priority is typically the active window, but if there is no active window, it is the window that was last to become active. For example, when an operation is performed on a part other than a window in the display area DA, there is no active window, but the window that was last to become active is displayed in the first display area DA1. In other words, the later the window is in the active window, the higher its display priority, and the window with the highest priority is displayed in the first display area DA1. However, for ease of understanding, in the following explanation, the window with the highest priority will be described as the "active window."
[0067] Furthermore, when the information processing device 10 switches from the single screen mode to the dual screen mode, it displays in the second display area DA2 (e.g., the secondary screen) thumbnail images corresponding to inactive windows excluding the active window among the windows in the single screen mode. Here, the inactive windows are windows other than the active window in the single screen mode immediately before transitioning to the dual screen mode. Hereinafter, the window in which the thumbnail images of the inactive windows are displayed is also referred to as the "thumbnail window."
[0068] With reference to FIG. 6, a display example in the dual-screen mode in which a thumbnail window is displayed in the second display area DA2 when the single-screen mode is switched to the dual-screen mode will be described. FIG. 6 is a diagram showing a display example of the dual screen mode according to this embodiment. Here, a display example of the dual screen mode in the display mode (c-1) shown in FIG. 4 is shown. This is a typical dual screen mode usage form of a clamshell type PC, in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. The display area is horizontally oriented, meaning that the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. The vertical direction corresponds to the vertical (up and down) direction, and the horizontal direction corresponds to the horizontal (left and right) direction. The vertical direction is typically the vertical direction. That is, the first display area DA1 and the second display area DA2 are arranged so that the edge on the lower side in the display orientation of the first display area DA1 is the edge on the upper side in the display orientation of the second display area DA2.
[0069] When the information processing device 10 switches from the single screen mode to the dual screen mode, the information processing device 10 displays the active window of the application running in the single screen mode in the first display area DA1. For example, when the information processing device 10 transitions to the dual screen mode, the information processing device 10 maximizes the active window that was displayed in the display area DA in the single screen mode to the entire display area of the first display area DA1 and displays it as the active window. Also, when the information processing device 10 transitions to the dual screen mode, the information processing device 10 causes a window that was an inactive window in the single screen mode to correspond to a layer behind the foreground where the active window in the first display area DA1 is displayed, while maintaining the layer relationship (window overlap order) in the single screen mode. Therefore, in the first display area DA1, the active window is maximized and displayed, and the inactive window is not displayed (is not visible to the user) although it exists in a layer behind the active window.
[0070] Furthermore, when switching from single screen mode to dual screen mode, information processing device 10 generates thumbnail images of windows that were inactive in single screen mode and displays the thumbnail windows in second display area DA2 (secondary screen). When there are multiple inactive windows, information processing device 10 displays a thumbnail window in which thumbnail images of the multiple inactive windows are arranged in second display area DA2.
[0071] For example, a thumbnail window displays thumbnail images (reduced images) of multiple windows side by side. A title bar B1 is displayed at the top of the thumbnail window. A close button "X" at the right end of the title bar B1 is displayed as an operator for closing the thumbnail window. A user can close (hide) all of the thumbnail images by operating (for example, tapping) the close button "X" of the title bar B1.
[0072] In addition, an inactive window (i.e., the main body (actual window) of an inactive window whose thumbnail image is displayed in the second display area DA2) existing in a layer behind an active window in the first display area DA1 may be arranged in the same size as the active window so as to be hidden behind the active window, in accordance with the priority order, or may be arranged in a size smaller than the active window so as to be arranged in the same size as the active window, in accordance with the priority order. In addition, all inactive windows (i.e., the main body (actual window) of an inactive window whose thumbnail image is displayed in the second display area DA2) may be temporarily minimized (for example, in Windows (registered trademark), a state in which only an application icon exists on the taskbar). In addition, when switching from the single screen mode to the dual screen mode, the position of the inactive window does not have to be replaced with the position in the single screen mode, and may be in a state where it is invisible or difficult to see from the user by the arrangement of the layer behind the active window arranged in the first display area DA1 and the thumbnail window displayed in the second display area DA2. For example, if the background of the thumbnail window (part other than the thumbnail image) is semi-transparent (see-through), the inactive window arranged in the layer behind will be in a state where it is difficult to see from the user. Or, if the thumbnail window is not semi-transparent (see-through), it will be invisible to the user even if it is placed behind it. In short, the main body (actual window) of the inactive window in which the thumbnail image is displayed in the second display area DA2 may be temporarily processed to be invisible or difficult to see from the user. Then, in the second display area DA2, the window of the application of the thumbnail image selected in the thumbnail window is displayed in the foreground as the active window.
[0073] Furthermore, the task bar B2 displayed at the bottom end of the second display area DA2 corresponds to the task bar B2 shown in Fig. 5, and is displayed in one place as a task bar common to the first display area DA1 and the second display area DA2. The position at which the task bar B2 is displayed may be the left or right end of the first display area DA1 or the second display area DA2, or may be the top end of the first display area DA1. As described above, a task bar may be displayed in each of the first display area DA1 and the second display area DA2. The position at which the task bar is displayed does not limit the application of the present invention.
[0074] 6 shows an example in which thumbnail images are displayed in the second display area DA2 as a thumbnail window including a title bar B1, but the title bar B1 may not be displayed and multiple thumbnail images may simply be displayed side by side. In this case, the thumbnail window may be closed (all thumbnail images may be closed and hidden) by the user performing an operation (for example, a tap operation) on the background part other than the thumbnail images in the thumbnail window or on the outside of the thumbnail window.
[0075] When any thumbnail image is selected by a user operation (e.g., a tap operation), the information processing device 10 closes (hides) the thumbnail window that was displayed in the second display area DA2, and displays an inactive window corresponding to the selected thumbnail image as an active window in the second display area DA2. Specifically, as an example, the information processing device 10 moves the inactive window corresponding to the selected thumbnail image from the first display area DA1 to the second display area DA2, and then maximizes it in the second display area DA2 to display it as the active window.
[0076] Here, in the case where there is one window in the single screen mode, when the information processing device 10 switches from the single screen mode to the dual screen mode, it displays the active window in the first display area DA1, but does not display a thumbnail window in the second display area DA2 because there is no thumbnail image to display in the second display area DA2. For example, in the second display area DA2, no window is displayed and only the desktop screen is displayed.
[0077] Also, in the case where there are two windows in the single screen mode, when the information processing device 10 switches from the single screen mode to the dual screen mode, it displays the active window in the first display area DA1, and displays an inactive window other than the active window in the second display area DA2, rather than displaying a thumbnail window. This is to avoid the need to take the trouble of selecting one thumbnail image for displaying the window of the thumbnail image, even if a thumbnail image of the only inactive window is displayed in the second display area DA2, which would make the operation complicated. It is more convenient to display the only inactive window as an inactive window in the second display area DA2, rather than displaying it as a thumbnail image and accepting a selection operation, since it is not necessary to take the trouble of selecting a thumbnail image.
[0078] In other words, when the information processing device 10 switches from single screen mode to dual screen mode, it controls whether or not to display thumbnail windows (thumbnail images) in the second display area DA2 based on the number of windows of the application that were running in the single screen mode.
[0079] FIG. 7 is a diagram showing a first example of display control when switching from single screen mode to dual screen mode according to this embodiment. FIG. 7(A) shows a display example in single screen mode, and FIG. 7(B) shows a display example after switching to dual screen mode. In the illustrated example, the number of windows of an application executed in single screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA. The window W1 is an active window arranged in the foreground layer (top layer). When switching from single screen mode to dual screen mode, the window W1 is maximized and displayed as an active window in the first display area DA1, and a thumbnail window in which thumbnail images SW2 and SW3 of the windows W2 and W3 are arranged is displayed in the second display area DA2. Note that if the number of windows of an application executed in single screen mode is four or more, the number of thumbnail images displayed in the second display area DA2 when switching to dual screen mode will also be three or more.
[0080] FIG. 8 is a diagram showing a second example of display control when switching from the single screen mode to the dual screen mode according to the present embodiment. FIG. 8(A) shows a display example in the single screen mode, and FIG. 8(B) shows a display example after switching to the dual screen mode. In the illustrated example, the number of windows of an application executed in the single screen mode is two. Here, two windows W1 and W2 are shown in the display area DA. The window W1 is an active window arranged in the foreground layer (top layer). When switching from the single screen mode to the dual screen mode, the window W1 is maximized and displayed as an active window in the first display area DA1, and the window W2 is maximized and displayed as an inactive window in the second display area DA2. Note that if the number of windows of an application executed in the single screen mode is one or less, neither the window of the application nor the thumbnail window (thumbnail image of the window) is displayed in the second display area DA2 when switching to the dual screen mode.
[0081] In this way, when information processing device 10 switches from single screen mode to dual screen mode, if the number of windows in single screen mode is more than two (the number of display areas in dual screen mode), it displays in second display area DA2 a thumbnail window in which thumbnail images of windows in single screen mode excluding the active window are arranged. On the other hand, when information processing device 10 switches from single screen mode to dual screen mode, if the number of windows in single screen mode is two or less (the number of display areas in dual screen mode), it does not display a thumbnail window, and if the number of windows in single screen mode is two, it displays inactive windows in single screen mode in second display area DA2.
[0082] In other words, when the information processing device 10 switches from single-screen mode to dual-screen mode, it controls whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the dual-screen mode and the number of windows in the single-screen mode.
[0083] Note that the window of an application running in single-screen mode may be minimized. In that case, the minimized window does not need to be included in the number of windows in single-screen mode.
[0084] FIG. 9 is a diagram showing a third example of display control when switching from the single screen mode to the dual screen mode according to the present embodiment. FIG. 9(A) shows a display example in the single screen mode, and FIG. 9(B) shows a display example after switching to the dual screen mode. In the illustrated example, the number of application windows executed in the single screen mode is three, namely, windows W1, W2, and W3, and one of them, window W3, is minimized. The minimized window W3 is in a state where only the application icon exists on the task bar. Note that the application icon of window W3 shown in the figure is to clearly indicate that window W3 is minimized, and is not displayed on the task bar as a result of minimization. In reality, application icons of windows W1 and W2 are also displayed on the task bar.
[0085] For example, the number of windows in single-screen mode is two, not including window W3 that was minimized. When switching from single-screen mode to dual-screen mode, window W1 is maximized and displayed as the active window in first display area DA1, and window W2 is maximized and displayed as an inactive window in second display area DA2. Window W3 continues to be minimized even after transition to dual-screen mode, and when an operation to open it from the minimized state (for example, an operation on the app icon on the taskbar) is performed, it is displayed on the first display area DA1 side.
[0086] In addition, when the window of the application being executed in the single screen mode is minimized, the minimized window may be included in the number of windows in the single screen mode. In that case, when switching from the single screen mode to the dual screen mode, the window W1 is maximized and displayed as the active window in the first display area DA1, and a thumbnail window in which thumbnail images SW2 and SW3 of the windows W2 and W3 are arranged is displayed in the second display area DA2, as in the display example of the dual screen mode shown in Fig. 7. In addition, when the number of windows in the single screen mode is two, including the minimized window, the thumbnail window is not displayed, and one of the two windows is displayed in the first display area DA1, and the other is displayed in the second display area DA2.
[0087] (Configuration of information processing device 10) The specific configuration of the information processing device 10 will be described below. 10 is a block diagram showing an example of a hardware configuration of an information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, and a control unit 18. These units are connected to each other so as to be able to communicate with each other via a bus or the like.
[0088] The communication unit 11 includes, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), and a communication device that performs wireless communication such as Bluetooth (registered trademark) and Wi-Fi (registered trademark). For example, the communication unit 11 can communicate with the above-mentioned external keyboard 30, etc., using Bluetooth (registered trademark).
[0089] In the RAM 12, programs and data for processing executed by the control unit 18 are deployed, and various data are appropriately saved or erased. For example, the RAM 12 also functions as a video memory (V-RAM) for display of the display 150. As an example, the RAM 12 functions as a video memory for data displayed in each display area when the display 150 is controlled in a single screen mode or a dual screen mode. The RAM 12 also stores information on running apps, apps in use (active window apps) among the running apps, information on other inactive window apps, in which display area each window is displayed, in which layer each window is arranged, the size of the window, whether it is minimized, and the like. Note that the RAM 12 is a volatile memory, and therefore does not hold data when power supply to the RAM 12 is stopped. Data that needs to be held when power supply to the RAM 12 is stopped is transferred to the storage unit 13.
[0090] The storage unit 13 is configured to include one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Residual Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores programs and setting data for a BIOS (Basic Input Output System), an OS (Operating System), programs for applications that run on the OS, and various data used by the applications. The speaker 14 outputs electronic sounds, voices, and the like.
[0091] The display unit 15 includes a display 150 and a touch sensor 155. As described above, the display 150 is a flexible display that can be bent according to the opening angle θ caused by the relative rotation of the first housing 101 and the second housing 102. The display 150 performs display corresponding to each display mode described with reference to FIG. 4 according to the control of the control unit 18. The touch sensor 155 is provided on the screen of the display 150 and detects a touch operation on the screen. For example, the touch sensor 155 detects a touch operation on the display area DA in the single screen mode. Also, the touch sensor 155 detects a touch operation on one or both of the first display area DA1 and the second display area DA2 in the dual screen mode. The touch operation includes a tap operation, a slide operation, a flick operation, a swipe operation, a pinch operation, and the like. The touch sensor 155 detects the touch operation and outputs operation information based on the detected operation to the control unit 18.
[0092] Camera 16 includes a lens, an imaging element, etc. Camera 16 captures an image (still image or video) according to the control of control unit 18, and outputs data of the captured image.
[0093] First acceleration sensor 161 is provided inside first housing 101, and detects the orientation and changes in orientation of first housing 101. For example, if a direction parallel to the longitudinal direction of first display area DA1 is defined as an X1 direction, a direction parallel to the lateral direction is defined as a Y1 direction, and a direction perpendicular to the X1 and Y1 directions is defined as a Z1 direction, first acceleration sensor 161 detects acceleration in each of the X1, Y1, and Z1 directions, and outputs the detection results to control unit 18.
[0094] The second acceleration sensor 162 is provided inside the second housing 102, and detects the orientation and changes in orientation of the second housing 102. For example, if the direction parallel to the longitudinal direction of the second display area DA2 is the X2 direction, the direction parallel to the lateral direction is the Y2 direction, and the direction perpendicular to the X2 and Y2 directions is the Z2 direction, the second acceleration sensor 162 detects acceleration in each of the X2, Y2, and Z2 directions, and outputs the detection results to the control unit 18.
[0095] The hall sensor 17 is provided to detect the connection of the keyboard 30. For example, when the keyboard 30 is placed on the second display area DA2 of the second housing 102, a magnet provided inside the bottom surface of the keyboard 30 approaches, changing the magnetic field, and the detection value (output value) of the hall sensor 17 changes. In other words, the hall sensor 17 outputs a different detection result depending on whether the keyboard 30 is placed. Note that, although the hall sensor 17 is used here to detect whether the keyboard 30 is placed, the detection method is not limited to this, and any detection method can be used.
[0096] The control unit 18 includes a processor such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and realizes various functions by executing programs (various programs such as a BIOS, an OS, and applications that run on the OS) stored in the storage unit 13, etc. For example, the control unit 18 detects the attitude (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Furthermore, the control unit 18 detects whether the information processing device 10 is in an open state or a closed state, and if in an open state, whether the information processing device 10 is in a bent form or a flat form, based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.
[0097] Furthermore, the control unit 18 detects a display mode switching operation by the user (for example, an operation on a display mode switching icon shown in FIG. 5). Furthermore, the control unit 18 detects a connection with the keyboard 30 based on the detection result of the hall sensor 17. Note that this connection with the keyboard 30 refers to placing the keyboard 30 on the second display area DA2, and does not refer to a communication connection. The control unit 18 detects the communication connection with the keyboard 30 using a function such as Bluetooth (registered trademark).
[0098] In addition, the control unit 18 controls the display of the display 150 described with reference to FIG. 4 and FIGS. 6 to 9 by detecting the state of the system, the attitude (orientation) of the information processing device 10, whether it is in an open or closed state, and if in an open state, whether it is in a bent form or a flat form, a display mode switching operation by the user (see FIG. 5), connection to the keyboard 30, etc.
[0099] Next, a functional configuration related to the display control process among the processes executed by the control unit 18 will be described. 11 is a block diagram showing an example of a functional configuration related to the display control process according to this embodiment. The control unit 18 includes a system processing unit 181, a detection processing unit 182, and a display processing unit 183. Here, the system processing unit 181 is a functional configuration in which a CPU executes processing based on, for example, an OS or a BIOS. The detection processing unit 182 is a functional configuration in which a microcomputer other than the CPU that executes processing such as an OS or a BIOS executes various detection processes. The display processing unit 183 is a functional configuration in which a CPU executes processing based on, for example, an OS or a program that runs on the OS.
[0100] The system processing unit 181 executes various programs such as an OS and drivers and applications that run on the OS. The system processing unit 181 also includes, for example, an active application information generating unit 1811. The active application information generating unit 1811 generates application information including identification information (for example, an application ID) of an active application and information indicating an application being used by a user among the active applications (i.e., an application whose window is active). The active application information generating unit 1811 also generates window information indicating the window state of the active application. The window state indicates whether or not the window is an active window, the window size (minimized, maximized, etc.), etc. The active application information generating unit 1811 stores and holds the generated application information and window information in the RAM 12.
[0101] The detection processing unit 182 includes an open / close detection unit 1821, a posture detection unit 1822, and a connection detection unit 1823 as functional configurations for detecting the state of the information processing device 10. The detection processing unit 182 outputs detection results by the open / close detection unit 1821, the posture detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.
[0102] The open / close detection unit 1821 detects whether the information processing device 10 is in an open state or a closed state based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. When the information processing device 10 is in an open state, the open / close detection unit 1821 detects an open angle θ between the first housing 101 and the second housing 102 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Then, the open / close detection unit 1821 detects whether the information processing device 10 is in a bent form or a flat form based on the detected open angle θ.
[0103] The attitude detection unit 1822 detects the attitude (direction) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.
[0104] The connection detection unit 1823 detects a connection with the keyboard 30. For example, the connection detection unit 1823 detects whether or not the keyboard 30 is placed on the second display area DA2 based on the detection result of the hall sensor 17, thereby detecting the connection with the keyboard 30. The detection processing unit 182 outputs the detection results (states of the information processing device 10) by the open / close detection unit 1821, the attitude detection unit 1822, and the connection detection unit 1823 to the display processing unit 183.
[0105] The detection processing unit 182 also includes an operation detection unit 1824 as a functional configuration for detecting an operation on the information processing device 10. The operation detection unit 1824 detects a user's operation based on operation information output from a touch sensor 155 provided on the screen of the display 150. For example, the operation detection unit 1824 acquires operation information based on a user's operation on a switching menu screen (see FIG. 5) that allows switching of the display mode, and detects a display mode switching operation by the user to switch the display mode based on the acquired operation information. The detection processing unit 182 outputs the detected user's operation information to the display processing unit 183.
[0106] The display processing unit 183 determines and switches the display mode based on the open / closed state and attitude (direction) of the information processing device 10 acquired from the detection processing unit 182, a user operation, and the like. Furthermore, the display processing unit 183 controls the display of windows (active windows and inactive windows) of the running application according to the display mode and the like, based on application information acquired from the system processing unit 181. Specifically, the display processing unit 183 includes a display mode determination unit 1831, a display mode switching unit 1832, a thumbnail generation unit 1833, and a display control unit 1834.
[0107] The display mode determination unit 1831 performs a determination process for determining a display mode based on a detection result of the state of the information processing device 10 or a user's operation detected by the detection processing unit 182. For example, the display mode determination unit 1831 acquires a detection result of the open / closed state of the information processing device 10, a detection result of whether the information processing device 10 is in a bent form or a flat form when in an open state, a detection result of the attitude (direction) of the information processing device 10, and user operation information from the detection processing unit 182. Then, the display mode determination unit 1831 determines the display mode described with reference to FIG. 4 based on each detection result and operation information acquired from the detection processing unit 182.
[0108] 4 based on the display mode determined by the display mode determination unit 1831. For example, the display mode switching unit 1832 sets a display mode such as switching to a single screen mode, a dual screen mode (or an inverted dual screen mode), a half screen mode, etc., the orientation of each display area, and the display contents of each display area, based on the display mode determined by the display mode determination unit 1831.
[0109] The thumbnail generating unit 1833 generates thumbnail images corresponding to inactive windows of the running applications. These thumbnail images are intended to be displayed as thumbnail windows in the second display area DA2 when, for example, switching from single screen mode to dual screen mode is performed.
[0110] The display control unit 1834 performs a display control process to display the icon C1, the switching menu M1, the switching menu M2, and the like shown in Fig. 5. For example, when the display control unit 1834 determines that an operation has been performed on the icon C1 based on the operation information from the operation detection unit 1824, the display control unit 1834 displays the switching menu M1 or the switching menu M2 based on the attitude (direction) of the information processing device 10 detected by the attitude detection unit 1822. When the display control unit 1834 determines that an operation has been performed on either the switching menu M1 or the display mode switching icon in the switching menu M2 based on the operation information from the operation detection unit 1824, the display control unit 1834 controls the switching menu that has been displayed to be hidden. Furthermore, the display control unit 1834 performs a display control process to output and display display data of the application window or thumbnail window to be displayed in each display area according to the display mode set by the display mode switching unit 1832.
[0111] For example, when the display mode switching unit 1832 switches from single screen mode to dual screen mode, the display control unit 1834 causes the first display area DA1 to display the active window (the active window displayed in the display area DA) of the application window that was executed in the single screen mode.
[0112] Furthermore, when the single screen mode is switched to the dual screen mode by the display mode switching unit 1832, the display control unit 1834 controls whether or not to display thumbnail images corresponding to inactive windows excluding the active window in the single screen mode in the second display area DA2, based on the number of windows in the single screen mode. For example, when the number of windows in the single screen mode is more than two (the number of display areas in the dual screen mode), the display control unit 1834 displays a thumbnail window in which thumbnail images of inactive windows in the single screen mode are arranged in the second display area DA2 when the mode is switched to the dual screen mode (see FIG. 7).
[0113] On the other hand, when the number of windows in the single screen mode is two or less (the number of display areas in the dual screen mode), the display control unit 1834 does not display a thumbnail window in the second display area DA2 when switching to the dual screen mode. For example, when the number of windows in the single screen mode is two, the display control unit 1834 displays an inactive window in the single screen mode in the second display area DA2 (see FIG. 8). Note that when the number of windows in the single screen mode is one or less, the display control unit 1834 does not display either the application window or the thumbnail window (thumbnail image of the window) in the second display area DA2 when switching to the dual screen mode.
[0114] Note that the display control unit 1834 does not need to include windows that have been minimized when the display mode switching unit 1832 switches from the single-screen mode to the dual-screen mode in the number of windows in the single-screen mode (see FIG. 9).
[0115] Furthermore, when any of the thumbnail images displayed in the second display area DA2 in the dual screen mode is selected, the display control unit 1834 displays an inactive window corresponding to the selected thumbnail image as an active window in the second display area DA2. For example, the display control unit 1834 displays the inactive window corresponding to the selected thumbnail image in the second display area DA2 in a maximized state as the active window.
[0116] (Thumbnail window display control process operation) Next, the operation of the display control process for controlling whether or not to display the thumbnail window when the control unit 18 switches from the single screen mode to the dual screen mode will be described. FIG. 12 is a flowchart showing an example of thumbnail window display control processing according to this embodiment.
[0117] (Step S101) The control unit 18 judges whether or not to switch from the single screen mode to the dual screen mode. For example, the control unit 18 judges whether or not to switch from the single screen mode to the dual screen mode based on detecting a change from a flat form to a bent form as described with reference to FIG. 4, or on a display mode switching operation as described with reference to FIG. 5. When the control unit 18 judges that the single screen mode is not to be switched to the dual screen mode (NO), the control unit 18 continues the single screen mode and performs the process of step S101 again. On the other hand, when the control unit 18 judges that the single screen mode is to be switched to the dual screen mode (YES), the control unit 18 switches to the dual screen mode in which the display area DA is divided into two display areas, a first display area DA1 and a second display area DA2, and proceeds to the process of step S103.
[0118] (Step S103) Control unit 18 determines whether the number of windows in single screen mode before switching to dual screen mode is two or less. If control unit 18 determines that the number of windows in single screen mode is two or less (YES), control unit 18 proceeds to the process of step S105. On the other hand, if control unit 18 determines that the number of windows in single screen mode is more than two (NO), control unit 18 proceeds to the process of step S109.
[0119] (Step S105) The control unit 18 sets the display of the thumbnail window when switching to the dual screen mode to off, and proceeds to the process of step S107.
[0120] (Step S107) Control unit 18 displays an active window in the single screen mode in first display area DA1, and displays an inactive window in the single screen mode in second display area DA2 (see FIG. 8). Note that, if there is one window in the single screen mode, control unit 18 does not display either an application window or a thumbnail window in second display area DA2.
[0121] (Step S109) The control unit 18 sets the display of the thumbnail window when switching to the dual screen mode to ON, and proceeds to the process of step S111.
[0122] (Step S111) Control unit 18 causes first display area DA1 to display an active window in the single screen mode, and causes second display area DA2 to display a thumbnail window in which thumbnail images of inactive windows in the single screen mode are arranged (see FIG. 7).
[0123] Next, a description will be given of the operation of the display control process when a thumbnail image is selected after the thumbnail window is displayed in the second display area DA2 in step S111 of Fig. 12. Fig. 13 is a flowchart showing an example of the display control process when a thumbnail image according to the present embodiment is selected.
[0124] (Step S201) The control unit 18 determines whether or not any of the thumbnail images displayed in the second display area DA2 has been selected. If the control unit 18 determines that no thumbnail image has been selected (NO), the control unit 18 proceeds to processing of step S203. On the other hand, if the control unit 18 determines that any of the thumbnail images has been selected (YES), the control unit 18 proceeds to processing of step S207.
[0125] (Step S203) The control unit 18 determines whether or not an operation has been performed on the close button "X" (see FIG. 6) displayed in the title bar B1 of the thumbnail window displayed in the second display area DA2 (secondary screen). If the control unit 18 determines that an operation has been performed on the close button "X" (YES), the control unit 18 proceeds to the process of step S205. On the other hand, if the control unit 18 determines that an operation has not been performed on the close button "X" (NO), the control unit 18 returns to the process of step S201.
[0126] (Step S205) If it is determined in step S203 that the close button "X" has been operated, the control unit 18 closes and hides the thumbnail window, and ends the display of the thumbnail window.
[0127] (Step S207) If the control unit 18 determines in step S201 that any of the thumbnail images has been selected, it closes the thumbnail window and proceeds to the process of step S209.
[0128] (Step S209) The control unit 18 causes a window corresponding to the selected thumbnail image to be displayed in the second display area DA2 as an active window (for example, maximized and displayed in the second display area DA2).
[0129] As described above, the information processing device 10 according to the present embodiment includes the display 150, the storage unit 13 (an example of a memory) that stores an application program, and the control unit 18 (for example, an example of a processor such as a CPU, GPU, or microcomputer) that performs control to display a window of the application on the display 150 by executing the application program stored in the storage unit 13. The control unit 18 performs a display mode switching process that controls switching between a one-screen mode (an example of a first display mode) in which the entire screen area of the display 150 is controlled as a single display area DA, and a two-screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into two display areas (for example, a first display area DA1 and a second display area DA2) and the display is controlled. In addition, when the control unit 18 switches from single screen mode to dual screen mode by the display mode switching process, it performs a display control process to display an active window (an example of one window) of the windows of an application that was executed in the single screen mode in the first display area DA1 of the multiple display areas, and to control whether or not to display thumbnail images corresponding to windows (e.g., inactive windows) excluding the active window of the windows in the single screen mode in the second display area DA2, based on the number of windows in the single screen mode.
[0130] As a result, when switching from single-screen mode to dual-screen mode, information processing device 10 displays the active windows in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of windows in single-screen mode, thereby enabling appropriate control of the display when switching from single-screen mode to dual-screen mode.
[0131] For example, when the display mode switching process switches from single screen mode to dual screen mode, the control unit 18 controls in the display control process whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the dual screen mode (i.e., two) and the number of windows in the single screen mode.
[0132] As a result, when switching from single screen mode to dual screen mode, the information processing device 10 controls whether or not to display thumbnail images of inactive windows (e.g., thumbnail windows) based on the number of display areas after switching (i.e., two) and the number of windows in the single screen mode before the switching, thereby enabling appropriate control of the display when switching from single screen mode to dual screen mode.
[0133] Specifically, when the control unit 18 switches from single screen mode to dual screen mode by the display mode switching process, in the display control process, if the number of windows in single screen mode is two or less (the number of display areas in dual screen mode), thumbnail images are not displayed, and the windows in single screen mode excluding the active window are displayed in the second display area DA2.
[0134] That is, when the control unit 18 switches from single screen mode to dual screen mode by the display mode switching process, in the display control process, if the number of display areas in the dual screen mode (here, two) is greater than or equal to the number of windows in the single screen mode, thumbnail images are not displayed, and the windows in the single screen mode excluding the active window are displayed in the second display area DA2.
[0135] As a result, when the information processing device 10 switches from the single screen mode to the dual screen mode, if the number of windows in the single screen mode before the switch is two or less, the windows in the single screen mode can be displayed using the two display areas of the dual screen mode, respectively, without the user having to take the trouble of displaying thumbnail images and selecting one, which is convenient. Therefore, the information processing device 10 can appropriately control the display when switching from the single screen mode to the dual screen mode.
[0136] When the number of windows in single screen mode is one or less, no windows are displayed in the second display area DA2. When the number of windows in single screen mode is zero, no windows are displayed in either the first display area DA1 or the second display area DA2 when switching to dual screen mode.
[0137] In addition, when the control unit 18 switches from single screen mode to dual screen mode by the display mode switching process, in the display control process, if the number of windows in single screen mode is greater than two (the number of display areas in dual screen mode), thumbnail images (e.g., thumbnail windows) are displayed in the second display area DA2.
[0138] That is, when the control unit 18 switches from single screen mode to dual screen mode by the display mode switching process, in the display control process, if the number of display areas in the dual screen mode (here, two) is less than the number of windows in the single screen mode, thumbnail images (e.g., thumbnail windows) are displayed in the second display area DA2.
[0139] As a result, when switching from single screen mode to dual screen mode, information processing device 10 displays thumbnail images (e.g., thumbnail windows) if the number of windows in the single screen mode before the switch is greater than the number of dual screen mode display areas (here, two), so that when the user wants to change from the currently active window in use to another window, he or she can select from among the thumbnail images, which is convenient.
[0140] Note that windows that were minimized when switching from single-screen mode to dual-screen mode do not have to be included in the number of windows in the single-screen mode. In other words, minimized windows are not subject to being displayed as thumbnail images in the thumbnail window, and do not have to be automatically displayed in the second display area DA2 when switching to dual-screen mode.
[0141] This allows the information processing device 10 to display thumbnail images of app windows that are unlikely to be used by the user, excluding the thumbnail images of the app windows, making it easier for the user to select the app window that he or she wants to use, especially when many apps are running.
[0142] Furthermore, the control method in the information processing device 10 according to this embodiment includes a display mode switching step in which the control unit 18 controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of the display 150 is displayed as a single display area DA, and a dual screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into two display areas (e.g., a first display area DA1 and a second display area DA2) and displayed; and a display control step in which, when switching from the single screen mode to the dual screen mode by the display mode switching step, an active window (an example of one window) of the windows of an application executed in the single screen mode is displayed in the first display area DA1 of the multiple display areas, and, based on the number of windows in the single screen mode, a thumbnail image corresponding to a window (e.g., an inactive window) excluding the active window among the windows in the single screen mode is displayed in the second display area DA2 excluding the first display area DA1 of the multiple display areas.
[0143] As a result, when switching from single-screen mode to dual-screen mode, information processing device 10 displays the active windows in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of windows in single-screen mode, thereby enabling appropriate control of the display when switching from single-screen mode to dual-screen mode.
[0144] <Second embodiment> Next, an overview of a second embodiment of the present invention will be described. In the first embodiment, the information processing device 10 has been described as having a single screen mode in which the entire screen area of the display 150 is treated as a single display area DA and the dual screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled. However, the screen area of the display 150 may also be divided into three or more display areas to control the display.
[0145] In this embodiment, in addition to the single-screen mode and dual-screen mode, the information processing device 10 has a triple-screen mode in which the screen area of the display 150 is divided into three display areas and the display is controlled by dividing it into four display areas, and a quadruple-screen mode in which the display is controlled by dividing it into four display areas. Display control when switching from the single-screen mode to the triple-screen mode and display control when switching from the single-screen mode to the quadruple-screen mode will be described below.
[0146] FIG. 14 is a diagram showing an example of the operation specifications of the display mode switching operation according to this embodiment. This diagram shows an example of a switching menu displayed by operating the icon C1 shown in FIG. 5(A), for example. FIG. 14(B) shows a switching menu M3 displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.), and FIG. 14(C) shows a switching menu M4 displayed when the usage mode is "Clamshell or Portrait" (display mode (c-1), display mode (e), display mode (e'), etc.). The switching menus M3 and M4 are different from the switching menus M1 in FIG. 5(B) and the switching menus M2 in FIG. 5(C) in that they can be switched to a triple-screen mode and a quadruple-screen mode.
[0147] Display mode switching icons C31, C32, C33, C34, and C35 are displayed in the switching menu M3. The display mode switching icon C31 is displayed as an operator for selecting the display mode (d) and display mode (d') of the single-screen mode. The display mode switching icon C32 is displayed as an operator for selecting the display mode (b) of the dual-screen mode. The display mode switching icon C33 and the display mode switching icon C34 are displayed as operators for selecting the display mode of the triple-screen mode. The display mode switching icon C33 and the display mode switching icon C34 differ in which side of the first display area DA1 and the second display area DA2 in the dual-screen mode is divided into two display areas. The display mode switching icon C35 is displayed as an operator for selecting the display mode of the quadruple-screen mode.
[0148] The numbers "1", "2", "3", and "4" in the figure are used to distinguish the display areas, as in Figure 5, and are expressed, for example, by numbers according to the priority order of the areas that has been preset for each display area. "1" has the highest priority, and the priority order of areas decreases in the order of "2", "3", and "4".
[0149] When the user performs an operation to select the display mode switching icon C33 or the display mode switching icon C34, the display of the switching menu ends and the display is controlled to the triple-screen mode in "Landscape." When the user performs an operation to select the display mode switching icon C35, the display of the switching menu ends and the display is controlled to the quadruple-screen mode in "Landscape."
[0150] Display mode switching icons C41, C42, C43, C44, and C45 are displayed in the switching menu M4. The display mode switching icon C41 is displayed as an operator for selecting the display mode (e) or display mode (e') of the single screen mode. The display mode switching icon C42 is displayed as an operator for selecting the display mode (c-1) of the dual screen mode. The display mode switching icon C43 and the display mode switching icon C44 are displayed as operators for selecting the display mode of the triple screen mode. The display mode switching icon C43 and the display mode switching icon C44 differ in which side of the first display area DA1 and the second display area DA2 in the dual screen mode is divided into two display areas. The display mode switching icon C45 is displayed as an operator for selecting the display mode of the quadruple screen mode.
[0151] When the user performs an operation to select the display mode switching icon C43 or the display mode switching icon C44, the display of the switching menu ends and the display is controlled to triple-screen mode in "Clamshell or Portrait." Also, when the user performs an operation to select the display mode switching icon C35, the display of the switching menu ends and the display is controlled to quadruple-screen mode in "Clamshell or Portrait."
[0152] (Display control when switching from 1-screen mode to 3-screen mode) Next, the display control when switching from the single screen mode to the triple screen mode will be described. Here, when the screen area of the display 150 is divided into three display areas in the triple screen mode, the areas are referred to as a first display area DA1, a second display area DA2, and a third display area DA3.
[0153] In the case of a triple screen mode in which the second display area DA2 side in the dual screen mode is divided into two display areas, the first display area DA1 corresponds to the first display area DA1 in the dual screen mode, and the second display area DA2 and the third display area DA3 correspond to the display areas obtained by dividing the second display area DA2 in the dual screen mode into two. Here, the second display area DA2 and the third display area DA3 in the triple screen mode can be said to be two second display areas obtained by dividing the display area excluding the first display area DA1 (for example, the second display area DA2 in the dual screen mode) into two. In order to distinguish between these two second display areas, the one with the higher priority of the area is indicated as the second display area DA2, and the other is indicated as the third display area DA3. In other words, the priority of the areas in the triple screen mode is, from the top, the first display area DA1, the second display area DA2, and the third display area DA3.
[0154] In addition, in the case of a triple screen mode in which the side of the first display area DA1 in the dual screen mode is divided into two display areas, the only difference is the display area on the side that is divided into two display areas compared to a triple screen mode in which the side of the second display area DA2 in the dual screen mode is divided into two display areas.
[0155] As described in the first embodiment, when the information processing device 10 switches from the single-screen mode to the dual-screen mode, it displays a thumbnail window in the second display area DA2 if the number of windows in the single-screen mode is more than two, and does not display a thumbnail window if the number of windows is two or less. In contrast, when the information processing device 10 switches from the single-screen mode to the triple-screen mode, it displays a thumbnail window in the second display area DA2 if the number of windows in the single-screen mode is more than three, and does not display a thumbnail window if the number of windows is three or less.
[0156] Below, with reference to Figures 15 to 17, we will explain an example of display control when, in single-screen mode (display mode (d) or display mode (d')) in "Landscape," an operation is performed to select the display mode switching icon C33 in Figure 14 (B), for example, and the dual-screen mode switches to a triple-screen mode in which the second display area DA2 side is divided into two display areas.
[0157] Fig. 15 is a diagram showing a first example of display control when switching from single screen mode to triple screen mode according to this embodiment. Fig. 15(A) shows a display example in single screen mode, and Fig. 15(B) shows a display example after switching to triple screen mode. In the illustrated example, the number of application windows executed in single screen mode is two. Here, two windows W1 and W2 are shown in the display area DA. Window W1 is the active window located in the foreground layer (top layer).
[0158] When switching from single-screen mode to triple-screen mode, in accordance with the area priority and window priority, window W1 is maximized and displayed as the active window in the first display area DA1, and window W2 is maximized and displayed as the inactive window in the second display area DA2. Also, since there is no window to be displayed in the third display area DA3 (the window with the third priority), no window is displayed and only the desktop screen is displayed.
[0159] In addition, when the number of windows of an application running in single screen mode is one (only window W1), window W1 is maximized and displayed as the active window in the first display area DA1, but since there are no windows to be displayed in the second display area DA2 and the third display area DA3, no windows are displayed and only the desktop screen is displayed.
[0160] Fig. 16 is a diagram showing a second example of display control when switching from single screen mode to triple screen mode according to this embodiment. Fig. 16(A) shows a display example in single screen mode, and Fig. 16(B) shows a display example after switching to triple screen mode. In the illustrated example, the number of application windows running in single screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA.
[0161] Window W1 is the active window that is located in the foreground layer (topmost layer). Window W2 is the window that was the active window before window W1 became the active window. Window W3 is the window that was the active window before window W2 became the active window. In other words, the priority of windows is given to window W1 at the top, followed by window W2 and window W3 in that order.
[0162] When switching from single-screen mode to triple-screen mode, in accordance with the area priority and window priority, window W1 is maximized and displayed as the active window in the first display area DA1, window W2 is maximized and displayed as the inactive window in the second display area DA2, and window W3 is maximized and displayed as the inactive window in the third display area DA3.
[0163] Fig. 17 is a diagram showing a third example of display control when switching from single screen mode to triple screen mode according to this embodiment. Fig. 17(A) shows a display example in single screen mode, and Fig. 17(B) shows a display example after switching to triple screen mode. In the illustrated example, the number of application windows running in single screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA.
[0164] Window W1 is the active window that is located in the foreground layer (the top layer). The priority order of windows is as follows: window W1 has the highest priority, followed by window W2, window W3, and window W4.
[0165] When switching from single-screen mode to triple-screen mode, window W1 is maximized and displayed as the active window in the first display area DA1 according to the area priority and window priority. A thumbnail window in which thumbnail images SW2, SW3, and SW4 of windows W2, W3, and W4 are arranged is displayed in the second display area DA2. Note that no windows are displayed in the third display area DA3, and the desktop screen is displayed. When the number of windows of an application running in single-screen mode is five or more, four or more thumbnail images are displayed in the second display area DA2.
[0166] Here, when any of the thumbnail images SW2, SW3, or SW4 displayed in the second display area DA2 is selected, an inactive window corresponding to the selected thumbnail image is displayed as an active window in the second display area DA2, and thumbnail windows in which the remaining thumbnail images are arranged are displayed in the third display area DA3.
[0167] In this way, when the information processing device 10 switches from the single screen mode to the triple screen mode, if the number of windows in the single screen mode is more than three (the number of display areas in the triple screen mode), it displays in the second display area DA2 a thumbnail window in which thumbnail images of windows in the single screen mode excluding the active window are arranged. On the other hand, when the information processing device 10 switches from the single screen mode to the triple screen mode, if the number of windows in the single screen mode is three or less (the number of display areas in the triple screen mode), it does not display a thumbnail window and displays inactive windows in the single screen mode in the second display area DA2, the third display area DA3, etc.
[0168] In other words, when the information processing device 10 switches from single-screen mode to triple-screen mode, it controls whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the triple-screen mode and the number of windows in the single-screen mode.
[0169] Note that the window of an application running in single-screen mode may be minimized. In that case, the minimized window does not need to be included in the number of windows in single-screen mode.
[0170] (Display control when switching from 1-screen mode to 4-screen mode) Next, the display control when switching from the single screen mode to the quad screen mode will be described. Here, when the screen area of the display 150 is divided into four display areas in the quad screen mode, the areas are referred to as the first display area DA1, the second display area DA2, the third display area DA3, and the fourth display area DA4.
[0171] Here, the second display area DA2, the third display area DA3, and the fourth display area DA4 in the 4-screen mode can be said to be three second display areas obtained by dividing the display area excluding the first display area DA1 into three. In order to distinguish between these three second display areas, they are shown as the second display area DA2, the third display area DA3, and the fourth display area DA4 in descending order of area priority. In other words, the order of area priority in the 4-screen mode is, from highest to lowest, the first display area DA1, the second display area DA2, the third display area DA3, and the fourth display area DA4.
[0172] When the information processing device 10 switches from single screen mode to quad screen mode, if the number of windows in single screen mode is more than four, it displays a thumbnail window in the second display area DA2, and if the number of windows is four or less, it does not display a thumbnail window.
[0173] Fig. 18 is a diagram showing a first example of display control when switching from single-screen mode to four-screen mode according to this embodiment. Fig. 18(A) shows a display example in single-screen mode, and Fig. 18(B) shows a display example after switching to four-screen mode. In the illustrated example, the number of application windows running in single-screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA.
[0174] Window W1 is the active window that is located in the foreground layer (the top layer). The priority order of windows is as follows: window W1 has the highest priority, followed by window W2, window W3, and window W4.
[0175] When switching from single-screen mode to four-screen mode, in accordance with the area priority and window priority, window W1 is maximized and displayed as the active window in the first display area DA1. Window W2 is maximized and displayed as the inactive window in the second display area DA2. Window W3 is maximized and displayed as the inactive window in the third display area DA3. Window W4 is maximized and displayed as the inactive window in the fourth display area DA4.
[0176] In addition, when the number of windows of an application running in single screen mode is one (only window W1), window W1 is maximized and displayed as the active window in the first display area DA1, but since there are no windows to be displayed in the second display area DA2, third display area DA3, and fourth display area DA4, no windows are displayed and only the desktop screen is displayed.
[0177] Furthermore, when an application is running in single screen mode with two windows (windows W1 and W2), window W1 is maximized and displayed as the active window in the first display area DA1, and window W2 is maximized and displayed as the active window in the second display area DA2, but since there are no windows to be displayed in the third display area DA3 and the fourth display area DA4, no windows are displayed and only the desktop screen is displayed.
[0178] Furthermore, when the number of windows of an application running in single screen mode is three (windows W1, W2, and W3), window W1 is maximized and displayed as the active window in the first display area DA1, window W2 is maximized and displayed as the active window in the second display area DA2, and window W3 is maximized and displayed as the active window in the third display area DA3, but since there are no windows to be displayed in the fourth display area DA4, no windows are displayed and only the desktop screen is displayed.
[0179] Fig. 19 is a diagram showing a second example of display control when switching from single screen mode to four screen mode according to this embodiment. Fig. 19(A) shows a display example in single screen mode, and Fig. 19(B) shows a display example after switching to four screen mode. In the illustrated example, the number of application windows running in single screen mode is five. Here, five windows W1, W2, W3, W4, and W5 are shown in the display area DA.
[0180] Window W1 is the active window that is located in the foreground layer (the top layer). The priority order of windows is as follows: window W1 has the highest priority, followed by window W2, window W3, window W4, and window W5.
[0181] When switching from single-screen mode to four-screen mode, window W1 is maximized and displayed as the active window in the first display area DA1 according to the area priority and window priority. A thumbnail window in which thumbnail images SW2, SW3, SW4, and SW5 of windows W2, W3, W4, and W5 are arranged is displayed in the second display area DA2. Note that no windows are displayed in the third display area DA3 and the fourth display area DA4, and the desktop screen is displayed instead. When the number of windows of an application running in single-screen mode is six or more, five or more thumbnail images are displayed in the second display area DA2.
[0182] Here, when any one of the thumbnail images SW2, SW3, SW4, SW5 displayed in the second display area DA2 is selected, an inactive window corresponding to the selected thumbnail image is displayed as an active window in the second display area DA2, and thumbnail windows in which the remaining thumbnail images are arranged are displayed in the third display area DA3. Furthermore, when any one of the thumbnail images displayed in the third display area DA3 is selected, an inactive window corresponding to the selected thumbnail image is displayed as an active window in the third display area DA3, and thumbnail windows in which the remaining thumbnail images are arranged are displayed in the fourth display area DA4.
[0183] In this way, when the information processing device 10 switches from the single-screen mode to the quad-screen mode, if the number of windows in the single-screen mode is more than four (the number of display areas in the quad-screen mode), it displays in the second display area DA2 a thumbnail window in which thumbnail images of windows in the single-screen mode excluding the active window are arranged. On the other hand, when the information processing device 10 switches from the single-screen mode to the quad-screen mode, if the number of windows in the single-screen mode is four or less (the number of display areas in the quad-screen mode), it does not display a thumbnail window, and displays inactive windows in the single-screen mode in the second display area DA2, the third display area DA3, the fourth display area DA4, etc.
[0184] In other words, when the information processing device 10 switches from single-screen mode to quadruple-screen mode, it controls whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the quadruple-screen mode and the number of windows in the single-screen mode.
[0185] Note that the window of an application running in single-screen mode may be minimized. In that case, the minimized window does not need to be included in the number of windows in single-screen mode.
[0186] (Thumbnail window display control process operation) Next, a description will be given of the operation of the display control process that controls whether or not to display the thumbnail window when the control unit 18 switches from the single screen mode to the multiple screen mode. The multiple screen mode includes, for example, the dual screen mode, triple screen mode, and quadruple screen mode.
[0187] FIG. 20 is a flowchart showing an example of thumbnail window display control processing according to this embodiment. (Step S301) The control unit 18 judges whether or not to switch from the single screen mode to the multiple screen mode. For example, the control unit 18 judges whether or not to switch from the single screen mode to the multiple screen mode based on detecting a change from a flat state (Flat form) to a bent state (Bent form) as described with reference to FIG. 4, or on the basis of a switching operation of the display mode as described with reference to FIG. 14. When the control unit 18 judges that the single screen mode is not to be switched to the multiple screen mode (NO), the control unit 18 continues the single screen mode and performs the process of step S301 again. On the other hand, when the control unit 18 judges that the single screen mode is to be switched to the multiple screen mode (YES), the control unit 18 switches to the multiple screen mode in which the display area DA is divided into two display areas, a first display area DA1 and a second display area DA2, and proceeds to the process of step S303.
[0188] (Step S303) Control unit 18 judges whether the number of display areas (screens) in the multiple screen mode after switching is equal to or greater than the number of windows in the single screen mode before switching to the multiple screen mode. If control unit 18 judges that the number of windows is equal to or greater than the number of windows in the single screen mode (YES), control unit 18 proceeds to the process of step S305. On the other hand, if control unit 18 judges that the number of windows is less than the number of windows in the single screen mode (NO), control unit 18 proceeds to the process of step S309.
[0189] (Step S305) The control unit 18 sets the display of the thumbnail window when switching to the multiple screen mode to be off, and proceeds to the process of step S307.
[0190] (Step S307) The control unit 18 displays an active window in the single screen mode in the first display area DA1, and displays inactive windows in the single screen mode in the other display areas (see Figs. 8, 15, and 16). For example, the control unit 18 displays inactive windows in the single screen mode in display areas other than the first display area DA1 according to the area priority and the window priority. Note that if the number of windows in the single screen mode is less than the number of display areas (screens) in the multiple screen mode after switching, the display areas other than the first display area DA1 include display areas in which no windows are displayed.
[0191] (Step S309) The control unit 18 sets the display of the thumbnail window when switching to the multi-screen mode to ON, and proceeds to the process of step S311.
[0192] (Step S311) Control unit 18 causes first display area DA1 to display an active window in the single screen mode, and causes second display area DA2 to display a thumbnail window in which thumbnail images of inactive windows in the single screen mode are arranged (see FIGS. 7, 17, and 19).
[0193] As described above, in the information processing device 10 according to the present embodiment, the control unit 18 performs a display mode switching process to control switching between a single screen mode (an example of a first display mode) in which the entire screen area of the display 150 is controlled to be displayed as one display area DA, and a multiple screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into a plurality of (two, three, four, etc.) display areas to control display. When switching from the single screen mode to the multiple screen mode by the display mode switching process, the control unit 18 performs a display control process to display an active window (an example of one window) of the windows of an application executed in the single screen mode in the first display area DA1 of the multiple display areas, and to control whether or not thumbnail images corresponding to windows (e.g., inactive windows) other than the active window of the windows in the single screen mode are displayed in the second display area (e.g., second display area DA2) of the multiple display areas other than the first display area DA1, based on the number of windows in the single screen mode.
[0194] As a result, when switching from single-screen mode to multiple-screen mode, information-processing device 10 displays the active windows in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of windows in the single-screen mode, thereby enabling appropriate control of the display when switching from single-screen mode to multiple-screen mode.
[0195] For example, when the control unit 18 switches from single screen mode to multiple screen mode by the display mode switching process, in the display control process, the control unit 18 controls whether or not to display thumbnail images in the second display area DA2 based on the number of display areas in the dual screen mode (i.e., two, three, four, etc.) and the number of windows in the single screen mode.
[0196] As a result, when switching from single screen mode to multiple screen mode, the information processing device 10 controls whether or not to display thumbnail images of inactive windows (e.g., thumbnail windows) based on the number of display areas after switching (i.e., two, three, four, etc.) and the number of windows in the single screen mode before the switching, thereby enabling appropriate control of the display when switching from single screen mode to multiple screen mode.
[0197] Specifically, when the control unit 18 switches from single screen mode to multiple screen mode by the display mode switching process, in the display control process, if the number of display areas in the multiple screen mode (e.g., two, three, or four) is greater than or equal to the number of windows in the single screen mode, thumbnail images are not displayed, and the windows in the single screen mode excluding the active window are displayed in a second display area (e.g., second display area DA2) excluding the first display area DA1.
[0198] As a result, when the information processing device 10 switches from the single screen mode to the multiple screen mode, if the number of windows in the single screen mode before the switch is equal to or less than the number of display areas in the multiple screen mode after the switch, the windows in the single screen mode can be displayed using the multiple display areas in the multiple screen mode, without the user having to take the trouble of displaying thumbnail images and selecting one, which is convenient. Thus, the information processing device 10 can appropriately control the display when switching from the single screen mode to the multiple screen mode.
[0199] In addition, when there are multiple second display areas excluding the first display area DA1 in the multiple screen mode (i.e., in the case of a triple screen mode or a quadruple screen mode in which the screen area is divided into three or more display areas and the display is controlled), the control unit 18 divides and displays each of the windows in the single screen mode, excluding the active window (an example of one window), in one of multiple second display areas (e.g., the second display area DA2, the third display area DA3, the fourth display area DA4, etc.), in the display control process.
[0200] As a result, when the information processing device 10 switches from the single screen mode to the triple screen mode, if the number of windows in the single screen mode before the switch is three or less, the windows in the single screen mode can be displayed using the three display areas of the triple screen mode, without the user having to take the trouble of displaying thumbnail images and performing a selection operation, which is convenient. Also, when the information processing device 10 switches from the single screen mode to the quadruple screen mode, if the number of windows in the single screen mode before the switch is four or less, the windows in the single screen mode can be displayed using the four display areas of the quadruple screen mode, without the user having to take the trouble of displaying thumbnail images and performing a selection operation, which is convenient. Thus, the information processing device 10 can appropriately control the display when switching from the single screen mode to the multiple screen mode.
[0201] For example, in a display control process, when the control unit 18 displays windows in single screen mode in each of the first display area DA1 and one or more second display areas (e.g., the second display area DA2, the third display area DA3, the fourth display area DA4, etc.), the control unit 18 displays the windows one by one in the first display area DA1 and one or more second display areas (e.g., the second display area DA2, the third display area DA3, the fourth display area DA4, etc.) according to preset area priorities and window priorities.
[0202] This makes it more convenient for the information processing device 10 to display, when switching from single screen mode to multiple screen mode, windows of applications that are more likely to be used by the user in a display area with a higher priority.
[0203] As an example, in the display control process, the control unit 18 increases the priority of a window that became the active window later among windows in the single screen mode.
[0204] This makes it more convenient for the information processing device 10 to display, when switching from single screen mode to multiple screen mode, windows of applications that are more likely to be used by the user in a display area with a higher priority.
[0205] In the display control process, the control unit 18 may lower the priority of a window that was minimized in the single screen mode below the priority of a window that is not minimized. For example, when a window that was the active window is minimized, the minimized window has a lower window priority than an inactive window that was the active window before the minimized window.
[0206] As a result, when the information processing device 10 switches from the single-screen mode to the multiple-screen mode, it preferentially displays the window of an application that is likely to be used by the user, which is convenient.
[0207] If the number of windows in single screen mode is one or less, no windows are displayed in the second display area DA2. If the number of windows in single screen mode is zero, no windows are displayed in either display area when switching to dual screen mode.
[0208] In addition, when there are multiple second display areas excluding the first display area DA1 in the multiple screen mode (i.e., in the case of triple screen mode, quadruple screen mode, etc.), when the control unit 18 switches from the single screen mode to the multiple screen mode by the display mode switching process, in the display control process, if the number of display areas in the multiple screen mode (e.g., three or four) is less than the number of windows in the single screen mode, a thumbnail image (e.g., a thumbnail window) is displayed in one of the second display areas excluding the first display area DA1 (e.g., the second display area DA2, the third display area DA3, or the fourth display area DA4).
[0209] As a result, when information processing device 10 switches from single screen mode to multiple screen mode, if the number of windows in the single screen mode before the switch is greater than the number of multiple screen mode display areas (e.g., two, three, or four), thumbnail images (e.g., thumbnail windows) are displayed, so that when the user wishes to change from the currently active window in use to another window, he or she can easily select from among the thumbnail images, which is convenient.
[0210] For example, in a display control process, the control unit 18 displays a thumbnail image (e.g., a thumbnail window) in one of the multiple second display areas (e.g., the second display area DA2) in accordance with a priority order of the multiple second display areas (e.g., the second display area DA2, the third display area DA3, or the fourth display area DA4) that has been preset in advance.
[0211] As a result, when switching from single screen mode to multiple screen mode, information processing device 10 can make it easier for the user to select the window of the application that he or she wants to use by displaying a thumbnail image (e.g., a thumbnail window) in a display area with a higher priority other than the display area in which the active window was displayed in single screen mode.
[0212] Furthermore, in the display control process, when one of the thumbnail images displayed in any one area (e.g., second display area DA2) of a plurality of second display areas (e.g., second display area DA2, third display area DA3, or fourth display area DA4) is selected, the control unit 18 causes a window corresponding to the selected thumbnail image to be displayed in the second display area (e.g., second display area DA2) in which the thumbnail image was being displayed, and also causes the unselected thumbnail images to be displayed in another second display area (e.g., third display area DA3) in accordance with the priority order of the areas.
[0213] This allows the information-processing device 10 to easily select from among the thumbnail images when the user wishes to change from the currently active window to another window, and since the remaining thumbnail images are displayed using other display areas, when the user wishes to further change to another window, the user can easily select from among the thumbnail images, which is convenient.
[0214] Note that windows that were minimized when switching from single-screen mode to multiple-screen mode do not have to be included in the number of windows in the single-screen mode. In other words, minimized windows are not subject to being displayed as thumbnail images in the thumbnail window, and do not have to be automatically displayed in the second display area DA2 when switching to the multiple-screen mode.
[0215] This allows the information processing device 10 to display thumbnail images of app windows that are unlikely to be used by the user, excluding the thumbnail images of the app windows, making it easier for the user to select the app window that he or she wants to use, especially when many apps are running.
[0216] Furthermore, the control method in the information processing device 10 according to this embodiment includes a display mode switching step in which the control unit 18 controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of the display 150 is controlled to be displayed as a single display area DA, and a multiple screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into a plurality of (two, three, four, etc.) display areas and controlled to be displayed; and a display control step in which, when switching from the single screen mode to the multiple screen mode by the display mode switching step, an active window (an example of one window) of the windows of an application executed in the single screen mode is displayed in the first display area DA1 of the multiple display areas, and a display control step in which, based on the number of windows in the single screen mode, thumbnail images corresponding to windows (e.g., inactive windows) excluding the active window of the windows in the single screen mode are controlled to be displayed in the second display area (e.g., second display area DA2) of the multiple display areas excluding the first display area DA1.
[0217] As a result, when switching from single-screen mode to multiple-screen mode, information-processing device 10 displays the active windows in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of windows in the single-screen mode, thereby enabling appropriate control of the display when switching from single-screen mode to multiple-screen mode.
[0218] According to this embodiment, when the number of windows in the single screen mode is three, the control unit 18 displays thumbnail images (for example, thumbnail windows) when the single screen mode is switched to the dual screen mode, but does not display thumbnail images (for example, thumbnail windows) when the mode is switched to the triple screen mode. When the number of windows in the single screen mode is four, the control unit 18 displays thumbnail images (for example, thumbnail windows) when the mode is switched to the dual screen mode or triple screen mode, but does not display thumbnail images (for example, thumbnail windows) when the mode is switched to the quadruple screen mode. In other words, the control unit 18 controls whether or not to display thumbnail images based on the number of display areas in the multiple screen mode when the mode is switched from the single screen mode to the multiple screen mode.
[0219] That is, when the control unit 18 switches from single screen mode to multiple screen mode by the display mode switching process, the control unit 18 performs a display control process in which an active window (one example of one window) of the windows of an application that was executed in the single screen mode is displayed in a first display area DA1 of the multiple display areas, and in a second display area (e.g., second display area DA2) of the multiple display areas excluding the first display area DA1, the control unit 18 performs a display control process in which the control unit 18 controls whether or not to display thumbnail images corresponding to windows (e.g., inactive windows) excluding the active window of the windows in the single screen mode, based on the number of display areas in the multiple screen mode.
[0220] As a result, when switching from single-screen mode to multiple-screen mode, information-processing device 10 displays the active window in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of display areas in the multiple-screen mode after the switch, thereby enabling appropriate control of the display when switching from single-screen mode to multiple-screen mode.
[0221] Furthermore, the control method in the information processing device 10 according to this embodiment includes a display mode switching step in which the control unit 18 controls switching between a single screen mode (an example of a first display mode) in which the entire screen area of the display 150 is controlled to be displayed as a single display area DA, and a multiple screen mode (an example of a second display mode) in which the screen area of the display 150 is divided into a plurality of (two, three, four, etc.) display areas and controlled to be displayed; and a display control step in which, when switching from the single screen mode to the multiple screen mode by the display mode switching step, an active window (an example of one window) of the windows of an application executed in the single screen mode is displayed in the first display area DA1 of the multiple display areas, and a display control step in which, based on the number of display areas in the multiple screen mode, a thumbnail image corresponding to a window (e.g., an inactive window) excluding the active window of the windows in the single screen mode is displayed in the second display area (e.g., second display area DA2) of the multiple display areas excluding the first display area DA1 is displayed.
[0222] As a result, when switching from single-screen mode to multiple-screen mode, information-processing device 10 displays the active window in the single-screen mode before the switch, and controls whether or not to display thumbnail images of inactive windows in a list depending on the number of display areas in the multiple-screen mode after the switch, thereby enabling appropriate control of the display when switching from single-screen mode to multiple-screen mode.
[0223] In addition, in accordance with a preset priority order of areas, an example (see Figs. 17 and 19) has been described in which a thumbnail image (e.g., a thumbnail window) is displayed in the second display area DA2, which has the highest priority order of areas (next to the first display area DA1) among the plurality of second display areas excluding the first display area DA1, but the present invention is not limited to this. For example, in the display control process, the control unit 18 may display a thumbnail image (e.g., a thumbnail window) in the area with the lowest priority order of areas among the plurality of second display areas excluding the first display area DA1. For example, the area with the lowest priority order of areas among the plurality of second display areas excluding the first display area DA1 is the third display area DA3 in the triple screen mode, and is the fourth display area DA4 in the quadruple screen mode.
[0224] An example of displaying a thumbnail image (eg, a thumbnail window) in an area with the last area priority is shown in FIG. 21 and FIG.
[0225] Fig. 21 is a diagram showing a fourth example of display control when switching from single screen mode to triple screen mode according to this embodiment, and shows an example in which a thumbnail window is displayed in the third display area DA3, which has the lowest area priority in triple screen mode. Fig. 21(A) shows a display example in single screen mode, and Fig. 21(B) shows a display example after switching to triple screen mode. In the example shown, the number of application windows running in single screen mode is four. Here, four windows W1, W2, W3, and W4 are shown in the display area DA.
[0226] Window W1 is the active window that is located in the foreground layer (the top layer). The priority order of windows is as follows: window W1 has the highest priority, followed by window W2, window W3, and window W4.
[0227] When switching from single-screen mode to triple-screen mode, in accordance with the area priority and window priority, window W1 is maximized and displayed as the active window in the first display area DA1. Window W2 is maximized and displayed as an inactive window in the second display area DA2. Also, in the third display area DA3, which has the last area priority, a thumbnail window in which thumbnail images SW3 and SW4 of windows W3 and W4 are displayed side by side is displayed. Note that when the number of windows of an application running in single-screen mode is five or more, three or more thumbnail images are displayed in the third display area DA3.
[0228] 22 is a diagram showing a third example of display control when switching from single-screen mode to quad-screen mode according to this embodiment, and shows an example in which a thumbnail window is displayed in the fourth display area DA4, which has the lowest area priority in the quad-screen mode. In the example shown, the number of application windows running in the single-screen mode is five. Here, five windows W1, W2, W3, W4, and W5 are shown in the display area DA.
[0229] Window W1 is the active window that is located in the foreground layer (the top layer). The priority order of windows is as follows: window W1 has the highest priority, followed by window W2, window W3, window W4, and window W5.
[0230] When switching from single-screen mode to four-screen mode, in accordance with the priority order of the areas and the priority order of the windows, the window W1 is maximized and displayed as the active window in the first display area DA1. The window W2 is maximized and displayed as the inactive window in the second display area DA2. The window W3 is maximized and displayed as the inactive window in the third display area DA3. In addition, the fourth display area DA4, which has the last priority order of the areas, displays a thumbnail window in which thumbnail images SW4 and SW5 of the windows W4 and W5 are arranged side by side. Note that when the number of windows of an application running in the single-screen mode is six or more, three or more thumbnail images are displayed in the fourth display area DA4.
[0231] This allows the information processing device 10 to more effectively utilize the multiple display areas in the multiple screen mode when switching from the single screen mode to the multiple screen mode, and to display multiple windows and thumbnail images (e.g., thumbnail windows) to the user. Therefore, the information processing device 10 can appropriately control the display when switching from the single screen mode to the multiple screen mode.
[0232] <Third embodiment> In the first and second embodiments, examples of the display mode switching operation have been described with reference to Fig. 5 and Fig. 14, but in this embodiment, other operation examples will be described. For example, the switching menu displayed as a pop-up screen by a drag operation on a window and the operation method thereof are not limited to those described with reference to Fig. 5 and Fig. 14.
[0233] FIG. 23 is a diagram showing an example of the operation specification of the display mode switching operation according to the present embodiment. For example, as shown in FIG. 23(A), by dragging the window W1 (active window) in the single screen mode, a switching menu M5 is displayed as a pop-up screen. For example, the switching menu M5 is displayed near the finger performing the dragging operation. In addition, in the case of a dragging operation with a mouse (for example, an operation of moving the mouse while holding down the mouse button), the switching menu M5 is displayed near the mouse cursor. In addition, the timing at which the switching menu M5 is displayed by the dragging operation may be, for example, when the dragged window W1 reaches a predetermined area in the screen area (a predetermined area at the top end, bottom bridge, left end, or right end of the screen area), or when the movement is stopped for a certain period of time while the dragging operation is performed.
[0234] Fig. 24 is a diagram showing an example of the display of a switching menu according to this embodiment. The switching menu M5 shown in the figure shows a switching menu displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.). Display mode switching icons C52, C53, and C54 are displayed in the switching menu M5. Each of the display mode switching icons C52, C53, and C54 corresponds to a state in which a number (number) according to the priority order of the divided display areas, such as "1", "2", and "3", is not displayed for each of the display mode switching icons C32, C33, and C34 shown in Fig. 14(B).
[0235] When the user moves the finger (or mouse cursor) that is performing the drag operation into the switching menu M5 and releases the finger (or stops pressing the mouse button) on one of the display mode switching icons in the switching menu M5, the dragged window W1 is placed and displayed in the display area corresponding to the area where the finger was released (or the mouse button was stopped). The priority order of the areas is set clockwise starting from the display area where the window W1 is placed.
[0236] For example, as shown in Fig. 24, when the user releases the finger that is dragging (or stops pressing the mouse button) in the top right area of the three divided areas of the display mode switching icon C53, the priority of the areas is set as follows: top right area is first, bottom right area is second, and left area is third. In this way, the priority of the areas changes depending on the area where the user releases the finger that is dragging (or stops pressing the mouse button) (because the priority of the areas is not set in advance), so the display mode switching icon in the switching menu M5 does not display a number according to the priority.
[0237] Also, when window W1 (active window) is displayed in the display area corresponding to the upper right area, if the number of windows in single screen mode is four or more, a thumbnail window is displayed in the display area corresponding to the lower right area, which has the second highest priority. If the number of windows in single screen mode is less than four, a thumbnail window is not displayed. For example, if the number of windows in single screen mode is three, window W1 (active window) is displayed in the display area corresponding to the upper right area, which has the first highest priority, and inactive windows in single screen mode are displayed in each of the display area corresponding to the lower right area, which has the second highest priority, and the display area corresponding to the left area, which has the third highest priority.
[0238] In this way, in the case of the display mode switching operation of this embodiment described with reference to Figures 23 and 24, as in the first and second embodiments, when switching from single screen mode to multiple screen mode, it is possible to control whether or not to display the thumbnail window based on the number of windows in single screen mode or the number of display areas in multiple screen mode.
[0239] 24 shows an example of the display of the switching menu M5 displayed when the usage mode is "Landscape", but the switching menu displayed when the usage mode is "Clamshell or Portrait" may be configured to include display mode switching icons C42, C43, and C44 shown in Fig. 14(C) that do not display numbers (numbers) according to the priority of the divided display areas, such as "1", "2", and "3". Also, while the example shown in Fig. 24 shows an example of a switching menu that allows switching to a dual-screen mode or triple-screen mode, the configuration may include a display mode switching icon that allows switching to a quadruple-screen mode or a multiple-screen mode of four or more.
[0240] The switching menu is displayed based on the window drag operation not only in single-screen mode, but also in multiple-screen modes such as dual-screen mode and triple-screen mode.
[0241] As described above, in this embodiment, the display control unit 1834 displays a switching menu M5 (an example of operation display information) as an operator for receiving an operation to switch to the multiple screen mode based on a user's operation of dragging an active window (for example, window W1 shown in FIG. 23) in the single screen mode (FIG. 23(B) and see FIG. 24). The switching menu M5 includes display mode switching icons C52, C53, and C54 (an example of display information) that enable selection of the number of display areas divided into multiple areas in the multiple screen mode and a display area in which to display the dragged active window (for example, window W1 shown in FIG. 23) among the multiple display areas, as options for the multiple screen mode when switching from the single screen mode to the multiple screen mode.
[0242] Then, when the display mode switching unit 1832 switches from the single screen mode to the multiple screen mode in response to an operation on the switching menu M5, the display control unit 1834 displays the active window in the display area selected as the display area for displaying the active window as the first display area DA1 with the first priority. The display control unit 1834 also sets a display area other than the display area for displaying the active window (for example, a display area with the second priority) as the second display area DA2. Then, similar to the second embodiment, the display control unit 1834 controls whether or not to display thumbnail images corresponding to inactive windows in the single screen mode in the second display area DA2 based on the number of display areas in the multiple screen mode selected by an operation on the switching menu M5 (for example, three in the example shown in FIG. 24).
[0243] The display control unit 1834 may control whether or not to display thumbnail images corresponding to inactive windows in the single screen mode in the second display area DA2 based on the number of windows in the single screen mode, as in the first and second embodiments. The display control unit 1834 may control whether or not to display thumbnail images corresponding to active windows in the single screen mode in the second display area DA2 based on the number of display areas in the multiple screen mode selected by an operation on the switching menu M5 and the number of windows in the single screen mode, as in the first and second embodiments.
[0244] As a result, even in the display mode switching operation described with reference to Figures 23 and 24, the information processing device 10 can control whether or not to display thumbnail images (thumbnail windows) depending on the number of windows in the single screen mode described in the first and second embodiments and the number of divisions of the display area in the multiple screen mode after switching.
[0245] In addition, the display mode switching process by the display mode switching operation according to this embodiment divides the screen area of the display 150 into multiple display areas and controls the arrangement (display) of windows, so it can also be called a display control process for each display area.
[0246] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configurations are not limited to those described above, and various design changes and the like are possible within the scope of the gist of the present invention. For example, the configurations described in the above embodiments may be combined in any desired manner.
[0247] In the above-described embodiment, an example in which one foldable display 150 is used in a single screen mode and a dual screen mode has been described, but two displays may be used. That is, the processing in the above-described embodiment can be applied to switching between a single screen mode in which the screen areas of the two displays are combined into one display area and the dual screen mode in which the screen areas of the two displays are individually combined into display areas and the display is controlled. In addition, the processing in the above-described embodiment can be applied to a triple screen mode or a quadruple screen mode in which one or both of the screen areas of the two displays are divided into two display areas and the display is controlled.
[0248] In addition, in the above-described embodiment, the information processing device 10 has been described as having, as multiple screen modes, a dual screen mode in which the display is controlled by dividing it into two display areas, a triple screen mode in which the display is controlled by dividing it into three display areas, and a quadruple screen mode in which the display is controlled by dividing it into four display areas, but it may also be configured to have a screen mode in which the display is controlled by dividing it into five or more display areas.
[0249] In addition, in the above-described embodiment, an example of touch operation on a plurality of touch panel type displays in which the input unit (touch sensor) and the display unit are integrally configured has been described, but this is not limited to touch operation, and may also be a click operation using a mouse, an operation using a gesture, or the like.
[0250] The above-mentioned control unit 18 has a computer system inside. A program for realizing the function of each of the components of the above-mentioned control unit 18 may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform processing in each of the components of the above-mentioned control unit 18. Here, "reading the program recorded in the recording medium into a computer system and executing it" includes installing the program in a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include a plurality of computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.
[0251] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by the respective components of the control unit 18, or each of the divided programs may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for realizing a part of the above-mentioned functions. Furthermore, the program may be a recording medium that can realize the above-mentioned functions in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program).
[0252] In addition, some or all of the functions of the control unit 18 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]
[0253] 10 information processing device, 101 first housing, 102 second housing, 103 hinge mechanism, 11 communication unit, 12 RAM, 13 storage unit, 14 speaker, 15 display unit, 16 camera, 150 display, 155 touch sensor, 161 first acceleration sensor, 162 second acceleration sensor, 17 hall sensor, 18 control unit, 181 system processing unit, 1811 execution application information generation unit, 182 detection processing unit, 1821 opening / closing detection unit, 1822 attitude detection unit, 1823 connection detection unit, 1824 operation detection unit, 183 display processing unit, 1831 display mode determination unit, 1832 display mode switching unit, 1833 thumbnail generation unit, 1834 display control unit
Claims
1. A display and A memory for storing application programs; a processor that controls displaying a window of the application on the display by executing a program of the application stored in the memory; Equipped with The processor, a display mode switching process for controlling switching between a first display mode in which the entire screen area of the display is treated as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and the display mode is controlled; a display control process for controlling, when the display mode is switched from the first display mode to the second display mode by the display mode switching process, whether or not to display, in a first display area of the plurality of display areas, one of the windows of the application executed in the first display mode, and, in a second display area of the plurality of display areas excluding the first display area, thumbnail images corresponding to the windows excluding the one window of the windows in the first display mode, based on the number of display areas in the second display mode; An information processing device that performs the above.
2. A display and A memory for storing application programs; a processor that controls displaying a window of the application on the display by executing a program of the application stored in the memory; Equipped with The processor, a display mode switching process for controlling switching between a first display mode in which the entire screen area of the display is treated as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and the display mode is controlled; a display control process for controlling, when the display mode is switched from the first display mode to the second display mode by the display mode switching process, whether or not to display, in a first display area of the plurality of display areas, one of the windows of the application executed in the first display mode, and, in a second display area of the plurality of display areas excluding the first display area, thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode, based on the number of the windows in the first display mode; An information processing device that performs the above.
3. The processor, When the display mode is switched from the first display mode to the second display mode by the display mode switching process, in the display control process, whether or not to display the thumbnail images in the second display area is controlled based on the number of display areas in the second display mode and the number of the windows in the first display mode.
3. The information processing device according to claim 1 or 2.
4. The processor, when the display mode is switched from the first display mode to the second display mode by the display mode switching process, in the display control process, if the number of display areas in the second display mode is equal to or greater than the number of windows in the first display mode, the thumbnail images are not displayed, and the windows in the first display mode except for the one window are displayed in the second display area. The information processing device according to claim 3 .
5. The processor, when the display mode is switched from the first display mode to the second display mode by the display mode switching process, in the display control process, if the number of display areas in the second display mode is smaller than the number of windows in the first display mode, the thumbnail images are displayed in the second display areas. The information processing device according to claim 3 .
6. The processor, When there are a plurality of second display areas in the second display mode, in the display control process, the windows in the first display mode except for the one window are displayed in any one of the plurality of second display areas. The information processing device according to claim 4.
7. The processor, in the display control process, when the windows in the first display mode are displayed in each of the first display area and the one or more second display areas, the windows are displayed one by one in accordance with a priority order of the areas and a priority order of the windows that are preset in the first display area and the one or more second display areas; The information processing device according to claim 6.
8. The processor, in the display control process, a priority order of a window is increased in accordance with a later order of becoming an active window among the windows in the first display mode. The information processing device according to claim 7.
9. The processor, In the display control process, a priority of the window that has been minimized in the first display mode is lowered to be lower than a priority of the window that has not been minimized. The information processing device according to claim 7.
10. The processor, When there are a plurality of second display areas in the second display mode, the thumbnail image is displayed in any one of the plurality of second display areas in the display control process. The information processing device according to claim 5 .
11. The processor, In the display control process, the thumbnail image is displayed in any one of the second display areas in accordance with a priority order of the second display areas that is preset in the second display areas. The information processing device according to claim 10.
12. The processor, when any one of the thumbnail images displayed in any one of the plurality of second display areas is selected in the display control process, the window corresponding to the selected thumbnail image is displayed in the second display area in which the thumbnail image was displayed, and the thumbnail images that are not selected are displayed in the other second display areas in accordance with the priority order of the areas. The information processing device according to claim 11.
13. The processor, In the display control process, the thumbnail image is displayed in an area having the last priority among the plurality of second display areas. The information processing device according to claim 11.
14. The window that was minimized when switching from the first display mode to the second display mode is not included in the number of windows in the first display mode. The information processing device according to claim 3 .
15. The processor, when an operation of dragging the one window in the first display mode is performed, displaying operation display information as an operator for receiving an operation for switching to the second display mode by the display control process; the operation display information includes, as options for the second display mode when switching from the first display mode to the second display mode, display information for selecting the number of display areas divided into a plurality of display areas in the second display mode and a display area in which the one dragged window is to be displayed among the plurality of divided display areas; When the first display mode is switched to the second display mode by the display mode switching process in response to an operation being performed on the operation display information, in the display control process, a display area selected as a display area in which to display the one window is set as the first display area, and the one window is displayed, and in the second display area excluding the first display area among the multiple display areas, whether or not thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode are displayed is controlled based on the number of display areas in the second display mode selected by an operation on the operation display information. The information processing device according to claim 1 .
16. The processor, when an operation of dragging the one window in the first display mode is performed, displaying operation display information as an operator for receiving an operation for switching to the second display mode by the display control process; the operation display information includes, as options for the second display mode when switching from the first display mode to the second display mode, display information for selecting the number of display areas divided into a plurality of display areas in the second display mode and a display area in which the one dragged window is to be displayed among the plurality of divided display areas; When the display mode is switched from the first display mode to the second display mode by the display mode switching process in response to an operation being performed on the operation display information, in the display control process, a display area selected as a display area in which to display the one window is set as the first display area, and the one window is displayed, and in the second display area excluding the first display area among the multiple display areas, whether or not thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode are displayed is controlled based on the number of the windows in the first display mode. The information processing device according to claim 2 .
17. The processor, When the first display mode is switched to the second display mode by the display mode switching process in response to an operation being performed on the operation display information, in the display control process, whether or not to display the thumbnail images in the second display area is controlled based on the number of display areas in the second display mode selected by the operation on the operation display information and the number of the windows in the first display mode.
17. The information processing device according to claim 15 or 16.
18. 1. A control method for an information processing device including a display, a memory that stores an application program, and a processor that performs control to display a window of the application on the display by executing the application program stored in the memory, comprising: The processor, a display mode switching step of controlling switching between a first display mode in which the entire screen area of the display is treated as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and the display mode is controlled; a display control step of, when switching from the first display mode to the second display mode by the display mode switching step, displaying one of the windows of the application executed in the first display mode in a first display area of the plurality of display areas, and controlling, based on the number of display areas in the second display mode, whether or not to display thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode in a second display area of the plurality of display areas excluding the first display area; A control method comprising:
19. 1. A control method for an information processing device including a display, a memory that stores an application program, and a processor that performs control to display a window of the application on the display by executing the application program stored in the memory, comprising: The processor, a display mode switching step of controlling switching between a first display mode in which the entire screen area of the display is treated as a single display area and a second display mode in which the screen area of the display is divided into a plurality of display areas and the display mode is controlled; a display control step of, when switching from the first display mode to the second display mode by the display mode switching step, displaying one of the windows of the application executed in the first display mode in a first display area of the plurality of display areas, and controlling, based on the number of the windows in the first display mode, whether or not to display thumbnail images corresponding to the windows excluding the one window among the windows in the first display mode in a second display area of the plurality of display areas excluding the first display area; A control method comprising:
Citation Information
Patent Citations
Information processing device and control method
JP2022070081A
Information processing apparatus and control method
JP2023039571A
Information Handling System Predictive Content Navigation
US20180329580A1
Method and device for providing user interface in electronic device having foldable display
US20210150953A1
Electronic device for providing execution screen of application and method for operating the same
US20210247805A1