Information processing apparatus and control method
The information processing device addresses the challenge of arranging thumbnail images in multiple display areas by controlling their placement in a predetermined order, improving user interface efficiency.
Patent Information
- Application Number
- JP2024087993
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-05-30
- Publication Date
- 2025-12-11
AI Technical Summary
Existing information processing devices struggle with determining the order in which to place thumbnail images of running windows in multiple display areas, making it difficult for users to arrange windows as intended.
An information processing device that controls the placement of windows and thumbnail images by dividing the screen area into multiple display areas and arranging thumbnail images in a predetermined order relative to the primary window's display area, such as clockwise or counterclockwise, or in specific positions based on the layout.
Facilitates easier and more intuitive window arrangement for users by establishing a clear order for placing thumbnail images, enhancing user experience in multi-display area layouts.
Smart Images

Figure 2025180574000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device and a control method. [Background technology]
[0002] There is an information processing device that can divide the screen area of a display into multiple display areas and display application windows, etc. in each display area. For example, Patent Document 1 discloses an information processing device that has a flexible display that spans first and second housings that can be rotated by a hinge mechanism, and that allows the screen area of the flexible display to be used as a single display area or as two divided display areas by bending the first and second housings or by laying them flat.
[0003] Recently, some devices have a snap function that allows a user to select any display area within a layout in which the screen area is divided into multiple display areas, such as two, three, or four, in response to a user's operation, and arrange the window of the application in that area. For example, the user can select a display area of any layout by dragging any window displayed on the display, and snap (arrange) that window to the display area of the selected layout.
[0004] Also, for example, some display areas other than the display area in which the window is located can display thumbnail images of windows of other running applications so that they can be viewed at a glance, and when the user selects a thumbnail image, the selected window can be displayed in the display area where the thumbnail image was displayed. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent No. 7440672 Summary of the Invention [Problem to be solved by the invention]
[0006] However, when a window is placed in any display area within a layout in which the screen area is divided into multiple display areas as described above, if thumbnail images of other running windows are to be placed and displayed in other display areas, the thumbnail images may be placed sequentially in the display area next to the window, or if a window is placed in the next display area, the thumbnail images may be placed in the display area after that, skipping that display area, or display areas in which no windows are displayed may be selected in Z-order and thumbnail images may be placed there.As a result, it is difficult to understand the rules for determining the order in which display areas to place thumbnail images, depending on the display state at the time, and the user may not be able to place windows as intended.
[0007] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objects is to provide an information processing device and a control method that make it easy for a user to arrange windows as intended within a layout in which the screen area is divided into multiple display areas. [Means for solving the problem]
[0008] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a memory that stores an application program, and a processor that executes the application program stored in the memory to control the placement and display of a window of the running application in a screen area of a display, wherein the processor performs a display control process that divides the screen area of the display into a plurality of display areas and places the windows, and in the display control process, when a first window of the windows is placed in one of the plurality of display areas, thumbnail images corresponding to one or more second windows other than the first window are placed in a display area other than the one display area of the plurality of display areas, and the display area in which the thumbnail images are placed is determined in a certain order relative to the one display area in which the first window is placed.
[0009] In the information processing device, in the display control process, the processor may prioritize arranging the thumbnail images even if any of the windows have already been arranged in the display area in which the thumbnail images are to be arranged in the certain order.
[0010] In the information processing device, the fixed arrangement order may be a clockwise order.
[0011] In the information processing device, the fixed arrangement order may be a counterclockwise order.
[0012] In the above-mentioned information processing device, when the processor divides the screen area of the display into two upper and lower display areas and arranges the windows in the display control process, when the processor arranges the first window in the upper first display area of the two divided display areas, it may arrange the thumbnail image in the lower second display area, and when the processor arranges the first window in the second display area, it may arrange the thumbnail image in the first display area.
[0013] In the above-mentioned information processing device, when the processor divides the screen area of the display into two display areas, left and right, to arrange the windows in the display control process, when the processor arranges the first window in the first display area, which is the left side of the two divided display areas, it may arrange the thumbnail image in the second display area, which is the right side, and when the processor arranges the first window in the second display area, it may arrange the thumbnail image in the first display area.
[0014] In the above-described information processing device, in the display control process, when the processor divides the screen area of the display into two upper and lower display areas and further divides the lower display area into two to divide the windows into three display areas, the processor may arrange the thumbnail image in the second display area on the lower right when the first window is arranged in the upper first display area of the three divided display areas, arrange the thumbnail image in the third display area on the lower left when the first window is arranged in the second display area, and arrange the thumbnail image in the first display area when the first window is arranged in the third display area.
[0015] In the above information processing device, in the display control process, when the processor divides the screen area of the display into two upper and lower display areas and further divides the lower display area into two to divide the windows into three display areas, the processor may arrange the thumbnail image in the second display area on the lower left when arranging the first window in the upper first display area of the three divided display areas, arrange the thumbnail image in the second display area on the lower left when arranging the first window in the second display area, arrange the thumbnail image in the third display area on the lower right when arranging the first window in the third display area, and arrange the thumbnail image in the first display area when arranging the first window in the third display area.
[0016] In the above-described information processing device, in the display control process, the processor may, when dividing the screen area of the display into two upper and lower display areas and further dividing the upper display area into two to divide the upper display area into three display areas and arranging the windows, arrange the thumbnail image in the second display area on the upper right when arranging the first window in the first display area on the upper left of the three divided display areas, arrange the thumbnail image in the second display area on the lower right when arranging the first window in the second display area, and arrange the thumbnail image in the third display area on the lower side when arranging the first window in the third display area.
[0017] In the above-described information processing device, in the display control process, the processor may, when dividing the screen area of the display into two upper and lower display areas and further dividing the upper display area into two to divide the upper display area into three display areas and arranging the windows, arrange the thumbnail image in the lower second display area when arranging the first window in the upper left first display area of the three divided display areas, arrange the thumbnail image in the lower second display area when arranging the first window in the second display area, arrange the thumbnail image in the upper right third display area when arranging the first window in the third display area, and arrange the thumbnail image in the first display area when arranging the first window in the third display area.
[0018] In the above-described information processing device, when the processor, in the display control processing, divides the screen area of the display into two display areas, left and right, and further divides the right-hand display area into two to divide the screen area into three display areas and arranges the windows, the processor may arrange the thumbnail image in the second display area on the upper right when arranging the first window in the first display area on the left of the three divided display areas, arrange the thumbnail image in the second display area on the upper right when arranging the first window in the second display area, and arrange the thumbnail image in the third display area on the lower right when arranging the first window in the third display area.
[0019] In the above information processing device, when the processor, in the display control process, divides the screen area of the display into two display areas, left and right, and further divides the right-hand display area into two to divide the screen area into three display areas and arranges the windows, the processor may arrange the thumbnail image in the second display area below on the right when arranging the first window in the first display area on the left of the three divided display areas, arrange the thumbnail image in the third display area above on the right when arranging the first window in the second display area, and arrange the thumbnail image in the first display area when arranging the first window in the third display area.
[0020] In the above-described information processing device, when the processor, in the display control processing, divides the screen area of the display into two display areas, left and right, and further divides the left display area into two to divide it into three display areas and arrange the windows, it may arrange the thumbnail image in the second display area on the right when arranging the first window in the first display area at the top left of the three divided display areas, arrange the thumbnail image in the third display area at the bottom left when arranging the first window in the second display area, and arrange the thumbnail image in the first display area when arranging the first window in the third display area.
[0021] In the above-described information processing device, when the processor, in the display control processing, divides the screen area of the display into two display areas, left and right, and further divides the left display area into two to divide it into three display areas and arrange the windows, it may arrange the thumbnail image in the second display area below the left side when arranging the first window in the first display area at the top left of the three divided display areas, arrange the thumbnail image in the second display area below the left side when arranging the first window in the second display area, arrange the thumbnail image in the third display area on the right side when arranging the first window in the third display area, and arrange the thumbnail image in the first display area when arranging the first window in the third display area.
[0022] In the above-described information processing device, in the display control process, when the processor divides the screen area of the display into four display areas vertically and horizontally to arrange the windows, when arranging the first window in a first display area at the top left of the four divided display areas, the processor may arrange the thumbnail image in a second display area at the top right of the four divided display areas, when arranging the first window in the second display area, the processor may arrange the thumbnail image in a third display area at the bottom right of the four divided display areas, when arranging the first window in the second display area, the processor may arrange the thumbnail image in a fourth display area at the bottom left of the four divided display areas, when arranging the first window in the third display area, the processor may arrange the thumbnail image in a fourth display area at the bottom left of the four divided display areas, and when arranging the first window in the fourth display area, the processor may arrange the thumbnail image in the first display area.
[0023] In the above-described information processing device, in the display control process, when the processor divides the screen area of the display into four display areas vertically and horizontally to arrange the windows, when arranging the first window in a first display area at the top left of the four divided display areas, the processor may arrange the thumbnail image in a second display area at the bottom left, when arranging the first window in the second display area, the processor may arrange the thumbnail image in a third display area at the bottom right, when arranging the first window in the third display area, the processor may arrange the thumbnail image in a fourth display area at the top right, when arranging the first window in the third display area, and when arranging the first window in the fourth display area, the processor may arrange the thumbnail image in the first display area.
[0024] In the above-described information processing device, when the processor divides the screen area of the display horizontally into three display areas and arranges the windows in the display control process, the processor may arrange the thumbnail image in the second display area in the center when the first window is arranged in the first display area on the left of the three divided display areas, arrange the thumbnail image in the third display area on the right when the first window is arranged in the second display area, and arrange the thumbnail image in the first display area when the first window is arranged in the third display area.
[0025] In the above-described information processing device, when the processor divides the screen area of the display horizontally into three display areas and arranges the windows in the display control process, the processor may arrange the thumbnail image in the second display area in the center when the first window is arranged in the first display area on the right of the three divided display areas, arrange the thumbnail image in the third display area on the left when the first window is arranged in the second display area, and arrange the thumbnail image in the first display area when the first window is arranged in the third display area.
[0026] In the above-described information processing device, when the processor divides the screen area of the display vertically into three display areas and arranges the windows in the display control process, the processor may arrange the thumbnail image in the central second display area when arranging the first window in the upper first display area of the three divided display areas, arrange the thumbnail image in the lower third display area when arranging the first window in the second display area, and arrange the thumbnail image in the first display area when arranging the first window in the third display area.
[0027] In the above-mentioned information processing device, when the processor divides the screen area of the display vertically into three display areas and arranges the windows in the display control process, the processor may arrange the thumbnail image in the central second display area when arranging the first window in the lower first display area of the three divided display areas, arrange the thumbnail image in the upper third display area when arranging the first window in the second display area, and arrange the thumbnail image in the first display area when arranging the first window in the third display area.
[0028] Furthermore, according to a second aspect of the present invention, there is provided a control method for an information processing device including a memory for storing an application program and a processor for controlling the placement and display of a window of the running application in a screen area of a display by executing the application program stored in the memory, the control method comprising the steps of: dividing the screen area of the display into a plurality of display areas; and placing a first window of the windows in one of the plurality of display areas; and placing thumbnail images corresponding to one or more second windows other than the first window in a display area of the plurality of display areas other than the one display area; and determining the display area in which to place the thumbnail image relative to the one display area in which the first window is to be placed according to a predetermined order. [Effects of the Invention]
[0029] According to the above aspects of the present invention, it is possible to make it easier for the user to arrange windows as intended within a layout in which the screen area is divided into a plurality of display areas. [Brief explanation of the drawings]
[0030] [Figure 1] FIG. 1 is a perspective view showing the appearance of an information processing apparatus according to a first embodiment. [Figure 2] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a bent state. [Figure 3] FIG. 1 is a side view showing an example of an information processing device in a flat state according to a first embodiment. [Figure 4] 3A to 3C are views showing specific examples of various display modes of the information processing device according to the first embodiment. [Figure 5] FIG. 4 is a diagram showing an example of display control when switching from a single-screen mode to a dual-screen mode according to the first embodiment. [Figure 6] FIG. 3 is a view showing a display example of layout selection icons according to the first embodiment. [Figure 7] FIG. 1 is a diagram showing an example of a configuration in which an information processing apparatus according to a first embodiment is connected to an external display. [Figure 8] FIG. 3 is a diagram showing a display example of a display selection icon according to the first embodiment. [Figure 9] FIG. 4 is a diagram showing an example of selection of a display selection icon according to the first embodiment. [Figure 10] FIG. 4 is a view showing a display example when a layout (display area) is selected using a layout selection icon according to the first embodiment. [Figure 11] 10A and 10B are diagrams showing an example of a display when the display position of a window is changed as a result of the end of a drag operation according to the first embodiment. [Figure 12] FIG. 4 is a view showing a first example of a rule for arranging thumbnail images according to the first embodiment. [Figure 13] FIG. 10 is a view showing a second example of the arrangement rule for thumbnail images according to the first embodiment. [Figure 14] FIG. 10 is a view showing a third example of the arrangement rule for thumbnail images according to the first embodiment. [Figure 15] FIG. 10 is a view showing a fourth example of the arrangement rule for thumbnail images according to the first embodiment. [Figure 16] FIG. 10 is a view showing a fifth example of the arrangement rule for thumbnail images according to the first embodiment. [Figure 17] FIG. 10 is a view showing a sixth example of the arrangement rule for thumbnail images according to the first embodiment. [Figure 18] FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing apparatus according to a first embodiment. [Figure 19] FIG. 1 is a block diagram showing an example of the functional configuration of an information processing apparatus according to a first embodiment. [Figure 20] 10 is a flowchart showing an example of a display layout change process according to the first embodiment. [Figure 21] FIG. 10 is a view showing another example of the arrangement rule for thumbnail images according to the first embodiment. [Figure 22] FIG. 10 is a view showing a first example of a rule for arranging thumbnail images according to the second embodiment. [Figure 23] FIG. 10 is a view showing a second example of the arrangement rule for thumbnail images according to the second embodiment. [Figure 24]FIG. 10 is a view showing a third example of the arrangement rule for thumbnail images according to the second embodiment. [Figure 25] FIG. 10 is a view showing a fourth example of the arrangement rule for thumbnail images according to the second embodiment. [Figure 26] FIG. 10 is a view showing a fifth example of the arrangement rule for thumbnail images according to the second embodiment. [Figure 27] FIG. 13 is a view showing a first example of a rule for arranging thumbnail images according to the third embodiment. [Figure 28] FIG. 13 is a view showing a second example of the arrangement rule for thumbnail images according to the third embodiment. [Figure 29] FIG. 13 is a view showing a third example of the arrangement rule for thumbnail images according to the third embodiment. [Figure 30] FIG. 13 is a view showing a fourth example of the arrangement rule for thumbnail images according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0031] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First Embodiment [External view of information processing device] FIG. 1 is a perspective view showing the appearance of an information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is a clamshell (notebook) type PC (personal computer). The information processing device 10 includes a first housing 101, a second housing 102, and a hinge mechanism 103. The first housing 101 and the second housing 102 are substantially rectangular, plate-shaped (e.g., flat) housings. One side of the first housing 101 and one side of the second housing 102 are coupled (connected) via the hinge mechanism 103, and the first housing 101 and the second housing 102 are relatively rotatable around a rotation axis formed by the hinge mechanism 103. When the opening angle θ between the first housing 101 and the second housing 102 about the rotation axis is substantially 0°, the first housing 101 and the second housing 102 are overlapping and closed. A state in which the first housing 101 and the second housing 102 are closed is referred to as a "closed state." In the closed state, the surfaces of the first housing 101 and the second housing 102 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." The opening angle θ can also be said to be the angle formed by the inner surfaces of the first housing 101 and the second housing 102. A state in which the first housing 101 and the second housing 102 are open relative to the closed state is referred to as an "open state." The open state is a state in which the first housing 101 and the second housing 102 are rotated relative to each other until the opening angle θ becomes larger than a preset threshold value (for example, 10°).
[0032] The information processing device 10 also includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided across the inner surface of the first housing 101 and the inner surface of the second housing 102. The camera 16 is provided, for example, on the inner surface of the first housing 101 outside the screen area of the display 150, and is capable of capturing an image of a user or the like who is on the side facing the display 150. The display 150 is a flexible display that can be bent to match an opening angle θ resulting from relative rotation of the first housing 101 and the second housing 102 (see FIGS. 2 and 3). An organic EL display or the like is used as the flexible display. The information processing device 10 can control display using the entire screen area of the display 150 as a single screen configuration, with the entire screen area being a single display area DA, or can control display using a dual-screen configuration by dividing the screen area of the display 150 into two display areas, a first display area DA1 and a second display area DA2. Here, first display area DA1 and second display area DA2 are display areas that do not overlap each other. Here, the display area of the screen area of display 150 that corresponds to the inner surface of first housing 101 is referred to as first display area DA1, and the display area that corresponds to the inner surface of second housing 102 is referred to as second display area DA2. Hereinafter, the display mode that controls display in a single-screen configuration is referred to as the "single-screen mode," and the display mode that controls display in a dual-screen configuration is referred to as the "dual-screen mode."
[0033] A touch sensor is provided above the screen area of the display 150. The information processing device 10 can detect a touch operation on the screen area of the display 150. By opening the information processing device 10, the user can view the displays 150 provided on the inner surfaces of the first housing 101 and the second housing 102 and perform touch operations on the displays 150, thereby enabling the user to use the information processing device 10.
[0034] Next, usage forms and screen modes of the information processing device 10 will be described in detail. First, usage forms of the information processing device 10 can be divided into a bent state in which the first housing 101 and the second housing 102 are bent (Bent form) and a flat state in which the first housing 101 and the second housing 102 are not bent (Flat form) depending on the opening angle θ between the first housing 101 and the second housing 102. Hereinafter, the bent state in which the first housing 101 and the second housing 102 are bent will be simply referred to as the "Bent form," and the flat state in which the first housing 101 and the second housing 102 are not bent will be simply referred to as the "Flat form." In the bent state, the display 150 provided across the first housing 101 and the second housing 102 is also bent. In the flat form, the display 150 is also flat.
[0035] FIG. 2 is a side view showing an example of the information processing device 10 in a bent state (bent form). The display 150 is disposed across (straddles) the first housing 101 and the second housing 102. The screen area of the display 150 (display area DA shown in FIG. 1) can be bent (flexed) at a fold line at a portion corresponding to the hinge mechanism 103. The display area on the first housing 101 side of the fold line is shown as a first display area DA1, and the display area on the second housing 102 side is shown as a second display area DA2. The display 150 bends in response to the rotation (opening angle θ) of the first housing 101 and the second housing 102. The information processing device 10 determines whether it is in a bent state (bent form) in response to the opening angle θ. For example, if 10°<θ<170°, the information processing device 10 determines that it is in a bent state (bent form). This state corresponds to a usage mode known as a clamshell mode or a book mode.
[0036] 3 is a side view showing an example of the information processing device 10 in a flat state (Flat form). The information processing device 10 typically determines that it is in a flat state (Flat form) when the opening angle θ is 180°, but as an example, it may also determine that it is in a flat state (Flat form) when 170°≦θ≦180°. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat state. This state corresponds to a usage form known as a tablet mode.
[0037] [Display mode explanation] Next, display modes according to various usage patterns of the information processing device 10 will be described in detail with reference to FIG. 4 is a diagram showing specific examples of various display modes of the information processing device 10 according to this embodiment. The display mode of the information processing device 10 differs depending on the usage form, which is classified by the opening angle θ between the first housing 101 and the second housing 102, the attitude (orientation) of the information processing device 10, whether it is a single-screen mode or a dual-screen mode, etc. Note that one screen is also called a single screen, and two screens are also called a split screen or dual screen.
[0038] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage pattern. For example, in this closed state, the information processing device 10 is in a standby state such as a sleep state or a hibernation state, and the display 150 is in a display-off state. This standby state such as a sleep state or a hibernation state corresponds to, for example, a system power state S3 or S4 defined by ACPI (Advanced Configuration and Power Interface).
[0039] Display mode (b) is a display mode in which the display 150 is in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled by dividing the two areas. The orientation of the information processing device 10 is such that the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. A vertically oriented display area means that the longer side of the four sides of the rectangular display area is vertical and the shorter side is horizontal. When the display area is vertically oriented, the display orientation is also vertical, with the direction along the longer side corresponding to the up-down direction and the direction along the shorter side corresponding to the left-right direction. This usage mode is such that the left and right pages of an open book correspond to the left and right screens, and corresponds to a so-called book mode. This usage form is also called "Fold Landscape" because the display is bent, the first display area DA1 and the second display area DA2 are arranged side by side, and the combined display area is horizontally long.
[0040] In this display mode (b), for example, in a normal operating state, the information processing device 10 is in a dual-screen display mode, with the first display area DA1 on the left side serving as the primary screen and the second display area DA2 on the right side serving as the secondary screen. Note that in display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and secondary screen may be reversed.
[0041] Display mode (c-1), like display mode (b), is a display mode in which the display 150 is in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, for display control, but the orientation of the information processing device 10 is different. The orientation of the information processing device 10 is an orientation in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically one above the other. A horizontal display area orientation refers to an orientation in which the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display orientation is also horizontal, and the direction along the short side corresponds to the up-down direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the common usage modes for clamshell-type PCs.
[0042] In this display mode (c-1), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode, with the first display area DA1 as the primary screen and the second display area DA2 as the secondary screen. Note that in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.
[0043] For example, the information processing device 10 automatically switches from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right relative to display mode (b) in the illustrated example, the information processing device 10 switches to display mode (c-1) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the right from the display mode (b) state. Also, since display mode (b) is a state in which the display 150 is rotated 90 degrees to the left relative to display mode (c-1) in the illustrated example, the information processing device 10 switches to display mode (b) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the left from the display mode (c-1) state.
[0044] The display mode (c-2) is similar to the display mode (c-1), in that the information processing device 10 is in the bent state (Bent form) and oriented in the same manner. However, the difference is that an external keyboard 30 (Dockable mini KBD: Keyboard) connectable to the information processing device 10 is connected. This usage mode is a typical usage mode of a clamshell PC with a physical keyboard 30 connected. For example, the keyboard 30 is approximately the same size as the second display area DA2 and is configured to be able to be placed on the second display area DA2. As an example, the keyboard 30 has a magnet on the inside (edge) of the bottom surface. When placed on the second display area DA2, the magnet is attracted to and fixed to a metal portion on the inner edge of the second housing 102. This results in a usage mode similar to that of a conventional clamshell PC that is originally equipped with a physical keyboard. The information processing device 10 and the keyboard 30 are connected via, for example, Bluetooth (registered trademark). In this display mode (c-2), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because the second display area DA2 cannot be seen due to the keyboard. In other words, this display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as "half screen mode"), and is a one-screen mode that uses only the first display area DA1.
[0045] For example, when the information processing device 10 detects connection of an external keyboard in the display mode (c-1), the display mode (c-1) is automatically switched to the display mode (c-2) (Switch by Dock).
[0046] Display mode (d) is in a bent state (Bent form) like display mode (b), and the orientation of the information processing device 10 is also the same, but it is a single-screen mode in which the entire screen area of the display 150 is controlled as a single display area DA. This usage mode differs from display mode (b) in that it is a single-screen mode, but is also called "Fold Landscape" because it is in a bent state (Bent form) and the display area DA is horizontally long. The display area DA is oriented horizontally, and the display orientation is also horizontal.
[0047] Here, switching between the single-screen mode and the dual-screen mode in the bent state (Bent form) can be performed by, for example, a user operation. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single-screen mode and the dual-screen mode somewhere on the screen, and switches from display mode (b) to display mode (d) based on an operation on the operator (Switch by UI).
[0048] Display mode (e) is in a bent state (bent form) like display mode (c-1), and the orientation of the information processing device 10 is also the same, but it is a single-screen mode in which the entire screen area of the display 150 is controlled as a single display area DA. This usage mode differs from display mode (c-1) in that it is a single-screen mode, but it corresponds to the usage mode of a clamshell PC in terms of the bent state (bent form) and the orientation of the information processing device 10. The display area DA is in portrait orientation, and the display orientation is also portrait.
[0049] For example, the information processing device 10 automatically switches from display mode (d) to display mode (e) or from display mode (e) to display mode (d) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since display mode (e) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure, the information processing device 10 switches to display mode (e) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the right from the display mode (d). Also, since display mode (d) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure, the information processing device 10 switches to display mode (d) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the left from the display mode (e) state.
[0050] Display mode (d') is a single-screen mode similar to display mode (d), in which the orientation of the information processing device 10 is such that the display area DA is horizontally long, but differs in that it is in a flat state (Flat form). The flat state (Flat form) is a state in which the opening angle θ between the first housing 101 and the second housing 102 is approximately 180°. This usage mode corresponds to the so-called tablet mode described with reference to FIG. 3, and is also called "Flat Landscape" because it is in a flat state (Flat form) and the display area DA is horizontally long. This display mode (d') differs from display mode (d) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to display mode (d), the display area DA is horizontally long, and the display orientation is also landscape.
[0051] Display mode (e') is a single-screen mode similar to display mode (e), in which the orientation of the information processing device 10 is such that the display area DA is vertically long, but it differs in that it is in a flat state (Flat form). This usage mode is also called "Flat Portrait" because it is in a flat state (Flat form) and the display area DA is vertically long. This display mode (e') differs from display mode (e) only in the opening angle θ between the first housing 101 and the second housing 102. Like display mode (e), the display area DA is vertically oriented, and the display orientation is also vertical.
[0052] For example, the information processing device 10 automatically switches from display mode (d') to display mode (e') or from display mode (e') to display mode (d') by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e') is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d'), the information processing device 10 switches to display mode (e') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d') state. Also, since the display mode (d') is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e'), the information processing device 10 switches to display mode (d') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e') state.
[0053] Here, switching between the single-screen mode and the dual-screen mode in the flat form can be performed by, for example, a user operation. For example, in the display mode (d') and the display mode (e'), the information processing device 10 can display an operator as a UI capable of switching between the single-screen mode and the dual-screen mode somewhere on the screen, as described above, and the user can operate this operator to switch to the dual-screen mode while remaining in the flat form. For example, when switching from the display mode (d') to the dual-screen mode, the display state in the flat form becomes the same as the display mode (b). Also, when switching from the display mode (e') to the dual-screen mode, the display state in the flat form becomes the same as the display mode (c-1).
[0054] Furthermore, when the information processing device 10 detects connection to the keyboard 30 while in the display mode (e'), it automatically switches from the display mode (e') to the display mode (c-2') (Switch by Dock). The display mode (c-2') is a flat state (Flat form), and differs from the display mode (c-2) only in the opening angle θ between the first housing 101 and the second housing 102. In this display mode (c-2'), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because it cannot be seen due to the keyboard. In other words, like the display mode (c-2), this display mode (c-2') is a half-screen mode in which only half of the screen is effective for display.
[0055] The information processing device 10 can also automatically switch from the single-screen mode to the dual-screen mode by detecting a change from a flat state (Flat form) to a bent state (Bent form) (Switch by Hinge angle). For example, when the information processing device 10 detects a change from the display mode (d') to the bent form based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (d') to the display mode (b). When the information processing device 10 detects a change from the display mode (e') to the bent form based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (e') to the display mode (c-1).
[0056] Here, when information processing device 10 is switched to the single-screen mode by the display mode switching function as described with reference to Fig. 4, the windows arranged in the screen area of display 150 are arranged using the screen area as a single display area. On the other hand, when information processing device 10 is switched to the dual-screen mode, the windows arranged in the screen area of display 150 can be arranged using two display areas obtained by dividing the screen area into two.
[0057] For example, when switching from single-screen mode to dual-screen mode, information processing device 10 displays the active window of an application running in single-screen mode in first display area DA1. For example, when transitioning to dual-screen mode, information processing device 10 maximizes the active window that was displayed in display area DA in single-screen mode to fill the entire display area of first display area DA1 and displays it as the active window. Furthermore, when transitioning to dual-screen mode, information processing device 10 places a window that was an inactive window in single-screen mode in a layer behind the active window in first display area DA1, while maintaining the layer relationship (window overlap order) in single-screen mode. Thus, in first display area DA1, the active window is maximized and displayed, and the inactive window, although present in the layer behind the active window, is not displayed (is invisible to the user).
[0058] Furthermore, when switching from single-screen mode to dual-screen mode, information processing device 10 generates thumbnail images of windows that were inactive in single-screen mode and displays them in second display area DA2 (secondary screen). If there are multiple inactive windows, information processing device 10 displays thumbnail images of the multiple inactive windows in second display area DA2.
[0059] 5A and 5B are diagrams showing an example of display control when switching from single-screen mode to dual-screen mode according to this embodiment. FIG. 5A shows a display example in single-screen mode, and FIG. 5B shows a display example after switching to dual-screen mode. In the example shown, the number of application windows running in single-screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA. Window W1 is the active window located in the foreground layer (top layer). When switching from single-screen mode to dual-screen mode, window W1 is maximized and relocated in the first display area DA1 and displayed as the active window.
[0060] Windows W2 and W3 are rearranged to a layer below window W1 while maintaining the hierarchical relationship between the layers, and thumbnail images SW2 and SW3 of windows W2 and W3 are displayed in the second display area DA2. Note that if the number of application windows running in single-screen mode is four or more, the number of thumbnail images displayed in the second display area DA2 when switching to dual-screen mode will also be three or more.
[0061] When the user selects one of the thumbnail images displayed in second display area DA2, information processing device 10 maximizes and rearranges the window corresponding to the selected thumbnail image in second display area DA2, displaying it as the active window. At this time, window W1, which was previously located in first display area DA1, continues to be displayed as an inactive window. Note that at this time, thumbnail images of windows other than the window rearranged in second display area DA2 may be displayed in first display area DA1.
[0062] Furthermore, in addition to the display mode switching function described above, information processing device 10 has a function (so-called snap function) for arranging application windows in a desired display area within the screen area. This snap function allows switching (selection) in which of the predetermined layouts within the screen area a selected window from among the windows arranged in the screen area of display 150 is to be arranged.
[0063] For example, information processing device 10 displays controls as a UI (User Interface) that allows the user to select in which display area within the screen area of display 150 a window is to be laid out, and displays the window in the display area selected by the user based on the user's operation of the controls. Hereinafter, this UI that allows the user to select the display area in which to lay out the window is referred to as a "layout selection icon."
[0064] The layout of the display area selectable by operating the layout selection icon is a layout for the entire screen area (display area DA) of display 150, regardless of whether the display mode described with reference to Fig. 4 is the single-screen mode or the dual-screen mode. In the half-screen mode, half of the screen area of display 150 (first display area DA1) is the valid screen area, so the layout is for first display area DA1.
[0065] [Example of layout selection icon] Next, a specific example of the layout selection icon will be described. Fig. 6 is a diagram showing an example of the display of layout selection icons according to this embodiment. Fig. 6(A) shows an example of the layout selection icon L1 displayed when the usage mode is "Portrait (or Clamshell)" (display mode (c-1), display mode (e), display mode (e'), etc.).
[0066] In the layout selection icon L1, the portion indicated by the symbol R11 is a layout in which the entire screen area of the display 150 is used as a single display area, and the entire screen area can be selected as the display area in which to place a window. The portion indicated by the symbol R12 is a layout in which the screen area is divided into two, vertically, and either the upper or lower display area within the screen area can be selected as the display area in which to place a window. The portions indicated by the symbols R13 and R14 are layouts in which the screen area is divided into three. The portion indicated by the symbol R13 is a layout in which the lower display area, which is obtained by dividing the screen area into two, vertically, is further divided into two, horizontally. The portion indicated by the symbol R14 is a layout in which the upper display area, which is obtained by dividing the screen area into two, vertically, is further divided into two, horizontally. The portions indicated by the symbols R13 and R14 are layouts in which any of the three display areas can be selected as the display area in which to place a window.
[0067] For example, when the usage mode is "Portrait (or Clamshell)," the user drags a window, causing a layout selection icon L1 to be displayed. As shown in the figure, when the dragging cursor CA is placed over the upper area of the layout, which divides the screen area indicated by the reference symbol R12 into two, the display area corresponding to the upper area is selected. The display mode (color, brightness, etc.) of the selected area within the layout selection icon L1 is changed. When the dragging operation is completed, the window is displayed in the selected upper display area.
[0068] FIG. 6B shows an example of a layout selection icon L2 that is displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.).
[0069] In the layout selection icon L2, the portion indicated by reference symbol R21 is a layout in which the entire screen area of the display 150 is used as a single display area, and the entire screen area can be selected as the display area in which to place a window. The portion indicated by reference symbol R22 is a layout in which the screen area is divided into two, left and right, and either the left display area or the right display area within the screen area can be selected as the display area in which to place a window. The portions indicated by reference symbols R23 and R24 are layouts in which the screen area is divided into three. The portion indicated by reference symbol R23 is a layout in which the screen area is divided into two, left and right, and the right display area is further divided into two, top and bottom. The portion indicated by reference symbol R24 is a layout in which the screen area is divided into two, left and right, and the left display area is further divided into two, top and bottom. The portions indicated by reference symbols R23 and R24 are layouts in which any of the three display areas can be selected as the display area in which to place a window.
[0070] For example, when the usage mode is "Landscape," the user drags a window, causing the layout selection icon L2 to be displayed. As shown in the figure, when the dragging cursor CA is placed over the upper right area of the layout, which divides the screen area indicated by the reference symbol R23 into three, the display area corresponding to the upper right area is selected. The display mode (color, brightness, etc.) of the selected area within the layout selection icon L2 is changed. When the dragging operation is completed, the window is displayed in the selected upper right display area.
[0071] [Connection configuration with external display] The information processing device 10 can also be used by connecting it to an external display. FIG. 7 is a diagram showing an example of a configuration in which an information processing device 10 according to this embodiment is connected to an external display. The information processing device 10 is connected to an external display device 20 (display device). Any connection method using HDMI (registered trademark), USB Type-C, DisplayPort, or the like can be applied. Note that the information processing device 10 may be connected to the external display device 20 wirelessly. The external display device 20 is configured to include a display 250 as an external display. In contrast to the external display, the display 150 of the information processing device 10 is a built-in display.
[0072] When information processing device 10 is connected to external display device 20 and controls display on multiple screen areas (multiple screen areas that do not overlap each other) including the screen area of the built-in display and the screen area of the external display, information processing device 10 can use the layout selection icon described with reference to Figure 6 to display windows on both the screen area of the built-in display and the screen area of the external display.
[0073] For example, information processing device 10 can display a window displayed in the screen area of the built-in display in any of the display areas in each layout within the screen area of the built-in display, or in any of the display areas in each layout of the external display. Similarly, information processing device 10 can display a window displayed in the screen area of the external display in any of the display areas in each layout of the external display, or in any of the display areas in each layout within the screen area of the built-in display.
[0074] When information processing device 10 is connected to external display device 20, before displaying the layout selection icon shown in Fig. 6, information processing device 10 displays a UI as an operator for selecting whether the built-in display or the external display will be used as the screen area for displaying the window. This UI will be referred to as the "display selection icon" below.
[0075] [Example of display selection icon] 8 is a diagram showing an example of the display of a display selection icon according to this embodiment. When a drag operation is started on window W1 displayed on the built-in display (display 150) or the external display (display 250), a display selection icon G1 is displayed near the position of cursor CA used for the drag operation. This diagram shows an example when a drag operation is started on window W1 displayed on the built-in display (display 150). The display position of this display selection icon G1 remains unchanged even when cursor CA is moved by the drag operation.
[0076] The display selection icon G1 includes an internal display icon G11 corresponding to the screen area of the internal display, and an external display icon G12 corresponding to the screen area of the external display. The internal display icon G11 and the external display icon G12 are displayed with different designs (patterns, pictures) that imitate the types of their respective displays. That is, the internal display icon G11 is designed to imitate the internal display provided in the information processing device 10 (for example, a notebook PC). On the other hand, the external display icon G12 is designed to imitate the shape of the external display device 20. This makes it intuitively clear which icon is for selecting the internal display and which icon is for selecting the external display when using the display selection icon G1 to select the display destination (screen area), providing good operability.
[0077] Furthermore, when an external display is connected, the display selection icon G1 includes a built-in display icon G11 and an external display icon G12, but when an external display is not connected, only the built-in display icon G11 is displayed. Even when an external display is not connected, the built-in display icon G11 is displayed as an operator for selecting whether to use the built-in display as the screen area for displaying a window.
[0078] 8, window W2 and window W3 arranged (displayed) in the screen area of the built-in display (display 150) are shown as examples of windows other than window W1 being dragged. In this case, window W1 being dragged is the active window, and window W2 and window W3 are inactive windows.
[0079] Figure 9 shows an example of selecting a display selection icon according to this embodiment. By placing the dragged cursor CA over either the built-in display icon G11 or the external display icon G12 of the display selection icon G1, it is possible to select the screen area of the built-in display or the screen area of the external display. Figure 9 shows an example of the display when the built-in display is selected with the display selection icon.
[0080] As shown in the figure, when cursor CA, which is being dragged over window W1, is hovered over built-in display icon G11 while still being dragged, the built-in display is selected. Also, when the screen area of the built-in display is selected, layout selection icons are displayed that allow you to select the display area for each layout within the screen area of the built-in display. The layout selection icon displayed is either layout selection icon L1 or layout selection icon L2, depending on whether the current usage mode is "Portrait (or Clamshell)" or "Landscape." Here, layout selection icon L1, which is displayed when "Portrait (or Clamshell)" is selected, is shown as an example.
[0081] 10 is a diagram showing an example of a display when a layout (display area) is selected using the layout selection icon according to this embodiment. As shown in the figure, if a cursor CA that has been placed over the built-in display icon G11 by a drag operation on the window W1 is placed over any area of the layout selection icon L1 by continuing to drag the cursor CA, the display area over which the cursor CA is placed can be selected.
[0082] In the illustrated example, the upper area of the three areas indicated by the reference symbol R13 of the layout selection icon L1 is selected by placing the cursor CA, which is being dragged, over the upper area.
[0083] Here, when the dragging operation is terminated while the dragging cursor CA is over the area of either the layout selection icon L1 or L2, the selection of the display and the layout (display area) is confirmed, and the display position of the dragged window W1 is changed to the display area within the screen area of the selected display.
[0084] Fig. 11 is a diagram showing a display example when the display position of a window is changed as a result of the end of a drag operation according to this embodiment. For example, if the drag operation is ended while the built-in display is selected as shown in Fig. 10 and the dragging cursor CA is positioned over the upper display area of the three display areas indicated by the symbol R13 of the layout selection icon L1, the window W1 being dragged is snapped to the display area in the built-in display (display 150) that corresponds to the upper display area.
[0085] Furthermore, thumbnail images of windows W2 and W3 other than the dragged window W1 are displayed in a display area other than the display area in which window W1 is located. For example, as shown in Fig. 11, when window W1 is located in the upper display area of the built-in display (display 150), thumbnail images of windows W2 and W3 are located in the lower right display area.
[0086] Here, information processing device 10 determines the display area in which thumbnail images of other windows are to be arranged in accordance with a predetermined arrangement rule in a fixed order relative to the display area in which the window is arranged using the snap function. For example, information processing device 10 always determines the display area in which thumbnail images are to be arranged clockwise, starting from the display area of the snapped (arranged) window.
[0087] Below, examples of arrangement rules for determining the display area in which thumbnail images are arranged will be described for a layout in which the screen area is divided into two display areas and a layout in which the screen area is divided into three display areas, which are layouts selectable using the layout selection icons L1 and L2 shown in Fig. 6. Note that the arrangement rules for thumbnail images are the same for both built-in displays and external displays, so no distinction will be made in the following description.
[0088] Fig. 12 is a diagram showing a first example of a rule for arranging thumbnail images according to this embodiment. Fig. 12 shows an example of a rule for arranging thumbnail images in a layout in which the screen area of a display is divided vertically into two display areas: a first display area (labeled "1") and a second display area (labeled "2"). The circled display areas "1" and "2" indicate display areas in which windows are arranged using the snap function. Furthermore, starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0089] When the upper area of the layout indicated by the symbol R12 is selected by dragging a window on the layout selection icon L1 shown in Fig. 6, the information processing device 10 arranges the window in the upper first display area and arranges thumbnail images of other windows in the lower second display area, as shown in Fig. 12(A). Note that even if a window has already been arranged in the lower second display area, the thumbnail image is arranged with priority. For example, the thumbnail image is arranged in a higher layer than the arranged window, the thumbnail image overwrites the arranged window, or the thumbnail image replaces the arranged window, thereby giving the thumbnail image priority.
[0090] Furthermore, when the lower area of the layout indicated by symbol R12 is selected by dragging a window on layout selection icon L1 shown in Fig. 6, information processing device 10 arranges the window in the lower second display area and arranges thumbnail images of other windows in the upper first display area, as shown in Fig. 12(B). Note that even if a window has already been arranged in the upper first display area, the thumbnail images are arranged preferentially.
[0091] Furthermore, when one of the thumbnail images arranged in the lower second display area shown in Fig. 12(A) is selected, information processing device 10 arranges a window corresponding to the selected thumbnail image in the lower second display area. At this time, the window already arranged in the upper first display area continues to be arranged. Furthermore, when one of the thumbnail images arranged in the upper first display area shown in Fig. 12(B) is selected, information processing device 10 arranges a window corresponding to the selected thumbnail image in the upper first display area. At this time, the window already arranged in the lower second display area continues to be arranged.
[0092] 12(A) is selected, information processing device 10 may place a window corresponding to the selected thumbnail image in the lower second display area, and prioritize placement of thumbnail images of other windows in the upper first display area. At this time, windows are already placed in the first display area before the thumbnail image is selected, but the thumbnail image is placed with priority. Similarly, when one of the thumbnail images placed in the upper first display area shown in FIG. 12(B) is selected, information processing device 10 may place a window corresponding to the selected thumbnail image in the upper first display area, and prioritize placement of thumbnail images of other windows in the lower second display area.
[0093] Note that, when a thumbnail image is displayed, if an operation (for example, a touch operation) is performed to select an area other than the thumbnail image, the thumbnail display (display of the thumbnail image) ends at that point. For example, in the example shown in FIG. 12(A), when a user performs a touch operation on a window displayed in the upper first display area to start working, the display of the thumbnail image displayed in the lower second display area ends. Similarly, for example, in the example shown in FIG. 12(B), when a user performs a touch operation on a window displayed in the lower second display area to start working, the display of the thumbnail image displayed in the upper first display area ends. Similarly, when a touch operation is performed on an area other than the thumbnail image in the display area where the thumbnail image is displayed, the thumbnail display ends.
[0094] Fig. 13 is a diagram showing a second example of the arrangement rules for thumbnail images according to this embodiment. Fig. 13 shows an example of the arrangement rules for thumbnail images in a layout in which the screen area of the display is divided horizontally into two display areas: a first display area (labeled "1") and a second display area (labeled "2"). As in Fig. 12, the circled display areas "1" and "2" indicate display areas in which windows are arranged using the snap function. Furthermore, starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0095] When the area on the left side of the layout indicated by symbol R22 is selected by dragging a window in layout selection icon L2 shown in Fig. 6, information processing device 10 arranges the window in the first display area on the left side and arranges thumbnail images of other windows in the second display area on the right side, as shown in Fig. 13(A). Note that even if a window has already been arranged in the second display area on the right side, the thumbnail images are arranged preferentially.
[0096] 6, when a right area of the layout indicated by symbol R22 is selected by dragging a window, information processing device 10 places the window in the second display area on the right, and places thumbnail images of other windows in the first display area on the left, as shown in Fig. 13(B). Note that even if a window has already been placed in the first display area on the left, the thumbnail images are given priority in placement.
[0097] Furthermore, when one of the thumbnail images arranged in the second display area on the right side shown in Fig. 13(A) is selected, information processing device 10 arranges a window corresponding to the selected thumbnail image in the second display area on the right side. At this time, the window already arranged in the first display area on the left side continues to be arranged. Furthermore, when one of the thumbnail images arranged in the first display area on the left side shown in Fig. 13(B) is selected, information processing device 10 arranges a window corresponding to the selected thumbnail image in the first display area on the left side. At this time, the window already arranged in the second display area on the right side continues to be arranged.
[0098] 13(A) is selected, information processing device 10 may place a window corresponding to the selected thumbnail image in the second display area on the right side, and prioritize placement of thumbnail images of other windows in the first display area on the left side, as shown in FIG. 13(B). In this case, although windows are already placed in the first display area before the selection of the thumbnail image, the thumbnail image is placed with priority (for example, placed in a higher layer). Similarly, when one of the thumbnail images placed in the first display area on the left side shown in FIG. 13(B) is selected, information processing device 10 may place a window corresponding to the selected thumbnail image in the first display area on the left side, and prioritize placement of thumbnail images of other windows in the second display area on the right side.
[0099] It should be noted that if an operation (for example, a touch operation) is performed to select an area other than the thumbnail image while the thumbnail image is being displayed, the thumbnail display ends at that point.
[0100] Fig. 14 is a diagram showing a third example of thumbnail image arrangement rules according to this embodiment. Fig. 14 shows an example of thumbnail image arrangement rules in a layout in which the screen area of a display is divided into two display areas, one above the other, and the lower display area is further divided into two, left and right, resulting in three display areas. This layout corresponds to the layout indicated by symbol R13 of layout selection icon L1 shown in Fig. 6.
[0101] Here, the upper display area is the first display area (labeled "1"), the lower right display area is the second display area (labeled "2"), and the lower left display area is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0102] When the upper area of the layout indicated by symbol R13 is selected by dragging a window in layout selection icon L1 shown in Fig. 6, information processing device 10 places the window in the upper first display area and places thumbnail images of other windows in the lower right second display area, as shown in Fig. 14(A). Note that even if a window has already been placed in the lower right second display area, the thumbnail images are given priority in placement.
[0103] Furthermore, when the lower right area of the layout indicated by the symbol R13 is selected by dragging the window on the layout selection icon L1 shown in Fig. 6, the information processing device 10 places the window in the lower right second display area and places thumbnail images of other windows in the lower left third display area, as shown in Fig. 14(B). Note that even if a window has already been placed in the lower left third display area, the thumbnail images are given priority in placement.
[0104] 6, when a drag operation on a window selects the lower left area of the layout indicated by the symbol R13, the information processing device 10 arranges the window in the lower left third display area and arranges thumbnail images of other windows in the upper first display area, as shown in Fig. 14(C). Note that even if a window has already been arranged in the upper first display area, the thumbnail images are arranged preferentially.
[0105] Furthermore, when one of the thumbnail images arranged in the second display area on the lower right shown in FIG. 14(A) is selected, similar to the example shown in FIG. 14(B), the information processing device 10 arranges a window corresponding to the selected thumbnail image in the second display area on the lower right, and arranges thumbnail images of other windows in the third display area on the lower left. Note that even if a window is already arranged in the display area in which the thumbnail image is to be arranged, the thumbnail image is arranged preferentially (for example, arranged in a higher layer). Subsequently, when one of the thumbnail images arranged in the third display area on the lower left is selected, the information processing device 10 arranges a window corresponding to the selected thumbnail image in the third display area on the lower left. At this time, no thumbnail image is arranged in the first display area on the upper side, and windows already arranged in both the first display area and the second display area remain arranged.
[0106] In this way, when a thumbnail image is selected in the second display area in Fig. 14(A), a window is displayed in the second display area and a thumbnail image is displayed in the third display area, but when a thumbnail image is subsequently selected in the third display area, a window is displayed in the third display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the first, second, and third display areas in that order and complete one revolution (i.e., the end of the first revolution). Also, when a thumbnail image is selected in the third display area in Fig. 14(B), a window is displayed in the third display area and a thumbnail image is displayed in the first display area, but when a thumbnail image is subsequently selected in the first display area, a window is displayed in the first display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the second, third, and first display areas in that order and complete one revolution (i.e., the end of the first revolution). 14(C), when a thumbnail image is selected in the first display area, a window is displayed in the first display area and the thumbnail image is displayed in the second display area, but when a thumbnail image is subsequently selected in the second display area, a window is displayed in the second display area but the thumbnail image is not displayed. In other words, the windows are displayed in the third display area, the first display area, and the second display area in that order, and the thumbnail display ends when one rotation is made (i.e., at the end of the first rotation).
[0107] Note that if an operation (for example, a touch operation) is performed to select an area other than the thumbnail images while the thumbnail images are being displayed, the thumbnail display will end at that point. Also, the thumbnail display does not have to end at the end of the first round, and thumbnail images may continue to be arranged in display areas determined according to a certain arrangement rule (a certain order).
[0108] Fig. 15 is a diagram showing a fourth example of the thumbnail image arrangement rule according to this embodiment. Fig. 15 shows an example of the thumbnail image arrangement rule in a layout in which the screen area of the display is divided into two display areas, one above the other, and the upper display area is further divided into two, one left and one right, resulting in three display areas. This layout corresponds to the layout indicated by symbol R14 of layout selection icon L1 shown in Fig. 6.
[0109] Here, the upper left display area is the first display area (labeled "1"), the upper right display area is the second display area (labeled "2"), and the lower display area is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas where windows are arranged using the snap function. Starting from the display area where windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area where thumbnail images are arranged.
[0110] When the upper left area of the layout indicated by reference symbol R14 is selected by dragging a window on layout selection icon L1 shown in Fig. 6, information processing device 10 places the selected window in the upper left first display area and places thumbnail images of other windows in the upper right second display area, as shown in Fig. 15(A). Note that even if a window has already been placed in the upper right second display area, the thumbnail images are given priority in placement.
[0111] Furthermore, when the upper right area of the layout indicated by the symbol R14 is selected by dragging a window on the layout selection icon L1 shown in Fig. 6, the information processing device 10 places the window in the upper right second display area and places thumbnail images of other windows in the lower third display area, as shown in Fig. 15(B). Note that even if there is a window already placed in the lower third display area, the thumbnail images are given priority in placement.
[0112] 6, when a lower area of the layout indicated by reference symbol R14 is selected by a drag operation on a window, information processing device 10 places the window in the lower third display area and places thumbnail images of other windows in the upper left first display area, as shown in Fig. 15(C). Note that even if a window has already been placed in the upper left first display area, the thumbnail images are given priority in placement.
[0113] Furthermore, when one of the thumbnail images arranged in the upper right second display area shown in FIG. 15(A) is selected, similar to the example shown in FIG. 15(B), the information processing device 10 arranges a window corresponding to the selected thumbnail image in the upper right second display area, and arranges thumbnail images of other windows in the lower third display area. Note that even if a window is already arranged in the display area in which the thumbnail image is to be arranged, the thumbnail image is arranged preferentially (for example, arranged in a higher layer). Subsequently, when one of the thumbnail images arranged in the lower third display area is selected, the information processing device 10 arranges a window corresponding to the selected thumbnail image in the lower third display area. At this time, no thumbnail image is arranged in the upper left first display area, and windows already arranged in both the first display area and the second display area remain arranged.
[0114] In this way, when a thumbnail image is selected in the second display area in Fig. 15(A), a window is displayed in the second display area and a thumbnail image is displayed in the third display area, but when a thumbnail image is subsequently selected in the third display area, a window is displayed in the third display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the first, second, and third display areas in that order and complete one revolution (i.e., the end of the first revolution). Also, when a thumbnail image is selected in the third display area in Fig. 15(B), a window is displayed in the third display area and a thumbnail image is displayed in the first display area, but when a thumbnail image is subsequently selected in the first display area, a window is displayed in the first display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the second, third, and first display areas in that order and complete one revolution (i.e., the end of the first revolution). 15(C), when a thumbnail image is selected in the first display area, a window is displayed in the first display area and the thumbnail image is displayed in the second display area, but when a thumbnail image is subsequently selected in the second display area, a window is displayed in the second display area but the thumbnail image is not displayed. In other words, the windows are displayed in the third display area, the first display area, and the second display area in that order, and the thumbnail display ends when one rotation is made (i.e., at the end of the first rotation).
[0115] Note that if an operation (for example, a touch operation) is performed to select an area other than the thumbnail images while the thumbnail images are being displayed, the thumbnail display will end at that point. Also, the thumbnail display does not have to end at the end of the first round, and thumbnail images may continue to be arranged in display areas determined according to a certain arrangement rule (a certain order).
[0116] Fig. 16 is a diagram showing a fifth example of thumbnail image arrangement rules according to this embodiment. Fig. 16 shows an example of thumbnail image arrangement rules in a layout in which the screen area of a display is divided into two display areas horizontally, and the right-hand display area is further divided into two display areas vertically, thereby dividing the screen area into three display areas. This layout corresponds to the layout indicated by symbol R23 of layout selection icon L2 shown in Fig. 6.
[0117] Here, the display area on the left is the first display area (labeled "1"), the display area on the upper right is the second display area (labeled "2"), and the display area on the lower right is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0118] When the left area of the layout indicated by the symbol R23 is selected by dragging a window in the layout selection icon L2 shown in Fig. 6, the information processing device 10 places the window in the first display area on the left, and places thumbnail images of other windows in the second display area on the top right, as shown in Fig. 16(A). Note that even if there is a window already placed in the second display area on the top right, the thumbnail images are given priority in placement.
[0119] Furthermore, when the upper right area of the layout indicated by the symbol R23 is selected by dragging a window in the layout selection icon L2 shown in Fig. 6, the information processing device 10 places the window in the second display area at the upper right, and places thumbnail images of other windows in the third display area at the lower right, as shown in Fig. 16(B). Note that even if a window has already been placed in the third display area at the lower right, the thumbnail images are given priority in placement.
[0120] 6, when a drag operation on a window is performed to select the area below the right side of the layout indicated by the symbol R23, the information processing device 10 places the window in the third display area below the right side, and places thumbnail images of other windows in the first display area on the left side, as shown in Fig. 16(C). Note that even if a window has already been placed in the first display area on the left side, the thumbnail images are given priority in placement.
[0121] Furthermore, when one of the thumbnail images arranged in the second display area at the top right shown in FIG. 16(A) is selected, similar to the example shown in FIG. 16(B), the information processing device 10 arranges a window corresponding to the selected thumbnail image in the second display area at the top right, and arranges thumbnail images of other windows in the third display area at the bottom right. Note that even if a window is already arranged in the display area in which the thumbnail image is to be arranged, the thumbnail image is arranged preferentially (for example, arranged in a higher layer). Subsequently, when one of the thumbnail images arranged in the third display area at the bottom right is selected, the information processing device 10 arranges a window corresponding to the selected thumbnail image in the third display area at the bottom right. At this time, the already arranged window continues to be arranged in the first display area at the left.
[0122] In this way, when a thumbnail image is selected in the second display area in Fig. 16(A), a window is displayed in the second display area and a thumbnail image is displayed in the third display area, but when a thumbnail image is subsequently selected in the third display area, a window is displayed in the third display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the first, second, and third display areas in that order and complete one revolution (i.e., the end of the first revolution). Also, when a thumbnail image is selected in the third display area in Fig. 16(B), a window is displayed in the third display area and a thumbnail image is displayed in the first display area, but when a thumbnail image is subsequently selected in the first display area, a window is displayed in the first display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the second, third, and first display areas in that order and complete one revolution (i.e., the end of the first revolution). 16(C), when a thumbnail image is selected in the first display area, a window is displayed in the first display area and the thumbnail image is displayed in the second display area, but when a thumbnail image is subsequently selected in the second display area, a window is displayed in the second display area but the thumbnail image is not displayed. In other words, the windows are displayed in the third display area, the first display area, and the second display area in that order, and the thumbnail display ends when one rotation is made (i.e., at the end of the first rotation).
[0123] Note that if an operation (for example, a touch operation) is performed to select an area other than the thumbnail images while the thumbnail images are being displayed, the thumbnail display will end at that point. Also, the thumbnail display does not have to end at the end of the first round, and thumbnail images may continue to be arranged in display areas determined according to a certain arrangement rule (a certain order).
[0124] Fig. 17 is a diagram showing a sixth example of thumbnail image arrangement rules according to this embodiment. Fig. 17 shows an example of thumbnail image arrangement rules in a layout in which the screen area of a display is divided into two display areas horizontally, and the left display area is further divided into two display areas vertically, thereby dividing the screen area into three display areas. This layout corresponds to the layout indicated by symbol R24 of layout selection icon L2 shown in Fig. 6.
[0125] Here, the display area on the upper left is the first display area (labeled "1"), the display area on the right is the second display area (labeled "2"), and the display area on the lower left is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0126] When the upper left area of the layout indicated by symbol R24 is selected by dragging a window in layout selection icon L2 shown in Fig. 6, information processing device 10 places the window in the first display area on the upper left side, and places thumbnail images of other windows in the second display area on the right side, as shown in Fig. 17(A). Note that even if a window has already been placed in the second display area on the right side, the thumbnail images are given priority in placement.
[0127] 6, when a right area of the layout indicated by symbol R24 is selected by dragging a window, information processing device 10 places the window in the second display area on the right, and places thumbnail images of other windows in the third display area below on the left, as shown in Fig. 17(B). Note that even if a window has already been placed in the third display area below on the left, the thumbnail images are given priority in placement.
[0128] 6, when a window is selected by dragging it to the lower left area of the layout indicated by reference symbol R24, information processing device 10 places the window in the third display area at the lower left, and places thumbnail images of other windows in the first display area at the upper right, as shown in Fig. 17(C). Note that even if a window has already been placed in the first display area at the upper right, the thumbnail images are given priority in placement.
[0129] Furthermore, when one of the thumbnail images arranged in the second display area on the right side shown in FIG. 17(A) is selected, similar to the example shown in FIG. 17(B), the information processing device 10 arranges a window corresponding to the selected thumbnail image in the second display area on the right side, and arranges thumbnail images of other windows in the third display area on the bottom left side. Note that even if a window is already arranged in the display area in which the thumbnail image is to be arranged, the thumbnail image is arranged preferentially (for example, arranged in a higher layer). Subsequently, when one of the thumbnail images arranged in the third display area on the bottom left side is selected, the information processing device 10 arranges a window corresponding to the selected thumbnail image in the third display area on the bottom left side. At this time, the already arranged window continues to be arranged in the first display area on the top left side.
[0130] In this way, when a thumbnail image is selected in the second display area in Fig. 17(A), a window is displayed in the second display area and a thumbnail image is displayed in the third display area, but when a thumbnail image is subsequently selected in the third display area, a window is displayed in the third display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the first, second, and third display areas in that order and complete one revolution (i.e., the end of the first revolution). Also, when a thumbnail image is selected in the third display area in Fig. 17(B), a window is displayed in the third display area and a thumbnail image is displayed in the first display area, but when a thumbnail image is subsequently selected in the first display area, a window is displayed in the first display area but no thumbnail image is displayed. In other words, the thumbnail display ends when the windows are displayed in the second, third, and first display areas in that order and complete one revolution (i.e., the end of the first revolution). 17(C), when a thumbnail image is selected in the first display area, a window is displayed in the first display area and the thumbnail image is displayed in the second display area, but when a thumbnail image is subsequently selected in the second display area, a window is displayed in the second display area but the thumbnail image is not displayed. In other words, the windows are displayed in the third display area, the first display area, and the second display area in that order, and the thumbnail display ends when one rotation is made (i.e., at the end of the first rotation).
[0131] Note that if an operation (for example, a touch operation) is performed to select an area other than the thumbnail images while the thumbnail images are being displayed, the thumbnail display will end at that point. Also, the thumbnail display does not have to end at the end of the first round, and thumbnail images may continue to be arranged in display areas determined according to a certain arrangement rule (a certain order).
[0132] In any of the above layouts, a previously snapped window maintains its snapped state (position, size) even if it is subsequently overwritten and snapped to another window. Also, if an operation is performed on a position other than the thumbnail image, the snap function ends, and only the position of the snapped window remains, and the display of the thumbnail image also ends.
[0133] [Configuration of information processing device] The specific configuration of the information processing device 10 will be described below. 18 is a block diagram showing an example of the hardware configuration of an information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, a control unit 18, and an external connection terminal 19. These units are connected to each other so as to be able to communicate with each other via a bus or the like.
[0134] The communication unit 11 includes, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), and a communication device that performs wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). For example, the communication unit 11 can communicate with the aforementioned external keyboard 30 or the like using Bluetooth (registered trademark).
[0135] In the RAM 12, programs and data for processes executed by the control unit 18 are loaded, and various data is saved or erased as appropriate. For example, the RAM 12 also functions as a video memory (V-RAM) for display on the display 150. As an example, the RAM 12 functions as a video memory for data displayed in each display area within the screen area of the display 150 (or the display 250 when the external display device 20 is connected). The RAM 12 also stores information about running apps, apps in use (active window apps) among the running apps, information about other inactive window apps, the display area in which each window is displayed, the layer in which each window is located, the size of the window, whether it is minimized, and the like. Note that the RAM 12 is a volatile memory, and therefore does not retain data when power supply to the RAM 12 is stopped. Data that needs to be retained when power supply to the RAM 12 is stopped is transferred to the storage unit 13.
[0136] The storage unit 13 is configured to include one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Residual Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores programs and setting data for a BIOS (Basic Input Output System), an OS (Operating System), programs for applications that run on the OS, and various data used by the applications. The speaker 14 outputs electronic sounds, voices, and the like.
[0137] The display unit 15 includes a display 150 and a touch sensor 155. As described above, the display 150 is a flexible display that can be bent to match the opening angle θ resulting from the relative rotation of the first housing 101 and the second housing 102. The display 150 performs display corresponding to each display mode described with reference to FIG. 4 under the control of the control unit 18. The touch sensor 155 is provided on the screen of the display 150 and detects touch operations on the screen. For example, in the single-screen mode, the touch sensor 155 detects touch operations on the display area DA. In addition, in the dual-screen mode, the touch sensor 155 detects touch operations on one or both of the first display area DA1 and the second display area DA2. Touch operations include tap operations, slide operations, flick operations, swipe operations, and pinch operations. The touch sensor 155 detects the touch operations and outputs operation information based on the detected operations to the control unit 18.
[0138] The camera 16 includes a lens, an imaging element, etc. The camera 16 captures an image (a still image or a video) according to the control of the control unit 18, and outputs data of the captured image.
[0139] First acceleration sensor 161 is provided inside first housing 101 and detects the orientation and changes in orientation of first housing 101. For example, if the direction parallel to the longitudinal direction of first display area DA1 is defined as the X1 direction, the direction parallel to the lateral direction is defined as the Y1 direction, and the direction perpendicular to the X1 and Y1 directions is defined as the Z1 direction, first acceleration sensor 161 detects acceleration in each of the X1, Y1, and Z1 directions and outputs the detection results to control unit 18.
[0140] The second acceleration sensor 162 is provided inside the second housing 102 and detects the orientation and changes in orientation of the second housing 102. For example, if the direction parallel to the longitudinal direction of the second display area DA2 is the X2 direction, the direction parallel to the lateral direction is the Y2 direction, and the direction perpendicular to the X2 and Y2 directions is the Z2 direction, the second acceleration sensor 162 detects acceleration in each of the X2, Y2, and Z2 directions and outputs the detection results to the control unit 18.
[0141] The Hall sensor 17 is provided to detect the connection of the keyboard 30. For example, when the keyboard 30 is placed on the second display area DA2 of the second housing 102, a magnet provided inside the bottom surface of the keyboard 30 approaches, changing the magnetic field, and changing the detection value (output value) of the Hall sensor 17. In other words, the Hall sensor 17 outputs a different detection result depending on whether the keyboard 30 is placed. Note that, although the Hall sensor 17 is used to detect whether the keyboard 30 is placed here, the detection method is not limited to this, and any detection method can be used.
[0142] The external connection terminal 19 is a connection terminal for connecting to an external display device 20 (external display). For example, the external connection terminal 19 is an HDMI (registered trademark) terminal, a USB Type-C terminal, a display port, etc. Note that the information processing device 10 and the external display device 20 may be connected wirelessly.
[0143] Control unit 18 is configured to include processors such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and realizes various functions by executing programs (various programs such as a BIOS, an OS, and applications running on the OS) stored in storage unit 13, etc. For example, control unit 18 detects the attitude (orientation) of information processing device 10 based on the detection results of first acceleration sensor 161 and second acceleration sensor 162. Furthermore, control unit 18 detects whether information processing device 10 is in an open state or a closed state, and if in an open state, whether it is in a bent state (bent form) or a flat state (flat form), based on the detection results of first acceleration sensor 161 and second acceleration sensor 162.
[0144] Furthermore, the control unit 18 detects a connection with the keyboard 30 based on the detection result of the hall sensor 17. Note that this connection with the keyboard 30 refers to the placement of the keyboard 30 on the second display area DA2, and does not refer to a communication connection. The control unit 18 detects the communication connection with the keyboard 30 using a function such as Bluetooth (registered trademark).
[0145] In addition, the control unit 18 performs the display mode switching control described with reference to Figures 4 and 5 by detecting the system state, the attitude (orientation) of the information processing device 10, whether it is in an open state or a closed state, and if it is in an open state, whether it is in a bent form or a flat form, and whether it is connected to the keyboard 30.
[0146] Control unit 18 also controls a display layout change process using a snap function that snaps (arranges) windows to desired display areas within the screen area. For example, control unit 18 controls the display of display selection icons and layout selection icons described with reference to Figures 6 to 11, and the snap function that arranges windows in the display area of a selected display. Control unit 18 also controls the arrangement of thumbnail images that arrange thumbnail images according to arrangement rules when windows are arranged using the snap function.
[0147] Next, a detailed description will be given of the display layout change process using the snap function among the processes executed by the control unit 18. In the following description, it is assumed that the information processing device 10 controls the display on the built-in display and the external display in a configuration connected to an external display device 20, as shown in FIG.
[0148] 19 is a block diagram showing an example of a functional configuration related to the display layout change processing of the information processing device 10 according to this embodiment. The control unit 18 includes a display selection icon display processing unit 181, a display selection processing unit 182, a layout selection icon display processing unit 183, a layout selection processing unit 184, and a display layout change unit 185 as functional configurations in which the CPU executes processing based on the OS or a program running on the OS.
[0149] The display selection icon display processing unit 181 performs a display process for displaying a display selection icon. For example, when a drag operation is received on a window displayed in at least one of the screen area of the built-in display and the screen area of the external display, the display selection icon display processing unit 181 displays a display selection icon G1 in the screen area of the display on which the drag operation was started (see FIG. 8). The display selection icon G1 includes a built-in display icon G11 corresponding to the screen area of the built-in display and an external display icon G12 corresponding to the screen area of the external display.
[0150] When no external display is connected, the display selection icon display processing unit 181 includes only the built-in display icon G11 in the display selection icons G1.
[0151] The display selection processing unit 182 selects the screen area corresponding to the icon selected by the drag operation, either the built-in display icon G11 or the external display icon G12, as the display destination for the dragged window.
[0152] Layout selection icon display processing unit 183 newly displays a layout selection icon that allows selection of a display area in which to display a window within the screen area of the display selected by display selection processing unit 182 (see FIG. 9). For example, when the usage mode is "Portrait (or Clamshell)", layout selection icon display processing unit 183 displays layout selection icon L1 shown in FIG. 6(A), and when the usage mode is "Landscape", layout selection icon L2 shown in FIG. 6(B).
[0153] Layout selection processing unit 184 selects the display area selected by the drag operation on the layout selection icon as the display area where the dragged window is to be displayed (see FIG. 10).
[0154] When the drag operation on the window is completed, the display layout change unit 185 places the window in the display area selected by the layout selection processing unit 184 within the screen area of the display selected by the display selection processing unit 182.
[0155] For example, when the layout indicated by the symbol R11 in the layout selection icon L1 shown in FIG. 6 or the layout indicated by the symbol R21 in the layout selection icon L2 is selected, the display layout change unit 185 performs a first display control process in which the screen area of the display is treated as a single display area and the dragged window is arranged.
[0156] Furthermore, the display layout modification unit 185 performs a second display control process of dividing the screen area of the display into a plurality of display areas and arranging windows therein. For example, when the layout indicated by the reference symbol R12 in the layout selection icon L1 or the layout indicated by the reference symbol R22 in the layout selection icon L2 shown in FIG. 6 is selected, the display layout modification unit 185 divides the screen area of the display into two display areas and arranges the dragged window in one of the two display areas (the selected display area). Furthermore, when arranging the dragged window in one of the two display areas, the display layout modification unit 185 arranges thumbnail images corresponding to one or more windows other than the dragged window in the other of the two display areas.
[0157] In addition, when the layout indicated by symbols R13 and R14 in the layout selection icon L1 shown in FIG. 6 or the layout indicated by symbols R23 and R24 in the layout selection icon L2 is selected, the display layout change unit 185 divides the screen area of the display into three display areas and places the dragged window in one of the three display areas (the selected display area).
[0158] Furthermore, when the display layout modification unit 185 arranges the dragged window in one of the three display areas, it arranges thumbnail images corresponding to one or more windows other than the dragged window in one of the other display areas of the three display areas. At this time, the display layout modification unit 185 determines the display area in which to arrange the thumbnail images relative to the display area in which to arrange the window according to a predetermined arrangement rule (a predetermined order). For example, the predetermined arrangement rule (a predetermined order) is a clockwise order.
[0159] Furthermore, the display layout modification unit 185 prioritizes the placement of thumbnail images in a display area determined according to a certain placement rule (certain order), even if any window has already been placed in the area.
[0160] [Display layout change process] Next, the operation of the display layout change process executed by the control unit 18 will be described. FIG. 20 is a flowchart showing an example of the display layout change process according to this embodiment.
[0161] (Step S101) When the control unit 18 receives that a drag operation on a window displayed in the screen area of the built-in display or the external display has started, the process proceeds to step S103.
[0162] (Step S103) The control unit 18 displays a display selection icon G1 in the screen area of the built-in display or the external display on which the drag operation was started (see FIG. 8). For example, the control unit 18 displays the built-in display icon G11 and the external display icon G12 included in the display selection icon G1 with different designs (patterns, designs) that imitate the types of the respective displays. Then, the process proceeds to step S105.
[0163] (Step S105) The control unit 18 selects the screen area corresponding to the icon selected by the drag operation from the built-in display icon G11 and the external display icon G12 as the screen area of the display destination for the dragged window (see FIG. 9). Then, the process proceeds to step S107.
[0164] (Step S107) Control unit 18 newly displays a layout selection icon that allows selection of a display area in which to display a window within the screen area of the display selected in step S105 (see FIG. 9). For example, when the usage mode is "Portrait (or Clamshell)", control unit 18 displays layout selection icon L1 shown in FIG. 6(A), and when the usage mode is "Landscape", control unit 18 displays layout selection icon L2 shown in FIG. 6(B). Then, the process proceeds to step S109.
[0165] (Step S109) Control unit 18 selects the display area selected by the drag operation on the layout selection icon as the display area for the dragged window, and then proceeds to the processing of step S111.
[0166] (Step S111) When control unit 18 receives that the drag operation on the window has ended, the process proceeds to step S113.
[0167] (Step S113) Control unit 18 changes the display position of the dragged window and places it in a display area within the screen area of the selected display. Control unit 18 also places thumbnail images corresponding to one or more windows other than the dragged window in a display area determined according to a certain arrangement rule (a certain order).
[0168] For example, the control unit 18 arranges the thumbnail images according to a certain arrangement rule (for example, clockwise order) as described with reference to FIGS.
[0169] Specifically, for example, when dividing the screen area of the display into two upper and lower display areas and arranging windows as shown in Fig. 12, when controlling unit 18 arranges a first window (for example, a window snapped by a drag operation) in the upper first display area of the two divided display areas, it arranges a thumbnail image in the lower second display area (see Fig. 12(A)). When controlling unit 18 arranges the first window in the second display area, it arranges a thumbnail image in the first display area (see Fig. 12(B)).
[0170] In this way, when information processing device 10 divides the screen area into two display areas, one above the other, and arranges windows, it determines the display area in which to arrange thumbnail images of other windows relative to the window snapped by a drag operation, for example, according to a certain arrangement rule (a certain order), making it easy for the user to understand. At this time, it does not matter whether another window has already been arranged in each area by a previous snap operation, and even if there is another window already arranged, the currently selected window is arranged on top of it.
[0171] Furthermore, for example, when dividing the screen area of the display into two display areas horizontally and arranging windows as shown in Fig. 13, when placing a first window (for example, a window snapped by a drag operation) in the first display area on the left side of the two divided display areas, control unit 18 places a thumbnail image in the second display area on the right side (see Fig. 13(A)). When placing the first window in the second display area, control unit 18 places a thumbnail image in the first display area (see Fig. 13(B)).
[0172] In this way, when the information processing device 10 divides the screen area into two display areas, left and right, to arrange windows, it determines the display area in which to arrange thumbnail images of other windows relative to a window snapped by a drag operation, for example, according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0173] 14, when the display screen area is divided into two display areas, one above the other, and the lower display area is further divided into two, one left and one right, to form three display areas for arranging windows, when the first window (for example, a window snapped by a drag operation) is arranged in the first display area, which is the upper one of the three divided display areas, the controller 18 arranges a thumbnail image in the second display area, which is on the lower right (see FIG. 14(A)). When the first window is arranged in the second display area, the controller 18 arranges a thumbnail image in the third display area, which is on the lower left (see FIG. 14(B)), and when the first window is arranged in the third display area, the controller 18 arranges a thumbnail image in the first display area (see FIG. 14(C)).
[0174] In this way, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0175] 15, when the display screen area is divided into two display areas, one above the other, and the upper display area is further divided into two, one left and one right, to form three display areas for arranging windows, control unit 18 arranges a thumbnail image in the second display area, the upper right, when arranging a first window (for example, a window snapped by a drag operation) in the first display area, the upper left, of the three divided display areas (see FIG. 15(A)). Furthermore, when arranging the first window in the second display area, control unit 18 arranges a thumbnail image in the third display area, the lower (see FIG. 15(B)), and when arranging the first window in the third display area, arranges a thumbnail image in the first display area (see FIG. 15(C)).
[0176] In this way, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0177] 16, when the display screen area is divided into two display areas horizontally and the right-hand display area is further divided into two display areas vertically to divide the display area into three display areas for arranging windows, when the first window (for example, a window snapped by a drag operation) is arranged in the first display area on the left of the three divided display areas, the control unit 18 arranges a thumbnail image in the second display area on the upper right (see FIG. 16(A)). When the first window is arranged in the second display area, the control unit 18 arranges a thumbnail image in the third display area on the lower right (see FIG. 16(B)), and when the first window is arranged in the third display area, the control unit 18 arranges a thumbnail image in the first display area (see FIG. 16(C)).
[0178] In this way, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0179] 17, when the display screen area is divided into two display areas horizontally and the left display area is further divided into two display areas vertically to divide the left display area into three display areas for arranging windows, when the first window (for example, a window snapped by a drag operation) is arranged in the first display area at the top left of the three divided display areas, the controller 18 arranges a thumbnail image in the second display area at the right (see FIG. 17(A)). When the first window is arranged in the second display area, the controller 18 arranges a thumbnail image in the third display area at the bottom left (see FIG. 17(B)), and when the first window is arranged in the third display area, the controller 18 arranges a thumbnail image in the first display area (see FIG. 17(C)).
[0180] In this way, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0181] In this embodiment, examples of dividing the screen area of the display into two display areas and three display areas have been shown, but another example will be described here. For example, the information processing device 10 may divide the screen area of the display into four or more display areas to arrange windows, and in that case, the display areas in which thumbnail images are to be arranged are determined according to a certain arrangement rule (a certain order).
[0182] Fig. 21 is a diagram showing another example of the arrangement rule for thumbnail images according to this embodiment. Fig. 21 shows an example of the arrangement rule for thumbnail images in a layout in which the screen area of a display is divided into two display areas, upper and lower, and each of the upper and lower display areas is further divided into two, left and right (i.e., divided into four, top, bottom, left, and right), thereby dividing the screen area into four display areas.
[0183] Here, the display area on the top left is the first display area (labeled "1"), the display area on the top right is the second display area (labeled "2"), the display area on the bottom right is the third display area (labeled "3"), and the display area on the bottom left is the fourth display area (labeled "4"). The circled display areas of "1," "2," "3," and "4" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0184] For example, as shown in FIG. 21(A), when the window snapped by dragging is placed in the first display area at the top left, the control unit 18 places a thumbnail image of the other window in the second display area at the top right. Also, as shown in FIG. 21(B), when the window snapped by dragging is placed in the second display area at the top right, the control unit 18 places a thumbnail image of the other window in the third display area at the bottom right. Also, as shown in FIG. 21(C), when the window snapped by dragging is placed in the third display area at the bottom right, the control unit 18 places a thumbnail image of the other window in the fourth display area at the bottom left. Also, as shown in FIG. 21(D), when the window snapped by dragging is placed in the fourth display area at the bottom left, the control unit 18 places a thumbnail image of the other window in the first display area at the top left.
[0185] In this way, when dividing the screen area of the display into four display areas vertically and horizontally as shown in Fig. 21 and arranging windows, when placing the first window (for example, a window snapped by a drag operation) in the first display area at the top left of the four divided display areas, control unit 18 arranges the thumbnail image in the second display area at the top right (see Fig. 21(A)), and when placing the first window in the second display area, control unit 18 arranges the thumbnail image in the third display area at the bottom right (see Fig. 21(B)). Furthermore, when placing the first window in the third display area, control unit 18 arranges the thumbnail image in the fourth display area at the bottom left (see Fig. 21(C)), and when placing the first window in the fourth display area, control unit 18 arranges the thumbnail image in the first display area (see Fig. 21(D)).
[0186] In this way, when the information processing device 10 divides the screen area into four display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0187] [Summary of the embodiment] As described above, the information processing device 10 according to the present embodiment includes a storage unit 13 (an example of a memory) that stores an application program, and a control unit 18 (an example of a processor such as a CPU, GPU, or microcomputer) that executes the application program stored in the storage unit 13 to control the arrangement and display of a window of the running application in a screen area of the display 150 (or the display 250). The control unit 18 performs a display control process that divides the screen area of the display 150 (or the display 250) into multiple display areas and arranges the windows. Furthermore, in the display control process, when the control unit 18 arranges a first window (e.g., a window snapped by a drag operation) of the running application in one of the multiple display areas, the control unit 18 arranges thumbnail images corresponding to one or more second windows other than the first window in a display area other than the one of the multiple display areas. The control unit 18 then determines the display area in which the thumbnail images are to be arranged relative to the one display area in which the first window is to be arranged, according to a specific arrangement rule (a specific order).
[0188] As a result, when information processing device 10 divides the screen area into multiple display areas and arranges windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is always determined according to a fixed arrangement rule (fixed order), making it easy for the user to understand. Therefore, information processing device 10 can easily arrange windows as intended within a layout in which the screen area is divided into multiple display areas.
[0189] For example, in the display control process, even if any window has already been placed in the display area where thumbnail images are to be placed according to a certain arrangement rule (certain order), the control unit 18 places thumbnail images with priority.
[0190] As a result, when the information processing device 10 divides the screen area into multiple display areas to arrange windows, for example, the display area in which to arrange thumbnail images of other windows relative to a window snapped by a drag operation is always determined according to a fixed arrangement rule (fixed order), regardless of whether the window is already arranged in the display area, making it easier for the user to understand and arrange the windows as intended.
[0191] The above-mentioned fixed arrangement rule (fixed order) for arranging thumbnail images may be a clockwise order. That is, control unit 18 determines the display area in which thumbnail images are to be arranged in a clockwise order relative to the display area in which the first window (for example, a window snapped by a drag operation) is to be arranged.
[0192] As a result, when the information processing device 10 divides the screen area into multiple display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is always determined in clockwise order, making it easy for the user to understand.
[0193] Furthermore, the control method in the information processing device 10 according to this embodiment includes the steps of: a control unit 18 (e.g., an example of a processor such as a CPU, GPU, or microcomputer) that controls the placement and display of windows of a running application in the screen area of the display 150 (or the display 250), dividing the screen area of the display 150 (or the display 250) into a plurality of display areas, and placing a first window of the windows (e.g., a window snapped by a drag operation) in one of the plurality of display areas; and placing thumbnail images corresponding to one or more second windows other than the first window in a display area other than the one of the plurality of display areas, and determining the display area in which to place the thumbnail image for the one display area in which to place the first window according to a certain order.
[0194] As a result, when dividing the screen area into multiple display areas and arranging windows, the control method in information processing device 10 always determines the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation according to a fixed arrangement rule (fixed order), making it easy for the user to understand. Therefore, the control method in information processing device 10 makes it easy for the user to arrange windows as intended within a layout in which the screen area is divided into multiple display areas.
[0195] <Second embodiment> Next, a second embodiment of the present invention will be described. In the first embodiment, an example was described in which the fixed arrangement rule (fixed order) for arranging thumbnail images is a clockwise order, but the fixed order is not limited to clockwise order, and may be, for example, a counterclockwise order. Below, an example will be described in which the thumbnail image arrangement rule is a counterclockwise order.
[0196] Fig. 22 is a diagram showing a first example of a thumbnail image arrangement rule according to this embodiment. Fig. 22 shows an example of a thumbnail image arrangement rule in a counterclockwise order in a layout similar to Fig. 14, in which the screen area of the display is divided into two display areas, one above the other, and the lower display area is further divided into two, one above the other, to form three display areas. This layout corresponds to the layout indicated by symbol R13 of layout selection icon L1 shown in Fig. 6.
[0197] Here, the upper display area is the first display area (labeled "1"), the lower left display area is the second display area (labeled "2"), and the lower right display area is the third display area (labeled "3"). The circled display areas "1," "2," and "3" indicate the display areas where windows are arranged using the snap function. Starting from the display area where windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area where thumbnail images are arranged.
[0198] For example, when the control unit 18 divides the screen area of the display into two display areas, vertically, and further divides the lower display area horizontally into two to divide the screen area into three display areas and arrange windows in the divided areas, when the control unit 18 arranges the first window (for example, a window snapped by a drag operation) in the first display area, which is the upper one of the three divided display areas, the control unit 18 arranges a thumbnail image in the second display area, which is on the lower left (see FIG. 22(A)). When the control unit 18 arranges the first window in the second display area, which is on the lower left, the control unit 18 arranges a thumbnail image in the third display area, which is on the lower right (see FIG. 22(B)). When the control unit 18 arranges the first window in the third display area, which is on the lower right, the control unit 18 arranges a thumbnail image in the first display area (see FIG. 22(C)).
[0199] As a result, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0200] Fig. 23 is a diagram showing a second example of thumbnail image arrangement rules according to this embodiment. Fig. 23 shows an example of thumbnail image arrangement rules in a counterclockwise order in a layout similar to Fig. 15, in which the screen area of the display is divided into two display areas, one above the other, and the upper display area is further divided into two, one below the other, resulting in three display areas. This layout corresponds to the layout indicated by symbol R14 of layout selection icon L1 shown in Fig. 6.
[0201] Here, the upper left display area is the first display area (labeled "1"), the lower display area is the second display area (labeled "2"), and the upper right display area is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0202] For example, when the control unit 18 divides the screen area of the display into two display areas, vertically, and further divides the upper display area horizontally into two to divide the screen area into three display areas and arrange windows in these three display areas, when the control unit 18 arranges a first window (for example, a window snapped by a drag operation) in the first display area, which is the upper left of the three divided display areas, the control unit 18 arranges a thumbnail image in the second display area, which is the lower right (see FIG. 23(A)). When the control unit 18 arranges the first window in the second display area, which is the lower right, the control unit 18 arranges a thumbnail image in the third display area, which is the upper right (see FIG. 23(B)). When the control unit 18 arranges the first window in the third display area, which is the upper right, the control unit 18 arranges a thumbnail image in the first display area, which is the upper left (see FIG. 23(C)).
[0203] As a result, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0204] Fig. 24 is a diagram showing a third example of thumbnail image arrangement rules according to this embodiment. Fig. 24 shows an example of thumbnail image arrangement rules in a counterclockwise order in a layout similar to Fig. 16, in which the screen area of the display is divided into two display areas horizontally, and the right-hand display area is further divided into two display areas vertically, thereby dividing the display area into three display areas. This layout corresponds to the layout indicated by symbol R23 of layout selection icon L2 shown in Fig. 6.
[0205] Here, the display area on the left is the first display area (labeled "1"), the display area on the lower right is the second display area (labeled "2"), and the display area on the upper right is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0206] For example, when the control unit 18 divides the screen area of the display into two horizontally and vertically divided display areas and then further divides the right-hand display area into two vertically and vertically to divide the screen area into three display areas and arranges windows in these three divided display areas, when the first window (for example, a window snapped by a drag operation) is arranged in the first display area on the left of the three divided display areas, the control unit 18 arranges a thumbnail image in the second display area on the bottom right (see FIG. 24(A)). When the control unit 18 arranges the first window in the second display area on the bottom right, the control unit 18 arranges a thumbnail image in the third display area on the top right (see FIG. 24(B)). When the control unit 18 arranges the first window in the third display area on the top right, the control unit 18 arranges a thumbnail image in the first display area on the left (see FIG. 24(C)).
[0207] As a result, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0208] Fig. 25 is a diagram showing a fourth example of thumbnail image arrangement rules according to this embodiment. Fig. 25 shows an example of thumbnail image arrangement rules in a counterclockwise order in a layout similar to Fig. 17, in which the screen area of the display is divided into two display areas horizontally, and the left display area is further divided into two display areas vertically, thereby dividing the display area into three display areas. This layout corresponds to the layout indicated by symbol R24 of layout selection icon L2 shown in Fig. 6.
[0209] Here, the display area on the upper left is the first display area (labeled "1"), the display area on the lower left is the second display area (labeled "2"), and the display area on the right is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0210] For example, when the control unit 18 divides the screen area of the display into two display areas horizontally and then further divides the left display area vertically into two to arrange windows, thereby dividing the screen area into three display areas, as shown in FIG. 25, when placing a first window (for example, a window snapped by a drag operation) in the first display area at the top left of the three divided display areas, the control unit 18 places a thumbnail image in the second display area at the bottom left (see FIG. 25(A)). When placing the first window in the second display area at the bottom left, the control unit 18 places a thumbnail image in the third display area at the right (see FIG. 25(B)). When placing the first window in the third display area at the right, the control unit 18 places a thumbnail image in the first display area at the top left (see FIG. 25(C)).
[0211] As a result, when the information processing device 10 divides the screen area into three display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0212] Fig. 26 is a diagram showing a fifth example of a thumbnail image arrangement rule according to this embodiment. Fig. 26 shows an example of a thumbnail image arrangement rule in a counterclockwise order in a layout similar to Fig. 21, in which the screen area of the display is divided into two display areas, upper and lower, and each of the upper and lower display areas is further divided into two, left and right (i.e., divided into four, top, bottom, left, and right), thereby dividing the display area into four display areas.
[0213] Here, the display area on the upper left is the first display area (labeled "1"), the display area on the lower left is the second display area (labeled "2"), the display area on the lower right is the third display area (labeled "3"), and the display area on the upper right is the fourth display area (labeled "4"). The circled display areas of "1," "2," "3," and "4" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0214] For example, when dividing the screen area of the display into four display areas vertically and horizontally as shown in FIG. 26 and arranging windows, when the first window (for example, a window snapped by a drag operation) is arranged in the first display area at the top left of the four divided display areas, the control unit 18 arranges a thumbnail image in the second display area at the bottom left (see FIG. 26(A)). When the first window is arranged in the second display area at the bottom left, the control unit 18 arranges a thumbnail image in the third display area at the bottom right (see FIG. 26(B)). When the first window is arranged in the third display area at the bottom right, the control unit 18 arranges a thumbnail image in the fourth display area at the top right (see FIG. 26(C)). When the first window is arranged in the fourth display area at the top right, the control unit 18 arranges a thumbnail image in the first display area at the top left (see FIG. 26(D)).
[0215] As a result, when the information processing device 10 divides the screen area into four display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is determined according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0216] In this way, the information processing device 10 may arrange thumbnail images in a counterclockwise order according to a certain arrangement rule (certain order).
[0217] As a result, when the information processing device 10 divides the screen area into multiple display areas to arrange windows, for example, the display area in which thumbnail images of other windows are arranged relative to a window snapped by a drag operation is always determined in counterclockwise order, making it easy for the user to understand.
[0218] <Third embodiment> Next, a third embodiment of the present invention will be described. In the above-described embodiments, examples of a three-division layout (see FIGS. 14 to 17 and 21 to 25) and a four-division layout (see FIGS. 21 and 26) have been described as examples of layouts in which the screen area of a display is divided into multiple display areas, but the way in which the screen area is divided is not limited to the examples described in the above-described embodiments. For example, a layout in which the screen area of a display is divided into multiple areas only in the horizontal direction, or a layout in which the screen area of a display is divided into multiple areas only in the vertical direction, may also be used. In this embodiment, a rule for arranging thumbnail images in another example of a layout in which the screen area of a display is divided into three display areas will be described.
[0219] Fig. 27 is a diagram showing a first example of a rule for arranging thumbnail images according to this embodiment, which shows an example of a rule for arranging thumbnail images in a layout in which the screen area of a display is divided horizontally into three display areas.
[0220] Here, the display area on the left is the first display area (labeled "1"), the display area in the center is the second display area (labeled "2"), and the display area on the right is the third display area (labeled "3"). The circled display areas "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0221] When dividing the screen area of the display into three display areas in the horizontal direction as shown in FIG. 27 and arranging windows, when the first window (for example, a window snapped by a drag operation) is arranged in the first display area on the left of the three divided display areas, control unit 18 arranges a thumbnail image in the second display area in the center (see FIG. 27(A)). When the first window is arranged in the second display area in the center, control unit 18 arranges a thumbnail image in the third display area on the right (see FIG. 27(B)). When the first window is arranged in the third display area on the right, control unit 18 arranges a thumbnail image in the first display area on the left (see FIG. 27(C)).
[0222] In this way, in a layout in which the screen area of the display is divided horizontally into three display areas, the information processing device 10 arranges thumbnail images in order to the right in the display area of the window snapped by the drag operation, and after reaching the right (rightmost) display area, determines the display area in which to arrange the thumbnail images in an order (corresponding to a clockwise order) that returns to the left (leftmost) display area.
[0223] As a result, even when the information processing device 10 divides the screen area horizontally into three display areas to arrange windows, it determines the display area in which to arrange thumbnail images of other windows relative to a window snapped by a drag operation according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0224] Fig. 28 is a diagram showing a second example of the thumbnail image arrangement rule according to this embodiment. Fig. 28 shows an example of the thumbnail image arrangement rule in accordance with the order from left to right (corresponding to the clockwise order) in a layout similar to Fig. 27 in which the screen area of the display is divided into three display areas in the left-right direction.
[0225] Here, the display area on the left is the first display area (labeled "1"), the display area in the center is the second display area (labeled "2"), and the display area on the right is the third display area (labeled "3"). The circled display areas of "1," "2," and "3" indicate the display areas in which windows are arranged using the snap function. Starting from the display area in which windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area in which thumbnail images are arranged.
[0226] When dividing the screen area of the display into three display areas in the horizontal direction as shown in FIG. 28 and arranging windows, when arranging the first window (for example, a window snapped by a drag operation) in the first display area on the right of the three divided display areas, control unit 18 arranges a thumbnail image in the second display area in the center (see FIG. 28(A)). When arranging the first window in the second display area in the center, control unit 18 arranges a thumbnail image in the third display area on the left (see FIG. 28(B)). When arranging the first window in the third display area on the left, control unit 18 arranges a thumbnail image in the first display area on the right (see FIG. 28(C)).
[0227] In this way, in a layout in which the screen area of the display is divided horizontally into three display areas, the information processing device 10 arranges thumbnail images in order from left to right in the display area of the window snapped by the drag operation, and after reaching the left (leftmost) display area, determines the display area in which to arrange the thumbnail images in an order (corresponding to a counterclockwise order) that returns to the right (rightmost) display area.
[0228] As a result, even when the information processing device 10 divides the screen area horizontally into three display areas to arrange windows, it determines the display area in which to arrange thumbnail images of other windows relative to a window snapped by a drag operation according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0229] Fig. 29 is a diagram showing a third example of the arrangement rule for thumbnail images according to this embodiment, which shows an example of the arrangement rule for thumbnail images in a layout in which the screen area of the display is divided vertically into three display areas.
[0230] Here, the upper display area is the first display area (labeled "1"), the central display area is the second display area (labeled "2"), and the lower display area is the third display area (labeled "3"). The circled display areas "1," "2," and "3" indicate the display areas where windows are arranged using the snap function. Starting from the display area where windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area where thumbnail images are arranged.
[0231] When dividing the screen area of the display into three display areas vertically as shown in FIG. 29 and arranging windows, when placing a first window (for example, a window snapped by a drag operation) in the upper first display area of the three divided display areas, control unit 18 places a thumbnail image in the central second display area (see FIG. 29(A)). When placing the first window in the central second display area, control unit 18 places a thumbnail image in the lower third display area (see FIG. 29(B)). When placing the first window in the lower third display area, control unit 18 places a thumbnail image in the upper first display area (see FIG. 29(C)).
[0232] In this way, in a layout in which the screen area of the display is divided into three display areas in the vertical direction, the information processing device 10 arranges thumbnail images in a downward order in the display area of the window snapped by the drag operation, and after reaching the lower (bottom end) display area, determines the display area in which to arrange the thumbnail images in an order that returns to the upper (top end) display area.
[0233] As a result, even when the information processing device 10 divides the screen area vertically into three display areas to arrange windows, it determines the display area in which to arrange thumbnail images of other windows relative to a window snapped by a drag operation according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0234] Fig. 30 is a diagram showing a fourth example of the thumbnail image arrangement rule according to this embodiment. Fig. 30 shows an example of the thumbnail image arrangement rule according to the order from top to bottom in a layout similar to Fig. 29 in which the screen area of the display is divided into three display areas in the vertical direction.
[0235] Here, the lower display area is the first display area (labeled "1"), the central display area is the second display area (labeled "2"), and the upper display area is the third display area (labeled "3"). The circled display areas "1," "2," and "3" indicate the display areas where windows are arranged using the snap function. Starting from the display area where windows are arranged using the snap function, the display area at the tip of the arrow indicates the display area where thumbnail images are arranged.
[0236] When dividing the screen area of the display into three display areas vertically as shown in FIG. 30 and arranging windows, when placing a first window (for example, a window snapped by a drag operation) in the lower first display area of the three divided display areas, control unit 18 places a thumbnail image in the central second display area (see FIG. 30(A)). When placing the first window in the central second display area, control unit 18 places a thumbnail image in the upper third display area (see FIG. 30(B)). When placing the first window in the upper third display area, control unit 18 places a thumbnail image in the lower first display area (see FIG. 30(C)).
[0237] In this way, in a layout in which the screen area of the display is divided into three display areas in the vertical direction, the information processing device 10 arranges thumbnail images in an upward order in the display area of the window snapped by the drag operation, and after reaching the upper (top) display area, determines the display area in which to arrange the thumbnail images in an order that returns to the lower (bottom) display area.
[0238] As a result, even when the information processing device 10 divides the screen area vertically into three display areas to arrange windows, it determines the display area in which to arrange thumbnail images of other windows relative to a window snapped by a drag operation according to a certain arrangement rule (a certain order), making it easy for the user to understand.
[0239] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like are possible within the scope of the gist of the present invention. For example, the configurations described in the above embodiments may be combined in any desired manner.
[0240] In the above embodiment, when the screen area is divided into multiple display areas and windows are arranged, an example has been described in which a window snapped by a drag operation is arranged in one display area, resulting in a thumbnail image being arranged in another display area. However, the arrangement of windows that causes thumbnail images to be arranged does not have to be due to the snap function. For example, when a window is arranged in one display area by switching from single-screen mode to dual-screen mode using the display mode switching control described with reference to Figures 4 and 5, and a thumbnail image is arranged in another display area, the thumbnail image arrangement rules described in the above embodiment can be applied.
[0241] 4 and 5 is a control for switching between single-screen mode, dual-screen mode, and half-screen mode, but it may also include control for switching to a screen mode in which the screen area of the display is divided into three or more display areas (e.g., triple-screen mode, quadruple-screen mode, etc.). In this case, the thumbnail image arrangement rules described in the above embodiment can be applied to a screen mode in which the screen area is divided into three or more display areas (e.g., triple-screen mode, quadruple-screen mode, etc.).
[0242] Furthermore, in the information processing device 10 according to the embodiment described above, one foldable display 150 is provided across the inner surface of the first housing 101 and the inner surface of the second housing 102, but this is not limiting. For example, the information processing device 10 may be configured to have a display only on the inner surface of the first housing 101. Furthermore, the information processing device 10 may be configured to have a display each on the inner surface of the first housing 101 and the inner surface of the second housing 102.
[0243] Furthermore, in the above-described embodiment, an example was shown in which the multiple displays whose display is controlled by the information processing device 10 are two, a built-in display of the information processing device 10 and an external display of the external display device 20, but this is not limited thereto. When the information processing device 10 is equipped with multiple built-in displays, the multiple displays whose display is controlled may be multiple built-in displays. When the information processing device 10 is connected to multiple external display devices 20, the multiple displays whose display is controlled may be multiple external displays, or multiple external displays and one or multiple built-in displays. In other words, the multiple displays whose display is controlled by the information processing device 10 may be two displays, or three or more displays, and these displays may be either built-in displays or external displays.
[0244] In the above-described embodiment, the layouts selectable with the layout selection icon L1 or L2 (see FIG. 6) are three types: a layout in which the entire screen area of the display 150 is used as one display area, a layout in which the screen area is divided into two parts, vertically, and a layout in which the screen area is divided into three parts, but are not limited to these. For example, only some of the above three types of layouts may be selectable, or a layout in which the screen area is divided into four or more display areas may be selectable.
[0245] In addition, in the above-described embodiment, examples of touch operations on multiple touch panel type displays in which the input unit (touch sensor) and the display unit are integrated are described, but this is not limited to touch panel type displays.
[0246] The information processing device 10 described above includes an internal computer system. A program for implementing the functions of each component of the information processing device 10 may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed to perform processing in each component of the information processing device 10. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computers connected via a network, including the Internet, a WAN, a LAN, a dedicated line, or other communication lines. The term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built into a computer system. The recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM.
[0247] The recording medium also includes internal or external recording media accessible from a distribution server for distributing the program. The program may be divided into multiple parts, downloaded at different times, and then combined by each component of the information processing device 10, or each divided program may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be a medium that realizes part of the above-described functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the above-described functions in combination with a program already stored in the computer system.
[0248] Furthermore, some or all of the functions of the information processing device 10 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually implemented as a processor, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]
[0249] 10 Information processing device, 101 First housing, 102 Second housing, 103 Hinge mechanism, 11 Communication unit, 12 RAM, 13 Storage unit, 14 Speaker, 15 Display unit, 16 Camera, 150 Display, 155 Touch sensor, 161 First acceleration sensor, 162 Second acceleration sensor, 17 Hall sensor, 18 Control unit, 19 External connection terminal, 181 Display selection icon display processing unit, 182 Display selection processing unit, 183 Layout selection icon display processing unit, 184 Layout selection processing unit, 185 Display layout change unit
Claims
1. a memory for storing an application program; a processor that executes the program of the application stored in the memory to control the placement and display of a window of the application being executed in a screen area of a display; Equipped with The processor: a display control process for dividing a screen area of the display into a plurality of display areas and arranging the windows; and In the display control process, when arranging a first window of the windows in one of the plurality of display areas, arranging thumbnail images corresponding to one or more second windows other than the first window in a display area of the plurality of display areas other than the one display area; determining a display area in which the thumbnail images are to be arranged relative to the one display area in which the first window is to be arranged, in accordance with a predetermined order; Information processing device.
2. The processor: In the display control process, even if any of the windows has already been arranged in the display area in which the thumbnail images determined in the certain order are to be arranged, the thumbnail images are arranged with priority. The information processing device according to claim 1 .
3. The predetermined order is a clockwise order.
3. The information processing device according to claim 1.
4. The predetermined order is a counterclockwise order.
3. The information processing device according to claim 1.
5. The processor: In the display control process, when the screen area of the display is divided into two display areas, one above the other, and the windows are arranged by dividing the screen area of the display into two display areas, when the first window is arranged in the first display area, which is the upper one of the two divided display areas, the thumbnail image is arranged in the second display area, which is the lower one, and when the first window is arranged in the second display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
6. The processor: In the display control process, when the screen area of the display is divided into two display areas, horizontally, and the windows are arranged by dividing the screen area of the display into two display areas, when the first window is arranged in the first display area on the left side of the two divided display areas, the thumbnail image is arranged in the second display area on the right side, and when the first window is arranged in the second display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
7. The processor: In the display control process, when the screen area of the display is divided into two display areas, one above the other, and the lower display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in the upper first display area of the three divided display areas, the thumbnail image is arranged in the lower right second display area, when the first window is arranged in the second display area, the thumbnail image is arranged in the lower left third display area, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
8. The processor: In the display control process, when the screen area of the display is divided into two display areas, one above the other, and the lower display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in the upper first display area of the three divided display areas, the thumbnail image is arranged in the lower left second display area, when the first window is arranged in the second display area, the thumbnail image is arranged in the lower right third display area, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
9. The processor: In the display control process, when the screen area of the display is divided into two display areas, one above the other, and the upper display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in the first display area, which is the upper left of the three divided display areas, the thumbnail image is arranged in the second display area, which is the upper right; when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area, which is the lower; and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
10. The processor: In the display control process, when the screen area of the display is divided into two display areas, one above the other, and the upper display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in the first display area on the upper left of the three divided display areas, the thumbnail image is arranged in the second display area on the lower side, when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area on the upper right, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
11. The processor: In the display control process, when the screen area of the display is divided into two display areas, left and right, and the right display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in the first display area, which is the left of the three divided display areas, the thumbnail image is arranged in the second display area, which is the upper right area; when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area, which is the lower right area; and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
12. The processor: In the display control process, when the screen area of the display is divided into two display areas, left and right, and the right display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in the first display area, which is the left of the three divided display areas, the thumbnail image is arranged in the second display area, which is below the right side; when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area, which is above the right side; and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
13. The processor: In the display control process, when the screen area of the display is divided into two display areas, left and right, and the left display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in a first display area on the upper left side of the three divided display areas, the thumbnail image is arranged in a second display area on the right side, when the first window is arranged in the second display area, the thumbnail image is arranged in a third display area on the lower left side, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
14. The processor: In the display control process, when the screen area of the display is divided into two display areas, left and right, and the left display area is further divided into two to divide the screen area into three display areas and arrange the windows, when the first window is arranged in the first display area, which is the upper left one of the three divided display areas, the thumbnail image is arranged in the second display area, which is the lower left one; when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area, which is the right one; and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
15. The processor: In the display control process, when the screen area of the display is divided into four display areas vertically and horizontally and the windows are arranged, when the first window is arranged in a first display area at the top left of the four divided display areas, the thumbnail image is arranged in a second display area at the top right, when the first window is arranged in the second display area, the thumbnail image is arranged in a third display area at the bottom right, when the first window is arranged in the second display area, the thumbnail image is arranged in a fourth display area at the bottom left when the first window is arranged in the third display area, and when the first window is arranged in the fourth display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
16. The processor: In the display control process, when the screen area of the display is divided into four display areas vertically and horizontally and the windows are arranged, when the first window is arranged in a first display area at the top left of the four divided display areas, the thumbnail image is arranged in a second display area at the bottom left, when the first window is arranged in the second display area, the thumbnail image is arranged in a third display area at the bottom right, when the first window is arranged in the third display area, the thumbnail image is arranged in a fourth display area at the top right, when the first window is arranged in the third display area, and when the first window is arranged in the fourth display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
17. The processor: In the display control process, when the screen area of the display is divided horizontally into three display areas and the windows are arranged, when the first window is arranged in the first display area on the left side of the three divided display areas, the thumbnail image is arranged in the second display area in the center, when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area on the right side, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
18. The processor: In the display control process, when the screen area of the display is divided horizontally into three display areas and the windows are arranged, when the first window is arranged in the first display area on the right side of the three divided display areas, the thumbnail image is arranged in the second display area in the center, when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area on the left side, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
19. The processor: In the display control process, when the screen area of the display is divided vertically into three display areas and the windows are arranged by dividing the screen area of the display into three display areas, when the first window is arranged in the upper first display area of the three divided display areas, the thumbnail image is arranged in the central second display area, when the first window is arranged in the second display area, the thumbnail image is arranged in the lower third display area, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
20. The processor: In the display control process, when the screen area of the display is divided vertically into three display areas and the windows are arranged by dividing the screen area of the display into three display areas, when the first window is arranged in the first display area which is the lower of the three divided display areas, the thumbnail image is arranged in the second display area which is the center, when the first window is arranged in the second display area, the thumbnail image is arranged in the third display area which is the upper, and when the first window is arranged in the third display area, the thumbnail image is arranged in the first display area.
3. The information processing device according to claim 1.
21. A control method for an information processing device including a memory that stores an application program, and a processor that executes the application program stored in the memory to control arranging and displaying a window of the application being executed in a screen area of a display, the method comprising: the processor: dividing a screen area of the display into a plurality of display areas and placing a first window of the windows in one of the plurality of display areas; placing thumbnail images corresponding to one or more second windows other than the first window in a display area other than the one display area among a plurality of display areas; Including, determining a display area in which the thumbnail images are to be arranged relative to the one display area in which the first window is to be arranged, in accordance with a predetermined order; Control method.
Citation Information
Patent Citations
Information processing device and control method
JP7440672B1