Information processing device, and control method
The information processing device manages display switching functions to prevent interference between window position and size changes during mode transitions, maintaining consistent window arrangements through a processor-controlled display change and restoration process.
Patent Information
- Application Number
- JP2024072150
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-26
- Publication Date
- 2025-11-07
AI Technical Summary
Existing information processing devices face issues where multiple functions that change the position or size of application windows interfere with each other during mode transitions, leading to inconsistent window arrangements.
The device employs a processor to manage display switching functions with a display change process, retention of original window positions and sizes, and a restoration process based on retained states, using multiple display switching functions like single/dual-screen modes and keyboard presence to maintain consistent window arrangements.
Prevents interference between functions that change window positions or sizes during mode transitions, ensuring stable and consistent display configurations.
Smart Images

Figure 2025167493000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device and a control method. [Background technology]
[0002] There is an information processing device that can divide the screen area of a display into multiple display areas and display application windows, etc., in each display area. For example, Patent Document 1 discloses an information processing device that has a flexible display that spans first and second housings that can be rotated by a hinge mechanism, and that can switch between a single-screen mode in which the screen area of the flexible display is used as a single display area and a dual-screen mode in which the screen area is divided into two display areas by bending the first and second housings or by flattening the first and second housings, or can switch to a half-screen mode when a physical keyboard is placed on the screen area.
[0003] In this way, when switching between single-screen mode, dual-screen mode, and half-screen mode, the position and size of the application window are changed to an appropriate position and size according to the screen mode. In addition, in recent years, some information processing devices have been equipped with a function (so-called snap function) that allows a window selected in response to a user's operation to be arbitrarily positioned in any of multiple display areas obtained by dividing the screen area. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 7440672 Summary of the Invention [Problem to be solved by the invention]
[0005] As mentioned above, there are multiple functions that allow you to appropriately change the position or size of an application window within the display screen area, but there is a desire to prevent each function from affecting the other when restoring the original position or size.
[0006] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objects is to provide an information processing device and a control method in which, when there are multiple functions that appropriately change the position or size of an application window in the screen area of a display, the functions are not affected by each other when restoring the position or size of the window. [Means for solving the problem]
[0007] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a memory for storing an application program, and a processor for controlling the display of a window of the application in a screen area of a display by executing the application program stored in the memory, wherein the processor performs a display change process for changing the arrangement of the window in the screen area using a display switching function selected from a plurality of display switching functions that switch the position and size of the window in the screen area according to predetermined rules, a display state retention process for retaining the position and size of the window before being changed by the display change process for each of the plurality of display switching functions, and a display restoration process for restoring at least one of the position and size of the window changed by the display change process using each of the plurality of display switching functions based on the position and size of the window retained by the display switching function used when performing the display change process.
[0008] In the above information processing device, the plurality of display switching functions may include at least two of a first display switching function that switches whether the screen area is arranged as a single display area or divided into multiple display areas when arranging the windows arranged in the screen area; a second display switching function that switches whether the entire screen area is arranged as a display area or only a portion of the screen area is arranged as a display area when arranging the windows arranged in the screen area; and a third display switching function that switches whether a selected window from the windows arranged in the screen area is arranged in one of predetermined layouts within the screen area.
[0009] The information processing device may include a foldable display as the display, and the first display switching function may be a function that can switch between arranging the windows in the screen area as a single display area or dividing the screen area into multiple display areas, depending on whether the display is in a folded state or not.
[0010] In the above information processing device, the second display switching function may be a function that can switch, triggered by whether a physical keyboard is placed in a portion of the screen area, between arranging the window as a display area for the entire screen area or as a display area for a portion of the screen area excluding the area where the keyboard is placed.
[0011] In the above information processing device, the third display switching function may be a function that can switch the layout of a selected window from among the windows arranged in the screen area to one of several predetermined layouts within the screen area.
[0012] Furthermore, according to a second aspect of the present invention, a control method for an information processing device having a memory for storing an application program and a processor for controlling the display of a window of the application in a screen area of a display by executing the program of the application stored in the memory includes a display change step in which the processor changes the arrangement of the window in the screen area using a display switching function selected from a plurality of display switching functions that switch the position and size of the window in the screen area according to predetermined rules; a display state retention step in which the position and size of the window before being changed by the display change step are retained for each of the plurality of display switching functions; and a display restoration step in which, when restoring at least one of the position and size of the window changed by the display change step using each of the plurality of display switching functions, the restoration is performed based on the position and size of the window retained by the display switching function used when performing the display change step. [Effects of the Invention]
[0013] According to the above aspect of the present invention, when there are multiple functions that appropriately change the position or size of an application window in the screen area of a display, it is possible to prevent the functions from affecting each other when restoring the window position or size. [Brief explanation of the drawings]
[0014] [Figure 1] FIG. 1 is a perspective view showing the appearance of an information processing apparatus according to an embodiment. [Figure 2] FIG. 1 is a side view showing an example of an information processing device in a bent state according to an embodiment. [Figure 3] FIG. 1 is a side view showing an example of an information processing apparatus in a flat state according to an embodiment. [Figure 4] 3A to 3C are views showing specific examples of various display modes of the information processing apparatus according to the embodiment. [Figure 5]5A and 5B are diagrams showing an example of display control when switching from a single-screen mode to a dual-screen mode according to the embodiment. [Figure 6] 10A and 10B are diagrams showing an example of control from a full-screen mode to a half-screen mode according to the embodiment; [Figure 7] 10A and 10B are diagrams showing display examples of layout selection icons according to the embodiment. [Figure 8] FIG. 1 is a diagram showing an example of a configuration in which an information processing apparatus according to an embodiment is connected to an external display. [Figure 9] 10A and 10B are diagrams showing examples of display selection icons according to the embodiment; [Figure 10] 10A and 10B are diagrams showing examples of a display when a built-in display is selected using a display selection icon according to an embodiment. [Figure 11] 10A and 10B are diagrams showing examples of a display when a layout (display area) is selected using a layout selection icon according to the embodiment. [Figure 12] 10A and 10B are diagrams showing an example of a display when the display position of a window is changed as a result of the end of a drag operation according to the embodiment. [Figure 13] FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 14] FIG. 1 is a block diagram showing an example of the functional configuration of an information processing apparatus according to an embodiment. [Figure 15] 10 is a flowchart showing an example of processing by a display switching function according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0015] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [External view of information processing device] FIG. 1 is a perspective view showing the appearance of an information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is a clamshell (notebook) type PC (personal computer). The information processing device 10 includes a first housing 101, a second housing 102, and a hinge mechanism 103. The first housing 101 and the second housing 102 are substantially rectangular, plate-shaped (e.g., flat) housings. One side of the first housing 101 and one side of the second housing 102 are coupled (connected) via the hinge mechanism 103, and the first housing 101 and the second housing 102 are relatively rotatable around a rotation axis formed by the hinge mechanism 103. When the opening angle θ between the first housing 101 and the second housing 102 about the rotation axis is substantially 0°, the first housing 101 and the second housing 102 are overlapping and closed. A state in which the first housing 101 and the second housing 102 are closed is referred to as a "closed state." In the closed state, the surfaces of the first housing 101 and the second housing 102 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." The opening angle θ can also be said to be the angle formed by the inner surfaces of the first housing 101 and the second housing 102. A state in which the first housing 101 and the second housing 102 are open relative to the closed state is referred to as an "open state." The open state is a state in which the first housing 101 and the second housing 102 are rotated relative to each other until the opening angle θ becomes larger than a preset threshold value (for example, 10°).
[0016] The information processing device 10 also includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided across the inner surface of the first housing 101 and the inner surface of the second housing 102. The camera 16 is provided, for example, on the inner surface of the first housing 101 outside the screen area of the display 150, and is capable of capturing an image of a user or the like who is on the side facing the display 150. The display 150 is a flexible display that can be bent to match an opening angle θ resulting from relative rotation of the first housing 101 and the second housing 102 (see FIGS. 2 and 3). An organic EL display or the like is used as the flexible display. The information processing device 10 can control display using the entire screen area of the display 150 as a single screen configuration, with the entire screen area being a single display area DA, or can control display using a dual-screen configuration by dividing the screen area of the display 150 into two display areas, a first display area DA1 and a second display area DA2. Here, first display area DA1 and second display area DA2 are display areas that do not overlap each other. Here, the display area of the screen area of display 150 that corresponds to the inner surface of first housing 101 is referred to as first display area DA1, and the display area that corresponds to the inner surface of second housing 102 is referred to as second display area DA2. Hereinafter, the display mode that controls display in a single-screen configuration is referred to as the "single-screen mode," and the display mode that controls display in a dual-screen configuration is referred to as the "dual-screen mode."
[0017] A touch sensor is provided above the screen area of the display 150. The information processing device 10 can detect a touch operation on the screen area of the display 150. By opening the information processing device 10, the user can view the displays 150 provided on the inner surfaces of the first housing 101 and the second housing 102 and perform touch operations on the displays 150, thereby enabling the user to use the information processing device 10.
[0018] Next, usage forms and screen modes of the information processing device 10 will be described in detail. First, usage forms of the information processing device 10 can be divided into a bent state in which the first housing 101 and the second housing 102 are bent (Bent form) and a flat state in which the first housing 101 and the second housing 102 are not bent (Flat form) depending on the opening angle θ between the first housing 101 and the second housing 102. Hereinafter, the bent state in which the first housing 101 and the second housing 102 are bent will be simply referred to as the "Bent form," and the flat state in which the first housing 101 and the second housing 102 are not bent will be simply referred to as the "Flat form." In the bent state, the display 150 provided across the first housing 101 and the second housing 102 is also bent. In the flat form, the display 150 is also flat.
[0019] FIG. 2 is a side view showing an example of the information processing device 10 in a bent state (bent form). The display 150 is disposed across (straddles) the first housing 101 and the second housing 102. The screen area of the display 150 (display area DA shown in FIG. 1) can be bent (flexed) at a fold line at a portion corresponding to the hinge mechanism 103. The display area on the first housing 101 side of the fold line is shown as a first display area DA1, and the display area on the second housing 102 side is shown as a second display area DA2. The display 150 bends in response to the rotation (opening angle θ) of the first housing 101 and the second housing 102. The information processing device 10 determines whether it is in a bent state (bent form) in response to the opening angle θ. For example, if 10°<θ<170°, the information processing device 10 determines that it is in a bent state (bent form). This state corresponds to a usage mode known as a clamshell mode or a book mode.
[0020] 3 is a side view showing an example of the information processing device 10 in a flat state (Flat form). The information processing device 10 typically determines that it is in a flat state (Flat form) when the opening angle θ is 180°, but as an example, it may also determine that it is in a flat state (Flat form) when 170°≦θ≦180°. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat state. This state corresponds to a usage form known as a tablet mode.
[0021] [Display mode explanation] Next, display modes according to various usage patterns of the information processing device 10 will be described in detail with reference to FIG. 4 is a diagram showing specific examples of various display modes of the information processing device 10 according to this embodiment. The display mode of the information processing device 10 differs depending on the usage form, which is classified by the opening angle θ between the first housing 101 and the second housing 102, the attitude (orientation) of the information processing device 10, whether it is a single-screen mode or a dual-screen mode, etc. Note that one screen is also called a single screen, and two screens are also called a split screen or dual screen.
[0022] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage pattern. For example, in this closed state, the information processing device 10 is in a standby state such as a sleep state or a hibernation state, and the display 150 is in a display-off state. This standby state such as a sleep state or a hibernation state corresponds to, for example, a system power state S3 or S4 defined by ACPI (Advanced Configuration and Power Interface).
[0023] Display mode (b) is a display mode in which the display 150 is in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled by dividing the two areas. The orientation of the information processing device 10 is such that the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. A vertically oriented display area means that the longer side of the four sides of the rectangular display area is vertical and the shorter side is horizontal. When the display area is vertically oriented, the display orientation is also vertical, with the direction along the longer side corresponding to the up-down direction and the direction along the shorter side corresponding to the left-right direction. This usage mode is such that the left and right pages of an open book correspond to the left and right screens, and corresponds to a so-called book mode. This usage form is also called "Fold Landscape" because the display is bent, the first display area DA1 and the second display area DA2 are arranged side by side, and the combined display area is horizontally long.
[0024] In this display mode (b), for example, in a normal operating state, the information processing device 10 is in a dual-screen display mode, with the first display area DA1 on the left side serving as the primary screen and the second display area DA2 on the right side serving as the secondary screen. Note that in display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and secondary screen may be reversed.
[0025] Display mode (c-1), like display mode (b), is a display mode in which the display 150 is in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, for display control, but the orientation of the information processing device 10 is different. The orientation of the information processing device 10 is an orientation in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically one above the other. A horizontal display area orientation refers to an orientation in which the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display orientation is also horizontal, and the direction along the short side corresponds to the up-down direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the common usage modes for clamshell-type PCs.
[0026] In this display mode (c-1), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode, with the first display area DA1 as the primary screen and the second display area DA2 as the secondary screen. Note that in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.
[0027] For example, the information processing device 10 automatically switches from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right relative to display mode (b) in the illustrated example, the information processing device 10 switches to display mode (c-1) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the right from the display mode (b) state. Also, since display mode (b) is a state in which the display 150 is rotated 90 degrees to the left relative to display mode (c-1) in the illustrated example, the information processing device 10 switches to display mode (b) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the left from the display mode (c-1) state.
[0028] The display mode (c-2) is similar to the display mode (c-1), in that the information processing device 10 is in the bent state (Bent form) and oriented in the same manner. However, the difference is that an external keyboard 30 (Dockable mini KBD: Keyboard) connectable to the information processing device 10 is connected. This usage mode is a typical usage mode of a clamshell PC with a physical keyboard 30 connected. For example, the keyboard 30 is approximately the same size as the second display area DA2 and is configured to be able to be placed on the second display area DA2. As an example, the keyboard 30 has a magnet on the inside (edge) of the bottom surface. When placed on the second display area DA2, the magnet is attracted to and fixed to a metal portion on the inner edge of the second housing 102. This results in a usage mode similar to that of a conventional clamshell PC that is originally equipped with a physical keyboard. The information processing device 10 and the keyboard 30 are connected via, for example, Bluetooth (registered trademark). In this display mode (c-2), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because the second display area DA2 cannot be seen due to the keyboard. In other words, this display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as "half screen mode"), and is a one-screen mode that uses only the first display area DA1.
[0029] For example, when the information processing device 10 detects connection of an external keyboard in the display mode (c-1), the display mode (c-1) is automatically switched to the display mode (c-2) (Switch by Dock).
[0030] Display mode (d) is in a bent state (Bent form) like display mode (b), and the orientation of the information processing device 10 is also the same, but it is a single-screen mode in which the entire screen area of the display 150 is controlled as a single display area DA. This usage mode differs from display mode (b) in that it is a single-screen mode, but is also called "Fold Landscape" because it is in a bent state (Bent form) and the display area DA is horizontally long. The display area DA is oriented horizontally, and the display orientation is also horizontal.
[0031] Here, switching between the single-screen mode and the dual-screen mode in the bent state (Bent form) can be performed by, for example, a user operation. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single-screen mode and the dual-screen mode somewhere on the screen, and switches from display mode (b) to display mode (d) based on an operation on the operator (Switch by UI).
[0032] Display mode (e) is in a bent state (bent form) like display mode (c-1), and the orientation of the information processing device 10 is also the same, but it is a single-screen mode in which the entire screen area of the display 150 is controlled as a single display area DA. This usage mode differs from display mode (c-1) in that it is a single-screen mode, but it corresponds to the usage mode of a clamshell PC in terms of the bent state (bent form) and the orientation of the information processing device 10. The display area DA is in portrait orientation, and the display orientation is also portrait.
[0033] For example, the information processing device 10 automatically switches from display mode (d) to display mode (e) or from display mode (e) to display mode (d) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since display mode (e) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure, the information processing device 10 switches to display mode (e) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the right from the display mode (d). Also, since display mode (d) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure, the information processing device 10 switches to display mode (d) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the left from the display mode (e) state.
[0034] Display mode (d') is a single-screen mode similar to display mode (d), in which the orientation of the information processing device 10 is such that the display area DA is horizontally long, but differs in that it is in a flat state (Flat form). The flat state (Flat form) is a state in which the opening angle θ between the first housing 101 and the second housing 102 is approximately 180°. This usage mode corresponds to the so-called tablet mode described with reference to FIG. 3, and is also referred to as "Flat Landscape" because it is in a flat state (Flat form) and the display area DA is horizontally long. This display mode (d') differs from display mode (d) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to display mode (d), the display area DA is horizontally oriented, and the display orientation is also landscape.
[0035] Display mode (e') is a single-screen mode similar to display mode (e), in which the orientation of the information processing device 10 is such that the display area DA is vertically long, but it differs in that it is in a flat state (Flat form). This usage mode is also called "Flat Portrait" because it is in a flat state (Flat form) and the display area DA is vertically long. This display mode (e') differs from display mode (e) only in the opening angle θ between the first housing 101 and the second housing 102. Like display mode (e), the display area DA is vertically oriented, and the display orientation is also vertical.
[0036] For example, the information processing device 10 automatically switches from display mode (d') to display mode (e') or from display mode (e') to display mode (d') by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e') is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d'), the information processing device 10 switches to display mode (e') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d') state. Also, since the display mode (d') is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e'), the information processing device 10 switches to display mode (d') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e') state.
[0037] Here, switching between the single-screen mode and the dual-screen mode in the flat form can be performed by, for example, a user operation. For example, in the display mode (d') and the display mode (e'), the information processing device 10 can display an operator as a UI capable of switching between the single-screen mode and the dual-screen mode somewhere on the screen, as described above, and the user can operate this operator to switch to the dual-screen mode while remaining in the flat form. For example, when switching from the display mode (d') to the dual-screen mode, the display state in the flat form becomes the same as the display mode (b). Also, when switching from the display mode (e') to the dual-screen mode, the display state in the flat form becomes the same as the display mode (c-1).
[0038] Furthermore, when the information processing device 10 detects connection to the keyboard 30 while in the display mode (e'), it automatically switches from the display mode (e') to the display mode (c-2') (Switch by Dock). The display mode (c-2') is a flat state (Flat form), and differs from the display mode (c-2) only in the opening angle θ between the first housing 101 and the second housing 102. In this display mode (c-2'), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because it cannot be seen due to the keyboard. In other words, like the display mode (c-2), this display mode (c-2') is a half-screen mode in which only half of the screen is effective for display.
[0039] The information processing device 10 can also automatically switch from the single-screen mode to the dual-screen mode by detecting a change from a flat state (Flat form) to a bent state (Bent form) (Switch by Hinge angle). For example, when the information processing device 10 detects a change from the display mode (d') to the bent form based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (d') to the display mode (b). When the information processing device 10 detects a change from the display mode (e') to the bent form based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (e') to the display mode (c-1).
[0040] 4, the display mode switching function that switches between a single-screen mode in which the screen area of display 150 is a single display area and a dual-screen mode in which the screen area is divided into two display areas is referred to as a "first display switching function." Also, the display mode switching function that switches between a full-screen mode in which the entire screen area of display 150 is the display area and a half-screen mode in which half of the screen area of display 150 is the display area, triggered by whether or not keyboard 30 is connected (placed), is referred to as a "second display switching function." Note that the full-screen mode is the same as the single-screen mode, and therefore hereinafter the full-screen mode will also be referred to as the single-screen mode.
[0041] When information processing device 10 switches to the single-screen mode using the first display switching function, it arranges windows arranged in the screen area of display 150 using the screen area as a single display area. On the other hand, when information processing device 10 switches to the dual-screen mode using the first display switching function, it can arrange windows arranged in the screen area of display 150 using two display areas obtained by dividing the screen area.
[0042] For example, when switching from single-screen mode to dual-screen mode, information processing device 10 displays the active window of an application running in single-screen mode in first display area DA1. For example, when transitioning to dual-screen mode, information processing device 10 maximizes the active window that was displayed in display area DA in single-screen mode to fill the entire display area of first display area DA1 and displays it as the active window. Furthermore, when transitioning to dual-screen mode, information processing device 10 places a window that was an inactive window in single-screen mode in a layer behind the active window in first display area DA1, while maintaining the layer relationship (window overlap order) in single-screen mode. Thus, in first display area DA1, the active window is maximized and displayed, and the inactive window, although present in the layer behind the active window, is not displayed (is invisible to the user).
[0043] Furthermore, when switching from single-screen mode to dual-screen mode, information processing device 10 generates thumbnail images of windows that were inactive in single-screen mode and displays the thumbnail windows in second display area DA2 (secondary screen). If there are multiple inactive windows, information processing device 10 displays thumbnail windows in which thumbnail images of the multiple inactive windows are arranged in second display area DA2.
[0044] 5A and 5B are diagrams showing an example of display control when switching from single-screen mode to dual-screen mode according to this embodiment. FIG. 5A shows a display example in single-screen mode, and FIG. 5B shows a display example after switching to dual-screen mode. In the example shown, the number of application windows running in single-screen mode is three. Here, three windows W1, W2, and W3 are shown in the display area DA. Window W1 is the active window located in the foreground layer (top layer). When switching from single-screen mode to dual-screen mode, window W1 is maximized and relocated in the first display area DA1 and displayed as the active window.
[0045] Windows W2 and W3 are rearranged in a layer below window W1 while maintaining the hierarchical relationship between the layers, and a thumbnail window displaying thumbnail images SW2 and SW3 of windows W2 and W3 is displayed in the second display area DA2. Note that if the number of application windows running in single-screen mode is four or more, the number of thumbnail images displayed in the second display area DA2 when switching to dual-screen mode will also be three or more.
[0046] When the user performs a selection operation on one of the thumbnail images displayed in the second display area DA2, the information processing device 10 maximizes and rearranges the window corresponding to the selected thumbnail image in the second display area DA2, for example, and displays it as the active window.
[0047] Furthermore, when the information processing device 10 switches to full screen mode using the second display switching function, it arranges the windows arranged in the screen area of the display 150 to occupy the entire screen area as the display area, and when it switches to half screen mode using the second display switching function, it arranges the windows arranged in the screen area of the display 150 to occupy half of the screen area as the display area.
[0048] 6 is a diagram showing an example of control from full-screen mode to half-screen mode according to this embodiment. In the full-screen mode shown in FIG. 6(A), the information processing device 10 controls display using the display area DA as a single display area, but when switching to the half-screen mode shown in FIG. 6(B), it controls display using only the first display area DA1 as the display target. Here, in the full-screen mode shown in FIG. 6(A), as in FIG. 5(A), three application windows are running, and three windows W1, W2, and W3 are shown in the display area DA. Window W1 is the active window located in the foreground layer (top layer).
[0049] When the keyboard 30 is placed in the second display area DA2 and the mode is switched from the full-screen mode to the half-screen mode, the window W1 is maximized and rearranged in the first display area DA1 and displayed as the active window. The window W1 may be displayed in the first display area DA1 at its original size without being maximized, or may be resized and displayed in the first display area DA1 only if it would overflow the first display area DA1 at its original size. The windows W2 and W3 are rearranged in a layer below the window W1 while maintaining the hierarchical relationship between the layers. Furthermore, the information processing device 10 controls the second display area DA2 on which the keyboard 30 is placed to be displayed in black or turned off.
[0050] Furthermore, in addition to the first and second display switching functions described above, information processing device 10 also has a function (so-called snap function) for arranging application windows in a desired display area within the screen area. This function is referred to as the "third display switching function." With the third display switching function, it is possible to switch (select) the layout of a selected window from among windows arranged in the screen area of display 150 among predetermined layouts within the screen area.
[0051] For example, information processing device 10 displays controls as a UI (User Interface) that allows the user to select in which display area within the screen area of display 150 a window is to be laid out, and displays the window in the display area selected by the user based on the user's operation of the controls. Hereinafter, this UI that allows the user to select the display area in which to lay out the window is referred to as a "layout selection icon."
[0052] The layout of the display area selectable by operating the layout selection icon is a layout for the entire screen area (display area DA) of display 150, regardless of whether the display mode described with reference to Fig. 4 is the single-screen mode or the dual-screen mode. In the half-screen mode, half of the screen area of display 150 (first display area DA1) is the valid screen area, so the layout is for first display area DA1.
[0053] [Example of layout selection icon] Next, a specific example of the layout selection icon will be described. 7A and 7B are diagrams showing examples of layout selection icons according to this embodiment. Fig. 7A shows an example of a layout selection icon L1 that is displayed when the usage mode is "Portrait (or Clamshell)" (display mode (c-1), display mode (e), display mode (e'), etc.).
[0054] In the layout selection icon L1, the portion indicated by the symbol R11 is a layout in which the entire screen area of the display 150 is used as a single display area, and the entire screen area can be selected as the display area in which to place a window. The portion indicated by the symbol R12 is a layout in which the screen area is divided into two, vertically, and either the upper or lower display area within the screen area can be selected as the display area in which to place a window. The portions indicated by the symbols R13 and R14 are layouts in which the screen area is divided into three. The portion indicated by the symbol R13 is a layout in which the lower display area, which is obtained by dividing the screen area into two, vertically, is further divided into two, horizontally. The portion indicated by the symbol R14 is a layout in which the upper display area, which is obtained by dividing the screen area into two, vertically, is further divided into two, horizontally. The portions indicated by the symbols R13 and R14 are layouts in which any of the three display areas can be selected as the display area in which to place a window.
[0055] For example, when the usage mode is "Portrait (or Clamshell)," the user drags a window, causing a layout selection icon L1 to be displayed. As shown in the figure, when the dragging cursor CA is placed over the upper area of the layout, which divides the screen area indicated by the reference symbol R12 into two, the display area corresponding to the upper area is selected. The display mode (color, brightness, etc.) of the selected area within the layout selection icon L1 is changed. When the dragging operation is completed, the window is displayed in the selected upper display area.
[0056] FIG. 7B shows an example of a layout selection icon L2 that is displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.).
[0057] In the layout selection icon L2, the portion indicated by reference symbol R21 is a layout in which the entire screen area of the display 150 is used as a single display area, and the entire screen area can be selected as the display area in which to place a window. The portion indicated by reference symbol R22 is a layout in which the screen area is divided into two, left and right, and either the left display area or the right display area within the screen area can be selected as the display area in which to place a window. The portions indicated by reference symbols R23 and R24 are layouts in which the screen area is divided into three. The portion indicated by reference symbol R23 is a layout in which the screen area is divided into two, left and right, and the right display area is further divided into two, top and bottom. The portion indicated by reference symbol R24 is a layout in which the screen area is divided into two, left and right, and the left display area is further divided into two, top and bottom. The portions indicated by reference symbols R23 and R24 are layouts in which any of the three display areas can be selected as the display area in which to place a window.
[0058] For example, when the usage mode is "Landscape," the user drags a window, causing the layout selection icon L2 to be displayed. As shown in the figure, when the dragging cursor CA is placed over the upper right area of the layout, which divides the screen area indicated by the reference symbol R23 into three, the display area corresponding to the upper right area is selected. The display mode (color, brightness, etc.) of the selected area within the layout selection icon L2 is changed. When the dragging operation is completed, the window is displayed in the selected upper right display area.
[0059] [Connection configuration with external display] The information processing device 10 can also be used by connecting it to an external display. FIG. 8 is a diagram showing an example of a configuration in which an information processing device 10 according to this embodiment is connected to an external display. The information processing device 10 is connected to an external display device 20 (display device). Any connection method using HDMI (registered trademark), USB Type-C, DisplayPort, or the like can be applied. Note that the information processing device 10 may be connected to the external display device 20 wirelessly. The external display device 20 is configured to include a display 250 as an external display. In contrast to the external display, the display 150 of the information processing device 10 is a built-in display.
[0060] When information processing device 10 is connected to external display device 20 and controls display on multiple screen areas (multiple screen areas that do not overlap each other) including the screen area of the built-in display and the screen area of the external display, information processing device 10 can use the layout selection icon described with reference to Figure 7 to display windows on both the screen area of the built-in display and the screen area of the external display.
[0061] For example, information processing device 10 can display a window displayed in the screen area of the built-in display in any of the display areas in each layout within the screen area of the built-in display, or in any of the display areas in each layout of the external display. Similarly, information processing device 10 can display a window displayed in the screen area of the external display in any of the display areas in each layout of the external display, or in any of the display areas in each layout within the screen area of the built-in display.
[0062] When information processing device 10 is connected to external display device 20, before displaying the layout selection icon shown in Fig. 7, information processing device 10 displays a UI as an operator for selecting whether the built-in display or the external display is to be used as the screen area on which the window is to be displayed. This UI will be referred to as the "display selection icon" below.
[0063] [Example of display selection icon] 9 is a diagram showing an example of the display of a display selection icon according to this embodiment. When a drag operation is started on a window W displayed on the built-in display (display 150) or the external display (display 250), a display selection icon G1 is displayed near the position of the cursor CA used for the drag operation. This diagram shows an example when a drag operation is started on a window W displayed on the built-in display (display 150). The display position of this display selection icon G1 remains unchanged even when the cursor CA is moved by the drag operation.
[0064] The display selection icon G1 includes an internal display icon G11 corresponding to the screen area of the internal display, and an external display icon G12 corresponding to the screen area of the external display. The internal display icon G11 and the external display icon G12 are displayed with different designs (patterns, pictures) that imitate the types of their respective displays. That is, the internal display icon G11 is designed to imitate the internal display provided in the information processing device 10 (for example, a notebook PC). On the other hand, the external display icon G12 is designed to imitate the shape of the external display device 20. This makes it intuitively clear which icon is for selecting the internal display and which icon is for selecting the external display when using the display selection icon G1 to select the display destination (screen area), providing good operability.
[0065] Furthermore, the display manner (e.g., the icon color (background color)) of the built-in display icon G11 and the external display icon G12 differs depending on whether the icon corresponds to the screen area where the drag operation started. For example, in the illustrated example, the background color of the built-in display icon G11 corresponding to the screen area where the drag operation started is blue, while the background color of the external display icon G12 outside the screen area where the drag operation started is gray.
[0066] 10 is a diagram showing an example of a display when the built-in display is selected using the display selection icon according to this embodiment. As shown in the figure, when the dragged cursor CA is hovered over the built-in display icon G11, the built-in display is selected. When the dragged cursor CA is hovered over the external display icon G12, the external display is selected.
[0067] 11 is a diagram showing an example of a display when a layout (display area) is selected using the layout selection icon according to this embodiment. As shown in the figure, if a cursor CA that has been placed over the built-in display icon G11 by a drag operation on the window W is continued to be dragged over one of the display areas included in the layout selection icon L1, the display area over which the cursor CA is placed can be selected.
[0068] In the illustrated example, the lower right display area of the three display areas indicated by the symbol R13 of the layout selection icon L1 is selected by placing the dragged cursor CA over the lower right display area. As a result, display information indicating that the display area has been selected is displayed in the lower right display area (the area corresponding to the selected display area) within the screen area of the built-in display (display 150). For example, semi-transparent display information (semi-transparent box BX) indicating the area corresponding to the selected display area is displayed. This makes it easy to intuitively identify the selected display area (the area where the dragged window W is displayed).
[0069] Here, when the dragging operation is terminated while the cursor CA being dragged is placed over one of the display areas included in the layout selection icon L1 or L2, the selection of the display and the selection of the layout (display area) are confirmed, and the display position of the window W being dragged is changed to a display area within the screen area of the selected display.
[0070] Fig. 12 is a diagram showing an example of a display when the display position of a window is changed as a result of the end of a drag operation according to this embodiment. For example, if the drag operation is ended while the built-in display is selected as shown in Fig. 11 and the dragging cursor CA is positioned over the lower right display area of the three display areas indicated by the symbol R13 of the layout selection icon L1, the dragged window W is snapped to the display area where the semi-transparent box BX was displayed in the built-in display (display 150) in Fig. 11.
[0071] When multiple windows are open, thumbnails of windows other than the window W being dragged may be displayed in a display area other than the display area in which window W is located.
[0072] [Configuration of information processing device] The specific configuration of the information processing device 10 will be described below. 13 is a block diagram showing an example of the hardware configuration of an information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, a control unit 18, and an external connection terminal 19. These units are connected to each other so as to be able to communicate with each other via a bus or the like.
[0073] The communication unit 11 includes, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), and a communication device that performs wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). For example, the communication unit 11 can communicate with the aforementioned external keyboard 30 or the like using Bluetooth (registered trademark).
[0074] In the RAM 12, programs and data for processes executed by the control unit 18 are loaded, and various data is saved or erased as appropriate. For example, the RAM 12 also functions as a video memory (V-RAM) for display on the display 150. As an example, the RAM 12 functions as a video memory for data displayed in each display area within the screen area of the display 150 (or the display 250 when the external display device 20 is connected). The RAM 12 also stores information about running apps, apps in use (active window apps) among the running apps, information about other inactive window apps, the display area in which each window is displayed, the layer in which each window is located, the size of the window, whether it is minimized, and the like. Note that the RAM 12 is a volatile memory, and therefore does not retain data when power supply to the RAM 12 is stopped. Data that needs to be retained when power supply to the RAM 12 is stopped is transferred to the storage unit 13.
[0075] The storage unit 13 is configured to include one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Residual Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores programs and setting data for a BIOS (Basic Input Output System), an OS (Operating System), programs for applications that run on the OS, and various data used by the applications. The speaker 14 outputs electronic sounds, voices, and the like.
[0076] The display unit 15 includes a display 150 and a touch sensor 155. As described above, the display 150 is a flexible display that can be bent to match the opening angle θ resulting from the relative rotation of the first housing 101 and the second housing 102. The display 150 performs display corresponding to each display mode described with reference to FIG. 4 under the control of the control unit 18. The touch sensor 155 is provided on the screen of the display 150 and detects touch operations on the screen. For example, in the single-screen mode, the touch sensor 155 detects touch operations on the display area DA. In addition, in the dual-screen mode, the touch sensor 155 detects touch operations on one or both of the first display area DA1 and the second display area DA2. Touch operations include tap operations, slide operations, flick operations, swipe operations, and pinch operations. The touch sensor 155 detects the touch operations and outputs operation information based on the detected operations to the control unit 18.
[0077] The camera 16 includes a lens, an imaging element, etc. The camera 16 captures an image (a still image or a moving image) according to the control of the control unit 18, and outputs data of the captured image.
[0078] First acceleration sensor 161 is provided inside first housing 101 and detects the orientation and changes in orientation of first housing 101. For example, if the direction parallel to the longitudinal direction of first display area DA1 is defined as the X1 direction, the direction parallel to the lateral direction is defined as the Y1 direction, and the direction perpendicular to the X1 and Y1 directions is defined as the Z1 direction, first acceleration sensor 161 detects acceleration in each of the X1, Y1, and Z1 directions and outputs the detection results to control unit 18.
[0079] The second acceleration sensor 162 is provided inside the second housing 102 and detects the orientation and changes in orientation of the second housing 102. For example, if the direction parallel to the longitudinal direction of the second display area DA2 is the X2 direction, the direction parallel to the lateral direction is the Y2 direction, and the direction perpendicular to the X2 and Y2 directions is the Z2 direction, the second acceleration sensor 162 detects acceleration in each of the X2, Y2, and Z2 directions and outputs the detection results to the control unit 18.
[0080] The Hall sensor 17 is provided to detect the connection of the keyboard 30. For example, when the keyboard 30 is placed on the second display area DA2 of the second housing 102, a magnet provided inside the bottom surface of the keyboard 30 approaches, changing the magnetic field, and changing the detection value (output value) of the Hall sensor 17. In other words, the Hall sensor 17 outputs a different detection result depending on whether the keyboard 30 is placed. Note that, although the Hall sensor 17 is used to detect whether the keyboard 30 is placed here, the detection method is not limited to this, and any detection method can be used.
[0081] The external connection terminal 19 is a connection terminal for connecting to an external display device 20 (external display). For example, the external connection terminal 19 is an HDMI (registered trademark) terminal, a USB Type-C terminal, a display port, etc. Note that the information processing device 10 and the external display device 20 may be connected wirelessly.
[0082] Control unit 18 is configured to include processors such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and realizes various functions by executing programs (various programs such as a BIOS, an OS, and applications running on the OS) stored in storage unit 13, etc. For example, control unit 18 detects the attitude (orientation) of information processing device 10 based on the detection results of first acceleration sensor 161 and second acceleration sensor 162. Furthermore, control unit 18 detects whether information processing device 10 is in an open state or a closed state, and if in an open state, whether it is in a bent state (bent form) or a flat state (flat form), based on the detection results of first acceleration sensor 161 and second acceleration sensor 162.
[0083] Furthermore, the control unit 18 detects a connection with the keyboard 30 based on the detection result of the hall sensor 17. Note that this connection with the keyboard 30 refers to the placement of the keyboard 30 on the second display area DA2, and does not refer to a communication connection. The control unit 18 detects the communication connection with the keyboard 30 using a function such as Bluetooth (registered trademark).
[0084] Control unit 18 also controls a first display switching function, a second display switching function, and a third display switching function that switch the position and size of windows within the screen area according to predetermined rules. Control unit 18 performs a display change process that changes the arrangement of windows within the screen area of display 150 (built-in display) or display 250 (external display) using a display switching function selected from the first display switching function, the second display switching function, and the third display switching function.
[0085] Furthermore, for each of the first, second, and third display switching functions, control unit 18 performs a display state retention process that retains the window position and size before being changed by each display change process. Furthermore, when restoring at least one of the window position and size changed using each of the first, second, and third display switching functions, control unit 18 performs a display restoration process that restores the window position and size based on the window position and size retained by each display switching function.
[0086] 14 is a block diagram showing an example of a functional configuration related to the display switching function of the information processing device 10 according to this embodiment. The control unit 18 includes a first display switching function unit 181, a second display switching function unit 182, and a third display switching function unit 183 as functional configurations in which the CPU executes processing based on the OS or a program running on the OS.
[0087] First display switching function unit 181 controls the first display switching function (see FIGS. 4 and 5) that switches between single-screen mode and dual-screen mode by detecting or determining the state of the system, the attitude (orientation) of information processing device 10, whether it is in an open state or a closed state, and, if in an open state, whether it is in a bent form or a flat form. For example, first display switching function unit 181 performs a display change process that changes the arrangement of windows within the screen area in response to switching between single-screen mode and dual-screen mode, according to rules predetermined in the first display switching function.
[0088] Furthermore, first display switching function unit 181 performs a display state retention process of retaining the positions and sizes of windows before their placement is changed by the display change process performed by the first display switching function in first retention unit 121. First retention unit 121 is configured to be included in, for example, RAM 12. For example, when first display switching function unit 181 changes the placement of windows within the screen area in response to switching between single-screen mode and dual-screen mode, it retains the positions and sizes of windows before the change in first retention unit 121 (RAM 12).
[0089] Then, when restoring at least one of the position and size of a window whose arrangement has been changed by the display change process using the first display switching function, first display switching function unit 181 performs a display restoration process that restores the position and size of the window based on the position and size of the window stored in first storage unit 121. Here, the trigger for restoration using the first display switching function is, for example, switching between single-screen mode and dual-screen mode. For example, the trigger for restoring at least one of the position and size of a window whose arrangement has been changed in response to switching from single-screen mode to dual-screen mode is switching from dual-screen mode to single-screen mode. Also, the trigger for restoring at least one of the position and size of a window whose arrangement has been changed in response to switching from dual-screen mode to single-screen mode is switching from single-screen mode to dual-screen mode.
[0090] The second display switching function unit 182 controls the second display switching function (see FIGS. 4 and 6) that switches between the single screen mode and the half screen mode by detecting connection with the keyboard 30. For example, the second display switching function unit 182 performs a display change process that changes the arrangement of windows within the screen area in response to switching between the single screen mode and the half screen mode, in accordance with rules predetermined in the second display switching function.
[0091] Furthermore, second display switching function unit 182 performs a display state retention process of retaining the positions and sizes of windows before their placement is changed by the display change process performed by the second display switching function in second retention unit 122. Second retention unit 122 is, for example, included in RAM 12. For example, when second display switching function unit 182 changes the placement of windows within the screen area in response to switching between full-screen mode and half-screen mode, it retains the positions and sizes of windows before the change in second retention unit 122 (RAM 12).
[0092] Then, when restoring at least one of the position and size of a window whose arrangement has been changed by the display change process using the second display switching function, second display switching function unit 182 performs a display restoration process that restores the position and size of the window based on the position and size of the window stored in second storage unit 122. Here, the trigger for restoration using the second display switching function is, for example, switching between single-screen mode and half-screen mode. For example, the trigger for restoring at least one of the position and size of a window whose arrangement has been changed in response to switching from single-screen mode to half-screen mode is switching from half-screen mode to single-screen mode. Also, the trigger for restoring at least one of the position and size of a window whose arrangement has been changed in response to switching from half-screen mode to single-screen mode is switching from single-screen mode to half-screen mode.
[0093] Third display switching function unit 183 controls a third display switching function (see FIGS. 7 to 12) that arranges (snaps) a window selected by a drag operation on a window arranged in the screen area of display 150 to any of the display areas of layouts selectable from the layout selection icons. For example, third display switching function unit 183 performs a display change process that changes the arrangement of a window selected by a drag operation on a window in accordance with a rule predetermined in the third display switching function.
[0094] Third display switching function unit 183 also performs a display state retention process that retains in third retention unit 123 the position and size of a window before its placement is changed by the display change process performed by the third display switching function. Third retention unit 123 is, for example, included in RAM 12. For example, when third display switching function unit 183 changes the placement of a window within the screen area in response to a drag operation on a window, it retains the position and size of the window before the change in third retention unit 123 (RAM 12). When an external display is connected, information indicating whether the position of the window is on the built-in display or the external display is also retained.
[0095] Then, when restoring the size of a window whose arrangement has been changed by the display change process using the third display switching function, third display switching function unit 183 performs a display restoration process that restores the size of the window based on the window size stored in third storage unit 123. Here, with the third display switching function, the position of the window is determined by a drag operation, so it is the size of the window that is restored. A trigger for restoring the size of a window using the third display switching function is, for example, a drag operation (unsnap) on a window whose arrangement has been changed. For example, if the arrangement of a window within the screen area is changed by the third display switching function in response to a drag operation on a window, the trigger for restoring the size of the window is when a drag operation is started again on the window whose arrangement has been changed, or when the drag operation is ended.
[0096] Next, with reference to FIG. 15, the operation of changing and restoring the window arrangement by the first display switching function, the second display switching function, or the third display switching function will be described. FIG. 15 is a flowchart showing an example of processing by the display switching function according to this embodiment.
[0097] (Step S101) Control unit 18 changes the layout of windows within the screen area of display 150 (built-in display) or display 250 (external display) using a display switching function selected from the first display switching function, the second display switching function, and the third display switching function. Then, the process proceeds to step S103.
[0098] (Step S103) Control unit 18 stores the window position and size before being changed by the display change process in association with the display switching function selected in step S101. That is, control unit 18 stores the window position and size before being changed by each display change process for each of the first, second, and third display switching functions. Then, the process proceeds to step S105.
[0099] (Step S105) The control unit 18 determines whether or not a trigger to restore at least one of the position and size of the window changed in step S101 has been acquired, and if it determines that a trigger has been acquired (YES), the control unit 18 proceeds to processing in step S107.
[0100] (Step S107) Control unit 18 restores at least one of the window position and size based on the window position and size held in association with the display switching function selected in step S101. That is, control unit 18 restores one or both of the window position and size held for the display switching function selected in step S101 based on the window position and size held for each of the first display switching function, the second display switching function, and the third display switching function.
[0101] For example, in the case of the first display switching function or the second display switching function, the control unit 18 restores both the position and size of the window, and in the case of the third display switching function, the control unit 18 restores only the size of the window.
[0102] [Summary of the embodiment] As described above, information processing device 10 according to the present embodiment includes storage unit 13 (an example of a memory) that stores application programs, and control unit 18 (an example of a processor such as a CPU, GPU, or microcomputer) that executes the application programs stored in storage unit 13 to display application windows in the screen area of display 150 (or display 250). Control unit 18 performs a display change process that changes the arrangement of windows in the screen area using a display switching function selected from a plurality of display switching functions that switch the positions and sizes of windows in the screen area according to predetermined rules, a display state retention process that retains, for each of the plurality of display switching functions, the positions and sizes of windows before being changed by the display change process, and a display restoration process that, when restoring at least one of the positions and sizes of windows changed by the display change process using each of the plurality of display switching functions, restores the positions and sizes of windows based on the positions and sizes of the windows retained by the display switching functions used when performing the display change process.
[0103] This allows the information processing device 10 to prevent the functions from affecting each other when restoring the window position or size in the case where there are multiple display switching functions that appropriately change the position or size of an application window in the screen area of the display 150 (or the display 250).
[0104] For example, the multiple display switching functions include a first display switching function, a second display switching function, and a third display switching function. The first display switching function is a display switching function that switches whether a screen area is arranged as a single display area or divided into multiple display areas when arranging windows arranged in the screen area. For example, the first display switching function is a display switching function that switches between a single-screen mode and a dual-screen mode. Note that dividing a screen area into multiple display areas is not limited to a dual-screen mode in which the screen area is divided into two display areas, but may also be divided into three or more display areas. The second display switching function is a display switching function that switches whether the entire screen area is arranged as a display area or a portion (e.g., half) of the screen area when arranging windows arranged in the screen area. For example, the second display switching function is a display switching function that switches between a single-screen mode (full-screen mode) and a half-screen mode. The third display switching function is a display switching function that switches whether a selected window arranged in the screen area is arranged (e.g., snapped) in a predetermined layout within the screen area. For example, the multiple display switching functions may include at least two of a first display switching function, a second display switching function, and a third display switching function. Furthermore, the multiple display switching functions are not limited to the first display switching function, the second display switching function, and the third display switching function, and may include other display switching functions.
[0105] As a result, when the information processing device 10 restores the position or size of an application window after changing it using any of the above-mentioned first display switching function, second display switching function, and third display switching function, it can restore the window to its position or size before the change without being affected by functions other than the display switching function used for the change.
[0106] Furthermore, information processing device 10 includes a bendable flexible display as display 150. The first display switching function is a function that can switch between arranging windows in a single display area on the screen, or dividing the screen area into multiple display areas (for example, two display areas) and arranging windows in the single display area on the screen (single screen mode or dual screen mode), depending on whether display 150 is bent or not.
[0107] This allows information processing device 10 to switch between, for example, a single-screen mode and a dual-screen mode depending on whether display 150 is bent or not, and to change the arrangement of windows appropriately according to each screen mode.
[0108] The second display switching function is a function that can switch between arranging a window in the entire screen area as the display area or in the partial area of the screen area excluding the area where the keyboard 30 is placed (single screen mode (full screen mode) or half screen mode), triggered by whether or not a physical keyboard 30 is placed in a partial area of the screen area.
[0109] This allows the information processing device 10 to switch between, for example, one screen mode (full screen mode) and half screen mode depending on whether the keyboard 30 is placed or not, and to change the layout of windows appropriately according to each screen mode.
[0110] The third display switching function is a function that can switch the layout of a selected window from among windows arranged in the screen area among predetermined layouts within the screen area.
[0111] This allows the information processing device 10 to place any window at a desired position within the screen area, for example, by a drag operation by the user.
[0112] Furthermore, the control method in the information processing device 10 according to this embodiment includes a display change step in which the control unit 18 (for example, an example of a processor such as a CPU, GPU, or microcomputer) changes the arrangement of windows within the screen area of the display 150 (or the display 250) using a display switching function selected from a plurality of display switching functions that switch the position and size of windows within the screen area according to predetermined rules; a display state retention step in which the position and size of the window before being changed by the display change step are retained for each of the plurality of display switching functions; and a display restoration step in which, when restoring at least one of the position and size of the window changed by the display change step using each of the plurality of display switching functions, the restoration is performed based on the position and size of the window retained by the display switching function used when performing the display change step.
[0113] As a result, the control method in the information processing device 10 can prevent the functions from affecting each other when restoring the window position or size when there are multiple display switching functions that appropriately change the window position or size of an application in the screen area of the display 150 (or the display 250).
[0114] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like are possible within the scope of the gist of the present invention. For example, the configurations described in the above embodiments may be combined in any desired manner.
[0115] Furthermore, although the information processing device 10 according to the above-described embodiment has one foldable display 150 provided across the inner surface of the first housing 101 and the inner surface of the second housing 102, the present invention is not limited to this. For example, the information processing device 10 may be configured so that a display is provided only on the inner surface of the first housing 101. Furthermore, the information processing device 10 may be configured so that a display is provided on each of the inner surfaces of the first housing 101 and the second housing 102. Regardless of the configuration of the information processing device 10, the first display switching function, the second display switching function, or the third display switching function described above may be applied.
[0116] Furthermore, in the above-described embodiment, an example was shown in which the multiple displays whose display is controlled by the information processing device 10 are two, a built-in display of the information processing device 10 and an external display of the external display device 20, but this is not limited thereto. When the information processing device 10 is equipped with multiple built-in displays, the multiple displays whose display is controlled may be multiple built-in displays. When the information processing device 10 is connected to multiple external display devices 20, the multiple displays whose display is controlled may be multiple external displays, or multiple external displays and one or multiple built-in displays. In other words, the multiple displays whose display is controlled by the information processing device 10 may be two displays, or three or more displays, and these displays may be either built-in displays or external displays.
[0117] In the above-described embodiment, the layouts selectable with the layout selection icon L1 or L2 (see FIG. 7) are three types: a layout in which the entire screen area of the display 150 is used as one display area, a layout in which the screen area is divided into two parts, vertically, and a layout in which the screen area is divided into three parts, but are not limited to these. For example, only some of the above three types of layouts may be selectable, or a layout in which the screen area is divided into four or more display areas may be selectable.
[0118] In addition, in the above-described embodiment, an example of touch operation on a plurality of touch panel type displays in which the input unit (touch sensor) and the display unit are integrated is described, but this is not limited to touch panel type displays.
[0119] The information processing device 10 described above includes an internal computer system. A program for implementing the functions of each component of the information processing device 10 may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed to perform processing in each component of the information processing device 10. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computers connected via a network, including the Internet, a WAN, a LAN, a dedicated line, or other communication lines. The term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built into a computer system. The recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM.
[0120] The recording medium also includes internal or external recording media accessible from a distribution server for distributing the program. The program may be divided into multiple parts, downloaded at different times, and then combined by each component of the information processing device 10, or each divided program may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be a medium that realizes part of the above-described functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the above-described functions in combination with a program already stored in the computer system.
[0121] Furthermore, some or all of the functions of the information processing device 10 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually implemented as a processor, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]
[0122] 10 Information processing device, 101 First housing, 102 Second housing, 103 Hinge mechanism, 11 Communication unit, 12 RAM, 13 Memory unit, 14 Speaker, 15 Display unit, 16 Camera, 150 Display, 155 Touch sensor, 161 First acceleration sensor, 162 Second acceleration sensor, 17 Hall sensor, 18 Control unit, 19 External connection terminal, 181 First display switching function unit, 182 Second display switching function unit, 183 Third display switching function unit, 121 First holding unit, 122 Second holding unit, 123 Third holding unit
Claims
1. a memory for storing an application program; a processor that executes the program of the application stored in the memory to control displaying a window of the application in a screen area of a display; Equipped with The processor: a display change process for changing the layout of the window within the screen area using a display change function selected from a plurality of display change functions that change the position and size of the window within the screen area according to a predetermined rule; a display state retention process for retaining the position and size of the window before being changed by the display change process for each of the plurality of display switching functions; a display restoration process for restoring at least one of the position and size of the window changed by the display change process using each of the plurality of display switching functions, based on the position and size of the window held by the display switching function used when the display change process is performed; An information processing device that performs the above.
2. The plurality of display switching functions include at least two of a first display switching function that switches whether the screen area is arranged as one display area or divided into a plurality of display areas when arranging the windows arranged in the screen area; a second display switching function that switches whether the entire screen area is arranged as a display area or a portion of the screen area is arranged as a display area when arranging the windows arranged in the screen area; and a third display switching function that switches whether a selected window from the windows arranged in the screen area is arranged in one of predetermined layouts within the screen area. The information processing device according to claim 1 .
3. The display is a foldable display, the first display switching function is a function capable of switching between arranging the windows in the screen area as a single display area or dividing the screen area into a plurality of display areas, depending on whether the display is in a bent state or not; The information processing device according to claim 2 .
4. the second display switching function is a function that, triggered by whether a physical keyboard is placed in a part of the screen area, can switch between arranging the window as a display area for the entire screen area or as a display area for a part of the screen area excluding the area where the keyboard is placed. The information processing device according to claim 2 .
5. the third display switching function is a function capable of switching the layout of a selected window from among the windows arranged in the screen area to one of predetermined layouts within the screen area; The information processing device according to claim 2 .
6. A control method for an information processing device including a memory that stores an application program, and a processor that controls displaying a window of the application in a screen area of a display by executing the application program stored in the memory, comprising: the processor: a display change step of changing the arrangement of the windows within the screen area using a display change function selected from a plurality of display change functions that change the positions and sizes of the windows within the screen area according to a predetermined rule; a display state maintaining step of maintaining the position and size of the window before being changed by the display changing step for each of the plurality of display switching functions; a display restoring step of restoring at least one of the position and size of the window changed in the display changing step using each of the plurality of display switching functions, based on the position and size of the window held by the display switching function used in the display changing step; A control method comprising:
Citation Information
Patent Citations
Information processing device and control method
JP7440672B1