Information processing apparatus and control method

Abstract

To improve the operability in selecting a screen area for display from among a plurality of screen areas of a display.SOLUTION: An information processing apparatus is configured to: display, when receiving a drag operation on a window of an application displayed on a display, first icons corresponding to one or more displays; select a display corresponding to an icon selected by the drag operation from among the first icons, as a display where the window is to be displayed; and display a second icon for selecting a display area in which the window is displayed within a screen area of the selected display. The information processing apparatus is configured to: suspend displaying the first icons and the second icon, in accordance with an operation position of the drag operation reaching a first area in the screen area of the display; and restart displaying the first icons and the second icon in accordance with the operation position of the drag operation moving outside a second area in the screen area.SELECTED DRAWING: Figure 15

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] There is an information processing device that can divide a display screen into multiple display areas and display application windows, etc. in each display area. For example, Patent Document 1 discloses an information processing device that has a flexible display that spans first and second housings that can be rotated by a hinge mechanism, and that allows the screen of the flexible display to be used as a single display area or as two divided display areas by changing the first and second housings into a bent state or a flat state.

[0003] In recent years, some operating systems such as Windows (registered trademark) or applications have a snap function that allows the user to select any display area in a layout that divides the screen into two, three, or four parts as the display destination and place the application window therein. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 7440672 Summary of the Invention [Problem to be solved by the invention]

[0005] As mentioned above, there are an increasing number of situations where the display screen area is divided into multiple display areas. However, for example, the snap function mentioned above may be supported by the OS or by an application running on the OS. There was a concern that users might get confused when using similar functions when both are present.

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objects is to provide an information processing device and a control method that improve operability when selecting an arbitrary display area from the screen area of ​​a display as the display destination. [Means for solving the problem]

[0007] The present invention has been made to solve the above-mentioned problems, and according to a first aspect of the present invention, an information processing device that controls display on one or more displays includes a memory that stores a system program and an application program that runs on the system, and a processor that controls displaying a window of the application in a screen area of ​​the display by executing the system program and the application program stored in the memory, wherein the processor performs a first display process that, when a drag operation is received on the window displayed on the display, displays a first icon corresponding to each of the one or more displays in the screen area of ​​the display on which the drag operation was started, and a second display process that displays a first icon corresponding to an icon selected by the drag operation among the first icons corresponding to each of the one or more displays. a first selection process for selecting a display on which the dragged window is to be displayed as a display on which the dragged window is to be displayed; a second display process for displaying a second icon within the screen area of ​​the display selected by the first selection process, which allows selection of a display area in which the window is to be displayed; a display cancellation process for canceling the display of the first icon by the first display process and the display of the second icon by the second display process in response to the operation position due to the drag operation reaching a predetermined first area within the screen area of ​​the display; and a display restart process for restarting the display of the first icon by the first display process and the display of the second icon by the second display process in response to the operation position due to the drag operation moving out of a second area including the first area within the screen area of ​​the display, after the display cancellation process.

[0008] In the above-mentioned information processing device, the first area and the second area may be set to correspond to an area within the screen area of ​​the display that is used by the system's functions, the first area may be set to correspond to an area in which a third icon is displayed that allows the system's functions to select a display area in which to display the window within the screen area of ​​the display in response to the operation position reached by the drag operation, and the second area may be set to correspond to an area in which the display of the third icon is maintained when, after the third icon is displayed, the display of the third icon is discontinued in response to the operation position reached by the drag operation moving away from the third icon.

[0009] In the information processing device, the second area may be set to be larger than the first area.

[0010] In the information processing device, the first area and the second area may be set as the same area.

[0011] In the information processing device, the first area or the second area may be set differently depending on the type of input device used by the user to perform the drag operation.

[0012] In the information processing device, the setting of the first area or the second area may differ depending on the screen size of the display.

[0013] In the above information processing device, the processor may perform a tracking process to track the movement of the operation position due to the drag operation, and may control whether to perform the display cancellation process based on the number of times the operation position due to the drag operation has reached the first area or moved out of the second area.

[0014] According to a second aspect of the present invention, there is provided a control method for an information processing device including a memory that stores a system program and an application program that runs on the system, and a processor that executes the system program and the application program stored in the memory to control displaying a window of the application in a screen area of ​​one or more displays, the method comprising the steps of: a first display step of, when the processor receives a drag operation on the window displayed on the display, displaying first icons corresponding to each of the one or more displays in a screen area of ​​the display on which the drag operation was started; and a second display step of, when the processor receives a drag operation on the window displayed on the display, displaying first icons corresponding to each of the one or more displays in a screen area of ​​the display on which the drag operation was started. a display canceling step of canceling the display of the first icon in the first displaying step and the display of the second icon in the second displaying step in response to the operation position due to the drag operation reaching a predetermined first area within the screen area of ​​the display; and a display resuming step of restarting the display of the first icon in the first displaying step and the display of the second icon in the second displaying step in response to the operation position due to the drag operation moving out of a second area including the first area within the screen area of ​​the display after the display canceling step. [Effects of the Invention]

[0015] According to the above aspect of the present invention, it is possible to improve the operability when selecting an arbitrary display area from the screen area of ​​the display as the display destination. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 1 is a perspective view showing the appearance of an information processing apparatus according to an embodiment. [Figure 2] FIG. 1 is a side view showing an example of an information processing device in a bent state according to an embodiment. [Figure 3] FIG. 1 is a side view showing an example of an information processing apparatus in a flat state according to an embodiment. [Figure 4] 3A to 3C are views showing specific examples of various display modes of the information processing apparatus according to the embodiment. [Figure 5] 10A and 10B are diagrams showing display examples of layout selection icons according to the embodiment. [Figure 6] FIG. 1 is a diagram showing an example of a configuration in which an information processing apparatus according to an embodiment is connected to an external display. [Figure 7] 10A and 10B are diagrams showing examples of display selection icons according to the embodiment; [Figure 8] 10A and 10B are diagrams showing a list of display modes of display selection icons according to the embodiment; [Figure 9] 10A and 10B are diagrams showing examples of a display when a display selection icon is selected according to the embodiment. [Figure 10] 10A and 10B are diagrams showing an example of a display when an operation position by a drag operation reaches a first area according to the embodiment. [Figure 11] 10A and 10B are diagrams showing an example of an area for determining whether an operation position by a drag operation has moved away from a display position selection icon according to the embodiment; [Figure 12] 10A and 10B are diagrams showing an example of a display when the operation position by the drag operation moves out of the second area according to the embodiment. [Figure 13] FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 14] FIG. 1 is a block diagram showing an example of the functional configuration of an information processing apparatus according to an embodiment. [Figure 15] 10 is a flowchart showing an example of a display layout change process according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [External view of information processing device] FIG. 1 is a perspective view showing the appearance of an information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is a clamshell (notebook) type PC (personal computer). The information processing device 10 includes a first housing 101, a second housing 102, and a hinge mechanism 103. The first housing 101 and the second housing 102 are substantially rectangular, plate-shaped (e.g., flat) housings. One side of the first housing 101 and one side of the second housing 102 are coupled (connected) via the hinge mechanism 103, and the first housing 101 and the second housing 102 are relatively rotatable around a rotation axis formed by the hinge mechanism 103. When the opening angle θ between the first housing 101 and the second housing 102 about the rotation axis is substantially 0°, the first housing 101 and the second housing 102 are overlapping and closed. A state in which the first housing 101 and the second housing 102 are closed is referred to as a "closed state." In the closed state, the surfaces of the first housing 101 and the second housing 102 that face each other are referred to as the "inner surfaces," and the surfaces opposite the inner surfaces are referred to as the "outer surfaces." The opening angle θ can also be said to be the angle formed by the inner surfaces of the first housing 101 and the second housing 102. A state in which the first housing 101 and the second housing 102 are open relative to the closed state is referred to as an "open state." The open state is a state in which the first housing 101 and the second housing 102 are rotated relative to each other until the opening angle θ becomes larger than a preset threshold value (for example, 10°).

[0018] The information processing device 10 also includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided across the inner surface of the first housing 101 and the inner surface of the second housing 102. The camera 16 is provided, for example, on the inner surface of the first housing 101 outside the screen area of ​​the display 150, and is capable of capturing an image of a user or the like who is on the side facing the display 150. The display 150 is a flexible display that can be bent to match an opening angle θ resulting from relative rotation of the first housing 101 and the second housing 102 (see FIGS. 2 and 3). An organic EL display or the like is used as the flexible display. The information processing device 10 can control display using the entire screen area of ​​the display 150 as a single screen configuration, with the entire screen area being a single display area DA, or can control display using a dual-screen configuration by dividing the screen area of ​​the display 150 into two display areas, a first display area DA1 and a second display area DA2. Here, first display area DA1 and second display area DA2 are display areas that do not overlap each other. Here, the display area of ​​the screen area of ​​display 150 that corresponds to the inner surface of first housing 101 is referred to as first display area DA1, and the display area that corresponds to the inner surface of second housing 102 is referred to as second display area DA2. Hereinafter, the display mode that controls display in a single-screen configuration is referred to as the "single-screen mode," and the display mode that controls display in a dual-screen configuration is referred to as the "dual-screen mode."

[0019] A touch sensor is provided above the screen area of ​​the display 150. The information processing device 10 can detect a touch operation on the screen area of ​​the display 150. By opening the information processing device 10, the user can view the displays 150 provided on the inner surfaces of the first housing 101 and the second housing 102 and perform touch operations on the displays 150, thereby enabling the user to use the information processing device 10.

[0020] Next, usage forms and screen modes of the information processing device 10 will be described in detail. First, usage forms of the information processing device 10 can be divided into a bent state in which the first housing 101 and the second housing 102 are bent (Bent form) and a flat state in which the first housing 101 and the second housing 102 are not bent (Flat form) depending on the opening angle θ between the first housing 101 and the second housing 102. Hereinafter, the bent state in which the first housing 101 and the second housing 102 are bent will be simply referred to as the "Bent form," and the flat state in which the first housing 101 and the second housing 102 are not bent will be simply referred to as the "Flat form." In the bent state, the display 150 provided across the first housing 101 and the second housing 102 is also bent. In the flat form, the display 150 is also flat.

[0021] FIG. 2 is a side view showing an example of the information processing device 10 in a bent state (bent form). The display 150 is disposed across (straddles) the first housing 101 and the second housing 102. The screen area of ​​the display 150 (display area DA shown in FIG. 1) can be bent (flexed) at a fold line at a portion corresponding to the hinge mechanism 103. The display area on the first housing 101 side of the fold line is shown as a first display area DA1, and the display area on the second housing 102 side is shown as a second display area DA2. The display 150 bends in response to the rotation (opening angle θ) of the first housing 101 and the second housing 102. The information processing device 10 determines whether it is in a bent state (bent form) in response to the opening angle θ. For example, if 10°<θ<170°, the information processing device 10 determines that it is in a bent state (bent form). This state corresponds to a usage mode known as a clamshell mode or a book mode.

[0022] 3 is a side view showing an example of the information processing device 10 in a flat state (Flat form). The information processing device 10 typically determines that it is in a flat state (Flat form) when the opening angle θ is 180°, but as an example, it may also determine that it is in a flat state (Flat form) when 170°≦θ≦180°. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat state. This state corresponds to a usage form known as a tablet mode.

[0023] [Display mode explanation] Next, display modes according to various usage patterns of the information processing device 10 will be described in detail with reference to FIG. 4 is a diagram showing specific examples of various display modes of the information processing device 10 according to this embodiment. The display mode of the information processing device 10 differs depending on the usage form, which is classified by the opening angle θ between the first housing 101 and the second housing 102, the attitude (orientation) of the information processing device 10, whether it is a single-screen mode or a dual-screen mode, etc. Note that one screen is also called a single screen, and two screens are also called a split screen or dual screen.

[0024] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage pattern. For example, in this closed state, the information processing device 10 is in a standby state such as a sleep state or a hibernation state, and the display 150 is in a display-off state. This standby state such as a sleep state or a hibernation state corresponds to, for example, a system power state S3 or S4 defined by ACPI (Advanced Configuration and Power Interface).

[0025] Display mode (b) is a display mode in which the display 150 is in a bent state (bent form) and in a dual-screen mode in which the screen area of ​​the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, and the display is controlled by dividing the two areas. The orientation of the information processing device 10 is such that the first display area DA1 and the second display area DA2 are arranged horizontally and vertically. A vertically oriented display area means that the longer side of the four sides of the rectangular display area is vertical and the shorter side is horizontal. When the display area is vertically oriented, the display orientation is also vertical, with the direction along the longer side corresponding to the up-down direction and the direction along the shorter side corresponding to the left-right direction. This usage mode is such that the left and right pages of an open book correspond to the left and right screens, and corresponds to a so-called book mode. This usage form is also called "Fold Landscape" because the display is bent, the first display area DA1 and the second display area DA2 are arranged side by side, and the combined display area is horizontally long.

[0026] In this display mode (b), for example, in a normal operating state, the information processing device 10 is in a dual-screen display mode, with the first display area DA1 on the left side serving as the primary screen and the second display area DA2 on the right side serving as the secondary screen. Note that in display mode (b), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and secondary screen may be reversed.

[0027] Display mode (c-1), like display mode (b), is a display mode in which the display 150 is in a bent state (bent form) and in a dual-screen mode in which the screen area of ​​the display 150 is divided into two display areas, a first display area DA1 and a second display area DA2, for display control, but the orientation of the information processing device 10 is different. The orientation of the information processing device 10 is an orientation in which the first display area DA1 and the second display area DA2 are arranged horizontally and vertically one above the other. A horizontal display area orientation refers to an orientation in which the long side of the four sides of the rectangular display area is horizontal and the short side is vertical. When the display area is horizontal, the display orientation is also horizontal, and the direction along the short side corresponds to the up-down direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the common usage modes for clamshell-type PCs.

[0028] In this display mode (c-1), the information processing device 10, for example, in a normal operating state, is in a dual-screen display mode, with the first display area DA1 as the primary screen and the second display area DA2 as the secondary screen. Note that in the display mode (c-1), the correspondence between the first display area DA1 and the second display area DA2 and the primary screen and the secondary screen may be reversed.

[0029] For example, the information processing device 10 automatically switches from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right relative to display mode (b) in the illustrated example, the information processing device 10 switches to display mode (c-1) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the right from the display mode (b) state. Also, since display mode (b) is a state in which the display 150 is rotated 90 degrees to the left relative to display mode (c-1) in the illustrated example, the information processing device 10 switches to display mode (b) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the left from the display mode (c-1) state.

[0030] The display mode (c-2) is similar to the display mode (c-1), in that the information processing device 10 is in the bent state (Bent form) and oriented in the same manner. However, the difference is that an external keyboard 30 (Dockable mini KBD: Keyboard) connectable to the information processing device 10 is connected. This usage mode is a typical usage mode of a clamshell PC with a physical keyboard 30 connected. For example, the keyboard 30 is approximately the same size as the second display area DA2 and is configured to be able to be placed on the second display area DA2. As an example, the keyboard 30 has a magnet on the inside (edge) of the bottom surface. When placed on the second display area DA2, the magnet is attracted to and fixed to a metal portion on the inner edge of the second housing 102. This results in a usage mode similar to that of a conventional clamshell PC that is originally equipped with a physical keyboard. The information processing device 10 and the keyboard 30 are connected via, for example, Bluetooth (registered trademark). In this display mode (c-2), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because the second display area DA2 cannot be seen due to the keyboard. In other words, this display mode (c-2) is a display mode in which only half of the screen is effective for display (hereinafter referred to as "half screen mode"), and is a one-screen mode that uses only the first display area DA1.

[0031] For example, when the information processing device 10 detects connection of an external keyboard in the display mode (c-1), the display mode (c-1) is automatically switched to the display mode (c-2) (Switch by Dock).

[0032] Display mode (d) is in a bent state (Bent form) like display mode (b), and the orientation of the information processing device 10 is also the same, but it is a single-screen mode in which the entire screen area of ​​the display 150 is controlled as a single display area DA. This usage mode differs from display mode (b) in that it is a single-screen mode, but is also called "Fold Landscape" because it is in a bent state (Bent form) and the display area DA is horizontally long. The display area DA is oriented horizontally, and the display orientation is also horizontal.

[0033] Here, switching between the single-screen mode and the dual-screen mode in the bent state (Bent form) can be performed by, for example, a user operation. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single-screen mode and the dual-screen mode somewhere on the screen, and switches from display mode (b) to display mode (d) based on an operation on the operator (Switch by UI).

[0034] Display mode (e) is in a bent state (bent form) like display mode (c-1), and the orientation of the information processing device 10 is also the same, but it is a single-screen mode in which the entire screen area of ​​the display 150 is controlled as a single display area DA. This usage mode differs from display mode (c-1) in that it is a single-screen mode, but it corresponds to the usage mode of a clamshell PC in terms of the bent state (bent form) and the orientation of the information processing device 10. The display area DA is in portrait orientation, and the display orientation is also portrait.

[0035] For example, the information processing device 10 automatically switches from display mode (d) to display mode (e) or from display mode (e) to display mode (d) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since display mode (e) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure, the information processing device 10 switches to display mode (e) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the right from the display mode (d). Also, since display mode (d) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure, the information processing device 10 switches to display mode (d) when it detects that the display 150 has rotated a predetermined angle (e.g., 45 degrees) or more to the left from the display mode (e) state.

[0036] Display mode (d') is a single-screen mode similar to display mode (d), in which the orientation of the information processing device 10 is such that the display area DA is horizontally long, but differs in that it is in a flat state (Flat form). The flat state (Flat form) is a state in which the opening angle θ between the first housing 101 and the second housing 102 is approximately 180°. This usage mode corresponds to the so-called tablet mode described with reference to FIG. 3, and is also referred to as "Flat Landscape" because it is in a flat state (Flat form) and the display area DA is horizontally long. This display mode (d') differs from display mode (d) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to display mode (d), the display area DA is horizontally oriented, and the display orientation is also landscape.

[0037] Display mode (e') is a single-screen mode similar to display mode (e), in which the orientation of the information processing device 10 is such that the display area DA is vertically long, but it differs in that it is in a flat state (Flat form). This usage mode is also called "Flat Portrait" because it is in a flat state (Flat form) and the display area DA is vertically long. This display mode (e') differs from display mode (e) only in the opening angle θ between the first housing 101 and the second housing 102. Like display mode (e), the display area DA is vertically oriented, and the display orientation is also vertical.

[0038] For example, the information processing device 10 automatically switches from display mode (d') to display mode (e') or from display mode (e') to display mode (d') by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e') is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d'), the information processing device 10 switches to display mode (e') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d') state. Also, since the display mode (d') is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e'), the information processing device 10 switches to display mode (d') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e') state.

[0039] Here, switching between the single-screen mode and the dual-screen mode in the flat form can be performed by, for example, a user operation. For example, in the display mode (d') and the display mode (e'), the information processing device 10 can display an operator as a UI capable of switching between the single-screen mode and the dual-screen mode somewhere on the screen, as described above, and the user can operate this operator to switch to the dual-screen mode while remaining in the flat form. For example, when switching from the display mode (d') to the dual-screen mode, the display state in the flat form becomes the same as the display mode (b). Also, when switching from the display mode (e') to the dual-screen mode, the display state in the flat form becomes the same as the display mode (c-1).

[0040] Furthermore, when the information processing device 10 detects connection to the keyboard 30 while in the display mode (e'), it automatically switches from the display mode (e') to the display mode (c-2') (Switch by Dock). The display mode (c-2') is a flat state (Flat form), and differs from the display mode (c-2) only in the opening angle θ between the first housing 101 and the second housing 102. In this display mode (c-2'), the information processing device 10 controls the second display area DA2 to be displayed in black or turned off because it cannot be seen due to the keyboard. In other words, like the display mode (c-2), this display mode (c-2') is a half-screen mode in which only half of the screen is effective for display.

[0041] The information processing device 10 can also automatically switch from the single-screen mode to the dual-screen mode by detecting a change from a flat state (Flat form) to a bent state (Bent form) (Switch by Hinge angle). For example, when the information processing device 10 detects a change from the display mode (d') to the bent form based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (d') to the display mode (b). When the information processing device 10 detects a change from the display mode (e') to the bent form based on the hinge angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (e') to the display mode (c-1).

[0042] Furthermore, information processing device 10 has a function of arranging application windows in desired display areas within a screen area (so-called snap display), in addition to switching between display modes such as the single-screen mode and dual-screen mode described above. For example, information processing device 10 displays controls as a UI (User Interface) that allows a user to select in which display area within the screen area of ​​display 150 a window is to be laid out, and displays the window in the display area selected by the user based on the user's operation of the controls. Hereinafter, the UI that allows a user to select the display area in which to lay out the window is referred to as a "layout selection icon."

[0043] The layout of the display area selectable by operating the layout selection icon is a layout for the entire screen area (display area DA) of display 150, regardless of whether the display mode described with reference to Fig. 4 is the single-screen mode or the dual-screen mode. In the half-screen mode, half of the screen area of ​​display 150 is the effective screen area, so the layout is for this half area.

[0044] [Example of layout selection icon] Next, a specific example of the layout selection icon will be described. 5A and 5B are diagrams showing examples of layout selection icons according to this embodiment. Fig. 5A shows an example of a layout selection icon L1 that is displayed when the usage mode is "Portrait (or Clamshell)" (display mode (c-1), display mode (e), display mode (e'), etc.).

[0045] In the layout selection icon L1, the portion indicated by the symbol R11 is a layout in which the entire screen area of ​​the display 150 is used as a single display area, and the entire screen area can be selected as the display area in which to place a window. The portion indicated by the symbol R12 is a layout in which the screen area is divided into two, vertically, and either the upper or lower display area within the screen area can be selected as the display area in which to place a window. The portions indicated by the symbols R13 and R14 are layouts in which the screen area is divided into three. The portion indicated by the symbol R13 is a layout in which the lower display area, which is obtained by dividing the screen area into two, vertically, is further divided into two, horizontally. The portion indicated by the symbol R14 is a layout in which the upper display area, which is obtained by dividing the screen area into two, vertically, is further divided into two, horizontally. The portions indicated by the symbols R13 and R14 are layouts in which any of the three display areas can be selected as the display area in which to place a window.

[0046] For example, when the usage mode is "Portrait (or Clamshell)," the user drags a window, causing a layout selection icon L1 to be displayed. As shown in the figure, when the dragging cursor CA is placed over the upper area of ​​the layout, which divides the screen area indicated by the reference symbol R12 into two, the display area corresponding to the upper area is selected. The display mode (color, brightness, etc.) of the selected area within the layout selection icon L1 is changed. When the dragging operation is completed, the window is displayed in the selected upper display area.

[0047] FIG. 5B shows an example of a layout selection icon L2 that is displayed when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d'), etc.).

[0048] In the layout selection icon L2, the portion indicated by reference symbol R21 is a layout in which the entire screen area of ​​the display 150 is used as a single display area, and the entire screen area can be selected as the display area in which to place a window. The portion indicated by reference symbol R22 is a layout in which the screen area is divided into two, left and right, and either the left display area or the right display area within the screen area can be selected as the display area in which to place a window. The portions indicated by reference symbols R23 and R24 are layouts in which the screen area is divided into three. The portion indicated by reference symbol R23 is a layout in which the screen area is divided into two, left and right, and the right display area is further divided into two, top and bottom. The portion indicated by reference symbol R24 is a layout in which the screen area is divided into two, left and right, and the left display area is further divided into two, top and bottom. The portions indicated by reference symbols R23 and R24 are layouts in which any of the three display areas can be selected as the display area in which to place a window.

[0049] For example, when the usage mode is "Landscape," the user drags a window, causing the layout selection icon L2 to be displayed. As shown in the figure, when the dragging cursor CA is placed over the upper right area of ​​the layout, which divides the screen area indicated by the reference symbol R23 into three, the display area corresponding to the upper right area is selected. The display mode (color, brightness, etc.) of the selected area within the layout selection icon L2 is changed. When the dragging operation is completed, the window is displayed in the selected upper right display area.

[0050] [Connection configuration with external display] The information processing device 10 can also be used by connecting it to an external display. FIG. 6 is a diagram showing an example of a configuration in which an information processing device 10 according to this embodiment is connected to an external display. The information processing device 10 is connected to an external display device 20 (display device). Any connection method using HDMI (registered trademark), USB Type-C, DisplayPort, or the like can be applied. Note that the information processing device 10 may be connected to the external display device 20 wirelessly. The external display device 20 is configured to include a display 250 as an external display. In contrast to the external display, the display 150 of the information processing device 10 is a built-in display.

[0051] When information processing device 10 is connected to external display device 20 and controls display on multiple screen areas (multiple screen areas that do not overlap each other) including the screen area of ​​the built-in display and the screen area of ​​the external display, information processing device 10 can use the layout selection icon described with reference to Figure 5 to display windows on both the screen area of ​​the built-in display and the screen area of ​​the external display.

[0052] For example, information processing device 10 can display a window displayed in the screen area of ​​the built-in display in any of the display areas in each layout within the screen area of ​​the built-in display, or in any of the display areas in each layout of the external display. Similarly, information processing device 10 can display a window displayed in the screen area of ​​the external display in any of the display areas in each layout of the external display, or in any of the display areas in each layout within the screen area of ​​the built-in display.

[0053] When information processing device 10 is connected to external display device 20, before displaying the layout selection icon shown in Fig. 5, information processing device 10 displays a UI as an operator for selecting whether the built-in display or the external display is to be used as the screen area on which the window is to be displayed. This UI will be referred to as the "display selection icon" below.

[0054] [Example of display selection icon] 7 is a diagram showing an example of the display of a display selection icon according to this embodiment. When a drag operation is started on a window W displayed on the built-in display (display 150) or the external display (display 250), a display selection icon G1 is displayed near the position of the cursor CA used for the drag operation. This diagram shows an example when a drag operation is started on a window W displayed on the built-in display (display 150). The display position of this display selection icon G1 remains unchanged even when the cursor CA is moved by the drag operation.

[0055] The display selection icon G1 includes an internal display icon G11 corresponding to the screen area of ​​the internal display, and an external display icon G12 corresponding to the screen area of ​​the external display. The internal display icon G11 and the external display icon G12 are displayed with different designs (patterns, pictures) that imitate the types of their respective displays. That is, the internal display icon G11 is designed to imitate the internal display provided in the information processing device 10 (for example, a notebook PC). On the other hand, the external display icon G12 is designed to imitate the shape of the external display device 20. This makes it intuitively clear which icon is for selecting the internal display and which icon is for selecting the external display when using the display selection icon G1 to select the display destination (screen area), providing good operability.

[0056] Furthermore, the display manner (e.g., the icon color (background color)) of the built-in display icon G11 and the external display icon G12 differs depending on whether the icon corresponds to the screen area where the drag operation started. For example, in the illustrated example, the background color of the built-in display icon G11 corresponding to the screen area where the drag operation started is blue, while the background color of the external display icon G12 outside the screen area where the drag operation started is gray.

[0057] Here, the types of display modes of the display selection icon G1 that change depending on conditions will be described with reference to FIG. FIG. 8 is a diagram showing a list of display modes of the display selection icon according to this embodiment.

[0058] (A1) to (A4) show examples of the display mode of the built-in display icon G11, and (B1) to (B4) show examples of the display mode of the external display icon G12. As mentioned above, the built-in display icon G11 and the external display icon G12 have different designs (patterns, pictures) that imitate the types of their respective displays.

[0059] The built-in display icon G11 changes to one of four display modes (A1), (A2), (A3), and (A4) depending on whether the display (screen area) where the drag operation was started is the display where the icon is selected. Here, the state where the built-in display icon G11 is selected is, for example, a state where the cursor CA being dragged is hovered over the built-in display icon G11. When the cursor CA being dragged does not hover over the built-in display icon G11 (not hovered), the built-in display icon G11 is in an unselected state.

[0060] (A1) shows an example of the display when a drag operation is started on a display other than the built-in display (here, an external display) and no selection is made (not hovered), for example, with a dark gray background color. (A2) shows an example of the display when a drag operation is started on a display other than the built-in display (here, an external display) and selection is made (hovered), for example, with a light gray background color.

[0061] (A3) shows an example of the display when a drag operation is started on the built-in display but no selection is made (not hovered), for example, with a dark blue background color. (A4) shows an example of the display when a drag operation is started on the built-in display but selection is made (hovered), for example, with a light blue background color.

[0062] Similarly, the external display icon G12 changes into four display modes (B1), (B2), (B3), and (B4) depending on whether it is the display (screen area) where the drag operation started and whether it is selected. Here, the state in which the external display icon G12 is selected is, for example, a state in which the cursor CA being dragged is hovered over the external display icon G12. When the cursor CA being dragged does not hover over the external display icon G12 (not hover), the external display icon G12 is in an unselected state.

[0063] (B1) shows an example of the display mode when a drag operation is started on a display other than the external display (here, the built-in display) and no selection is made (not hovered), for example, with a dark gray background color. (B2) shows an example of the display mode when a drag operation is started on a display other than the external display (here, the built-in display) and selection is made (hovered), for example, with a light gray background color.

[0064] (B3) shows an example of the display mode when a drag operation is started on the external display and no selection is made (not hovered), for example, with a dark blue background color. (B4) shows an example of the display mode when a drag operation is started on the external display and a selection is made (hovered), for example, with a light blue background color.

[0065] In this way, when selecting the display on which to display a window from the built-in display and the external display, the designs (pattern, design) of the built-in display icon G11 and the external display icon G12 to be selected are different, and the display manner (for example, background color) of the icon on the display on which the drag operation was started is different from that of the icons on the other displays, so it is intuitively easy to understand which display each icon corresponds to, and operability is good.

[0066] 9 is a diagram showing an example of the display when a display selection icon according to this embodiment is selected. By placing the cursor CA being dragged over either the built-in display icon G11 or the external display icon G12 of the display selection icon G1 displayed by starting a drag operation on the window W described with reference to FIG. 7, it is possible to select the built-in display or the external display.

[0067] As shown in the figure, when the dragging cursor CA is hovered over the built-in display icon G11, the built-in display (display 150) is selected. Furthermore, when the built-in display is selected, layout selection icons are displayed that allow the user to select the display area for each layout within the screen area of ​​the built-in display. The layout selection icon displayed is either layout selection icon L1 or layout selection icon L2, depending on whether the current usage mode is "Portrait (or Clamshell)" or "Landscape." Here, layout selection icon L1, which is displayed in "Portrait (or Clamshell)," is shown as an example. By selecting a display area for one of the layouts with this layout selection icon L1, as shown in FIG. 5, the window being dragged is displayed in the display area of ​​the selected layout.

[0068] When the external display icon G12 is selected (hovered), the layout selection icon displayed is layout selection icon L1 if the aspect ratio of the external display screen is portrait, and layout selection icon L2 if the aspect ratio is landscape. If the external display has a rotation function, the displayed layout selection icon will also change if the aspect ratio of the screen changes due to rotation.

[0069] Furthermore, even if an external display is not connected and only a built-in display is used, when a drag operation is performed on an application window, a display selection icon G1 that includes only the built-in display icon G11 out of the built-in display icon G11 and external display icon G12 shown in Fig. 7 may be displayed. If the layout selection icon L1 or layout selection icon L2 is displayed directly without displaying the display selection icon G1 at the time the drag operation is started, a relatively large area will be occupied within the screen area, but because there are cases where the user simply wants to move the window, it is advantageous to initially occupy a smaller area as this makes it easier to avoid erroneous operations (unintentional snapping).

[0070] Here, the snap function for arranging the above-mentioned application window in a desired display area within the screen area is realized by executing a specific application program running on the OS, but the OS may also have a similar snap function. The OS's snap function also displays icons (hereinafter referred to as "display position selection icons" to distinguish them from layout selection icons) that allow selection of a display area in which to display windows similar to the layout selection icons L1 and L2. Therefore, in this embodiment, when the OS's snap function displays a display position selection icon, control is performed so that the display selection icon and layout selection icon are not displayed overlappingly.

[0071] For example, as shown in FIG. 9, assume that the dragged cursor CA (operation position) moves toward a first region R1 (in the direction indicated by the dashed arrow) above the screen area of ​​the display 150 in response to a user operation. Then, when the dragged cursor CA reaches the first region R1, the display selection icon G1 and the layout selection icon L1 are no longer displayed. Here, the first region R1 is set corresponding to an area used by the OS's snap function. The first region R1 is set in advance corresponding to an area where the display position selection icon is displayed by the OS's snap function in response to the arrival of the dragged cursor CA. The display position selection icon is an icon that allows the user to select a display area in which to display a window within the screen area of ​​the display 150.

[0072] 10 is a diagram showing an example of a display when the operation position due to a drag operation according to this embodiment reaches the first region R1. As shown in the figure, when the dragged cursor CA reaches the first region R1, a display position selection icon LW is displayed by the OS's snap function. At this time, the display selection icon G1 and layout selection icon L1 that were displayed in FIG. 9 are no longer displayed. As a result, when the display position selection icon LW is displayed by the OS's snap function, the display selection icon G1 and layout selection icon L1 are not displayed, and similar functions are not mixed together, resulting in improved operability.

[0073] In addition, after the display position selection icon LW is displayed by the snap function of the OS, when the cursor CA being dragged moves away from the display position selection icon LW and a certain time has passed, the display position selection icon LW is hidden by the snap function of the OS.

[0074] 11 is a diagram showing an example of an area for determining whether the operation position by the drag operation according to this embodiment has moved away from the display position selection icon LW. The illustrated second area R2, like the first area R1, is set to correspond to an area used by the OS snap function. The second area R2 is set in advance to correspond to an area in which the display of the display position selection icon LW is maintained when the display of the display position selection icon LW is stopped as the cursor CA being dragged moves away from the display position selection icon LW after the display position selection icon LW is displayed by the OS snap function.

[0075] For example, the second region R2 includes the first region R1 and is set as a region wider than the first region R1. As an example, the second region R2 is a region that is set as a wide region a certain distance outside the range in which the display position selection icon LW is displayed.

[0076] 11, assume that the cursor CA being dragged is moved (in the direction indicated by the dashed arrow) outside the second region R2 below the screen area of ​​the display 150 in response to a user operation. An example of the display when the cursor CA being dragged moves out of the second region R2 is shown in FIG.

[0077] 12 is a diagram showing a display example when the drag operation position according to this embodiment moves outside the second region R2. As shown in FIG. 12, when the dragging cursor CA moves outside the second region R2, the display position selection icon LW displayed by the OS's snap function in FIG. 11 is hidden. At this time, the display selection icon G1 and layout selection icon L1, which had been hidden when the dragging cursor CA reached the first region R1, are displayed again. As a result, when the display position selection icon LW by the OS's snap function is hidden, the display selection icon G1 and layout selection icon L1 are displayed again, which improves operability by preventing similar functions from being mixed together.

[0078] Although FIG. 7 and FIGS. 9 to 12 show examples of display on the built-in display (display 250), the display on the external display (display 250) is similar.

[0079] [Configuration of information processing device] The specific configuration of the information processing device 10 will be described below. 13 is a block diagram showing an example of the hardware configuration of an information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a speaker 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a Hall sensor 17, a control unit 18, and an external connection terminal 19. These units are connected to each other so as to be able to communicate with each other via a bus or the like.

[0080] The communication unit 11 includes, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), and a communication device that performs wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). For example, the communication unit 11 can communicate with the aforementioned external keyboard 30 or the like using Bluetooth (registered trademark).

[0081] In the RAM 12, programs and data for processes executed by the control unit 18 are loaded, and various data is saved or erased as appropriate. For example, the RAM 12 also functions as a video memory (V-RAM) for display on the display 150. As an example, the RAM 12 functions as a video memory for data displayed in each display area within the screen area of ​​the display 150 (or the display 250 when the external display device 20 is connected). The RAM 12 also stores information about running apps, apps in use (active window apps) among the running apps, information about other inactive window apps, the display area in which each window is displayed, the layer in which each window is located, the size of the window, whether it is minimized, and the like. Note that the RAM 12 is a volatile memory, and therefore does not retain data when power supply to the RAM 12 is stopped. Data that needs to be retained when power supply to the RAM 12 is stopped is transferred to the storage unit 13.

[0082] The storage unit 13 is configured to include one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Residual Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores programs and setting data for a BIOS (Basic Input Output System), an OS (Operating System), programs for applications that run on the OS, and various data used by the applications. The speaker 14 outputs electronic sounds, voices, and the like.

[0083] The display unit 15 includes a display 150 and a touch sensor 155. As described above, the display 150 is a flexible display that can be bent to match the opening angle θ resulting from the relative rotation of the first housing 101 and the second housing 102. The display 150 performs display corresponding to each display mode described with reference to FIG. 4 under the control of the control unit 18. The touch sensor 155 is provided on the screen of the display 150 and detects touch operations on the screen. For example, in the single-screen mode, the touch sensor 155 detects touch operations on the display area DA. In addition, in the dual-screen mode, the touch sensor 155 detects touch operations on one or both of the first display area DA1 and the second display area DA2. Touch operations include tap operations, slide operations, flick operations, swipe operations, and pinch operations. The touch sensor 155 detects the touch operations and outputs operation information based on the detected operations to the control unit 18.

[0084] The camera 16 includes a lens, an imaging element, etc. The camera 16 captures an image (a still image or a moving image) according to the control of the control unit 18, and outputs data of the captured image.

[0085] First acceleration sensor 161 is provided inside first housing 101 and detects the orientation and changes in orientation of first housing 101. For example, if the direction parallel to the longitudinal direction of first display area DA1 is defined as the X1 direction, the direction parallel to the lateral direction is defined as the Y1 direction, and the direction perpendicular to the X1 and Y1 directions is defined as the Z1 direction, first acceleration sensor 161 detects acceleration in each of the X1, Y1, and Z1 directions and outputs the detection results to control unit 18.

[0086] The second acceleration sensor 162 is provided inside the second housing 102 and detects the orientation and changes in orientation of the second housing 102. For example, if the direction parallel to the longitudinal direction of the second display area DA2 is the X2 direction, the direction parallel to the lateral direction is the Y2 direction, and the direction perpendicular to the X2 and Y2 directions is the Z2 direction, the second acceleration sensor 162 detects acceleration in each of the X2, Y2, and Z2 directions and outputs the detection results to the control unit 18.

[0087] The Hall sensor 17 is provided to detect the connection of the keyboard 30. For example, when the keyboard 30 is placed on the second display area DA2 of the second housing 102, a magnet provided inside the bottom surface of the keyboard 30 approaches, changing the magnetic field, and changing the detection value (output value) of the Hall sensor 17. In other words, the Hall sensor 17 outputs a different detection result depending on whether the keyboard 30 is placed. Note that, although the Hall sensor 17 is used to detect whether the keyboard 30 is placed here, the detection method is not limited to this, and any detection method can be used.

[0088] The external connection terminal 19 is a connection terminal for connecting to an external display device 20 (external display). For example, the external connection terminal 19 is an HDMI (registered trademark) terminal, a USB Type-C terminal, a display port, etc. Note that the information processing device 10 and the external display device 20 may be connected wirelessly.

[0089] Control unit 18 is configured to include processors such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and a microcomputer, and realizes various functions by executing programs (various programs such as a BIOS, an OS, and applications running on the OS) stored in storage unit 13, etc. For example, control unit 18 detects the attitude (orientation) of information processing device 10 based on the detection results of first acceleration sensor 161 and second acceleration sensor 162. Furthermore, control unit 18 detects whether information processing device 10 is in an open state or a closed state, and if in an open state, whether it is in a bent state (bent form) or a flat state (flat form), based on the detection results of first acceleration sensor 161 and second acceleration sensor 162.

[0090] Furthermore, the control unit 18 detects a connection with the keyboard 30 based on the detection result of the hall sensor 17. Note that this connection with the keyboard 30 refers to the placement of the keyboard 30 on the second display area DA2, and does not refer to a communication connection. The control unit 18 detects the communication connection with the keyboard 30 using a function such as Bluetooth (registered trademark).

[0091] In addition, the control unit 18 controls the display of the display 150 described with reference to FIG. 4 by detecting the system state, the attitude (orientation) of the information processing device 10, whether it is in an open state or a closed state, and if it is in an open state, whether it is in a bent state (bent form) or a flat state (flat form), connection with the keyboard 30, etc.

[0092] Furthermore, by dragging a window displayed on display 150 (built-in display) or display 250 (external display), control unit 18 displays display selection icons or layout selection icons for selecting the display destination and screen layout of the window (see FIGS. 5 to 9). Furthermore, control unit 18 controls the stopping and restarting of the display of the display selection icons and layout selection icons according to the operation position by the drag operation within the screen area so that the display selection icons or layout selection icons are not displayed overlapping with the display position selection icons LW (see FIGS. 10 and 11) displayed by the snap function of the OS (see FIGS. 9 to 12).

[0093] Next, a detailed description will be given of a display layout change process that changes the display destination and layout of a window using a display selection icon and a layout selection icon among the processes executed by control unit 18. Note that in the following description, as shown in Fig. 6, information processing device 10 will be described as controlling the display on the built-in display and the external display in a configuration connected to external display device 20. Note that when not connected to external display device 20, only the built-in display icon G11 is included in display selection icon G1, which is different from the case where only the built-in display is selected.

[0094] 14 is a block diagram showing an example of a functional configuration related to the display layout change processing of the information processing device 10 according to this embodiment. The control unit 18 includes a display selection icon display processing unit 181, a display selection processing unit 182, a layout selection icon display processing unit 183, a layout selection processing unit 184, a display layout change unit 185, and an icon display control unit 186 as functional configurations in which the CPU executes processing based on the OS or a program running on the OS.

[0095] The display selection icon display processing unit 181 performs a process for displaying display selection icons. For example, when a drag operation is received on a window displayed in at least one of the screen area of ​​the built-in display and the screen area of ​​the external display, the display selection icon display processing unit 181 displays a display selection icon G1 in the screen area where the drag operation was started (see FIG. 7). The display selection icon G1 includes a built-in display icon G11 corresponding to the screen area of ​​the built-in display and an external display icon G12 corresponding to the screen area of ​​the external display.

[0096] For example, the display selection icon display processing unit 181 displays the built-in display icon G11 and the external display icon G12 in different designs that resemble the respective types of displays (see FIGS. 7 and 8).

[0097] Furthermore, the display selection icon display processing unit 181 differentiates the display mode of the icon corresponding to the screen area where the drag operation has started, either the built-in display icon G11 or the external display icon G12, from that of other icons. For example, the display selection icon display processing unit 181 differentiates the color (e.g., background color) of the icon corresponding to the screen area where the drag operation has started, either the built-in display icon G11 or the external display icon G12, from that of the other icons (see FIGS. 7 and 8).

[0098] In addition, the display selection icon display processing unit 181 changes the display mode when the built-in display icon G11 is selected by a drag operation and when it is not selected, and when the external display icon G12 is selected by a drag operation and when it is not selected (see FIG. 8).

[0099] For example, if the icon corresponding to the screen area where the drag operation has started is the built-in display icon G11, the display selection icon display processing unit 181 changes the background color of the built-in display icon G11 to blue and the background color of the external display icon G12 to gray. At this time, the display selection icon display processing unit 181 changes the background color of the built-in display icon G11 to, for example, dark blue when the drag operation has started (when not selected), and to, for example, light blue when selected. Furthermore, the display selection icon display processing unit 181 changes the background color of the external display icon G12 to, for example, dark gray when the drag operation has started (when not selected), and to, for example, light gray when selected.

[0100] Furthermore, for example, if the icon corresponding to the screen area where the drag operation has started is the external display icon G12, the display selection icon display processing unit 181 changes the background color of the external display icon G12 to blue and the background color of the built-in display icon G11 to gray. At this time, the display selection icon display processing unit 181 changes the background color of the external display icon G12 to, for example, dark blue when the drag operation has started (when not selected), and to, for example, light blue when selected. Furthermore, the display selection icon display processing unit 181 changes the background color of the built-in display icon G11 to, for example, dark gray when the drag operation has started (when not selected), and to, for example, light gray when selected.

[0101] The display selection processing unit 182 selects the screen area corresponding to the icon selected by the drag operation, either the built-in display icon G11 or the external display icon G12, as the screen area where the dragged window is to be displayed.

[0102] Layout selection icon display processing unit 183 newly displays a layout selection icon that allows selection of a display area in which to display a window within the screen area selected by display selection processing unit 182 (see FIG. 9). For example, when the usage mode is "Portrait (or Clamshell)", layout selection icon display processing unit 183 displays layout selection icon L1 shown in FIG. 5(A), and when the usage mode is "Landscape", layout selection icon L2 shown in FIG. 5(B).

[0103] Layout selection processing unit 184 selects the display area selected by a drag operation on the layout selection icon as the display area for the window being dragged.

[0104] In response to the end of the drag operation on the window, the display layout change unit 185 changes the display position of the window to the display area selected by the layout selection processing unit 184 within the screen area of ​​the display selected by the display selection processing unit 182.

[0105] The icon display control unit 186 performs a display stop process to stop the display of the display selection icon by the display selection icon display processing unit 181 and the display by the layout selection icon display processing unit 183, and a display restart process to restart the stopped display.

[0106] For example, the icon display control unit 186 performs the above-described display cancellation process in response to the operation position (e.g., the position of the cursor CA) resulting from a drag operation on a window reaching the first region R1 within the screen region of the display 150 (or the display 250) (see FIGS. 9 and 10). When only the display selection icon is displayed, the icon display control unit 186 cancels the display of the display selection icon in response to the operation position (e.g., the position of the cursor CA) resulting from the drag operation reaching the first region R1. Furthermore, when the display selection icon and the layout selection icon are displayed, the icon display control unit 186 cancels the display of the display selection icon and the layout selection icon in response to the operation position (e.g., the position of the cursor CA) resulting from the drag operation reaching the first region R1.

[0107] Furthermore, after performing the above-mentioned display stop processing, the icon display control unit 186 performs the above-mentioned display resume processing in response to the operation position (e.g., the position of the cursor CA) caused by the drag operation on the window moving out of the second region R2 within the screen region of the display 150 (or the display 250) (see FIGS. 11 and 12). For example, if only the display selection icon was displayed before performing the above-mentioned display stop processing, the icon display control unit 186 resumes display of the display selection icon in response to the operation position (e.g., the position of the cursor CA) caused by the drag operation moving out of the second region R2. Furthermore, if the display selection icon and the layout selection icon were displayed before performing the above-mentioned display stop processing, the icon display control unit 186 resumes display of the display selection icon and the layout selection icon in response to the operation position (e.g., the position of the cursor CA) caused by the drag operation moving out of the second region R2.

[0108] [Display layout change process] Next, the operation of the display layout change process executed by the control unit 18 will be described. FIG. 15 is a flowchart showing an example of the display layout change process according to this embodiment.

[0109] (Step S101) When the control unit 18 receives that a drag operation on a window displayed in the screen area of ​​the built-in display or the external display has started, the process proceeds to step S103.

[0110] (Step S103) The control unit 18 determines whether or not the operation position (for example, the position of the cursor CA) resulting from the drag operation has reached the first region R1. If the control unit 18 determines that the operation position resulting from the drag operation has not reached the first region R1 (NO), the control unit 18 proceeds to the processing of step S105. On the other hand, if the control unit 18 determines that the operation position resulting from the drag operation has reached the first region R1 (YES), the control unit 18 proceeds to the processing of step S121.

[0111] (Step S105) The control unit 18 displays a display selection icon G1 in the screen area of ​​the built-in display or the external display on which the drag operation was started (see FIG. 7). For example, the control unit 18 displays the built-in display icon G11 and the external display icon G12 included in the display selection icon G1 with different designs (patterns, pictures) that imitate the types of the respective displays (see FIG. 7). Then, the process proceeds to step S107.

[0112] (Step S107) Control unit 18 determines whether a display has been selected by a drag operation on display selection icon G1. If control unit 18 determines that a display has not been selected (NO), the process proceeds to step S109. On the other hand, if control unit 18 determines that a display has been selected (YES), control unit 18 selects the display corresponding to the selected icon, either built-in display icon G11 or external display icon G12, included in display selection icon G1, as the display on which the dragged window will be displayed. Then, the process proceeds to step S111.

[0113] (Step S109) The control unit 18 determines whether or not the operation position (for example, the position of the cursor CA) resulting from the drag operation has reached the first region R1. If the control unit 18 determines that the operation position resulting from the drag operation has not reached the first region R1 (NO), the control unit 18 returns to the processing of step S107. On the other hand, if the control unit 18 determines that the operation position resulting from the drag operation has reached the first region R1 (YES), the control unit 18 proceeds to the processing of step S121.

[0114] (Step S111) The control unit 18 changes the display mode of the icon selected in step S107. For example, the control unit 18 changes the background color of the icon selected from the built-in display icon G11 and the external display icon G12 from dark blue to light blue, or from dark gray to light gray (see FIG. 8). Then, the process proceeds to step S113.

[0115] (Step S113) Control unit 18 newly displays a layout selection icon that allows selection of a display area in which to display a window within the screen area of ​​the display selected in step S107 (see FIG. 9). For example, when the usage mode is "Portrait (or Clamshell)", control unit 18 displays layout selection icon L1 shown in FIG. 5(A), and when the usage mode is "Landscape", control unit 18 displays layout selection icon L2 shown in FIG. 5(B). Then, the process proceeds to step S115.

[0116] (Step S115) The control unit 18 determines whether a layout (display area) has been selected by a drag operation on the layout selection icon L1 or L2. For example, the control unit 18 determines that a layout (display area) has been selected when the user places the cursor CA (operation position) of the drag operation over any of the display areas included in the layout selection icon L1 or L2. On the other hand, the control unit 18 determines that a layout (display area) has not been selected when the cursor CA (operation position) of the drag operation does not overlap any of the display areas included in the layout selection icon L1 or L2.

[0117] If control unit 18 determines that a layout (display area) has not been selected (NO), the process proceeds to step S117. On the other hand, if control unit 18 determines that a layout (display area) has been selected (YES), control unit 18 selects the display area selected by the drag operation on the layout selection icon as the display area for the dragged window, and proceeds to step S119.

[0118] (Step S117) The control unit 18 determines whether or not the operation position (for example, the position of the cursor CA) resulting from the drag operation has reached the first region R1. If the control unit 18 determines that the operation position resulting from the drag operation has not reached the first region R1 (NO), the control unit 18 returns to the processing of step S115. On the other hand, if the control unit 18 determines that the operation position resulting from the drag operation has reached the first region R1 (YES), the control unit 18 proceeds to the processing of step S121.

[0119] (Step S119) The control unit 18 changes the display mode (color, brightness, etc.) of the display area in the layout selection icon selected in step S111 (see FIG. 5), and then proceeds to the processing of step S127.

[0120] (Step S121) If the display selection icon G1 and the layout selection icon L1 or L2 are displayed, the control unit 18 stops displaying them. For example, if the control unit 18 determines in step S109 that the operation position due to the drag operation has reached the first region R1, only the display selection icon G1 is displayed, so the control unit 18 stops displaying the display selection icon G1 and hides it. Also, if the control unit 18 determines in step S117 that the operation position due to the drag operation has reached the first region R1, both the display selection icon G1 and the layout selection icon L1 or L2 are displayed, so the control unit 18 stops displaying both the display selection icon G1 and the layout selection icon L1 or L2 and hides them. Note that if the control unit 18 determines in step S103 that the operation position due to the drag operation has reached the first region R1, the control unit 18 would normally display the display selection icon G1 in response to the start of the drag operation on the window in step S101, but stops displaying it and hides it (does not display the display selection icon G1). Then, the process proceeds to step S123.

[0121] (Step S123) The control unit 18 determines whether the operation position (for example, the position of the cursor CA) caused by the drag operation has moved outside the second region R2. If the control unit 18 determines that the operation position caused by the drag operation has not moved outside the second region R2 (NO), the control unit 18 continues to stop displaying the display selection icon G1 and the layout selection icon L1 or L2, and performs the processing of step S123 again. On the other hand, if the control unit 18 determines that the operation position caused by the drag operation has moved outside the second region R2 (YES), the control unit 18 proceeds to the processing of step S125.

[0122] (Step S125) The control unit 18 resumes displaying the display selection icon G1, and returns to the processing of step S107.

[0123] (Step S127) The control unit 18 determines whether the drag operation has ended while a layout (display area) has been selected by dragging the layout selection icon. If the control unit 18 determines that the drag operation has not ended (NO), the process returns to step S115. On the other hand, if the control unit 18 determines that the drag operation has ended (YES), the process proceeds to step S129.

[0124] (Step S129) Control unit 18 changes the display position of the window for which the drag operation has been completed to the layout (display area) within the screen area of ​​the selected display, and ends the display layout change process. Note that when changing the display position of the window, control unit 18 ends (hides) the display of display selection icon G1 and layout selection icon L1 or L2 that had been displayed.

[0125] [Summary of the embodiment] As described above, the information processing device 10 according to this embodiment controls display on one or more displays (for example, either one or both of the built-in display (display 150) and the external display (display 250)). The information processing device 10 includes a storage unit 13 (an example of a memory) that stores an OS (an example of a system) program and application programs, and a control unit 18 (an example of a processor such as a CPU, GPU, or microcomputer) that executes the OS program and the application program stored in the storage unit 13 to control display of application windows on the displays. When the control unit 18 receives a drag operation on a window displayed on a display, the control unit 18 performs a first display process of displaying display selection icons G1 (an example of a first icon) corresponding to each of the one or more displays in the screen area of ​​the display on which the drag operation was initiated. The control unit 18 also performs a first selection process of selecting a display corresponding to an icon selected by the drag operation from among the display selection icons G1 corresponding to each of the one or more displays as the display on which the dragged window is to be displayed. Furthermore, the control unit 18 performs a second display process of displaying a layout selection icon L1 or L2 (an example of a second icon) that allows selection of a display area in which a window is to be displayed within the screen area of ​​the display selected by the first selection process. Furthermore, the control unit 18 performs a display stop process of stopping the display of the display selection icon G1 through the first display process and the display of the layout selection icon L1 or L2 through the second display process in response to the operation position by the drag operation reaching a predetermined first area R1 within the screen area of ​​the display. Furthermore, after stopping the display of the display selection icon G1 and the display of the layout selection icon L1 or L2 through the second display process in the display stop process, the control unit 18 performs a display resume process of restarting the display of the display selection icon G1 through the first display process and the display of the layout selection icon L1 or L2 through the second display process in response to the operation position by the drag operation moving out of the second area R2 including the first area R1 within the screen area of ​​the display.

[0126] As a result, the information processing device 10 can suspend or resume the display of the display selection icon G1 and the layout selection icon L1 or L2 depending on the operation position of the drag operation relative to the window, thereby preventing overlapping and simultaneous display with the display position selection icon LW displayed by the OS's snap function depending on the operation position of the drag operation. Therefore, the information processing device 10 does not mix displays of similar functions, allowing the user to use the displayed function without hesitation, improving operability. Therefore, the information processing device 10 can improve operability when selecting an arbitrary display area from the screen area of ​​the display as the display destination.

[0127] For example, the first region R1 and the second region R2 are set to correspond to regions within the screen area of ​​the display that are used by OS functions. The first region R1 is set to correspond to a region where a display position selection icon LW (an example of a third icon) that allows a user to select a display area in which a window is to be displayed within the screen area of ​​the display by a snap function of the OS in response to the arrival of an operation position by a drag operation. The second region R2 is set to correspond to a region where the display of the display position selection icon LW is maintained after the display of the display position selection icon LW is stopped in response to the operation position by a drag operation moving away from the display position selection icon LW.

[0128] This allows the information processing device 10 to not display the display selection icon G1 and the layout selection icon L1 or L2 only while the display position selection icon LW is being displayed by the snap function of the OS.

[0129] Furthermore, since the information processing device 10 controls based on the operation position of the drag operation within the screen area of ​​the display, it can stop and resume displaying the display selection icon G1 and the layout selection icon L1 or L2 even if it cannot receive control information from the OS for displaying or hiding the display position selection icon LW using the OS's snap function.

[0130] For example, the second region R2 is set to be larger than the first region R1.

[0131] As a result, in a case where hysteresis is provided between the operation position of the drag operation at which the display position selection icon LW is displayed and the operation position at which the drag operation is hidden by the OS snap function, the information processing device 10 can perform control by providing similar hysteresis to the operation position at which the display of the display selection icon G1 and the layout selection icon L1 or L2 is stopped and the operation position at which it is resumed.

[0132] The first region R1 and the second region R2 may be set as the same region.

[0133] As a result, when there is no hysteresis between the drag operation position where the display position selection icon LW is displayed and the drag operation position where it is hidden by the OS snap function, the information processing device 10 can perform control without hysteresis between the operation position where the display selection icon G1 and the layout selection icon L1 or L2 are stopped and the operation position where it is resumed.

[0134] The settings of the first area R1 or the second area R2 may differ depending on the type of input device used by the user to perform the drag operation. Examples of the input device include a mouse, pointing device, touch panel, and touch pad. For example, the user's operational feel when moving the operation position by dragging differs depending on whether the cursor CA is moved with a mouse or the like or when a finger is moved on a touch panel. Therefore, the settings of the first area R1 or the second area R2 may differ.

[0135] This allows the information processing device 10 to change the size of the first area R1 or the second area R2 in accordance with the snap function of the OS when the operation position is moved by a drag operation, whether it is by moving the cursor CA with a mouse or by moving a finger on a touch panel.

[0136] Furthermore, the settings of the first region R1 or the second region R2 may differ depending on the screen size of the display.

[0137] As a result, in the information processing device 10, for example, when the screen size of the display is large and the icons to be displayed are also large, the first region R1 or the second region R2 can also be set to be large.

[0138] Furthermore, the control unit 18 may perform a tracking process to track the movement of the operation position due to the drag operation, and may control whether or not to perform the display stop process based on the number of times the operation position due to the drag operation has reached the first region R1 or gone outside the second region R2. For example, the control unit 18 may

[0139] As a result, even if the control of display / hide of the display position selection icon LW by the OS's snap function differs depending on whether the starting position of the drag operation is inside or outside the first area R1 or the second area R2, or whether it is the first time the first area R1 is reached or the second time or later, the information processing device 10 can stop and resume displaying the display selection icon G1 and the layout selection icon L1 or L2 in response to that control.

[0140] Furthermore, the control method in the information processing device 10 according to this embodiment includes a first display step in which, when the control unit 18 receives a drag operation on a window displayed on a display, a display selection icon G1 (an example of a first icon) corresponding to each of one or more displays is displayed in a screen area of ​​the display on which the drag operation was started; a first selection step in which a display corresponding to an icon selected by the drag operation among the display selection icons G1 corresponding to each of the one or more displays is selected as a display on which the window being dragged is to be displayed; and a layout selection icon L1 or L2 (a second icon) that can select a display area in which the window is to be displayed within the screen area of ​​the display selected in the first selection step. a display cancel step of canceling the display of the display selection icon G1 in the first display step and the display of the layout selection icon L1 or L2 in the second display step in response to the operation position due to the drag operation reaching a predetermined first region R1 within the screen area of ​​the display; and a display restart step of restarting the display of the display selection icon G1 in the first display step and the display of the layout selection icon L1 or L2 in the second display step in response to the operation position due to the drag operation moving out of the second region R2 including the first region R1 within the screen area of ​​the display, after the display cancel step has stopped the display of the display selection icon G1 and the display of the layout selection icon L1 or L2.

[0141] As a result, the control method in the information processing device 10 can suspend or resume the display of the display selection icon G1 and the layout selection icon L1 or L2 depending on the operation position of the drag operation relative to the window, thereby preventing them from overlapping and simultaneously displaying the display position selection icon LW displayed by the OS's snap function depending on the operation position of the drag operation. Therefore, the control method in the information processing device 10 prevents the mixing of displays of similar functions, allowing the user to use the displayed function without hesitation, improving operability. Therefore, the control method in the information processing device 10 can improve operability when selecting an arbitrary display area from the screen area of ​​the display as the display destination.

[0142] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like are possible within the scope of the gist of the present invention. For example, the configurations described in the above embodiments may be combined in any desired manner.

[0143] Furthermore, although the information processing device 10 according to the embodiment described above has one foldable display 150 provided across the inner surface of the first housing 101 and the inner surface of the second housing 102, the present invention is not limited to this. For example, the information processing device 10 may be configured so that a display is provided only on the inner surface of the first housing 101. Furthermore, the information processing device 10 may be configured so that a display is provided on each of the inner surfaces of the first housing 101 and the second housing 102. Regardless of the configuration of the information processing device 10, the processes relating to the display of each icon and the change of the display layout described with reference to FIGS. 5 to 12 and 15 can be applied.

[0144] Furthermore, in the above-described embodiment, an example was shown in which the multiple displays whose display is controlled by the information processing device 10 are two, a built-in display of the information processing device 10 and an external display of the external display device 20, but this is not limited thereto. When the information processing device 10 is equipped with multiple built-in displays, the multiple displays whose display is controlled may be multiple built-in displays. When the information processing device 10 is connected to multiple external display devices 20, the multiple displays whose display is controlled may be multiple external displays, or multiple external displays and one or multiple built-in displays. In other words, the multiple displays whose display is controlled by the information processing device 10 may be two displays, or three or more displays, and these displays may be either built-in displays or external displays.

[0145] In the above-described embodiment, the layouts selectable with the layout selection icon L1 or L2 (see FIG. 5) are three types: a layout in which the entire screen area of ​​the display 150 is used as one display area, a layout in which the screen area is divided into two parts, one above the other, and a layout in which the screen area is divided into three parts, but are not limited to these. For example, only some of the above three types of layouts may be selectable, or a layout in which the screen area is divided into four or more display areas may be selectable.

[0146] In addition, in the above-described embodiment, examples of touch operations on multiple touch panel type displays in which the input unit (touch sensor) and the display unit are integrated are described, but this is not limited to touch panel type displays.

[0147] The information processing device 10 described above includes an internal computer system. A program for implementing the functions of each component of the information processing device 10 may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed to perform processing in each component of the information processing device 10. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computers connected via a network, including the Internet, a WAN, a LAN, a dedicated line, or other communication lines. The term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built into a computer system. The recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM.

[0148] The recording medium also includes internal or external recording media accessible from a distribution server for distributing the program. The program may be divided into multiple parts, downloaded at different times, and then combined by each component of the information processing device 10, or each divided program may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be a medium that realizes part of the above-described functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the above-described functions in combination with a program already stored in the computer system.

[0149] Furthermore, some or all of the functions of the information processing device 10 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually implemented as a processor, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]

[0150] 10 Information processing device, 101 First housing, 102 Second housing, 103 Hinge mechanism, 11 Communication unit, 12 RAM, 13 Storage unit, 14 Speaker, 15 Display unit, 16 Camera, 150 Display, 155 Touch sensor, 161 First acceleration sensor, 162 Second acceleration sensor, 17 Hall sensor, 18 Control unit, 19 External connection terminal, 181 Display selection icon display processing unit, 182 Display selection processing unit, 183 Layout selection icon display processing unit, 184 Layout selection processing unit, 185 Display layout change unit, 186 Icon display control unit

Claims

1. An information processing device that controls display on one or more displays, a memory for storing a system program and an application program that runs on the system; a processor that controls displaying a window of the application in a screen area of ​​the display by executing the system program and the application program stored in the memory; Equipped with The processor: a first display process for, when a drag operation is received on the window displayed on the display, displaying first icons corresponding to one or more of the displays in a screen area of ​​the display on which the drag operation is started; a first selection process of selecting a display corresponding to an icon selected by the drag operation from among the first icons corresponding to each of the one or more displays as a display on which the window being dragged is to be displayed; a second display process for displaying a second icon that allows selection of a display area in which the window is to be displayed within the screen area of ​​the display selected by the first selection process; a display canceling process of canceling the display of the first icon by the first displaying process and the display of the second icon by the second displaying process in response to an operation position by the dragging operation reaching a predetermined first region within a screen region of the display; a display restart process of restarting the display of the first icon by the first display process and the display of the second icon by the second display process in response to an operation position by the drag operation moving out of a second area including the first area within a screen area of ​​the display, after the display of the first icon and the display of the second icon by the display stop process; An information processing device that performs the above.

2. the first area and the second area are set corresponding to areas within a screen area of ​​the display that are used by functions of the system, the first area is set corresponding to an area where a third icon is displayed, which allows a user to select a display area in which the window is to be displayed within a screen area of ​​the display by a function of the system in response to the arrival of an operation position by the drag operation; the second area is set corresponding to an area in which the display of the third icon is maintained when, after the third icon is displayed, the display of the third icon is stopped in response to the operation position by the drag operation being moved away from the third icon. The information processing device according to claim 1 .

3. The second area is set to be larger than the first area. The information processing device according to claim 1 .

4. The first area and the second area are set as the same area. The information processing device according to claim 1 .

5. The setting of the first area or the second area differs depending on the type of input device used by the user to perform the drag operation. The information processing device according to claim 1 .

6. The setting of the first area or the second area varies depending on the screen size of the display. The information processing device according to claim 1 .

7. The processor: performing a tracking process for tracking the movement of the operation position due to the drag operation; controlling whether or not to perform the display stop process based on the number of times the operation position has reached the first area or the number of times it has moved out of the second area as a result of the drag operation; The information processing device according to claim 1 .

8. A control method for an information processing device including a memory that stores a system program and an application program that runs on the system, and a processor that controls displaying a window of the application in a screen area of ​​one or more displays by executing the system program and the application program stored in the memory, comprising: the processor: a first display step of, when a drag operation is received on the window displayed on the display, displaying first icons corresponding to one or more of the displays in a screen area of ​​the display on which the drag operation is started; a first selection step of selecting a display corresponding to an icon selected by the drag operation from among the first icons corresponding to each of the one or more displays as a display on which the window being dragged is to be displayed; a second display step of displaying a second icon that allows selection of a display area in which the window is to be displayed within the screen area of ​​the display selected in the first selection step; a display canceling step of canceling the display of the first icon in the first displaying step and the display of the second icon in the second displaying step in response to the operation position by the drag operation reaching a predetermined first region within a screen region of the display; a display resuming step of resuming the display of the first icon in the first displaying step and the display of the second icon in the second displaying step in response to an operation position caused by the drag operation moving out of a second area including the first area within a screen area of ​​the display, after the display of the first icon and the display of the second icon has been stopped in the display stopping step; A control method comprising:

Images