Information processing device and control method
Patent Information
- Application Number
- JP2023150974
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-09-19
- Publication Date
- 2025-03-04
- Estimated Expiration
- 2042-06-07
AI Technical Summary
【0024】 本発明の上記態様によれば、複数の表示モードを容易に切り替えることができる。
Smart Images

Figure 0007639088000001 
Figure 0007639088000002 
Figure 0007639088000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device and a control method. [Background technology]
[0002] In recent years, information processing devices have been disclosed in which a foldable flexible display (display unit) is provided across a first housing and a second housing so as to be bendable in response to rotation of the first housing and the second housing (see, for example, Patent Document 1). When one display is provided across the first housing and the second housing in this manner, it is possible to have a plurality of display modes, such as controlling the display as a single screen area on the display, as well as controlling the display as a plurality of screen areas (for example, two screen areas). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-13850 A Summary of the Invention [Problem to be solved by the invention]
[0004] In an information processing device having a plurality of display modes as described above, it is desirable that the display modes be easily switchable.
[0005] The present invention has been made in consideration of the above circumstances, and has as its object to provide an information processing device and a control method that can easily switch between a plurality of display modes. [Means for solving the problem]
[0006] The present invention has been made to solve the above-mentioned problems, and an information processing device according to a first aspect of the present invention comprises a single foldable display, a memory for temporarily storing display data to be displayed on the display, and a processor for controlling the display of the display data stored in the memory on the display, wherein the processor performs a display mode switching process for toggling between a plurality of display modes determined by a combination of screen area control for controlling the display of the screen area of the display as a single screen area or as a plurality of screen areas, and display orientation control for controlling the orientation of the display in the screen area of the display, in a predetermined order each time a specific input is made by the user, and a display mode restriction process for restricting the display modes that can be switched by the display mode switching process from among the plurality of display modes, depending on the usage form of the display.
[0007] In addition, an information processing device according to a second aspect of the present invention comprises a single foldable display, a memory that temporarily stores display data to be displayed on the display, and a processor that controls the display of the display data stored in the memory on the display, wherein the processor performs a display mode switching process that toggles between a plurality of display modes determined by a combination of screen area control that controls the display of the screen area of the display as a single screen area or as a plurality of screen areas, and display orientation control that controls the orientation of the display in the screen area of the display, in a predetermined order each time a specific input is made by a user, and a display mode order change process that changes the predetermined order when switching between the plurality of display modes by the display mode switching process depending on the manner in which the display is used.
[0008] In the above information processing device, the plurality of display modes may be determined, in addition to the screen area control and the display direction control, by which screen area is to be set as a primary screen when controlling display as a plurality of screen areas.
[0009] In the information processing device, the usage mode of the display may be based on at least one or both of whether the display is in a bent state and the orientation of the display.
[0010] In the above-mentioned information processing device, the processor may further perform a history storage process for storing a history of display modes selected by the user for each mode of use of the display, and in the display mode restriction process, a display mode among the plurality of display modes that is infrequently selected by the user for each mode of use of the display may be excluded from the display modes that can be switched by the display mode switching process.
[0011] In the above-mentioned information processing device, the processor may further perform a history storage process for storing a history of display modes selected by the user for each mode of use of the display, and in the display mode order changing process, the predetermined order for switching between the plurality of display modes by the display mode switching process may be an order that prioritizes a display mode that is selected more frequently by the user among the plurality of display modes for each mode of use of the display.
[0012] In the information processing device, the specific input may be an operation input to a specific shortcut key on a keyboard connected to the information processing device.
[0013] In the information processing device, the processor may control the display mode switching process by an operation input to the keyboard to be enabled or disabled depending on a usage mode of the display.
[0014] In the above information processing device, the processor may enable the display mode switching process by operational input to the keyboard when the display is in a bent state, and disable the display mode switching process by operational input to the keyboard when the display is not in a bent state.
[0015] In the information processing device, the specific input may be a specific operation input to a touchpad provided on a keyboard connected to the information processing device.
[0016] In the information processing device, the specific operation input may be a specific touch operation on the display.
[0017] In the information processing device, the processor may control the display mode switching process to be enabled or disabled by an operation input to the display depending on a usage mode of the display.
[0018] In the above information processing device, the processor may determine whether or not the information processing device is being held by a user, and if it is determined that the information processing device is being held by a user, enable the display mode switching process by operational input to the display, and if it is determined that the information processing device is not being held by a user, disable the display mode switching process by operational input to the display.
[0019] In the information processing device, the processor may disable the display mode switching process performed by an operation input to the display when a connection to a keyboard is detected.
[0020] In the above-mentioned information processing device, the specific operation input is a specific gesture, and the processor may further perform a gesture image detection process to detect the specific gesture image from an image captured by an imaging unit, and execute the display mode switching process each time the specific gesture image is detected by the gesture image detection process.
[0021] In the above-mentioned information processing device, the specific input is a specific audio input, and the information processing device further includes a sound collection unit that collects audio, and the processor further performs a sound detection process to detect the specific audio from the audio collected by the sound collection unit that collects audio, and executes the display mode switching process each time the specific audio is detected by the sound detection process.
[0022] Furthermore, according to a third aspect of the present invention, a control method in an information processing device having a single foldable display, a memory for temporarily storing display data to be displayed on the display, and a processor for controlling the display of the display data stored in the memory on the display includes a step in which the processor toggles between a plurality of display modes determined by a combination of screen area control for controlling the display of the screen area of the display as a single screen area or a plurality of screen areas, and display orientation control for controlling the orientation of the display in the screen area of the display, in a predetermined order each time a specific input is made by the user, and a step of limiting the switchable display modes among the plurality of display modes depending on the manner in which the display is used.
[0023] Furthermore, according to a fourth aspect of the present invention, a control method in an information processing device having a single foldable display, a memory for temporarily storing display data to be displayed on the display, and a processor for controlling the display of the display data stored in the memory on the display includes a step in which the processor toggles between a plurality of display modes determined by a combination of screen area control for controlling the display of the screen area of the display as a single screen area or a plurality of screen areas, and display orientation control for controlling the orientation of the display on the screen area of the display, in a predetermined order each time a specific input is made by the user, and a step of changing the predetermined order when switching between the plurality of display modes depending on the manner in which the display is used. Effect of the Invention
[0024] According to the above aspects of the present invention, a plurality of display modes can be easily switched. [Brief description of the drawings]
[0025] [Figure 1] FIG. 1 is a perspective view showing the appearance of an information processing apparatus according to a first embodiment. [Diagram 2] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a bent state. [Diagram 3] FIG. 2 is a side view showing an example of the information processing device according to the first embodiment in a flat state. [Figure 4] 3A to 3C are views showing specific examples of various display modes of the information processing device according to the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of a trigger for switching a display mode according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing a first example of display modes that can be toggled and their order according to the first embodiment. [Figure 7] 4A and 4B are diagrams showing a second example of display modes that can be toggled and their order according to the first embodiment. [Figure 8] 11A and 11B are diagrams showing a third example of display modes that can be toggled and their order according to the first embodiment. [Figure 9] 13 is a view showing a fourth example of display modes that can be toggled and their order according to the first embodiment. FIG. [Figure 10] FIG. 11 is a view showing a fifth example of display modes that can be toggled and their order according to the first embodiment. [Figure 11] 13 is a view showing a sixth example of display modes that can be toggled and their order according to the first embodiment. FIG. [Figure 12] 13 is a diagram showing a seventh example of toggle-type switchable display modes and their order according to the first embodiment. FIG. [Figure 13] FIG. 2 is a block diagram showing an example of a hardware configuration of the information processing apparatus according to the first embodiment. [Figure 14]FIG. 2 is a block diagram showing an example of a functional configuration related to a display mode switching process of the information processing device according to the first embodiment. [Figure 15] 6 is a flowchart showing an example of a display mode switching process according to the first embodiment. [Figure 16] 13A and 13B are diagrams showing an example of a trigger for switching a display mode according to the second embodiment. [Figure 17] 13 is a flowchart showing an example of an on / off process of switching a display mode using a keyboard according to the third embodiment. [Figure 18] 13A and 13B are diagrams showing an example of a trigger for switching a display mode according to the fourth embodiment. [Figure 19] 13 is a flowchart showing a first example of an on / off process for switching a display mode by a touch operation on a display according to a fourth embodiment. [Figure 20] 13 is a flowchart showing a second example of an on / off process for switching a display mode by a touch operation on a display according to the fourth embodiment. [Figure 21] 13A and 13B are diagrams showing an example of a trigger for switching a display mode according to the fifth embodiment. [Figure 22] 13 is a view showing an example of a trigger for switching a display mode according to the sixth embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0026] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <First embodiment> First, the first embodiment will be described. FIG. 1 is a perspective view showing the appearance of an information processing device 10 according to this embodiment. The information processing device 10 according to this embodiment is a clamshell type (notebook type) PC (personal computer). The information processing device 10 includes a first housing 101, a second housing 102, and a hinge mechanism 103. The first housing 101 and the second housing 102 are substantially rectangular plate-shaped (for example, flat) housings. One side surface of the first housing 101 and one side surface of the second housing 102 are coupled (connected) via the hinge mechanism 103, and the first housing 101 and the second housing 102 can rotate relatively around a rotation axis formed by the hinge mechanism 103. A state in which the opening angle θ of the first housing 101 and the second housing 102 around the rotation axis is substantially 0° is a state in which the first housing 101 and the second housing 102 overlap and are closed. A state in which the first housing 101 and the second housing 102 are closed is referred to as a "closed state." In the closed state, the surfaces of the first housing 101 and the second housing 102 that face each other are referred to as the "inner surface," and the surface opposite to the inner surface is referred to as the "outer surface." The opening angle θ can also be said to be an angle formed by the inner surface of the first housing 101 and the inner surface of the second housing 102. A state in which the first housing 101 and the second housing 102 are open relative to the closed state is referred to as an "open state." The open state is a state in which the first housing 101 and the second housing 102 are rotated relatively until the opening angle θ becomes larger than a preset threshold value (for example, 10°).
[0027] The information processing device 10 also includes a camera 16 and a display 150. The camera 16 is provided on the inner surface of the first housing 101. The display 150 is provided from the inner surface of the first housing 101 to the inner surface of the second housing 102. The camera 16 is provided, for example, on the outer side of the screen area of the display 150 on the inner surface of the first housing 101, and can capture an image of a user or the like present on the side facing the display 150. The display 150 is a flexible display that can be bent according to an opening angle θ due to relative rotation between the first housing 101 and the second housing 102 (see FIGS. 2 and 3). As the flexible display, an organic EL display or the like is used. The information processing device 10 can control the display of the entire screen area of the display 150 as a single screen configuration as one screen area DA, or can control the display of the entire screen area of the display 150 as a two-screen configuration by dividing the entire screen area of the display 150 into two screen areas, a first screen area DA1 and a second screen area DA2. Here, the first screen area DA1 and the second screen area DA2 are screen areas that do not overlap with each other. Here, the screen area of the display 150 that corresponds to the inner surface side of the first housing 101 is the first screen area DA1, and the screen area that corresponds to the inner surface side of the second housing 102 is the second screen area DA2. Hereinafter, the display mode that controls the display in a single screen configuration is referred to as the "single screen mode," and the display mode that controls the display in a dual screen configuration is referred to as the "dual screen mode."
[0028] A touch sensor is provided above the screen area of the display 150. The information processing device 10 can detect a touch operation on the screen area of the display 150. By opening the information processing device 10, the user can view the display 150 provided on the inner surface of each of the first housing 101 and the second housing 102 and can perform a touch operation on the display 150, thereby enabling the user to use the information processing device 10.
[0029] Next, the use form and the screen mode of the information processing device 10 will be described in detail. First, the use form of the information processing device 10 is divided into a state in which the first housing 101 and the second housing 102 are bent (Bent form) and a state in which the first housing 101 and the second housing 102 are not bent (Flat form) depending on the opening angle θ between the first housing 101 and the second housing 102. Hereinafter, the state in which the first housing 101 and the second housing 102 are bent (Bent form) is simply referred to as the "Bent form", and the state in which the first housing 101 and the second housing 102 are not bent (Flat form) is simply referred to as the "Flat form". In the bent form, the display 150 provided across the first housing 101 and the second housing 102 is also bent. In the flat form, the display 150 is also flat.
[0030] FIG. 2 is a side view showing an example of the information processing device 10 in a bent state (bent form). The display 150 is arranged across (straddling) the first housing 101 and the second housing 102. The screen area of the display 150 (screen area DA shown in FIG. 1) can be bent (bent) at a crease at a portion corresponding to the hinge mechanism 103, and the screen area on the first housing 101 side with respect to the crease is shown as a first screen area DA1, and the screen area on the second housing 102 side is shown as a second screen area DA2. The display 150 bends according to the rotation (opening angle θ) of the first housing 101 and the second housing 102. The information processing device 10 determines whether or not it is in a bent state (bent form) according to the opening angle θ. For example, when 10°<θ<170°, the information processing device 10 determines that it is in a bent state (bent form). This state corresponds to a usage form called a clamshell mode or a book mode.
[0031] 3 is a side view showing an example of the information processing device 10 in a flat form. The information processing device 10 typically determines that it is in a flat form when the opening angle θ is 180°, but as an example, it may determine that it is in a flat form when 170°≦θ≦180°. For example, when the opening angle θ between the first housing 101 and the second housing 102 is 180°, the display 150 is also in a flat form. This state corresponds to a usage form called a tablet mode.
[0032] Next, display modes according to various usage patterns of the information processing device 10 will be described in detail with reference to FIG. 4 is a diagram showing specific examples of various display modes of the information processing device 10 according to this embodiment. The information processing device 10 has different display modes depending on the usage form classified by the opening angle θ between the first housing 101 and the second housing 102, the attitude (direction) of the information processing device 10, whether it is a single-screen mode or a dual-screen mode, etc. Note that one screen is also called a single screen, and two screens are also called a split screen or dual screen.
[0033] Display mode (a) is a display mode when the first housing 101 and the second housing 102 are in a closed state (Closed) as a usage form. For example, in this closed state, the information processing device 10 is in a standby state such as a sleep state or a hibernation state, and the display 150 is in a display-off state. This standby state such as a sleep state or a hibernation state corresponds to, for example, a system power state S3 or S4 defined by ACPI (Advanced Configuration and Power Interface).
[0034] In the closed state, the information processing device 10 may be in a stopped state. The stopped state is a state in which the system is shut down and the power is turned off, and corresponds to, for example, S5 defined by ACPI. The standby state and the stopped state are states in which some or all of the processing by the system is restricted compared to the normal operating state. The normal operating state is an operating state after the system is started and logged in, and is an operating state in which the system can execute processing without any particular restrictions. The normal operating state corresponds to, for example, S0 state defined by ACPI. Next, a display mode when the first housing 101 and the second housing 102 are in the open state will be described.
[0035] The display mode (b) is a display mode in which the display 150 is in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two screen areas, a first screen area DA1 and a second screen area DA2, and the display is controlled. The orientation of the information processing device 10 is such that the first screen area DA1 and the second screen area DA2 are arranged horizontally and vertically. The screen area is vertically oriented when the long side of the four sides of the rectangular screen area is vertical and the short side is horizontal. When the screen area is vertically oriented, the display orientation is also vertical, and the direction along the long side corresponds to the up-down direction and the direction along the short side corresponds to the left-right direction. This usage mode is such that the left and right pages of a book when it is opened correspond to the left and right screens, and corresponds to a so-called book mode. This usage form is also called "Fold Landscape" because the first screen area DA1 and the second screen area DA2 are arranged side by side in a bent form, and the combined screen area is horizontally long.
[0036] In this display mode (b), the information processing device 10, for example, in a normal operating state, is in a two-screen display mode in which the first screen area DA1 on the left side is used as the primary screen and the second screen area DA2 on the right side is used as the secondary screen. Note that in the display mode (b), the correspondence between the first screen area DA1 and the second screen area DA2 and the primary screen and secondary screen may be reversed.
[0037] The display mode (c-1), like the display mode (b), is a display mode in a bent state (bent form) and in a dual-screen mode in which the screen area of the display 150 is divided into two screen areas, a first screen area DA1 and a second screen area DA2, and the display is controlled, but the orientation of the information processing device 10 is different. The orientation of the information processing device 10 is an orientation in which the first screen area DA1 and the second screen area DA2 are arranged horizontally and vertically above and below. The horizontal orientation of the screen area means that the long side of the four sides of the rectangular screen area is horizontal and the short side is vertical. When the screen area is horizontal, the display orientation is also horizontal, and the direction along the short side corresponds to the vertical direction and the direction along the long side corresponds to the left-right direction. This usage mode is one of the general usage modes of a clamshell type PC.
[0038] In this display mode (c-1), the information processing device 10, for example, in a normal operating state, is in a two-screen display mode with the first screen area DA1 as the primary screen and the second screen area DA2 as the secondary screen. Note that in the display mode (c-1), the correspondence between the first screen area DA1 and the second screen area DA2 and the primary screen and the secondary screen may be reversed.
[0039] For example, the information processing device 10 automatically switches from display mode (b) to display mode (c-1) or from display mode (c-1) to display mode (b) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (c-1) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure with respect to the display mode (b), the information processing device 10 switches to display mode (c-1) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (b) state. Also, since the display mode (b) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure with respect to the display mode (c-1), the information processing device 10 switches to display mode (b) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (c-1) state.
[0040] The display mode (c-2) is the same as the display mode (c-1) in that the information processing device 10 is in the bent form and the orientation is the same, but it is different in that an external keyboard 30 (Dockable mini KBD: Keyboard) connectable to the information processing device 10 is connected. This usage mode is a state in which a physical keyboard 30 is connected to a general usage mode of a clamshell type PC. For example, the keyboard 30 is almost the same size as the second screen area DA2 and is configured to be able to be placed on the second screen area DA2. As an example, the keyboard 30 has a magnet on the inside (end) of the bottom surface, and when placed on the second screen area DA2, it is attracted to and fixed to a metal part at the end of the inner surface of the second housing 102. This results in a usage mode similar to that of a conventional clamshell type PC that is originally provided with a physical keyboard. In addition, the information processing device 10 and the keyboard 30 are connected by, for example, Bluetooth (registered trademark). In this display mode (c-2), the information processing device 10 controls the second screen area DA2 to be displayed in black or to be turned off since it cannot be seen by the keyboard 30. In other words, this display mode (c-2) is a display mode (hereinafter referred to as "half screen mode") in which only half of the screen area of the display 150 is effective for display, and is a one-screen mode using only the first screen area DA1. In other words, the half screen mode is a display mode in which the display is controlled by using a part of the screen area (screen area DA) of the display 150 (first screen area DA1) excluding the screen area on the side where the keyboard 30 is placed (second screen area DA2) as the screen area.
[0041] For example, when the information processing device 10 detects a connection to an external keyboard in the display mode (c-1), the display mode is automatically switched from the display mode (c-1) to the display mode (c-2) (Switch by Dock).
[0042] Display mode (d) is in a bent state (Bent form) like display mode (b), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the entire screen area of the display 150 is controlled as a single screen area DA. This usage form is different from display mode (b) in that it is a single screen mode, but since it is in a bent state (Bent form) and the screen area DA is horizontally long, it is also called "Fold Landscape". The screen area DA is horizontal, and the display orientation is also horizontal.
[0043] Here, switching between the single screen mode and the dual screen mode in the bent state (Bent form) is performed, for example, by a user operation. For example, the information processing device 10 displays an operator as a UI (User Interface) capable of switching between the single screen mode and the dual screen mode at any location on the screen, and switches from display mode (b) to display mode (d) based on an operation on the operator (Switch by UI). A specific example of this display mode switching operation will be described later.
[0044] Display mode (e) is in a bent state (bent form) like display mode (c-1), and the orientation of the information processing device 10 is also the same, but it is different in that it is a single screen mode in which the display is controlled with the entire screen area of the display 150 as a single screen area DA. This usage mode differs from display mode (c-1) in that it is a single screen mode, but it corresponds to the usage mode of a clamshell type PC from the bent state (bent form) and the orientation of the information processing device 10. The screen area DA is vertical, and the display orientation is also vertical.
[0045] For example, the information processing device 10 automatically switches from display mode (d) to display mode (e) or from display mode (e) to display mode (d) by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e) is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d), the information processing device 10 switches to display mode (e) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d) state. Also, since the display mode (d) is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e), the information processing device 10 switches to display mode (d) when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e) state.
[0046] The display mode (d') is a single screen mode similar to the display mode (d), and the orientation of the information processing device 10 is also a landscape orientation of the screen area DA, but is different in that it is in a flat state (Flat form). The flat state (Flat form) is a state in which the opening angle θ between the first housing 101 and the second housing 102 is approximately 180°. This usage form corresponds to the so-called tablet mode described with reference to FIG. 3, and is also called "Flat Landscape" because it is in a flat state (Flat form) and the screen area DA is landscape. This display mode (d') is different from the display mode (d) only in the opening angle θ between the first housing 101 and the second housing 102. Similar to the display mode (d), the screen area DA is landscape, and the display orientation is also landscape.
[0047] Like the display mode (e), the display mode (e') is a single screen mode in which the orientation of the information processing device 10 is such that the screen area DA is vertically long, but the display mode (e') is different in that the information processing device 10 is in a flat state (Flat form). This usage form is also called "Flat Portrait" because the information processing device 10 is in a flat state (Flat form) and the screen area DA is vertically long. The only difference between the display mode (e') and the display mode (e) is the opening angle θ between the first housing 101 and the second housing 102. Like the display mode (e), the screen area DA is vertically long, and the display orientation is also vertical.
[0048] For example, the information processing device 10 automatically switches from display mode (d') to display mode (e') or from display mode (e') to display mode (d') by detecting a change in the attitude (orientation) of the information processing device 10 (Switch by Rotation). For example, since the display mode (e') is a state in which the display 150 is rotated 90 degrees to the right as shown in the figure compared to the display mode (d'), the information processing device 10 switches to display mode (e') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the right from the display mode (d'). Also, since the display mode (d') is a state in which the display 150 is rotated 90 degrees to the left as shown in the figure compared to the display mode (e'), the information processing device 10 switches to display mode (d') when it detects that the display 150 has rotated a predetermined angle (for example, 45 degrees) or more to the left from the display mode (e').
[0049] In addition, in display mode (d') and display mode (e'), it is also possible to switch to dual screen mode while remaining in flat form by the user operating the UI (operator) described above. For example, when switching from display mode (d') to dual screen mode, the display state in flat form becomes the same as display mode (b). Also, when switching from display mode (e') to dual screen mode, the display state in flat form becomes the same as display mode (c-1).
[0050] Furthermore, when the information processing device 10 detects a connection to the keyboard 30 in the display mode (e'), the display mode (e') is automatically switched to a display mode (c-2') (Switch by Dock). The display mode (c-2') is a flat state (Flat form), and differs from the display mode (c-2) only in the opening angle θ between the first housing 101 and the second housing 102. In this display mode (c-2'), the information processing device 10 controls the second screen area DA2 to be displayed in black or turned off, since the second screen area DA2 cannot be seen by the keyboard 30. In other words, like the display mode (c-2), this display mode (c-2') is a half screen mode in which only half of the screen area of the display 150 is effective for display.
[0051] Furthermore, the information processing device 10 can also switch from the single screen mode to the dual screen mode when detecting a change from a flat state (flat form) to a bent state (bent form). For example, when the information processing device 10 detects a change to a bent state (bent form) in the display mode (d') based on the opening angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (d') to the display mode (b). Furthermore, when the information processing device 10 detects a change to a bent state (bent form) in the display mode (e') based on the opening angle θ between the first housing 101 and the second housing 102, the information processing device 10 automatically switches from the display mode (e') to the display mode (c-1).
[0052] The use modes of the display modes (b), (d), and (d') are all referred to as "Landscape" because the screen area DA of the display 150 is horizontally long, whereas the use modes of the display modes (c-1), (e), and (e') are all referred to as "Portrait" because the screen area DA of the display 150 is vertically long. In addition, the use mode of the information processing device 10 can also be referred to as the use mode of the display 150 because it is determined by the screen mode of the display 150 (single screen mode or dual screen mode) and the orientation of the display 150 (landscape or portrait), etc.
[0053] (Display mode switching operation) Next, the operation specifications when switching the display mode by the user's operation input will be described. As described above, the information processing device 10 can switch the display mode according to the change in the usage form such as the rotation to the left or right direction or the change between the flat state and the bent state, and can also switch the display mode by the user's operation.
[0054] For example, the information processing device 10 displays a selection menu screen in which options of the display mode to be switched are displayed side by side as a pop-up screen, and switches to the display mode selected by a user's operation on the selection menu screen. The information processing device 10 also displays an operation icon for displaying the selection menu screen on the task bar. This allows the user to display the selection menu screen by operating the operation icon displayed on the task bar, and then to select the display mode to be switched to from the options of the display mode displayed on the selection menu screen, thereby switching to the desired display mode.
[0055] However, this method of switching display modes using a selection menu screen requires at least two operations. In addition, depending on the OS, adding an operation icon to the taskbar may not be permitted as a specification of the OS. In that case, the operation icon that displays the selection menu screen is moved to an overflow area that is popped up by operating a specific icon on the taskbar, for example, so at least three operations are required to switch the display mode. In addition, since multiple icons are lined up in the overflow area, it may be difficult to find the desired icon. Thus, in the method of switching display modes using a selection menu screen, the operations when switching may be cumbersome and difficult.
[0056] Therefore, the information processing device 10 according to the present embodiment has a method of switching the display mode in a toggle manner with each operation input, in addition to a method of using a selection menu screen, as an operation specification when switching the display mode by a user's operation input. As an operation input that serves as a trigger for switching the display mode in this toggle manner, for example, a shortcut key on the keyboard can be used as shown in FIG.
[0057] 5 is a diagram showing an example of a trigger for switching the display mode according to the present embodiment. As shown in the figure, a specific shortcut key (F5+Ctrl, as an example) set in advance may be used as an operation input that serves as a trigger for switching the display mode in a toggle manner. For example, the information processing device 10 switches the display mode in a toggle manner every time a user operates a specific shortcut key (F5+Ctrl, as an example) on the connected keyboard 30.
[0058] The shortcut key used to switch the display mode can be determined arbitrarily while taking into consideration other shortcut keys. When an external keyboard other than the keyboard 30 is connected to the information processing device 10, the information processing device 10 can switch the display mode by the shortcut key in the same manner using the connected keyboard.
[0059] Furthermore, when switching the display mode in a toggle manner, the information processing device 10 switches the display mode in a predetermined order every time a shortcut key operation input is performed, as shown in, for example, FIGS.
[0060] FIG. 6 is a diagram showing a first example of toggle-type switchable display modes and their order according to this embodiment. The example shown in FIG. 6 shows switchable display modes and their order when the usage mode is "Landscape." Note that "1" in the two-screen mode in the diagram indicates the primary screen, and "2" indicates the secondary screen. When the usage mode is "Landscape," the switchable display modes are limited to the display modes when the usage mode is "Landscape" (display mode (b), display mode (d), display mode (d')).
[0061] (LA) is a display mode (b) in the dual screen mode, in which the first screen area DA1 is the primary screen and the second screen area DA2 is the secondary screen, and is hereinafter referred to as display mode LA. (LB) is a display mode (b) in the dual screen mode, in which the second screen area DA2 is the primary screen and the first screen area DA1 is the secondary screen, and is hereinafter referred to as display mode LB. (LC) is a display mode (d) or display mode (d') in the single screen mode, and is hereinafter referred to as display mode LC. In the illustrated example, the order in which the display modes are toggled is display mode LA, display mode LB, display mode LC, display mode LA, ... (the same order will be used hereinafter).
[0062] Fig. 7 is a diagram showing a second example of toggle-type switchable display modes and their order according to this embodiment. The example shown in Fig. 7 shows switchable display modes and their order when the usage mode is "Portrait". When the usage mode is "Portrait", the switchable display modes are limited to the display modes when the usage mode is "Portrait" (display mode (c-1), display mode (e), display mode (e')).
[0063] (PA) is a display mode (c-1) in the dual screen mode, in which the first screen area DA1 is the primary screen and the second screen area DA2 is the secondary screen, and is hereinafter referred to as display mode PA. (PB) is a display mode (c-1) in the dual screen mode, in which the second screen area DA2 is the primary screen and the first screen area DA1 is the secondary screen, and is hereinafter referred to as display mode PB. (PC) is a display mode (e) or display mode (e') in the single screen mode, and is hereinafter referred to as display mode PC. In the illustrated example, the order in which the display modes are toggled is display mode PA, display mode PB, display mode PC, display mode PA, ... (the same order will be used hereinafter).
[0064] The information processing device 10 may further limit the switchable display modes depending on the usage form. For example, when the information processing device 10 is in a bent state (bent form), the switchable display modes may be limited to only the dual-screen mode.
[0065] 8 is a diagram showing a third example of the display modes that can be toggled in this embodiment and their order, showing an example of the bent form and "Landscape". In the illustrated example, the display mode LC of the single screen mode is excluded from the switchable display modes compared to the example shown in FIG. 6. The order in which the display modes are toggled is display mode LA, display mode LB, display mode LA, ... (and so on).
[0066] 9 is a diagram showing a fourth example of the display modes and their order that can be switched in a toggle manner according to this embodiment, showing an example of the bent form and "Portrait". In the illustrated example, the display mode PC of the single screen mode is excluded from the switchable display modes compared to the example shown in FIG. 7. The order in which the display modes are switched in a toggle manner is display mode PA, display mode PB, display mode PA, ... (the same order will be used hereafter).
[0067] Furthermore, the information processing device 10 may store a history of display modes selected by the user for each usage mode, and may limit the switchable display modes by excluding display modes that are selected by the user infrequently.
[0068] Fig. 10 is a diagram showing a fifth example of display modes that can be switched in a toggle manner and their order according to the present embodiment. For example, in the case of "Landscape" in the dual screen mode, if the display mode LA is selected frequently by the user and the display mode LB is selected less frequently, the information processing device 10 excludes the display mode LB, which is selected less frequently, from the switchable display modes in comparison with the example shown in Fig. 6. The order in which the display modes are switched in a toggle manner is display mode LA, display mode LC, display mode LA, ... (the same order will be used hereinafter).
[0069] 10 shows an example of "Landscape", but the same may be done for "Portrait" in dual screen mode. In other words, when the display mode PA is frequently selected by the user and the display mode PB is selected less frequently, the display mode PB which is selected less frequently may be excluded from the switchable display modes, as compared to the example shown in FIG 7. In other words, the order in which the display modes are toggled may be display mode PA, display mode PC, display mode PA, ... (the same order hereafter).
[0070] In addition, the information processing device 10 may change the order of switching the display modes in a toggle manner depending on the usage form. For example, the information processing device 10 may switch the display modes in the order shown in Fig. 6 and Fig. 7 with priority given to the dual-screen mode in the bent form, and may switch the display modes in the order with priority given to the single-screen mode in the flat form.
[0071] 11 is a diagram showing a sixth example of the display modes that can be switched in a toggle manner according to the present embodiment and their order, showing an example in the case of a flat state (Flat form) and "Landscape". In the illustrated example, the display mode LC of the single screen mode is given priority over the example shown in FIG. 6. In the illustrated example, the order when switching the display mode in a toggle manner is display mode LC, display mode LA, display mode LB, display mode LC, ... (the same order will be used hereafter).
[0072] Similarly, in the case of a flat state (Flat form) and "Portrait", the display mode PC in single-screen mode may be given priority in the example shown in Figure 7, and the order in which the display mode is toggled may be display mode PC, display mode PA, display mode PB, display mode PC, ... (and so on).
[0073] Furthermore, the information processing device 10 may store a history of display modes selected by the user for each usage mode, and may set the order of display modes toggling in a manner that prioritizes display modes that are more frequently selected by the user. In other words, the information processing device 10 may set the order of display modes toggling in a manner that lowers the priority of display modes that are less frequently selected by the user.
[0074] Fig. 12 is a diagram showing a seventh example of display modes that can be switched in a toggle manner and their order according to the present embodiment. For example, in the case of "Landscape" in the dual screen mode, it is assumed that the display mode LA is selected by the user more frequently and the display mode LB is selected less frequently. In this case, the information processing device 10 switches the display modes in a toggle manner in an order that prioritizes the display mode LA that is selected more frequently by the user and lowers the priority of the display mode LB, as compared to the example shown in Fig. 6. For example, the order in which the display modes are switched in a toggle manner is the display mode LA, display mode LC, display mode LB, display mode LA, ... (the same order will be used hereinafter).
[0075] (Configuration of information processing device 10) The specific configuration of the information processing device 10 will be described below. 13 is a block diagram showing an example of a hardware configuration of an information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a Hall sensor 14, a display unit 15, a camera 16, a first acceleration sensor 161, a second acceleration sensor 162, a speaker 17, a microphone 18, and a control unit 19. These units are connected to each other so as to be able to communicate with each other via a bus or the like.
[0076] The communication unit 11 includes, for example, a plurality of Ethernet (registered trademark) ports, a plurality of digital input / output ports such as USB (Universal Serial Bus), and a communication device that performs wireless communication such as Bluetooth (registered trademark) and Wi-Fi (registered trademark). For example, the communication unit 11 can communicate with the above-mentioned external keyboard 30, etc., using Bluetooth (registered trademark).
[0077] In the RAM 12, programs and data for processing executed by the control unit 19 are deployed, and various data are appropriately saved or erased. For example, the RAM 12 also functions as a video memory (V-RAM) that temporarily stores display data to be displayed on the display 150. As an example, the RAM 12 functions as a video memory for data displayed in the screen area DA when the display 150 is controlled in the single screen mode. The RAM 12 also functions as a video memory for data displayed in the first screen area DA1 and the second screen area DA2 when the display 150 is controlled in the dual screen mode. The RAM 12 also functions as a video memory for data displayed in the first screen area DA1 when the display 150 is controlled in the half screen mode. Since the RAM 12 is a volatile memory, it does not hold data when power supply to the RAM 12 is stopped. Data that needs to be held when power supply to the RAM 12 is stopped is transferred to the storage unit 13.
[0078] The storage unit 13 is configured to include one or more of an SSD (Solid State Drive), an HDD (Hard Disk Drive), a ROM (Residual Only Memory), a Flash-ROM, etc. For example, the storage unit 13 stores programs and setting data for a BIOS (Basic Input Output System), an OS (Operating System), programs for applications that run on the OS, and various data used by the applications.
[0079] The hall sensor 14 is provided to detect the connection of the keyboard 30. For example, when the keyboard 30 is placed on the second screen area DA2 of the second housing 102, a magnet provided inside the bottom surface of the keyboard 30 approaches, changing the magnetic field, and changing the detection value (output value) of the hall sensor 14. In other words, the hall sensor 14 outputs a different detection result depending on whether the keyboard 30 is placed or not.
[0080] The display unit 15 includes a display 150 and a touch sensor 155. As described above, the display 150 is a flexible display that can be bent according to the opening angle θ caused by the relative rotation of the first housing 101 and the second housing 102. The display 150 performs display corresponding to each display mode described with reference to FIG. 4 according to the control of the control unit 19. The touch sensor 155 is provided on the screen of the display 150 and detects a touch operation on the screen. For example, the touch sensor 155 detects a touch operation on the screen area DA in the single screen mode. Also, the touch sensor 155 detects a touch operation on one or both of the first screen area DA1 and the second screen area DA2 in the dual screen mode. The touch operation includes a tap operation, a slide operation, a flick operation, a swipe operation, a pinch operation, and the like. The touch sensor 155 detects the touch operation and outputs operation information based on the detected operation to the control unit 19.
[0081] Camera 16 includes a lens, an imaging element, etc. Camera 16 captures an image (a still image or a video) according to the control of control unit 19, and outputs data of the captured image.
[0082] First acceleration sensor 161 is provided inside first housing 101, and detects the orientation and changes in orientation of first housing 101. For example, if a direction parallel to the longitudinal direction of first screen area DA1 is defined as an X1 direction, a direction parallel to the lateral direction is defined as a Y1 direction, and a direction perpendicular to the X1 and Y1 directions is defined as a Z1 direction, first acceleration sensor 161 detects acceleration in each of the X1, Y1, and Z1 directions, and outputs the detection results to control unit 19.
[0083] The second acceleration sensor 162 is provided inside the second housing 102, and detects the orientation and changes in orientation of the second housing 102. For example, if the direction parallel to the longitudinal direction of the second screen area DA2 is the X2 direction, the direction parallel to the lateral direction is the Y2 direction, and the direction perpendicular to the X2 and Y2 directions is the Z2 direction, the second acceleration sensor 162 detects acceleration in each of the X2 direction, the Y2 direction, and the Z2 direction, and outputs the detection results to the control unit 19.
[0084] The speaker 17 outputs electronic sounds, voices, and the like. The microphone 18 is a microphone (sound pickup unit) that picks up surrounding sounds.
[0085] The control unit 19 is configured to include processors such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), a microcomputer, etc., and realizes various functions by executing programs (various programs such as BIOS, OS, and applications that run on the OS) stored in the memory unit 13, etc.
[0086] For example, the control unit 19 detects the attitude (orientation) of the information processing device 10 based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Furthermore, the control unit 19 determines whether the information processing device 10 is in an open state or a closed state, and if in an open state, whether the information processing device 10 is in a bent form or a flat form, based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. Furthermore, the control unit 19 detects whether the information processing device 10 is connected to the keyboard 30. The control unit 19 controls the display mode according to these detection results or a user's operation input.
[0087] (Functional configuration of control unit 19) Next, a functional configuration related to a display mode switching process in which the control unit 19 switches the display mode in response to an operation input of a shortcut key will be described. 14 is a block diagram showing an example of a functional configuration related to a display mode switching process according to this embodiment. The control unit 19 includes a usage mode determination unit 191, a keyboard connection detection unit 192, a trigger detection unit 193, and a display mode control unit 194 as functional configurations in which a CPU executes processes based on a program running on an OS, for example.
[0088] The usage mode determination unit 191 determines the usage mode of the information processing device 10 (display 150). This usage mode is based on various states of the information processing device 10 (display 150), and is based on at least one or both of whether the information processing device 10 (display 150) is in a bent state and the orientation of the information processing device 10 (display 150).
[0089] For example, the use form determination unit 191 determines whether the display 150 is in a bent form or a flat form based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. The use form determination unit 191 also determines whether the orientation of the display 150 is "Landscape" or "Portrait" based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162. The use form determination unit 191 may also determine whether the information processing device 10 is in an open state or a closed state based on the detection results of the first acceleration sensor 161 and the second acceleration sensor 162.
[0090] The keyboard connection detection unit 192 detects a connection with the keyboard 30. For example, the keyboard connection detection unit 192 detects whether or not the keyboard 30 is placed on the second screen area DA2 based on the detection result of the hall sensor 14, thereby detecting the presence or absence of a connection with the keyboard 30. The keyboard connection detection unit 192 may detect the connection with the keyboard 30 based on whether or not the keyboard 30 is communicatively connected via the communication unit 11. The keyboard connection detection unit 192 may also detect a connection with an external keyboard other than the keyboard 30 based on whether or not the keyboard 30 is communicatively connected via the communication unit 11.
[0091] The trigger detection unit 193 detects a trigger for switching the display mode in a toggle manner. For example, the trigger detection unit 193 acquires an operation signal due to an operation input to the keyboard 30 (or another external keyboard) via the communication unit 11, and detects an operation input of a shortcut key as the above-mentioned trigger based on the acquired operation signal. Every time the trigger detection unit 193 detects an operation input of a shortcut key, it transmits that fact to the display mode control unit 194.
[0092] The display mode control unit 194 controls display according to each of a plurality of display modes and controls switching between display modes. As shown in Fig. 4, the plurality of display modes are determined by a combination of screen area control, which controls display of the screen area of the display 150 as one screen area DA or as a plurality of screen areas (for example, a first screen area DA1 and a second screen area DA2), and display direction control, which controls the orientation of the display in the screen area of the display 150. In addition to the above screen area control and display direction control, the plurality of display modes are determined by which screen area is to be set as the primary screen when controlling display as a plurality of screen areas.
[0093] For example, the display mode control unit 194 performs screen area control to control the display of the screen area of the display 150 as one screen area DA or as multiple screen areas (for example, a first screen area DA1 and a second screen area DA2) according to each display mode. Also, the display mode control unit 194 performs display direction control to control the orientation of the display on the screen area of the display 150 according to each display mode. Also, the display mode control unit 194 controls which screen area is to be the primary screen when controlling the display as multiple screen areas according to each display mode.
[0094] Moreover, the display mode control unit 194 includes, as components for controlling switching of the display mode, a display mode switching unit 1941 and a switching specification control unit 1942. The display mode switching unit 1941 performs a display mode switching process for switching the display mode of the display 150 in a predetermined order every time the trigger detection unit 193 detects an operation input of a shortcut key.
[0095] The switching mode control unit 1942 limits the switchable display modes among the multiple display modes in accordance with the usage mode determined by the usage mode determination unit 191. Here, limiting the switchable display modes among the multiple display modes means, in other words, that only some of the multiple display modes are switchable.
[0096] For example, the switching specification control unit 1942 limits the switchable display modes depending on the orientation of the display 150. Specifically, as one example, when the usage mode is "Landscape", the switching specification control unit 1942 limits the switchable display modes to the display modes for "Landscape", as described with reference to Fig. 6. As another example, when the usage mode is "Portrait", the switching specification control unit 1942 limits the switchable display modes to the display modes for "Portrait", as described with reference to Fig. 7.
[0097] Furthermore, when the display is in a bent form, the switching specification control unit 1942 may limit the switchable display modes to only the two-screen mode (see FIGS. 8 and 9).
[0098] The switching specification control unit 1942 may further perform a history storage process for storing a history of the display modes selected by the user for each usage mode. The switching specification control unit 1942 may limit the switchable display modes by excluding a display mode that is less frequently selected by the user for each usage mode from the switchable display modes (see FIG. 10).
[0099] Furthermore, the switching specification control unit 1942 changes the predetermined order for switching between a plurality of display modes in accordance with the use form determined by the use form determination unit 191. For example, in a bent form, the switching specification control unit 1942 sets the predetermined order for switching between display modes to an order that prioritizes the dual-screen mode display mode (see FIGS. 6 and 7). On the other hand, in a flat form, the switching specification control unit 1942 sets the predetermined order for switching between display modes to an order that prioritizes the single-screen mode display mode (see FIG. 11).
[0100] Furthermore, the switching specification control unit 1942 may set the predetermined order for switching the display mode to an order that prioritizes a display mode that is frequently selected by the user for each usage pattern among a plurality of display modes (see FIG. 12).
[0101] (Display mode control process operation) Next, the operation of a display mode switching process in which the control unit 19 switches the display mode in a toggle manner in response to a user operation will be described. FIG. 15 is a flowchart showing an example of the display mode switching process according to the present embodiment.
[0102] (Step S101) The control unit 19 determines the usage form of the information processing device 10 (display 150). For example, the control unit 19 determines whether the display 150 is in a bent form or a flat form. The control unit 19 also determines whether the orientation of the display 150 is "Landscape" or "Portrait". Then, the process proceeds to step S103.
[0103] (Step S103) The control unit 19 determines the display mode switching specifications according to the usage mode determined by the usage mode determination unit 191. Specifically, the control unit 19 determines the restrictions on switchable display modes among the multiple display modes and the switching order, as illustrated in Fig. 6 to Fig. 12. Then, the process proceeds to step S105.
[0104] (Step S105) The control unit 19 determines whether or not a display mode switching trigger that switches the display mode in a toggle manner has been detected. For example, a display mode switching trigger is an operation input to a specific shortcut key (one example is F5+Ctrl). If the control unit 19 determines that a display mode switching trigger has not been detected (NO), the control unit 19 returns to step S101. On the other hand, if the control unit 19 determines that a display mode switching trigger has been detected (YES), the control unit 19 proceeds to step S107.
[0105] (Step S107) The control unit 19 switches the display mode according to the display mode switching specifications determined in step S103. Then, the process returns to step S101. The control unit 19 repeats this display mode switching process, and switches the display mode in a toggle manner according to the display mode switching specifications determined in step S103 every time a display mode switching trigger is detected.
[0106] In addition, when an operation input to a specific shortcut key is used as a display mode switching trigger, it is assumed that the keyboard 30 (or another external keyboard) is connected. If the keyboard 30 (or another external keyboard) is not connected, the operation input to this specific shortcut key cannot be performed, and therefore the display mode switching process is invalid.
[0107] As described above, the information processing device 10 according to the present embodiment includes one foldable display 150, an RMA 12 (an example of a memory) that temporarily stores display data to be displayed on the display 150, and a control unit 19 (an example of a processor) that controls display of the display data stored in the RMA 12 on the display 150. The control unit 19 performs a display mode switching process that toggles between a plurality of display modes determined by a combination of screen area control that controls display of the screen area of the display 150 as one screen area DA or as a plurality of screen areas (for example, a first screen area DA1 and a second screen area DA2) and display direction control that controls the display direction of the screen area of the display 150 in a predetermined order every time a specific input (for example, input of a display mode switching trigger) is performed by the user. In addition, the control unit 19 performs a display mode limiting process that limits the display modes that can be switched by the display mode switching process among the plurality of display modes according to the usage form of the display 150.
[0108] This allows the information processing device 10 to toggle between only one of the multiple display modes that corresponds to the usage pattern at each operation, thereby making it possible to easily switch between multiple display modes.
[0109] Furthermore, the control unit 19 performs a display mode order change process for changing a predetermined order when switching between a plurality of display modes by the display mode switching process, depending on the usage mode of the display 150.
[0110] This allows the information processing device 10 to toggle between a plurality of display modes in an order according to the usage pattern each time an operation is performed, thereby making it possible to easily switch between a plurality of display modes.
[0111] In addition to the above-mentioned screen area control and display direction control, the multiple display modes are also determined by which screen area is to be set as the primary screen when controlling the display as multiple screen areas.
[0112] This allows the information processing device 10 to easily switch the screen area to be used as the primary screen.
[0113] The usage mode of display 150 is based on at least one or both of whether display 150 is in a bent state and the orientation of display 150.
[0114] This allows the information processing device 10 to easily switch between a plurality of display modes depending on whether the display 150 is bent or not, or the orientation of the display 150.
[0115] Moreover, control unit 19 further performs a history storage process for storing a history of display modes selected by the user for each mode of use of display 150. In the display mode restriction process, control unit 19 may exclude a display mode that is selected less frequently by the user for each mode of use of display 150 from the display modes that can be switched by the display mode switching process.
[0116] As a result, the information processing device 10 toggles only the display mode that the user frequently uses among the multiple display modes at each operation, allowing the user to easily switch to a desired display mode.
[0117] In addition, in the display mode order changing process, the control unit 19 may set the predetermined order for switching between multiple display modes by the display mode switching process to an order that prioritizes a display mode that is frequently selected by the user for each usage pattern of the display 150 among the multiple display modes.
[0118] As a result, the information processing device 10 toggles between the display modes in the order of the display modes that the user frequently uses among the multiple display modes, each time an operation is performed, so that the user can easily switch to a desired display mode.
[0119] Here, the specific input by the user (for example, input of a display mode switching trigger) is an operation input to a specific shortcut key (for example, F5+Ctrl) on the keyboard 30 (or another external keyboard) connected to the information processing device 10.
[0120] This allows the information processing device 10 to toggle between display modes every time the user performs one operation using a shortcut key, making it possible to easily switch between a plurality of display modes.
[0121] Furthermore, the control method in the information processing device 10 according to this embodiment includes a step in which the control unit 19 toggles between a plurality of display modes determined by a combination of screen area control, in which the control unit 19 controls the display of the screen area of the display 150 as one screen area DA or as a plurality of screen areas (e.g., a first screen area DA1 and a second screen area DA2), and display direction control, in which the control unit 19 controls the display orientation of the screen area of the display 150, in a predetermined order each time a specific input (e.g., input of a display mode switching trigger) is made by the user; and a step in which the control unit 19 limits the display modes that can be switched by the display mode switching process among the plurality of display modes depending on the usage form of the display 150.
[0122] This allows the information processing device 10 to toggle between only one of the multiple display modes that corresponds to the usage pattern at each operation, thereby making it possible to easily switch between multiple display modes.
[0123] Furthermore, the control method in the information processing device 10 according to this embodiment includes a step in which the control unit 19 toggles between a plurality of display modes determined by a combination of screen area control for controlling the display of the screen area of the display 150 as one screen area DA or as a plurality of screen areas (e.g., a first screen area DA1 and a second screen area DA2) and display direction control for controlling the orientation of the display in the screen area of the display 150 in a predetermined order each time a specific input (e.g., input of a display mode switching trigger) is made by the user, and a step of changing the predetermined order when switching between the plurality of display modes by the display mode switching process according to the usage form of the display 150.
[0124] This allows the information processing device 10 to toggle between a plurality of display modes in an order according to the usage pattern each time an operation is performed, thereby making it possible to easily switch between a plurality of display modes.
[0125] <Second embodiment> Next, a second embodiment will be described. In the first embodiment, an example was described in which the display mode is toggled each time a specific shortcut key (for example, F5+Ctrl) is operated on the keyboard 30 (or other external keyboard) connected to the information processing device 10. However, instead of the shortcut key, the display mode may be switched each time a specific operation is operated on a touchpad provided on the keyboard 30 (or other external keyboard).
[0126] FIG. 16 is a diagram showing an example of a trigger for switching the display mode according to the present embodiment. As shown in the figure, a specific operation input to the touchpad 35 provided on the keyboard 30 may be an operation input that triggers switching the display mode in a toggle manner. An example of the specific operation input to the touchpad 35 is a swipe operation with two fingers. The specific operation input to the touchpad 35 can be arbitrarily determined while taking other operations into consideration. In addition to the keyboard 30, when another external keyboard equipped with a touchpad is connected to the information processing device 10, the information processing device 10 can also switch the display mode using the touchpad provided on the connected keyboard.
[0127] Thus, in the information processing device 10 according to this embodiment, the specific input (display mode switching trigger input) when switching the display mode in a toggle manner is a specific operation input to the touchpad of the keyboard 30 (or other external keyboard) connected to the information processing device 10.
[0128] This allows the information processing device 10 to toggle between display modes every time the user performs one operation on the touch pad, making it possible to easily switch between a plurality of display modes.
[0129] <Third embodiment> Next, a third embodiment will be described. In the first and second embodiments, an example of a display mode switching process has been described in which the display mode is switched in a toggle manner each time an operation input (operation input to a shortcut key or a touchpad) is made to the keyboard 30 (or other external keyboard) connected to the information processing device 10. However, the display mode switching process caused by operation input to this keyboard may be controlled to be enabled or disabled depending on the mode of use.
[0130] For example, the information processing device 10 may enable the display mode switching process by operation input to the shortcut key only in the bent state (Bent form) and disable the display mode switching process by the shortcut key in the flat state (Flat form). Similarly, the information processing device 10 may enable the display mode switching process by operation input to the touchpad only in the bent state (Bent form) and disable the display mode switching process by operation input to the touchpad in the flat state (Flat form).
[0131] Hereinafter, with reference to FIG. 17, a process operation in which the control unit 19 controls the display mode switching process by an operational input to the keyboard to be enabled (ON) or disabled (OFF) depending on the mode of use will be described. FIG. 17 is a flowchart showing an example of an on / off process for switching the display mode using the keyboard according to this embodiment.
[0132] (Step S201) The control unit 19 determines the usage form of the information processing device 10 (display 150). For example, the control unit 19 determines whether the information processing device 10 is in a bent form or a flat form. Then, the process proceeds to step S203.
[0133] (Step S203) If the control unit 19 determines that the bent state (bent form) is present (YES), the process proceeds to step S205. On the other hand, if the control unit 19 determines that the bent state (bent form) is not present (NO), the process proceeds to step S207.
[0134] (Step S205) The control unit 19 enables a display mode switching process by an operation input to a keyboard (a shortcut key or an operation input to a touch pad).
[0135] (Step S207) The control unit 19 disables the display mode switching process based on an operation input to the keyboard (a shortcut key or an operation input to the touch pad).
[0136] In this manner, in the information processing device 10 according to the present embodiment, the control unit 19 controls the display mode switching process by operation input to the keyboard 30 (or another external keyboard) to be enabled or disabled depending on the usage form of the display 150.
[0137] This allows the information processing device 10 to appropriately control the operation method of the display mode switching process depending on the mode of use.
[0138] For example, when the display 150 is in a bent form, the control unit 19 enables the display mode switching process by an operation input to the keyboard 30 (or another external keyboard). On the other hand, when the display 150 is not in a bent form (i.e., in a flat form), the control unit 19 disables the display mode switching process by an operation input to the keyboard 30 (or another external keyboard).
[0139] As a result, the information processing device 10 can disable the display mode switching process by operation input to the keyboard because the keyboard is unlikely to be used in the flat form, and can enable the display mode switching process by operation input to the keyboard only in the bent form. Thus, the information processing device 10 can appropriately control the operation method of the display mode switching process according to the usage form.
[0140] <Fourth embodiment> Next, a fourth embodiment will be described. In the first and second embodiments, an example of a display mode switching process has been described in which the display mode is switched in a toggle manner each time an operation input (operation input to a shortcut key or a touchpad) is made to the keyboard 30 (or other external keyboard) connected to the information processing device 10. However, instead of the keyboard, the display mode may be switched each time a specific operation input is made to the display 150.
[0141] 18 is a diagram showing an example of a trigger for switching the display mode according to the present embodiment. As shown in the figure, a specific touch operation (touch gesture) input on the screen area DA of the display 150 may be an operation input that serves as a trigger for switching the display mode in a toggle manner. An example of the specific touch operation (touch gesture) input on the display 150 is a swipe operation with four fingers. Note that the specific touch operation (touch gesture) input on the display 150 can be arbitrarily determined while taking other operations into consideration.
[0142] In this manner, in the information processing device 10 according to the present embodiment, the specific input (input of a display mode switching trigger) for switching the display mode in a toggle manner is a specific touch operation (touch gesture) input on the display 150.
[0143] This allows the information processing device 10 to toggle between display modes every time the user performs one operation on the display 150, making it possible to easily switch between a plurality of display modes.
[0144] The information processing device 10 may control the display mode switching process by an operation input (touch gesture) to the display 150 to be enabled or disabled depending on the usage mode. For example, when it is estimated that the information processing device 10 is being held by a user, the information processing device 10 may enable the display mode switching process by an operation input (touch gesture) to the display 150. On the other hand, when the information processing device 10 is not being held by a user (for example, when it is placed on a desk, etc.), the information processing device 10 may disable the display mode switching process by an operation input (touch gesture) to the display 150.
[0145] Hereinafter, with reference to FIG. 19, a process operation in which the control unit 19 controls the display mode switching process by an operation input (touch gesture) to the display 150 to be enabled (ON) or disabled (OFF) depending on the usage form will be described. FIG. 19 is a flowchart showing a first example of an on / off process for switching the display mode by a touch operation on the display 150 according to the present embodiment.
[0146] (Step S301) Control unit 19 acquires detection results of first acceleration sensor 161 and second acceleration sensor 162, and detects shaking of information processing device 10 based on the acquired detection results. Then, the process proceeds to step S303.
[0147] (Step S303) The control unit 19 determines whether or not the information processing device 10 is being held by the user based on the shaking of the information processing device 10 detected in step S301. For example, the control unit 19 determines that the information processing device 10 is being held by the user when the shaking is equal to or greater than a predetermined value, and determines that the information processing device 10 is not being held by the user (for example, placed on a desk, etc.) when the shaking is less than the predetermined value. If the control unit 19 determines that the information processing device 10 is being held by the user (YES), the process proceeds to step S305. On the other hand, if the control unit 19 determines that the information processing device 10 is not being held by the user (NO), the process proceeds to step S307.
[0148] (Step S305) The control unit 19 enables a display mode switching process based on an operation input (touch gesture) on the display 150.
[0149] (Step S307) The control unit 19 disables the display mode switching process based on an operation input (touch gesture) to the display 150.
[0150] When determining whether the information processing device 10 is being held by the user, the control unit 19 may determine based on whether the opening angle θ is changing (changing) instead of or in addition to determining based on the presence or absence of shaking of the information processing device 10. That is, when the opening angle θ is changing, it may be determined that the information processing device 10 is being held by the user.
[0151] In this way, the control unit 19 controls the display mode switching process by an operation input (touch gesture) to the display 150 to be enabled or disabled depending on the usage mode of the display 150.
[0152] This allows the information processing device 10 to appropriately control the operation method of the display mode switching process depending on the mode of use.
[0153] For example, the control unit 19 determines whether the information processing device 10 is being held by a user, and when it is determined that the information processing device 10 is being held by a user, it enables the display mode switching process by an operation input to the display 150. On the other hand, when it is determined that the information processing device 10 is not being held by a user, the control unit 19 disables the display mode switching process by an operation input to the display 150.
[0154] As a result, since it is assumed that the information processing device 10 is not using the keyboard 30 (or other external keyboard) when the information processing device 10 is being held by the user, the user can easily switch the display mode by enabling the display mode switching process via operational input to the display 150.
[0155] Furthermore, the information processing device 10 may control whether to enable or disable the display mode switching process by operation input (touch gesture) to the display 150 depending on whether or not the information processing device 10 is connected to the keyboard 30 (or another external keyboard). For example, when the information processing device 10 is not connected to the keyboard 30 (or another external keyboard), the information processing device 10 may enable the display mode switching process by operation input (touch gesture) to the display 150, and when the information processing device 10 detects the connection to the keyboard 30 (or another external keyboard), the information processing device 10 may disable the display mode switching process by operation input (touch gesture) to the display 150.
[0156] Hereinafter, with reference to FIG. 20, the operation of the control unit 19 to control the display mode switching process by operation input (touch gesture) to the display 150 to be enabled (on) or disabled (off) depending on whether or not a keyboard is connected will be described. FIG. 20 is a flowchart showing a second example of an on / off process for switching the display mode by a touch operation on the display 150 according to the present embodiment.
[0157] (Step S401) The control unit 19 detects a connection with the keyboard 30 (or another external keyboard). For example, when the control unit 19 detects whether or not the keyboard 30 is connected, the control unit 19 detects by detecting whether or not the keyboard 30 is placed on the second screen area DA2 based on the detection result of the hall sensor 14. The control unit 19 may detect the connection with the keyboard 30 based on whether or not it is communicatively connected to the keyboard 30 via the communication unit 11. Furthermore, when the control unit 19 detects a connection with an external keyboard other than the keyboard 30, the control unit 19 detects by whether or not it is communicatively connected to the keyboard 30 via the communication unit 11. Then, the process proceeds to step S403.
[0158] (Step S403) The control unit 19 judges whether or not the keyboard 30 (or another external keyboard) is connected based on the detection result of step S401. If the control unit 19 judges that the keyboard 30 (or another external keyboard) is connected (YES), the process proceeds to step S405. On the other hand, if the control unit 19 judges that the keyboard 30 (or another external keyboard) is not connected (NO), the process proceeds to step S407.
[0159] (Step S405) The control unit 19 disables the display mode switching process based on an operation input (touch gesture) to the display 150.
[0160] (Step S407) The control unit 19 enables a display mode switching process based on an operation input (touch gesture) to the display 150.
[0161] In this way, the control unit 19 disables the display mode switching process performed by an operation input to the display 150 when the connection of the keyboard 30 (or another external keyboard) is detected.
[0162] As a result, when the user is using the keyboard 30 (or other external keyboard), the information processing device 10 can easily switch display modes using the shortcut keys or touchpad described in the first to third embodiments, and therefore, by disabling the display mode switching process caused by operational input to the display 150, the processing load can be reduced and erroneous operations can be prevented.
[0163] <Fifth embodiment> Next, a fifth embodiment will be described. In this embodiment, an example will be described in which the display mode is switched in a toggle manner when a user makes a specific gesture toward the camera 16, which serves as a trigger input.
[0164] 21 is a diagram showing an example of a trigger for switching the display mode according to the present embodiment. As shown in the figure, a specific gesture made to the camera 16 may be used as a trigger for switching the display mode in a toggle manner. An example of the specific gesture is a specific hand sign. Note that the specific gesture such as a hand sign can be arbitrarily determined while taking into consideration other gestures (operation inputs).
[0165] For example, the control unit 19 performs a gesture image detection process to detect a specific gesture image from an image captured by the camera 16 (an example of an imaging unit). Then, the control unit 19 performs a display mode switching process to switch the display mode in a toggle manner every time a specific gesture image is detected by the gesture image detection process.
[0166] This allows the information processing device 10 to toggle between display modes every time the user performs a specific gesture once, making it possible to easily switch between a plurality of display modes.
[0167] Sixth embodiment Next, a sixth embodiment will be described. In this embodiment, an example will be described in which the display mode is switched in a toggle manner when a specific voice input by the user is used as a trigger input.
[0168] 22 is a diagram showing an example of a trigger for switching the display mode according to the present embodiment. As shown in the figure, a specific voice input by a user's speech may be used as a trigger for toggling the display mode. Examples of the specific voice include "display mode" and "change display mode." Note that the specific voice can be determined arbitrarily while taking into consideration commands using other voices.
[0169] For example, the control unit 19 performs a voice detection process to detect a specific voice from the voice collected by the microphone 18. Then, the control unit 19 executes a display mode switching process to switch the display mode in a group manner every time a specific voice is detected by the voice detection process.
[0170] This allows the information processing device 10 to toggle between display modes every time the user performs a specific voice input once, making it possible to easily switch between a plurality of display modes.
[0171] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configurations are not limited to those described above, and various design changes and the like are possible within the scope of the gist of the present invention. For example, the configurations described in the above embodiments may be combined in any desired manner.
[0172] In addition, in the above-described embodiment, examples have been described of a single screen mode in which the screen area of display 150 is controlled as a single screen area DA, and a dual screen mode in which the screen area is divided into two screen areas, a first screen area DA1 and a second screen area DA2, and the display is controlled. However, when dividing the screen area of display 150, it is not limited to dividing it into two screen areas, and it may be divided into three or more screen areas.
[0173] The information processing device 10 described above has a computer system inside. A program for implementing the functions of each component of the information processing device 10 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each component of the information processing device 10 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. The "computer system" may also include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM.
[0174] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined by each component of the information processing device 10, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The program may be a recording medium for implementing part of the above-mentioned functions. Furthermore, the program may be a recording medium that can realize the above-mentioned functions in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program).
[0175] In addition, some or all of the functions of the information processing device 10 in the above-mentioned embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]
[0176] 10 information processing device, 101 first housing, 102 second housing, 103 hinge mechanism, 11 communication unit, 12 RAM, 13 storage unit, 14 Hall sensor, 15 display unit, 150 display, 155 touch sensor, 16 camera, 161 first acceleration sensor, 162 second acceleration sensor, 17 speaker, 18 microphone, 19 control unit, 191 usage form determination unit, 192 keyboard connection detection unit, 193 trigger detection unit, 194 display mode control unit, 1941 display mode switching unit, 1942 switching specification control unit
Claims
1. A foldable display; a memory for temporarily storing display data to be displayed on the display; a processor that controls displaying the display data stored in the memory on the display; Equipped with The processor, a display mode switching process for switching between a plurality of display modes determined by a combination of a screen area control for controlling the display of a screen area of the display as one screen area or a plurality of screen areas, and a display direction control for controlling the direction of display in the screen area of the display, in a toggle manner in a predetermined order each time a specific input is performed by a user; a display mode order changing process for changing the predetermined order in which the plurality of display modes are switched by the display mode switching process in accordance with a usage mode of the display; Do the following: The usage mode of the display is based on at least one or both of whether the display is in a folded state and the orientation of the display; Information processing device.
2. The plurality of display modes are determined by, in addition to the screen area control and the display direction control, which screen area is to be set as a primary screen when controlling display as a plurality of screen areas. The information processing device according to claim 1 .
3. The processor, performing a history storage process for storing a history of a display mode selected by the user for each mode of use of the display; In the display mode order changing process, the predetermined order when switching between the plurality of display modes by the display mode switching process is set to an order that gives priority to a display mode that is frequently selected by the user for each usage mode of the display among the plurality of display modes. The information processing device according to claim 1 .
4. the specific input is an operation input to a specific shortcut key on a keyboard connected to the information processing device; The information processing device according to claim 1 .
5. The processor, controlling the display mode switching process to be enabled or disabled by an operation input to the keyboard according to a usage mode of the display; The information processing device according to claim 4.
6. The processor, when the display is in a bent state, the display mode switching process by the operation input to the keyboard is enabled, and when the display is not in a bent state, the display mode switching process by the operation input to the keyboard is disabled. The information processing device according to claim 5 .
7. the specific input is a specific operation input to a touchpad provided on a keyboard connected to the information processing device, The information processing device according to claim 1 .
8. The specific input is a specific touch operation on the display. The information processing device according to claim 1 .
9. The processor, controlling the display mode switching process to be enabled or disabled in response to the specific input to the display in accordance with a usage mode of the display; The information processing device according to claim 8.
10. The processor, determining whether the information processing device is being held by a user; when it is determined that the information processing device is in a state in which it is held by a user, the display mode switching process in response to the specific input to the display is enabled, and when it is determined that the information processing device is not in a state in which it is held by a user, the display mode switching process in response to the specific input to the display is disabled. The information processing device according to claim 9.
11. The processor, when a connection to a keyboard is detected, the display mode switching process performed by the specific input to the display is disabled; The information processing device according to claim 8.
12. the specific input is a specific gesture; The processor, A gesture image detection process is further performed to detect an image in which the specific gesture is captured from the captured image captured by the imaging unit. executing the display mode switching process every time an image in which the specific gesture is captured is detected by the gesture image detection process; The information processing device according to claim 1 .
13. the particular input is a particular voice input, Further comprising a sound pickup unit for picking up sound, The processor, further performing a voice detection process for detecting the specific voice from the voice collected by a sound collection unit that collects the voice; executing the display mode switching process every time the specific sound is detected by the sound detection process; The information processing device according to claim 1 .
14. A control method for an information processing device including a foldable display, a memory that temporarily stores display data to be displayed on the display, and a processor that controls displaying the display data stored in the memory on the display, comprising: The processor, a step of toggling between a plurality of display modes determined by a combination of a screen area control for controlling display of a screen area of the display as one screen area or a plurality of screen areas and a display direction control for controlling a display direction of the screen area of the display in a predetermined order each time a specific input is performed by a user; changing the predetermined order for switching between the plurality of display modes in accordance with a usage pattern of the display; Including, The usage mode of the display is based on at least one or both of whether the display is in a folded state and the orientation of the display; Control methods.
Citation Information
Patent Citations
Opening and shutting apparatus for vehicle door moving vertically
JP1981053920A
Hot-water supplying device
JP1985000258A
Portable information processing device, its screen switching method, and computer-executable program
JP2017010226A
Portable information device
JP2018013850A
Display method, program and display system
JP2018182697A