Information processing device, information processing method, and program

Abstract

An information processing apparatus according to the present invention comprises: a display control unit that displays a size-adjustable window on a touch panel display; a setting unit that sets adjustment areas for performing size adjustment of the window through a touch operation at least at positions of four corners of the window, and sets one of the four corners of the window as a fixed angle for size adjustment; and an adjustment unit that performs a process for size adjustment of the window in response to a user's touch operation in an adjustment area associated with a diagonal of the fixed angle, in which the setting unit changes a setting of the fixed angle to a diagonal of the other angle when the user slides a touch position to the adjustment area associated with the other angle.

Description

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. Background Art

[0002] In recent years, information processing devices (eg, smartphones) with touch panel displays have been actively developed. In many cases, these information processing devices can display resizable windows on the touch panel displays.

[0003] Citation List

[0004] Patent Literature

[0005] Patent Document 1: WO 2020 / 170461 Summary of the invention

[0006] Technical issues

[0007] In many cases, the size of a window displayed on a non-touch panel display is changed by the user dragging a size adjustment handle arranged at a corner of the window with a mouse. In contrast, the size of a window displayed on a touch panel display is changed by the user performing a touch operation on a size adjustment handle (touch area) arranged at a corner of the window. In a touch operation, a target portion on the display cannot be dragged with precise accuracy. Therefore, size adjustment performed by a touch operation may cause inconvenience to the user.

[0008] For example, when using a mouse to change the size of a window, the user can drag the target portion with precise accuracy. Therefore, the size of the handle can be reduced. However, when changing the size of the window by touch operation, the user's finger touches a specific area of ​​the display. Therefore, in order to prevent misoperation, the size of the handle needs to be increased to a certain extent. In this case, the user cannot perform a touch operation on the user interface (UI) visible behind the handle, which causes inconvenience.

[0009] Therefore, the present disclosure proposes an information processing device, an information processing method, and a program with high convenience.

[0010] Solutions to the Problem

[0011] In order to solve the above-mentioned problem, according to an embodiment of the present disclosure, an information processing device includes: a display control unit, which displays a window whose size can be adjusted on a touch panel display; a setting unit, which sets an adjustment area for adjusting the size of the window by touch operation at least at the positions of the four corners of the window, and sets one of the four corners of the window as a fixed angle for size adjustment; and an adjustment unit, which performs processing for size adjustment of the window in response to a user's touch operation in an adjustment area associated with a diagonal corner of the fixed angle, wherein when the user slides the touch position to the adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to the diagonal corner of the other corner. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A resizable window TW displayed on the touch panel display is shown.

[0013] Figure 2 A resizable window TW displayed on a non-touch panel display is shown.

[0014] Figure 3 A resizable window TW displayed on the touch panel display is shown.

[0015] Figure 4 Shows handles for resizing embedded in the UI bar.

[0016] Figure 5 The solution of the embodiment is outlined.

[0017] Figure 6 A configuration example of a terminal device according to an embodiment of the present disclosure is shown.

[0018] Figure 7 An example of the appearance of a terminal device is shown.

[0019] Figure 8 A window displayed on the screen is shown.

[0020] Fig. 9 Shows how the window moves.

[0021] Fig.10 It shows how the window moves horizontally when the display is in the vertical state.

[0022] Fig.11 It shows how the window moves horizontally when the display is in the vertical state.

[0023] Fig.12 Shows how the window moves vertically when the display is in the vertical position.

[0024] Fig.13 It shows how the window moves horizontally when the display is in a horizontal state.

[0025] Fig.14 Summarizes window resizing operations.

[0026] Fig.15 Mode 1 resizing operation is shown.

[0027] Fig.16A A resizing operation in the adjustment area A is shown. Fig. 16B A resizing operation in the adjustment area B is shown. Fig. 16C A resizing operation in the adjustment area C is shown. Fig.16D A resizing operation in the adjustment area D is shown.

[0028] Fig.16E A resizing operation in the adjustment area E is shown.

[0029] Fig.16F A resizing operation in the adjustment area F is shown.

[0030] Figure 16G The resizing operation in the adjustment area G is shown.

[0031] Fig.16H A resizing operation in the adjustment area H is shown.

[0032] Fig.16I A resizing operation in the adjustment area I is shown.

[0033] Fig.17 Mode 2 resizing operation is shown.

[0034] Fig.18A A resizing operation in the adjustment area A is shown.

[0035] Fig.18B A resizing operation in the adjustment area B is shown.

[0036] Fig. 18C A resizing operation in the adjustment area C is shown.

[0037] Fig.18D A resizing operation in the adjustment area D is shown.

[0038] Fig.18E A resizing operation in the adjustment area E is shown.

[0039] Fig.18F A resizing operation in the adjustment area F is shown.

[0040] Figure 18G The resizing operation in the adjustment area G is shown.

[0041] Fig.18H A resizing operation in the adjustment area H is shown.

[0042] Fig.18I A resizing operation in the adjustment area I is shown.

[0043] Fig.19 Mode 3 resizing operation is shown.

[0044] Fig. 20A A resizing operation in the adjustment area A is shown.

[0045] Fig. 20B A resizing operation in the adjustment area B is shown.

[0046] Fig. 20C A resizing operation in the adjustment area C is shown.

[0047] Fig.20D A resizing operation in the adjustment area D is shown.

[0048] Fig.20E A resizing operation in the adjustment area E is shown.

[0049] Fig.20F A resizing operation in the adjustment area F is shown.

[0050] Figure 20G The resizing operation in the adjustment area G is shown.

[0051] Fig. 20H A resizing operation in the adjustment area H is shown.

[0052] Fig.20I A resizing operation in the adjustment area I is shown.

[0053] Fig.21 An example of highlighting is shown.

[0054] Fig. 22 Another example of highlighting is shown.

[0055] Fig.23 Another example of highlighting is shown.

[0056] Fig.24 The sizing method guide process is outlined.

[0057] Fig.25 is a flowchart showing the resizing method guidance process.

[0058] Fig.26 One example of a guide display for guiding the resizing method to the user is shown. DETAILED DESCRIPTION

[0059] Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that in the following embodiments, the same reference numerals are attached to the same parts to omit repeated descriptions.

[0060] Furthermore, the present disclosure will be described according to the following item order.

[0061] 1. Overview of the Embodiments

[0062] 2. Configuration of terminal equipment

[0063] 3. Example of basic display control of windows

[0064] 3-1. Window display example

[0065] 3-2. Change the display mode according to the window position

[0066] 4. Operation of terminal equipment

[0067] 4-1. Overview of resizing operations

[0068] 4-2. Size adjustment operation (mode 1)

[0069] 4-3. Size adjustment operation (mode 2)

[0070] 4-4. Size adjustment operation (mode 3)

[0071] 4-5. Highlight

[0072] 4-6. Guidance on how to adjust the size

[0073] 5. Variations

[0074] 6. Conclusion

[0075] <<1. Overview of Embodiments>>

[0076] In many cases, an information processing device such as a smartphone having a touch panel display can display a resizable window on the display. Figure 1 A resizable window TW displayed on the touch panel display is shown.

[0077] Figure 2An adjustable size window TW displayed on a non-touch panel display is shown. In many cases, handles H11 to H14 for adjusting the size are arranged at the four corners of the window TW on the non-touch panel display. In many cases, the size of the window TW displayed on the non-touch panel display is adjusted by the user dragging and moving one of the handles H11 to H14 with a mouse. The mouse enables the user to drag the target portion with precise accuracy. Therefore, in the case of using a mouse for size adjustment, the handle for size adjustment needs to be small in size. Figure 2 In the example of FIG. 1 , each of the handles H11 to H14 for size adjustment has a small-sized dot.

[0078] Figure 3 A resizable window TW displayed on a touch panel display is shown. In addition, in the window TW on the touch panel display, handles (touch areas) H21 to H24 for size adjustment are arranged at four corners as invisible operation blocks. In this case, the user adjusts the size of the window TW by touching one of the handles H21 to H24 and sliding his / her finger to the target position as it is. In the touch operation, the user's finger touches a specific area of ​​the display. In order to prevent erroneous operation, the size of the handles H21 to H24 for size adjustment needs to be increased to a certain extent. For example, the size of the handles H21 to H24 is ideally about 10 mm × 10 mm (at least about 7 mm × 7 mm).

[0079] The handles H21 to H24 for size adjustment are transparent operation blocks that are invisible to the user. Therefore, the user can see the user interface (UI), such as icons behind the handles H21 to H24. The large-sized handles H21 to H24 for size adjustment prevent the user from performing touch operations on the UI even when the user can see the UI behind the handles H21 to H24. Therefore, the user feels inconvenienced.

[0080] Embedding resizing handles in the UI bar is a possible solution to this problem. Figure 4 A handle H3 for size adjustment embedded in the UI bar is shown. The information processing device automatically places the handle H3 only at one corner in the direction in which the user is likely to change the size according to the position of the window TW in the screen. Figure 4 In the example of , the window TW is located at the lower right side of the screen. Therefore, the information processing device arranges the UI bar in the upper direction of the window TW and arranges the handle H3 for size change in the upper left corner. Note that the window TW may have a minimum size limit to prevent the window TW from being lost. The minimum size window may be, for example, a square window.

[0081] In the case of the solution, the handle H3 for size adjustment is embedded in the UI bar so that no invisible operation block is generated. Therefore, unnecessary functions and displays do not occupy the screen. In addition, the solution has the advantage that a mode change for size adjustment is unnecessary (i.e., the user can adjust the size of the window TW with one action). On the contrary, the solution has the disadvantage that even when the size in the direction of the corner where the handle H3 is arranged can be adjusted, the size in the other three directions cannot be changed.

[0082] Therefore, in this embodiment, while maintaining the advantages of the above-mentioned solution, the size change in the other three directions is made possible. Figure 5 The solution of this embodiment is outlined.

[0083] The information processing apparatus according to the embodiment sets adjustment areas for adjusting the size of the window TW at the positions of at least four corners of the window TW. Figure 5 In the example, the information processing device sets an upper left direction adjustment area at the upper left corner of the window TW, sets an upper right direction adjustment area at the upper right corner of the window TW, sets a lower left direction adjustment area at the lower left corner of the window TW, and sets a lower right direction adjustment area at the lower right corner of the window TW.

[0084] The information processing device sets one of the four corners of the window TW as a capture corner in response to a user's touch operation, and sets its opposite corner as a fixed corner (anchor) for size adjustment. The capture corner is a corner dragged by the user's touch operation. For example, when the user touches the handle H3 displayed on the UI bar, the information processing device sets the upper left corner of the window TW as a capture corner, and sets the lower right corner as its opposite corner as a fixed angle. The information processing device performs processing for adjusting the size of the window TW in response to the user's touch operation (e.g., a finger sliding on the touch panel) in the adjustment area at the capture corner (the opposite corner of the fixed angle). For example, the information processing device changes the size of the window TW with the lower right corner as an anchor in response to the user's touch operation (finger sliding) in the upper left direction adjustment area at the upper left corner.

[0085] In this case, when the user keeps his / her finger touching the display and slides the touch position to the adjustment area at another corner, the setting of the capture angle is changed to the other corner, and the setting of the fixed angle is changed to the opposite corner of the other corner. For example, when the user slides his / her finger from the upper left adjustment area to the lower left adjustment area, the setting of the capture angle is changed from the upper left corner to the lower left corner, and the setting of the fixed angle is changed from the lower right corner to the upper right corner. Then, the information processing device changes the size of the window TW with the lower right corner as an anchor in response to the user's touch operation (finger sliding) in the upper left direction adjustment area at the upper left corner.

[0086] This prevents the generation of invisible operation blocks and prevents unnecessary functions and displays from occupying the screen. In addition, no mode change is required for size adjustment. Moreover, the user can adjust not only the size in the direction of the corner where the handle H3 is arranged, but also the size in the other three directions.

[0087] Although the embodiment has been outlined above, the terminal device 10 according to the embodiment will be described in detail below.

[0088] <<2. Configuration of terminal equipment>>

[0089] First, the configuration of the terminal device 10 will be described.

[0090] Figure 6 The configuration example of the terminal device 10 according to the embodiment of the present disclosure is shown. The terminal device 10 is an information processing apparatus (computer) owned by a user. The terminal device 10 is connected to another communication device (for example, a server device) via a network.

[0091] Here, the network is a communication network such as a local area network (LAN), a wide area network (WAN), a cellular network, a fixed telephone network, a regional Internet Protocol (IP) network, and the Internet. The network may include a wired network or a wireless network. In addition, the network may include a core network. The core network includes, for example, an evolved packet core (EPC) and a 5G core network (5GC). In addition, the network may include a data network other than the core network. The data network may be a service network of a telecommunications operator, such as an IP multimedia subsystem (IMS) network. In addition, the data network may be a dedicated network, such as an internal company network.

[0092] The terminal device 10 is generally a smart device (smart phone or tablet), but is not limited to a smart device. Any form of information processing device (computer) can be used as the terminal device 10. For example, the terminal device 10 can be a mobile terminal such as a mobile phone, a smart device, a personal digital assistant (PDA), and a notebook PC. In addition, the terminal device 10 can be a wearable device such as a smart watch. In addition, the terminal device 10 can be a portable Internet of Things (IoT) device.

[0093] Note that the terminal device 10 may be an xR device such as an augmented reality (AR) device, a virtual reality (VR) device, and a mixed reality (MR) device. In this case, the xR device may be a glasses-type device such as AR glasses and MR glasses, or may be a head-mounted device such as a VR head-mounted display. When the terminal device 10 is an xR device, the terminal device 10 may be an independent device including only a user-worn part (e.g., a glasses part). In addition, the terminal device 10 may be a terminal interlocking device including a user-worn part (e.g., a glasses part) and a terminal part (e.g., a smart device) interlocked with the part.

[0094] like Figure 6 As shown, the terminal device 10 includes a communication unit 11, a storage unit 12, a control unit 13, an input unit 14 and an output unit 15. Note that Figure 6 A functional configuration is shown, and the hardware configuration may be different from this configuration. In addition, the functions of the terminal device 10 may be distributed in and implemented in a plurality of physically separated configurations.

[0095] The communication unit 11 is a communication interface for communicating with another device. For example, the communication unit 11 is a local area network (LAN) interface, such as a network interface card (NIC). The communication unit 11 may be a wired interface or a wireless interface.

[0096] When the communication unit 11 includes a wireless interface, the communication unit 11 can be connected to a network or another communication device by using a radio access technology (RAT) such as long term evolution (LTE), new radio (NR), Wi-Fi and Bluetooth (registered trademark). In this case, the communication device may be able to use different types of radio access technologies. For example, the communication device may be able to use NR and Wi-Fi. In addition, the communication device can use different types of cellular communication technologies (e.g., LTE and NR). LTE and NR are types of cellular communication technologies, and enable mobile communication of communication devices by arranging multiple areas covered by base stations in a cell shape. In addition, the terminal device 10 can be connected to a network or other communication devices by using radio access technologies other than LTE, NR, Wi-Fi and Bluetooth.

[0097] The storage unit 12 is a data readable / writable storage device such as a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash memory, and a hard disk. The storage unit 12 is used as a storage device of the terminal device 10.

[0098] The control unit 13 is a controller that controls each unit of the terminal device 10. The control unit 13 is implemented by a processor such as a central processing unit (CPU), a microprocessing unit (MPU), and a graphics processing unit (GPU). For example, the control unit 13 is implemented by the processor executing various programs stored in a storage device in the terminal device 10 using a random access memory (RAM) or the like as a work area. Note that the control unit 13 can be implemented by an integrated circuit such as an application specific integrated circuit (ASIC) and a field programmable gate array (FPGA). Any of the CPU, MPU, GPU, ASIC, and FPGA can be regarded as a controller.

[0099] The control unit 13 includes a setting unit 131 and a changing unit 132. In addition to these blocks, the control unit 13 may also include a display control unit that controls the display on the screen. The modules (setting unit 131, changing unit 132, display control unit) that constitute the control unit 13 are functional modules that have the functions of the control unit 13. These functional modules can be software modules or hardware modules. For example, the above-mentioned functional blocks can be either a software module implemented by software (including microprograms) or a circuit block on a semiconductor chip (bare die). Of course, each functional block can be a processor or an integrated circuit. The control unit 13 may include functional units different from the above-mentioned functional blocks. Any method of constituting such functional blocks can be adopted.

[0100] Note that the control unit 13 may include functional units different from the above-mentioned functional blocks. In addition, another device may perform some or all operations of the modules (setting unit 131, change unit 132, display control unit) constituting the control unit 13. For example, a server device on the cloud may perform some or all operations of the modules constituting the control unit 13. The operations of the modules constituting the control unit 13 will be described later.

[0101] The input unit 14 is an input device that receives various inputs from the outside. For example, the input unit 14 is an operation device for the user to perform various operations, such as a keyboard, a mouse, and an operation key. Note that when a touch panel is adopted as the terminal device 10, the touch panel is included in the input unit 14. In this case, the user performs various operations by touching the screen with his / her finger or a stylus.

[0102] Note that the terminal device 10 may include a touch sensor for operating separately from the touch panel. Figure 7An example of the appearance of the terminal device 10 is shown. For example, the terminal device 10 may be provided with sensor areas 141 and 142 capable of detecting the contact of the user's finger along the longitudinal direction on the outside of the display screen. The user can perform various operations of the terminal device 10 by sliding, for example, his / her thumb in the area.

[0103] Back to Figure 6 , the output unit 15 is a device that provides various outputs such as sound, light, vibration and images to the outside. The output unit 15 gives various outputs to the user under the control of the control unit 13. Note that the output unit 15 includes a display device that displays various information. The display device is, for example, a liquid crystal display or an organic electroluminescent (EL) display. In the following description, the display device of the terminal device 10 or the screen formed by the display device may be referred to as a display screen 151. Note that the display screen 151 may be a touch panel display device. In this case, the display screen 151 may be considered to be integrated with the input unit 14.

[0104] The display screen 151 may be, for example, Figure 7 The vertical long screen shown. The upper area A1 of the display screen 151 is used to display general information (e.g., time, radio wave status, and battery status). In addition, the lower area A3 of the display screen 151 is used to display various keys (e.g., back key, main key, and menu / multitasking key). The central area A2 sandwiched between these areas is the display area of ​​the application screen. Note that the display area of ​​the application screen is not limited to the central area A2. For example, the terminal device 10 can set the area obtained by combining the upper area A1 and / or the lower area A3 with the central area A2 as the display area of ​​the application screen.

[0105] Note that when the terminal device 10 is an xR device (e.g., AR / MR glasses), the output unit 15 may be a transmission device that projects an image onto the glasses, or may be a retinal projection device that projects an image directly onto the user's retina. Note that the terminal device 10 may not have a screen as an object (e.g., a screen projected onto a display, a panel, etc.) because the terminal device 10 has, for example, a device that projects an image directly onto the user's retina. Even in this case, if the user can recognize the screen as a screen, the screen can be regarded as the display screen 151 of the present embodiment.

[0106] Note that when the terminal device 10 is an xR device, the terminal device 10 can detect an operation of the user touching the screen based on information from a sensor that detects the movement of the user's hand. In this case, the operation of the user touching the screen can be considered as a touch operation, and the following embodiments can be applied. In the following description, in one example, the display screen 151 of the terminal device 10 is a touch panel display.

[0107] <<Example of basic display control of window>>

[0108] The configuration of the terminal device 10 has been described above. Before describing the operation of the terminal device 10, an example of basic display control of a window will be described.

[0109] <3-1. Window display example>

[0110] The terminal device 10 displays a window TW whose position and size can be changed on the display screen 151 in response to a user operation. Figure 8 Window TW displayed on the screen is shown. Figure 8 In the example of FIG. 4 , the window TW is displayed in the central area A2 , which is the display area of ​​the application screen.

[0111] Here, the application screen may be a background screen on which icons and the like are displayed, or may be a main window displayed in a center area A2 on the entire screen. Note that the window TW may be superimposed and displayed on another window (eg, the main window). Figure 8 In the example of , the illustration of the application screen is omitted to facilitate visual recognition of the window TW. The user freely changes the position and size of the window TW to balance the display with the application screen.

[0112] At least when the focus is on the window TW, the terminal device 10 arranges the strip area (UI strip) in one of the end areas (upper end area, lower end area, left end area, and right end area) of the window TW. Figure 8 In the example of FIG. 1 , the terminal device 10 displays a UI bar N in the upper end region of the window TW. The terminal device 10 arranges one or more function icons related to window operations on the UI bar N. Note that the function icons may be referred to by other names, such as function buttons.

[0113] exist Figure 8 In the example of FIG. 4 , the function icon F1 , the function icon F2 , the function icon F3 , and the function icon F4 are arranged on the UI bar N. FIG.

[0114] The function icon F1 is an icon (resize button) for adjusting the size of the window TW. A handle for size adjustment (for example, Figure 4 When the user touches the function icon F1, the terminal device 10 performs a process for adjusting the size of the window TW in response to the user's touch operation.

[0115] The function icon F2 is an icon (close button) for closing the window TW. When the user touches the function icon F2, the terminal device 10 closes the window TW.

[0116] The function icon F3 is an icon for displaying an icon of the window TW. When the user touches the function icon F3, the terminal device 10 iconifies the window TW and displays the window TW on the screen. In this case, the terminal device 10 can display an icon image associated with the application displayed on the window TW. When the user touches the icon, the terminal device 10 displays the window TW on the screen again.

[0117] The function icon F4 is an icon for displaying the window TW on the entire screen. When the user touches the function icon F4, the terminal device 10 displays the window TW on the entire screen.

[0118] Note that a function icon non-display area SP is provided in the UI bar N of the window TW. The terminal device 10 moves the position of the window TW based on the user's movement operation of the window TW using the non-display area SP. For example, when the user keeps touching the non-display area SP and slides (swipes) his / her finger, the terminal device 10 moves the window TW according to the user's movement operation. Note that the non-display area can be referred to by other names, such as a blank area.

[0119] <3-2. Change of display mode depending on window position>

[0120] Next, a change in the display mode of the window TW on the display screen 151 depending on the position of the window TW will be described.

[0121] <3-2-1. Movement of window TW>

[0122] As described above, the position and size of the window TW can be changed. Fig. 9 shows how the window TW moves. Fig. 9 In the state S11, the window TW is displayed on the display screen 151. Note that Fig. 9 In the example of , illustration of the application screen (eg, the main window displayed on the entire screen) behind the window TW is omitted to facilitate visual recognition of the movement of the window TW.

[0123] The terminal device 10 moves the window TW based on the user's movement operation using the non-display area SP. In the movement operation, for example, the user keeps touching the non-display area SP and slides (swipes) his / her finger. The terminal device 10 moves the window TW according to the user's movement operation (state S12).

[0124] In this case, the user can make a part of the window TW protrude from the display screen 151. That is, the terminal device 10 of this embodiment can move the window TW beyond at least one of the upper end, the lower end, the left end, and the right end of the display screen 151. In this case, the terminal device 10 expects to move the window TW so as to leave at least a part of the non-display area SP on the display screen 151.

[0125] When a part of the window TW protrudes from the display screen 151, a part of the UI bar N protrudes from the display screen 151 and disappears. As described above, the non-display area SP and a plurality of function icons are displayed in the UI bar N. In this case, if the non-display area SP and the function icon F5 (resize button) protrude from the display screen 151, the user cannot change the position and size of the window TW thereafter. Therefore, at least one of the non-display area SP and the function icon F5 needs to remain on the display screen 151. As a result, the movement of the window TW is restricted.

[0126] Therefore, the terminal device 10 of the present embodiment changes the display mode of the window TW according to the situation so as to increase the movable area on the display screen 151 of the window TW. For example, the terminal device 10 changes the display position of the UI bar N and the arrangement of the function icons based on the position of the window TW on the display screen 151. The operation of the terminal device 10 will be described below with reference to the accompanying drawings.

[0127] <3-2-2. Changing the display mode when horizontal movement is performed in a vertical state>

[0128] First, a change in the display mode of the window TW in the case where the window TW is moved horizontally while the display screen 151 is in the vertical state will be described. Fig.10 and 11 It shows how the window TW moves horizontally when the display screen 151 is in the vertical state. Fig.10 It is shown how the window TW moves to the left. Fig.11 Here, the vertical state refers to the vertical direction of the display screen 151 corresponding to the vertical direction of the display screen 151. Fig.10 and 11 The status of the up and down directions is shown.

[0129] In the vertical state, the UI bar N is located at the upper end region or the lower end region of the window TW. When the window TW moves horizontally, the terminal device 10 changes the display order of multiple function icons in the UI bar N based on information about the position of the window TW in the display screen 151.

[0130] (1) Move left

[0131] First, refer to Fig.10Describes the movement of window TW to the left. Fig.10 In the example of FIG. 4 , the UI bar N is arranged in the upper end region of the window TW, but the UI bar N may be arranged in the lower end region.

[0132] Note that in the following description, the fulcrum P defines the position of the window TW on the display screen 151. The fulcrum P is located somewhere in the display area of ​​the window TW. The fulcrum P is located at a fixed position on the window TW and moves according to the movement of the window TW. In this embodiment, in one example, the fulcrum P is located at the upper center of the window TW. More specifically, as Fig.10 As shown, the fulcrum P is located at the center in the horizontal direction of the window TW, on the upper side of the area of ​​the window TW except the UI bar N. Note that although the figure shows the position of the fulcrum P in this embodiment, this is only for the convenience of understanding the embodiment, and the fulcrum P is not actually displayed on the display screen 151.

[0133] also, Fig.10 Line L11 and line L12 along the longitudinal direction of the display screen 151 are shown. Line L11 is located at a position offset to the left by a predetermined distance from the center in the horizontal direction. Line L12 is located at a position offset to the right by a predetermined position from the center in the horizontal direction. These lines trigger a change in the display order of multiple function icons. When the fulcrum P reaches the range from the right end of the display screen 151 to the line L11 or the range from the left end of the display screen 151 to the line L12, the terminal device 10 changes the display order of multiple function icons. The range between line L11 and line L12 is lagging, which is used to prevent the display order of multiple function icons from being frequently changed. These lines are also only to help understand the embodiment, rather than actually being displayed on the display screen 151.

[0134] exist Fig.10 In state S21, the window TW is displayed. Fig.10 In the example of state S21, the illustration of the application screen behind the window TW (for example, the main window displayed on the entire screen) is omitted to facilitate the visual recognition of the movement of the window TW. In the example of state S21, the UI bar N is located in the upper end area of ​​the window TW. Then, according to the display order of the function icons in the UI bar N, the function icon F2, the function icon F3, the function icon F4 and the function icon F1 are arranged from the right.

[0135] The terminal device 10 moves the window TW to the left according to the user operation. Then, when the fulcrum P of the window TW reaches the line L11, the display order of the multiple function icons in the UI bar N is changed (state S22). In the example of state S22, the terminal device 10 changes the function icon F1 used to adjust the size of the window TW to the position farthest from the left end of the display screen 151. More specifically, the terminal device 10 changes the display order of the function icons in the UI bar N to the order of function icon F1, function icon F4, function icon F3 and function icon F2 from the right. As the display order of the multiple function icons changes, the function icon non-display area SP is located at a position far away from the left end of the display screen 151.

[0136] The terminal device 10 also moves the window TW to the left according to the user operation (state S23). Since the function icon F1 and the non-display area SP have been moved to a position away from the left end of the display screen 151, the terminal device 10 can increase the downward movement range of the window TW. For example, the terminal device 10 can make the window TW protrude significantly outward from the left end of the display screen 151.

[0137] (2) Move right

[0138] Next, we will refer to Fig.11 Describes the leftward movement of window TW, although, similarly, Fig.11 In the example of FIG. 1 , the UI bar N is arranged in the upper end region of the window TW, but the UI bar N may be arranged in the lower end region. Fig.10 In the example of FIG. 1 , the pivot point P defines the position of the window TW on the display screen 151. Fig.10 In the example of FIG. 4 , line L11 and line L12 trigger a change in the display order of multiple function icons.

[0139] exist Fig.11 In the state S31, the window TW is displayed. Fig.11 In the example of state S32, the illustration of the application screen behind the window TW (for example, the main window displayed on the entire screen) is omitted to facilitate visual recognition of the movement of the window TW. In the example of state S32, the UI bar N is located in the upper end area of ​​the window TW. Then, the function icon F2, the function icon F3, the function icon F4 and the function icon F1 are arranged from the left in the display order of the function icons in the UI bar N.

[0140] The terminal device 10 moves the window TW to the right according to the user operation. Then, when the fulcrum P of the window TW reaches the line L12, the display order of the multiple function icons in the UI bar N is changed (state S32). In the example of state S32, the terminal device 10 changes the function icon F1 to the position farthest from the right end of the display screen 151. More specifically, the terminal device 10 changes the display order of the function icons in the UI bar N to the order of function icon F1, function icon F4, function icon F3 and function icon F2 from the left. As the display order of the multiple function icons changes, the function icon non-display area SP is located at a position far away from the right end of the display screen 151.

[0141] The terminal device 10 also moves the window TW to the right according to the user operation (state S33). Since the function icon F1 and the non-display area SP have been moved to a position away from the right end of the display screen 151, the terminal device 10 can increase the rightward movement range of the window TW. For example, the terminal device 10 can make the window TW protrude significantly outward from the right end of the display screen 151.

[0142] <3-2-3. Changing the display mode when vertical movement is performed in the vertical state>

[0143] Next, a description will be given of a change in the display mode of the window TW in the case where the window TW is vertically moved with the display screen 151 in the vertical state. Fig.12 It shows how the window TW moves vertically when the display screen 151 is in the vertical state.

[0144] In the vertical state, the UI bar N is located at the upper end region or the lower end region of the window TW. In the case of vertical movement, the terminal device 10 changes the position of the UI bar N to the other end region based on information about the position of the window TW in the display screen 151.

[0145] As in Fig.10 In the example of , the pivot point P defines the position of the window TW on the display screen 151. In addition, Fig.12 Line L21 and line L22 are shown at positions spaced apart from each other on the upper side in the lateral direction of the display screen 151. These lines trigger a change in the display position of the UI bar N. When the fulcrum P reaches the range from the upper end of the display screen 151 to the line L21 or the range from the lower end of the display screen 151 to the line L22, the terminal device 10 changes the display order of the plurality of function icons. The range between the line L21 and the line L22 is lagging, and is used to prevent the position of the UI bar N from being frequently changed.

[0146] exist Fig.12 In state S41, the window TW is displayed. Fig.12In the example of state S41, the illustration of the application screen behind the window TW (eg, the main window displayed on the entire screen) is omitted to facilitate visual recognition of the movement of the window TW. In the example of state S41, the UI bar N is located in the upper end area of ​​the window TW.

[0147] The terminal device 10 moves the window TW upward according to the user operation. Then, when the fulcrum P of the window TW reaches the line L21, the position of the UI bar N changes (state S42). In the example of state S42, the terminal device 10 changes the UI bar N from the upper end area of ​​the window TW to the lower end area, so that the UI bar N is located away from the upper end of the display screen 151. Since the UI bar N has been moved to a position away from the upper end of the display screen 151, the terminal device 10 can increase the upward movement range of the window TW. For example, the terminal device 10 can make the window TW protrude significantly outward from the upper end of the display screen 151.

[0148] Next, the terminal device 10 moves the window TW downward according to the user operation. Then, when the fulcrum P of the window TW reaches the line L22, the position of the UI bar N changes (state S43). In the example of state S43, the terminal device 10 changes the UI bar N from the lower end area of ​​the window TW to the upper end area, so that the UI bar N is located at a position away from the lower end of the display screen 151. Since the UI bar N has been moved to a position away from the lower end of the display screen 151, the terminal device 10 can increase the downward movement range of the window TW. For example, the terminal device 10 can make the window TW protrude significantly outward from the lower end of the display screen 151.

[0149] <3-2-4. Changes in display mode in horizontal state>

[0150] Although the display screen 151 is in a vertical state in the above-described embodiment, the display screen 151 may be in a horizontal state. Here, the horizontal state refers to a state in which the longitudinal direction of the display screen 151 corresponds to the horizontal direction. The following will describe a change in the display mode of the window TW when the window TW moves while the display screen 151 is in a horizontal state.

[0151] First, a change in the display mode of the window TW in the case where the window TW is horizontally moved will be described. Fig.13 It shows how the window TW moves horizontally when the display screen 151 is in the horizontal state.

[0152] In the horizontal state, the UI bar N is located at the left end region or the right end region of the window TW. In the case of horizontal movement, the terminal device 10 changes the position of the UI bar N to the other end region based on information about the position of the window TW in the display screen 151.

[0153] As in Fig.10In the example of , the pivot point P defines the position of the window TW on the display screen 151. Fig.13 In the example, the fulcrum P is located at the upper center. In addition, Fig.13 Line L31 and line L32 along the longitudinal direction of the display screen 151 are shown. Line L31 is located at a position offset to the left by a predetermined distance from the center in the horizontal direction. Line L32 is located at a position offset to the right by a predetermined position from the center in the horizontal direction. These lines trigger a change in the display position of the UI bar N. When the fulcrum P reaches the range from the left end of the display screen 151 to the line L31 or the range from the right end of the display screen 151 to the line L32, the terminal device 10 changes the display order of multiple function icons. The range between line L31 and line L32 is lagging, which is used to prevent the position of the UI bar N from being frequently changed.

[0154] exist Fig.13 In state S51, the window TW is displayed. Fig.13 In the example of state S51, the illustration of the application screen behind the window TW (eg, the main window displayed on the entire screen) is omitted to facilitate visual recognition of the movement of the window TW. In the example of state S51, the UI bar N is located in the right end region of the window TW.

[0155] The terminal device 10 moves the window TW to the right according to the user operation. Then, when the fulcrum P of the window TW reaches the line L32, the position of the UI bar N changes (state S52). In the example of state S52, the terminal device 10 changes the UI bar N from the right end area of ​​the window TW to the left end area, so that the UI bar N is located at a position away from the right end of the display screen 151. Since the UI bar N has been moved to a position away from the right end of the display screen 151, the terminal device 10 can increase the right movement range of the window TW. For example, the terminal device 10 can make the window TW protrude significantly outward from the right end of the display screen 151.

[0156] Next, the terminal device 10 moves the window TW to the left according to the user operation. Then, when the fulcrum P of the window TW reaches the line L31, the position of the UI bar N changes (state S53). In the example of state S53, the terminal device 10 changes the UI bar N from the left end area of ​​the window TW to the right end area, so that the UI bar N is located away from the left end of the display screen 151. Since the UI bar N has been moved to a position away from the left end of the display screen 151, the terminal device 10 can increase the left movement range of the window TW. For example, the terminal device 10 can make the window TW protrude significantly outward from the left end of the display screen 151.

[0157] Even when the window TW moves vertically, the display mode of the window TW can be changed. Specifically, the terminal device 10 operates similarly when the display screen 151 is in a vertical state and the window TW moves horizontally. Specifically, the terminal device 10 changes the display order of multiple function icons in the UI bar N based on the position of the window TW in the display screen 151 (fulcrum P). For example, the terminal device 10 displays multiple function icons in the left end area or the right end area of ​​the window TW. Then, when the window TW reaches a predetermined range from the upper end or the lower end of the display screen 151 as the window TW moves vertically, the terminal device 10 changes the display order of multiple function icons in the UI bar N. Specifically, as Fig.10 and Fig.11 As in the example of FIG. 1 , the terminal device 10 moves the positions of the function icon F1 and the non-display area SP to positions farther from the upper end or lower end of the display screen 151. This enables the terminal device 10 to increase the upward movement range or downward movement range of the window TW.

[0158] <<4. Operation of terminal equipment>>

[0159] An example of basic display control of the window TW has been described above. Next, the operation of the terminal device 10 of the present embodiment will be described in detail.

[0160] <4-1. Overview of Resizing Operation>

[0161] First, the resizing operation of the window TW will be outlined. Fig.14 The resizing operation of the window TW is summarized.

[0162] The terminal device 10 displays the resizable window TW on the display screen 151 in response to the user operation. When the user touches the function icon F1 of the window TW (state S61), the terminal device 10 superimposes and displays a semi-transparent window for resizing (hereinafter referred to as the window TWc for resizing) on ​​the window TW (state S62). In the example of state S62, the function icon F1 is displayed in the upper left corner of the window TW, so that the terminal device 10 displays the window TWc for resizing with the upper left corner as the capture object.

[0163] The terminal device 10 changes the shape of the window TWc for size adjustment in response to the user's touch operation (e.g., finger sliding operation) without changing the shape of the window TW (state S63). When the user changes the size of the window TWc for size adjustment to a desired size and releases his / her finger from the display screen 151, the terminal device 10 changes the size of the window TWc to the size of the window TWc for size adjustment (state S64).

[0164] exist Fig.14In the example of , the function icon F1 is arranged at the upper left of the window TW, so that the initial capture angle is the upper left corner of the original window TWo. Therefore, the initial fixed angle is the lower right corner, which is the angle opposite to the initial capture angle. However, as described in <3-2> above, the position of the function icon F1 to the window changes according to the position of the original-sized window TWo on the display screen 151, so that the positions of the initial capture angle and the initial fixed angle change according to the position of the original-sized window TWo on the display screen 151. For example, the function icon F1 is located at the lower left of the window TW, as shown in FIG. Fig.12 As shown in state S42, the initial capture angle is the lower left corner of the original window TWo, and the initial fixed angle is the upper right corner.

[0165] In the following description, although the initial capture angle is the upper left corner and the initial fixed angle is the lower right corner in one example, the initial capture angle and the initial fixed angle can be changed appropriately.

[0166] Although the resizing operation has been outlined above, the resizing operation will be described in detail. Depending on the relationship between the capture object (capture angle) and the fixing angle (anchor), multiple resizing operation modes are envisioned. In this embodiment, three modes of modes 1 to 3 will be described.

[0167] <4-2. Size Adjustment Operation (Mode 1)>

[0168] First, a description will be given of the resizing operation of Mode 1. In Mode 1, one of the four corners of the minimum-sized window is set as a fixed corner (anchor).

[0169] Fig.15 Mode 1 resizing operation is shown. Fig.15 1 shows the relationship between the window TW and the adjustment area for adjusting the window size. The window TWo is a window of the original size. The setting of the minimum size window TWm is provided in the window TW. In mode 1, the minimum size window TWm is located in a fixed area within the area of ​​the window TWo. Specifically, the minimum size window is located by adjusting the initial fixed angle ( Fig.15 The lower right corner in the example of ) is used as an anchor in the area obtained by reducing window Two to the minimum size.

[0170] The terminal device 10 sets a plurality of adjustment regions for adjusting the size of the window TW for the above-mentioned window. In this embodiment, the terminal device 10 sets the adjustment regions at the positions of at least four corners of the window TW. Fig.15 In the example of FIG. 4 , adjustment areas A, C, G, and I are provided at the four corners of the window TW.

[0171] Adjustment area A corresponds to the adjustment area associated with the upper left corner of window TW, and is located in the upper left direction of the area where the minimum size window TWm is located. Adjustment area C corresponds to the adjustment area associated with the upper right corner of window TW, and is located in the upper right direction of the area where the minimum size window TWm is located. Adjustment area G corresponds to the adjustment area associated with the lower left corner of window TW, and is located in the lower left direction of the area where the minimum size window TWm is located. Adjustment area I corresponds to the adjustment area associated with the lower right corner of window TW, and is located in the lower right direction of the minimum size window TWm.

[0172] Furthermore, in this embodiment, in addition to these four adjustment areas, the terminal device 10 sets adjustment areas at the positions of the four sides of the window TW. Fig.15 In the example of FIG. 4 , adjustment areas B, D, F, and H are provided on four sides of the window TW.

[0173] The adjustment region B corresponds to the adjustment region associated with the upper side of the window TW, and is located in the upward direction of the region where the minimum size window TWm is located. The adjustment region D corresponds to the adjustment region associated with the left side of the window TW, and is located in the left direction of the region where the minimum size window TWm is located. The adjustment region F corresponds to the adjustment region associated with the right side of the window TW, and is located in the right direction of the region where the minimum size window TWm is located. The adjustment region H corresponds to the adjustment region associated with the lower side of the window TW, and is located below the region where the minimum size window TWm is located.

[0174] Furthermore, in the present embodiment, the terminal device 10 sets an adjustment area E in the area where the minimum size window TWm is located, in addition to the eight adjustment areas.

[0175] When the user touches the function icon F1, the terminal device 10 sets one of the four corners of the window TW as a capture object (capture corner), and sets one of the four corners of the window TW as a fixed angle (anchor) for size adjustment. In this embodiment, the terminal device 10 sets the corner opposite to the capture corner as a fixed angle (anchor). For example, Fig.15 As shown, when the upper left corner of the window TW is set as a capture object (capture corner), the terminal device 10 sets the lower right corner as its opposite corner as a fixed angle.

[0176] Then, the terminal device 10 performs a process for adjusting the size of the window TW in response to a user's touch operation in the adjustment area at a corner opposite to the fixed angle (ie, a capture angle). Fig.15As shown, when the upper left corner of the window TW is set as a capture object (capture corner), the terminal device 10 changes the shape of the window TWc for size adjustment with the lower right corner as an anchor in response to the user's finger sliding operation in the adjustment area A. Specifically, the terminal device 10 changes the shape of the size adjustment window TWc with the upper left direction seen from the minimum size window TWm as the scaling direction while maintaining the lower right corner as a fixed corner at that position.

[0177] In addition, when the user slides the touch position to another adjustment area, the terminal device 10 changes the capture object (capture angle) to an angle associated with another adjustment area and changes the setting of the fixed angle. In mode 1, the terminal device 10 changes the setting of the fixed angle to one of the four corners of the minimum size window TWm, that is, the angle opposite to the angle associated with the adjustment area of ​​the sliding destination. For example, assuming that the user slides the touch position from Fig.15 The adjustment area A in the window 10 slides to the adjustment area G. In this case, the terminal device 10 changes the capture object (capture angle) to the lower left corner, and changes the fixed angle to the upper right corner of the minimum size window TWm.

[0178] Table 1 shows the relationship between the anchor (fixed angle), snap object (snap angle), and scaling direction in Mode 1.

[0179] (Table 1) Mode 1

[0180]

[0181]

[0182] In this table, A to I in the left column correspond to Fig.17 The size adjustment operation of the terminal device 10 for each adjustment area will be described in detail below.

[0183] (1) Adjust area A

[0184] Fig.16A The resizing operation in the adjustment area A is shown. When the upper left corner of the window TW is set as a capture object (capture angle) by a touch operation of the user, the terminal device 10 sets the lower right corner, which is the diagonal angle thereof, as a fixed angle. The terminal device 10 changes the shape of the window TWc for resizing in response to the finger sliding operation of the user in the adjustment area A, with the lower right corner as an anchor and the upper left direction when viewed from the minimum size window TWm as a scaling direction.

[0185] (2) Adjust area B

[0186] Fig. 16BThe size adjustment operation in the adjustment area B is shown. When the user's finger slides from another adjustment area to the adjustment area B, the terminal device 10 sets the upper side as the capture object and sets the relative lower side as the anchor. Note that the terminal device 10 can set the lower right corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area B, the terminal device 10 changes the shape of the window TWc for size adjustment with the lower side (lower right corner) as the anchor and the upward direction when viewed from the minimum size window TWm as the scaling direction.

[0187] (3) Adjustment area C

[0188] Fig. 16C The size adjustment operation in the adjustment area C is shown. When the user's finger slides from another adjustment area to the adjustment area C, the terminal device 10 sets the upper right corner as the capture object and sets the lower left corner as its diagonal corner as the fixed angle. In response to the user's finger sliding operation in the adjustment area C, the terminal device 10 changes the shape of the window TWc for size adjustment with the lower left corner as the anchor and the upper right direction when viewed from the minimum size window TWm as the scaling direction.

[0189] (4) Adjustment area D

[0190] Fig.16D The size adjustment operation in the adjustment area D is shown. When the user's finger slides from another adjustment area to the adjustment area D, the terminal device 10 sets the left side as the capture object and sets the opposite right side as the anchor. Note that the terminal device 10 can set the lower right corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area D, the terminal device 10 changes the shape of the window TWc for size adjustment with the right side (lower right corner) as the anchor and the left direction when viewed from the minimum size window TWm as the scaling direction.

[0191] (5) Adjustment area E

[0192] Fig.16E A size adjustment operation is shown in the adjustment area E. When the user's finger slides from another adjustment area to the adjustment area E, the terminal device 10 fixes the window TWc for size adjustment to a window having the same size as the minimum size window TWm.

[0193] (6) Adjustment area F

[0194] Fig.16FThe size adjustment operation in the adjustment area F is shown. When the user's finger slides from another adjustment area to the adjustment area F, the terminal device 10 sets the right side as the capture object and sets the opposite left side as the anchor. Note that the terminal device 10 can set the lower left corner as a fixed angle (anchor). In response to the user's finger sliding operation in the adjustment area F, the terminal device 10 changes the shape of the window TWc for size adjustment with the left side (lower left corner) as the anchor and the right direction when viewed from the minimum size window TWm as the scaling direction.

[0195] (7) Adjustment area G

[0196] Figure 16G The size adjustment operation in the adjustment area G is shown. When the user's finger slides from another adjustment area to the adjustment area G, the terminal device 10 sets the lower left corner as the capture object and sets the upper right corner as its diagonal corner as the fixed angle. In response to the user's finger sliding operation in the adjustment area G, the terminal device 10 changes the shape of the window TWc for size adjustment with the upper right corner as the anchor and the lower left direction when viewed from the minimum size window TWm as the scaling direction.

[0197] (8) Adjustment area H

[0198] Fig.16H The size adjustment operation in the adjustment area H is shown. When the user's finger slides from another adjustment area to the adjustment area H, the terminal device 10 sets the lower side as the capture object and sets the opposite upper side as the anchor. Note that the terminal device 10 can set the upper right corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area H, the terminal device 10 changes the shape of the window TWc for size adjustment, using the upper side (upper right corner) as the anchor and the downward direction when viewed from the minimum size window TWm as the scaling direction.

[0199] (9) Adjustment area I

[0200] Fig.16I The size adjustment operation in the adjustment area I is shown. When the user's finger slides from another adjustment area to the adjustment area I, the terminal device 10 sets the lower right corner as the capture object and sets the upper left corner as its diagonal corner as the fixed angle. In response to the user's finger sliding operation in the adjustment area I, the terminal device 10 changes the shape of the window TWc for size adjustment with the upper left corner as the anchor and the lower right direction when viewed from the minimum size window TWm as the scaling direction.

[0201] According to mode 1, even when the user's finger slides on the adjustment area, the shape of the window TWc for size adjustment changes smoothly. For example, when the user's finger slides from the adjustment area D to the adjustment area G, the size of the window TWc for size adjustment does not change suddenly. In addition, according to mode 1, even when the user mistakenly slides his / her finger to another adjustment area, the display state of the window TWc for size adjustment can be immediately returned to the original state. For example, when the user mistakenly slides his / her finger from the adjustment area D to the adjustment area G, if the user returns the finger to the adjustment area D, the display state of the window TWc for size adjustment can be immediately returned to the original state. Therefore, when mode 1 is adopted, a size adjustment operation with a low strange feeling can be performed.

[0202] <4-3. Size Adjustment Operation (Mode 2)>

[0203] In the case of mode 1, one of the four corners of the minimum size window is set as a fixed angle. An operation such as enlarging the window TW in the lower left direction with the upper right corner of the original size window TWo as a fixed angle cannot be performed by one action. Therefore, in mode 2, one of the four corners of the original size window TWo is set as a fixed angle (anchor). The resizing operation of mode 2 will be described below.

[0204] Fig.17 Mode 2 resizing operation is shown. Fig.17 1 shows the relationship between the window TW and the adjustment area for adjusting the window size. The window TWo is a window of the original size. The setting of the minimum size window TWm is provided in the window TW. In mode 2, the minimum size window TWm is located in a fixed area within the area of ​​the window TWo. Specifically, the minimum size window is located by adjusting the initial fixed angle ( Fig.17 The lower right corner in the example of ) is used as an anchor in the area obtained by reducing window Two to the minimum size.

[0205] The terminal device 10 sets a plurality of adjustment regions for adjusting the size of the window TW for the above-mentioned window. In this embodiment, the terminal device 10 sets the adjustment regions at the positions of at least four corners of the window TW. Fig.17 In the example of FIG. 4 , adjustment areas A, C, G, and I are provided at the four corners of the window TW.

[0206] Adjustment area A corresponds to the adjustment area associated with the upper left corner of window TW, and is located in the upper left direction of the area where the minimum size window TWm is located. Adjustment area C corresponds to the adjustment area associated with the upper right corner of window TW, and is located in the upper right direction of the area where the minimum size window TWm is located. Adjustment area G corresponds to the adjustment area associated with the lower left corner of window TW, and is located in the lower left direction of the area where the minimum size window TWm is located. Adjustment area I corresponds to the adjustment area associated with the lower right corner of window TW, and is located in the lower right direction of the minimum size window TWm.

[0207] Furthermore, in this embodiment, in addition to these four adjustment areas, the terminal device 10 sets adjustment areas at the positions of the four sides of the window TW. Fig.17 In the example of FIG. 4 , adjustment areas B, D, F, and H are provided on four sides of the window TW.

[0208] The adjustment region B corresponds to the adjustment region associated with the upper side of the window TW, and is located in the upward direction of the region where the minimum size window TWm is located. The adjustment region D corresponds to the adjustment region associated with the left side of the window TW, and is located in the left direction of the region where the minimum size window TWm is located. The adjustment region F corresponds to the adjustment region associated with the right side of the window TW, and is located in the right direction of the region where the minimum size window TWm is located. The adjustment region H corresponds to the adjustment region associated with the lower side of the window TW, and is located below the region where the minimum size window TWm is located.

[0209] Furthermore, in the present embodiment, the terminal device 10 sets an adjustment area E in the area where the minimum size window TWm is located, in addition to the eight adjustment areas.

[0210] When the user touches the function icon F1, the terminal device 10 sets one of the four corners of the window TW as a capture object (capture corner), and sets one of the four corners of the window TW as a fixed angle (anchor) for size adjustment. In this embodiment, the terminal device 10 sets the diagonal angle of the capture corner as a fixed angle (anchor). For example, Fig.17 As shown, when the upper left corner of the window TW is set as a capture object (capture angle), the terminal device 10 sets the lower right corner as its opposite angle as a fixed angle.

[0211] Then, the terminal device 10 performs a process for adjusting the size of the window TW in response to a user's touch operation in the adjustment area at the opposite corner of the fixed angle (ie, the capture angle). Fig.17As shown, when the upper left corner of the window TW is set as a capture object (capture corner), the terminal device 10 changes the shape of the window TWc for size adjustment with the lower right corner as an anchor in response to the user's finger sliding operation in the adjustment area A. Specifically, the terminal device 10 changes the shape of the size adjustment window TWc with the upper left direction seen from the minimum size window TWm as the scaling direction while maintaining the lower right corner as a fixed corner at that position.

[0212] In addition, when the user slides the touch position to another adjustment area, the terminal device 10 changes the capture object (capture angle) to an angle associated with another adjustment area and changes the setting of the fixed angle. In mode 2, the terminal device 10 changes the setting of the fixed angle to one of the four corners of the window TWo of the original size, that is, the opposite angle of the angle associated with the adjustment area of ​​the sliding destination. For example, assuming that the user slides the touch position from Fig.17 The adjustment area A in the window TWo slides to the adjustment area G. In this case, the terminal device 10 changes the capture object (capture angle) to the lower left corner, and changes the fixed angle to the upper right corner of the window TWo of the original size.

[0213] Table 2 shows the relationship between the anchor (fixed angle), the snap object (capture angle), and the scaling direction in Mode 2.

[0214] (Table 2) Mode 2

[0215]

[0216]

[0217] In this table, A to I in the left column correspond to Fig.17 The size adjustment operation of the terminal device 10 for each adjustment area will be described in detail below.

[0218] (1) Adjust area A

[0219] Fig.18A The resizing operation in the adjustment area A is shown. When the upper left corner of the window TW is set as a capture object (capture angle) by a touch operation of the user, the terminal device 10 sets the lower right corner as its opposite angle as a fixed angle. The terminal device 10 changes the shape of the window TWc for resizing in response to the user's finger sliding operation in the adjustment area A, with the lower right corner as an anchor and the upper left direction when viewed from the minimum size window TWm as a scaling direction.

[0220] (2) Adjust area B

[0221] Fig.18BThe size adjustment operation in the adjustment area B is shown. When the user's finger slides from another adjustment area to the adjustment area B, the terminal device 10 sets the upper side as the capture object and sets the relative lower side as the anchor. Note that the terminal device 10 can set the lower right corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area B, the terminal device 10 changes the shape of the window TWc for size adjustment, using the lower side (lower right corner) as the anchor and the upper direction when viewed from the minimum size window TWm as the scaling direction.

[0222] (3) Adjustment area C

[0223] Fig. 18C The size adjustment operation in the adjustment area C is shown. When the user's finger slides from another adjustment area to the adjustment area C, the terminal device 10 sets the upper right corner as the capture object and sets the lower left corner as its diagonal corner as the fixed angle. In response to the user's finger sliding operation in the adjustment area C, the terminal device 10 changes the shape of the window TWc for size adjustment with the lower left corner as the anchor and the upper right direction when viewed from the minimum size window TWm as the scaling direction.

[0224] (4) Adjustment area D

[0225] Fig.18D The size adjustment operation in the adjustment area D is shown. When the user's finger slides from another adjustment area to the adjustment area D, the terminal device 10 sets the left side as the capture object and sets the opposite right side as the anchor. Note that the terminal device 10 can set the lower right corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area D, the terminal device 10 changes the shape of the window TWc for size adjustment with the right side (lower right corner) as the anchor and the left direction when viewed from the minimum size window TWm as the scaling direction.

[0226] (5) Adjustment area E

[0227] Fig.18E A size adjustment operation is shown in the adjustment area E. When the user's finger slides from another adjustment area to the adjustment area E, the terminal device 10 fixes the window TWc for size adjustment to a window having the same size as the minimum size window TWm.

[0228] (6) Adjustment area F

[0229] Fig.18FThe size adjustment operation in the adjustment area F is shown. When the user's finger slides from another adjustment area to the adjustment area F, the terminal device 10 sets the right side as the capture object and sets the opposite left side as the anchor. Note that the terminal device 10 can set the lower left corner as a fixed angle (anchor). In response to the user's finger sliding operation in the adjustment area F, the terminal device 10 changes the shape of the window TWc for size adjustment with the left side (lower left corner) as the anchor and the right direction when viewed from the minimum size window TWm as the scaling direction.

[0230] (7) Adjustment area G

[0231] Figure 18G The size adjustment operation in the adjustment area G is shown. When the user's finger slides from another adjustment area to the adjustment area G, the terminal device 10 sets the lower left corner as the capture object and sets the upper right corner as its diagonal corner as the fixed angle. In response to the user's finger sliding operation in the adjustment area G, the terminal device 10 changes the shape of the window TWc for size adjustment with the upper right corner as the anchor and the lower left direction when viewed from the minimum size window TWm as the scaling direction.

[0232] (8) Adjustment area H

[0233] Fig.18H The size adjustment operation in the adjustment area H is shown. When the user's finger slides from another adjustment area to the adjustment area H, the terminal device 10 sets the lower side as the capture object and sets the opposite upper side as the anchor. Note that the terminal device 10 can set the upper right corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area H, the terminal device 10 changes the shape of the window TWc for size adjustment, using the upper side (upper right corner) as the anchor and the downward direction when viewed from the minimum size window TWm as the scaling direction.

[0234] (9) Adjustment area I

[0235] Fig.18I The size adjustment operation in the adjustment area I is shown. When the user's finger slides from another adjustment area to the adjustment area I, the terminal device 10 sets the lower right corner as the capture object and sets the upper left corner as its diagonal corner as the fixed angle. In response to the user's finger sliding operation in the adjustment area I, the terminal device 10 changes the shape of the window TWc for size adjustment with the upper left corner as the anchor and the lower right direction when viewed from the minimum size window TWm as the scaling direction.

[0236] According to mode 2, for example, an operation such as enlarging the window TW in the lower left direction with the upper right corner of the window TWo of the original size as a fixed angle can be performed by one action. In addition, according to mode 1, even when the user slides his / her finger to another adjustment area by mistake, if the user returns the finger to the original adjustment area, the display state of the window TWc for size adjustment can be immediately returned to the original state.

[0237] <4-4. Size Adjustment Operation (Mode 3)>

[0238] In the case of mode 2, the adjustment area is fixed at a predetermined position of the window TWo of the original size. Therefore, operations such as taking the upper right corner as a fixed angle, taking the lower left corner as a capture angle, and reducing the window TW by moving the capture angle in the upper right direction cannot be performed. Therefore, in mode 3, the positions of the minimum size window TWm and the adjustment area are changed in response to the user's touch operation. The size adjustment operation of mode 3 will be described below.

[0239] Fig.19 Mode 3 resizing operation is shown. Fig.19 The relationship between the window TW and the adjustment area for adjusting the window size is shown. The window TWo is a window of the original size. The setting of the minimum size window TWm is provided in the window TW.

[0240] In mode 3, the position of the minimum size window TWm changes within the area of ​​the original size window TWo as the fixed angle changes. Specifically, the area of ​​the minimum size window TWm is located in the area obtained by reducing the original size window Two to the minimum size with the current fixed angle as an anchor. For example, Fig.19 As shown in the above figure, if the current capture object (capture corner) is the upper left corner, the area of ​​the minimum size window TWm is located in the area obtained by reducing the original size window Two to the minimum size with the lower right corner as the anchor. In addition, as Fig.19 As shown in the following figure, if the current capture object (capture corner) is changed to the lower right corner, the area of ​​the minimum size window TWm is located in the area obtained by reducing the original size window Two to the minimum size with the upper left corner as the anchor.

[0241] In the following description, the area obtained by reducing the original-sized window Two to the minimum size with the lower right corner as an anchor is referred to as the lower right area. The area obtained by reducing the original-sized window Two to the minimum size with the lower left corner as an anchor is referred to as the lower left area. The area obtained by reducing the original-sized window TWo to the minimum size with the upper right corner as an anchor is referred to as the upper right area. The area obtained by reducing the original-sized window Two to the minimum size with the upper left corner as an anchor is referred to as the upper left area.

[0242] The terminal device 10 sets a plurality of adjustment regions for adjusting the size of the window TW for the above-mentioned window. In this embodiment, the terminal device 10 sets the adjustment regions at the positions of at least four corners of the window TW. Fig.19 In the example of FIG. 4 , adjustment areas A, C, G, and I are provided at the four corners of the window TW.

[0243] Adjustment area A corresponds to the adjustment area associated with the upper left corner of window TW, and is located in the upper left direction of the area where the minimum size window TWm is located. Adjustment area C corresponds to the adjustment area associated with the upper right corner of window TW, and is located in the upper right direction of the area where the minimum size window TWm is located. Adjustment area G corresponds to the adjustment area associated with the lower left corner of window TW, and is located in the lower left direction of the area where the minimum size window TWm is located. Adjustment area I corresponds to the adjustment area associated with the lower right corner of window TW, and is located in the lower right direction of the minimum size window TWm.

[0244] Furthermore, in this embodiment, in addition to these four adjustment areas, the terminal device 10 sets adjustment areas at positions on the four sides of the window TW. Fig.19 In the example of FIG. 1 , adjustment areas B, D, F, and H are provided on four sides of the window TW.

[0245] The adjustment region B corresponds to the adjustment region associated with the upper side of the window TW, and is located in the upward direction of the region where the minimum size window TWm is located. The adjustment region D corresponds to the adjustment region associated with the left side of the window TW, and is located in the left direction of the region where the minimum size window TWm is located. The adjustment region F corresponds to the adjustment region associated with the right side of the window TW, and is located in the right direction of the region where the minimum size window TWm is located. The adjustment region H corresponds to the adjustment region associated with the lower side of the window TW, and is located below the region where the minimum size window TWm is located.

[0246] Furthermore, in the present embodiment, the terminal device 10 sets an adjustment area E in the area where the minimum size window TWm is located, in addition to the eight adjustment areas.

[0247] As described above, the position of the minimum size window TWm changes within the area of ​​the window TWo of the original size as the fixed angle changes. Therefore, when the user's hand moves on the adjustment area, the boundary between the adjustment areas changes. That is, in mode 3, the boundary is different between when the user's hand moves from the original adjustment area to another adjustment area and when the user's hand returns from another adjustment area to the original adjustment area, which results in the same state as the state of providing hysteresis. Thus, it is possible to prevent the shape of the size adjustment window TWc from changing frequently and significantly when the user's hand is located at the boundary between the adjustment areas.

[0248] When the user touches the function icon F1, the terminal device 10 sets one of the four corners of the window TW as a capture object (capture corner), and sets one of the four corners of the window TW as a fixed angle (anchor) for size adjustment. In this embodiment, the terminal device 10 sets the diagonal angle of the capture corner as a fixed angle (anchor). For example, Fig.19 As shown in the above figure, when the upper left corner of the window TW is set as the capture object (capture angle), the terminal device 10 sets the lower right corner as its opposite corner as the fixed angle.

[0249] Then, the terminal device 10 performs a process for adjusting the size of the window TW in response to a user's touch operation in the adjustment area at the opposite corner of the fixed angle (ie, the capture angle). Fig.19 As shown in the above figure, when the upper left corner of the window TW is set as the capture object (capture corner), the terminal device 10 changes the shape of the window TWc for size adjustment with the lower right corner as an anchor in response to the user's finger sliding operation in the adjustment area A. Specifically, the terminal device 10 changes the shape of the size adjustment window TWc with the upper left direction seen from the minimum size window TWm as the scaling direction while maintaining the lower right corner as a fixed corner at this position.

[0250] In addition, when the user slides the touch position to another adjustment area, the terminal device 10 changes the capture object (capture angle) to an angle associated with another adjustment area and changes the setting of the fixed angle. In mode 3, the terminal device 10 changes the setting of the fixed angle to one of the four corners of the window TWo of the original size, that is, the opposite angle of the angle associated with the adjustment area of ​​the sliding destination. For example, assuming that the user slides the touch position from Fig.19 The terminal device 10 slides the adjustment area A in the adjustment area to the adjustment area G. In this case, the terminal device 10 changes the capture object (capture angle) to the lower left corner, and changes the fixed angle to the upper right corner of the window TWo of the original size. In addition, the terminal device 10 changes the position of the minimum size window TWm in the area of ​​the window TWo of the original size as the fixed angle changes. In addition, the terminal device 10 changes the setting of the adjustment area as the fixed angle changes.

[0251] Table 3 shows the relationship between the anchor (fixed angle), the capture object (capture angle), and the scaling direction in Mode 3.

[0252] (Table 3) Mode 3

[0253]

[0254] In this table, A to I in the left column correspond to Fig.19 The size adjustment operation of the terminal device 10 for each adjustment area will be described in detail below.

[0255] (1) Adjust area A

[0256] Fig. 20A The size adjustment operation in the adjustment area A is shown. When the upper left corner of the window TW is set as a capture object (capture angle) by a touch operation of the user, the terminal device 10 sets the lower right corner as its diagonal as a fixed angle. When the setting of the minimum size window TWm is not provided in the lower right area of ​​the window TWo of the original size, the terminal device 10 changes the setting of the minimum size window TWm to the lower right area. When the position of the minimum size window TWm changes, the adjustment area also changes accordingly. In response to the user's finger sliding operation in the adjustment area A, the terminal device 10 changes the shape of the window TWc for size adjustment, with the lower right corner as an anchor and the upper left direction when viewed from the minimum size window TWm as a scaling direction.

[0257] (2) Adjust area B

[0258] Fig. 20B 1 shows a size adjustment operation in adjustment area B. When the user's finger slides from another adjustment area to adjustment area B, the terminal device 10 sets the upper side as the capture object and sets the opposite lower side as the anchor. Note that the terminal device 10 can directly set the fixed angle (anchor) in the adjustment area of ​​the sliding source as the fixed angle (anchor). For example, when the user's finger slides from adjustment area A, the terminal device 10 sets the lower right corner as the fixed angle (anchor), as shown in FIG. Fig. 20B As shown. In contrast, when the user's finger slides from the adjustment area C, the terminal device 10 sets the lower left corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area B, the terminal device 10 changes the shape of the window TWc for size adjustment with the lower side (lower right corner or lower left corner) as the anchor and the upper direction when viewed from the minimum size window TWm as the scaling direction.

[0259] (3) Adjustment area C

[0260] Fig. 20CA resizing operation in the adjustment area C is shown. When the user's finger slides from another adjustment area to the adjustment area C, the terminal device 10 sets the upper right corner as a capture object, and sets the lower left corner as its diagonal as a fixed angle. When the setting of the minimum size window TWm is not provided in the lower left area of ​​the window TWo of the original size, the terminal device 10 changes the setting of the minimum size window TWm to the lower left area. When the position of the minimum size window TWm changes, the adjustment area also changes accordingly. In response to the user's finger sliding operation in the adjustment area C, the terminal device 10 changes the shape of the window TWc for resizing, with the lower left corner as an anchor and the upper right direction when viewed from the minimum size window TWm as a scaling direction.

[0261] (4) Adjustment area D

[0262] Fig.20D 1 shows a size adjustment operation in adjustment area D. When the user's finger slides from another adjustment area to adjustment area D, the terminal device 10 sets the left side as the capture object and sets the opposite right side as the anchor. Note that the terminal device 10 can directly set the fixed angle (anchor) in the adjustment area of ​​the sliding source as the fixed angle (anchor). For example, when the user's finger slides from adjustment area A, the terminal device 10 sets the lower right corner as the fixed angle (anchor), as shown in FIG. Fig.20D As shown. In contrast, when the user's finger slides from the adjustment area G, the terminal device 10 sets the upper right corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area D, the terminal device 10 changes the shape of the window TWc for size adjustment with the right side (lower right corner or upper right corner) as the anchor and the left direction when viewed from the minimum size window TWm as the scaling direction.

[0263] (5) Adjustment area E

[0264] Fig.20E The size adjustment operation in the adjustment area E is shown. When the user's finger slides from another adjustment area to the adjustment area E, the terminal device 10 fixes the window TWc for size adjustment to a window having the same size as the minimum size window TWm. Note that the terminal device 10 can directly set the fixed angle (anchor) in the adjustment area of ​​the sliding source to the fixed angle (anchor).

[0265] (6) Adjustment area F

[0266] Fig.20F1 shows a size adjustment operation in adjustment area F. When the user's finger slides from another adjustment area to adjustment area F, the terminal device 10 sets the right side as the capture object and sets the opposite left side as the anchor. Note that the terminal device 10 can directly set the fixed angle (anchor) in the adjustment area of ​​the sliding source as the fixed angle (anchor). For example, when the user's finger slides from adjustment area C, the terminal device 10 sets the lower left corner as the fixed angle (anchor), as shown in FIG. Fig.20F In contrast, when the user's finger slides from the adjustment area I, the terminal device 10 sets the upper left corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area F, the terminal device 10 changes the shape of the window TWc for size adjustment with the left side (lower left corner or upper left corner) as the anchor and the right direction when viewed from the minimum size window TWm as the scaling direction.

[0267] (7) Adjustment area G

[0268] Figure 20G A resizing operation in the adjustment area G is shown. When the user's finger slides from another adjustment area to the adjustment area G, the terminal device 10 sets the lower left corner as a capture object and sets the upper right corner as its diagonal as a fixed angle. When the setting of the minimum size window TWm is not provided in the upper right area of ​​the window TWo of the original size, the terminal device 10 changes the setting of the minimum size window TWm to the upper right area. When the position of the minimum size window TWm changes, the adjustment area also changes accordingly. In response to the user's finger sliding operation in the adjustment area G, the terminal device 10 changes the shape of the window TWc for resizing, with the upper right corner as an anchor and the lower left direction when viewed from the minimum size window TWm as a scaling direction.

[0269] (8) Adjustment area H

[0270] Fig. 20H 1 shows a size adjustment operation in the adjustment area H. When the user's finger slides from another adjustment area to the adjustment area H, the terminal device 10 sets the lower side as the capture object and sets the upper side as the anchor. Note that the terminal device 10 can directly set the fixed angle (anchor) in the adjustment area of ​​the sliding source as the fixed angle (anchor). For example, when the user's finger slides from the adjustment area G, the terminal device 10 sets the upper right corner as the fixed angle (anchor), as shown in FIG. Fig. 20H As shown. In contrast, when the user's finger slides from the adjustment area I, the terminal device 10 sets the upper left corner as a fixed corner (anchor). In response to the user's finger sliding operation in the adjustment area H, the terminal device 10 changes the shape of the window TWc for size adjustment, using the upper side (upper right corner or upper left corner) as the anchor and the downward direction when viewed from the minimum size window TWm as the scaling direction.

[0271] (9) Adjustment area I

[0272] Fig.18I The size adjustment operation in the adjustment area I is shown. When the user's finger slides from another adjustment area to the adjustment area I, the terminal device 10 sets the lower right corner as the capture object and sets the upper left corner as its diagonal corner as the fixed angle. When the setting of the minimum size window TWm is not provided in the upper left area of ​​the window TWo of the original size, the terminal device 10 changes the setting of the minimum size window TWm to the upper left area. When the position of the minimum size window TWm changes, the adjustment area also changes accordingly. In response to the user's finger sliding operation in the adjustment area I, the terminal device 10 changes the shape of the window TWc for size adjustment, with the upper left corner as the anchor and the lower right direction when viewed from the minimum size window TWm as the scaling direction.

[0273] According to mode 3, the minimum size window is not fixed, which enables more flexible resizing. For example, the terminal device 10 can perform operations such as reducing the window TW by moving the capture angle in the upper right corner direction with the upper right corner as a fixed angle and the lower left corner as a capture angle.

[0274] <4-5. Highlight>

[0275] When the user changes the size of the window TW, the terminal device 10 can highlight the current fixed angle so that the user can easily see where the current fixed angle (anchor) is. In addition, the terminal device 10 can highlight the two sides (two edges) of the four sides of the window that sandwich the current capture angle (i.e., the diagonal of the current fixed angle) so that the user can easily see where the current capture angle is.

[0276] Fig.21 An example of highlighting is shown. Fig.21 A display example of a case where one of the four corners of the minimum window TWm is set as a fixed angle is shown. Fig.21 In the example of FIG. 1 , highlight L1 and highlight L2 are given to window TWc for resizing. Highlight L1 highlights the current fixed angle. Highlight L2 highlights the two sides sandwiching the current snap angle.

[0277] Fig. 22 Another example of highlighting is shown. Fig. 22 A display example is shown in which one of the four corners of the original-size window TWo is set to a fixed angle. Fig. 22 In the example of FIG. 1 , highlight L1 and highlight L2 are given to window TWc for resizing. Highlight L1 highlights the current fixed angle. Highlight L2 highlights the two sides sandwiching the current snap angle.

[0278] Fig.23 Another example of highlighting is shown. Fig.23 An example is shown in which the terminal device 10 does not display the window TWc for size adjustment when the function icon F1 is touched. Fig.23 In the example of , the terminal device 10 directly changes the size of the window TW in real time in response to the user's touch operation. Also in this case, the terminal device 10 can directly give the highlight L1 and the highlight L2 to the window TW.

[0279] Note that although Fig.21 , 22 In the examples of 23, both highlight L1 and highlight L2 are given to the window, but only one of highlight L1 and highlight L2 may be given to the window. Note that Fig.21 , 22 The highlighted display L1 and the highlighted display L2 in FIG. 23 are merely examples. Other displays such as changing the color of the corners and sides (edges) may be used as the highlighted display.

[0280] <4-6. Guidance on size adjustment>

[0281] Since the above-mentioned resizing method is slightly more complicated than the conventional resizing method, the user may continue to use the terminal device 10 without finding the method. Therefore, in order to inform the user of the method of resizing the window TW, when a predetermined condition is met, the terminal device 10 guides the user to a page (hereinafter, also referred to as a usage guide page) where the resizing method is queried.

[0282] Fig.24 The resizing method guidance process is summarized. When the window TW is displayed on the display screen 151, if it is determined that the preset condition is met, a guidance display for guiding the user to the resizing method is performed (step S201). For example, the terminal device 10 displays a tool tip T on the upper part of the window TW. A link to a usage guide page can be set in the tool tip T, and when the user taps the tool tip T (step S202), the terminal device 10 displays a usage guide page for introducing the resizing method to the user (step S203).

[0283] Although the resizing method guidance process has been outlined above, the details of the resizing method guidance process will be described below. Fig.25 is a flowchart showing the size adjustment method guidance process. Fig.25 The flowchart depicts the resizing method boot process.

[0284] When the user performs a predetermined touch operation, the terminal device 10 activates the window TW (step S301). Then, the terminal device 10 determines whether a count condition has been satisfied (step S302).

[0285] In this embodiment, in order to be able to present guidance on the operation method to the user at a timing when the user feels the limitation or frustration of the size adjustment method, the number of predetermined user operations on the window TW is counted. Only when the counter reaches a predetermined number, a guidance display for notifying the user of the size adjustment method is performed.

[0286] Various conditions can be used as counting conditions of the counter. For example, the terminal device 10 can count the number of times the window TW is newly activated at the default position. In addition, the timing of the counter to perform counting is not limited to when the window TW is activated. For example, the terminal device 10 can count the number of times both window movement and size adjustment are performed from the activation of the window TW to the closing. In addition, the terminal device 10 can measure the time it takes for the user to perform size adjustment, and the counter can be counted when the user spends 20 seconds or more to perform size adjustment.

[0287] When the counting condition is not satisfied (step S302: No), the terminal device 10 returns the process to step S301. When the counting condition is satisfied (step S302: Yes), the terminal device 10 increments the counter by one (step S303).

[0288] Next, the terminal device 10 determines whether the counter is a predetermined threshold or greater (step S304). The terminal device 10 determines whether the counter is 10 or greater. The user or developer can optionally determine the threshold. In addition, the threshold can be changed. For example, after displaying the tool tip T, the threshold can be reset to a value greater than or less than the current threshold. When the counter is less than the predetermined threshold (step S304: No), the terminal device 10 returns the process to step S301. When the counter is a predetermined threshold or greater (step S304: Yes), the terminal device 10 displays the tool tip T on the display screen 151 (step S305). Then, the terminal device 10 resets the counter (step S306).

[0289] Subsequently, the terminal device 10 determines whether the tool tip T has been tapped (step S307). When the tool tip T has been tapped (step S307: Yes), the terminal device 10 displays a usage guide page for introducing the size adjustment method to the user (step S308). When the display is completed, the terminal device 10 ends the size adjustment method guidance process.

[0290] In contrast, when the tool tip T is not tapped (step S307: No), the terminal device 10 determines whether the erasure condition of the tool tip T is satisfied (step S309). Various conditions can be used as the erasure condition. For example, when the user performs a touch operation outside the tool tip T or a predetermined time (e.g., four seconds) has passed without an operation, the terminal device 10 can determine that the erasure condition of the tool tip T has been satisfied. When the erasure condition is not satisfied, the terminal device 10 returns the process to step S307. In contrast, when the erasure condition is satisfied, the terminal device 10 erases the tool tip (step S310) and returns the process to step S301.

[0291] <<5. Changes>>

[0292] The above-described embodiment is one example, and various modifications and applications are possible.

[0293] For example, in the above-described embodiment, the tool tip T has been displayed as a guide display for guiding the user in the size adjustment method. However, the guide display is not limited to the tool tip T, and may be an animation for guiding the user in the size adjustment method. Fig.26 An example of a guide display for guiding the user in the size adjustment method is shown. Fig.26 As shown, the terminal device 10 may display an animation for notifying the user of the size adjustment function when the user performs size adjustment. Fig.26 In the example of , the terminal device 10 displays an arrow on the screen to notify the user that the size change operation handle can be moved further downward.

[0294] Furthermore, in the above-described embodiment, when the function icon F1 is touched, the terminal device 10 displays, for example, Fig.14 The size of the window TWc for size adjustment is then changed in response to the user's touch operation. However, when the function icon F1 is touched, the terminal device 10 may directly change the size of the window TW in real time in response to the user's touch operation without displaying the window TWc for size adjustment. In this case, the terminal device 10 may display the UI bar in the window TW, without necessarily displaying the UI bar in the window TW. In addition, the terminal device 10 may give highlight L1 and / or highlight L2 to the window TW, for example, Fig.26 shown.

[0295] The control device for controlling the terminal device 10 of this embodiment may be implemented by a dedicated computer system or a general-purpose computer system.

[0296] For example, a communication program for performing the above-mentioned operation is stored in a computer-readable recording medium such as an optical disk, a semiconductor memory, a magnetic tape, and a floppy disk to be distributed. Then, for example, the program is installed in a computer, and the above-mentioned processing is performed to constitute a control device. In this case, the control device may be a device (e.g., a personal computer) outside the terminal device 10. In addition, the control device may be a device (e.g., a control unit 13) inside the terminal device 10.

[0297] In addition, the above-mentioned communication program can be stored in a disk device of a server device on a network such as the Internet, so that the communication program can be downloaded to a computer, for example. In addition, the above-mentioned functions can be implemented by the cooperation of an operating system (OS) and application software. In this case, the part other than the OS can be stored in a medium for distribution, or the part other than the OS can be stored in a server device, so that the part can be downloaded to a computer, for example.

[0298] In addition, in each process described in the above embodiments, all or part of the process described as being automatically performed may be performed manually, or all or part of the process described as being manually performed may be automatically performed by a known method. In addition, unless otherwise specified, the process, specific name, and information including various data and parameters in the above documents and drawings may be arbitrarily changed. For example, various information in each figure is not limited to the information illustrated.

[0299] In addition, each component of the device shown is functional and conceptual, and does not necessarily need to be physically configured as shown. That is, the specific form of dispersion / integration of the device is not limited to the form shown, and all or part of the device can be configured in any unit in a functionally or physically dispersed / integrated manner according to various loads and usage conditions.

[0300] Furthermore, the above-described embodiments can be appropriately combined in areas where the processing contents do not contradict each other. Furthermore, the order of the processing in the above-described embodiments can be appropriately changed.

[0301] In addition, for example, the embodiments may be performed as any configuration constituting a device or a system, such as a processor used as a system large scale integration (LSI) or the like, a module using a plurality of processors or the like, a unit using a plurality of modules or the like, a collection obtained by further adding other functions to the unit (i.e., a configuration of a part of the device), and the like.

[0302] Furthermore, for example, the embodiment may adopt a configuration of cloud computing in which one function is shared and processed cooperatively by a plurality of devices via a network.

[0303] <<6. Conclusion>>

[0304] As described above, according to one embodiment of the present disclosure, the terminal device 10 displays a resizable window TW on the display screen 151. Then, the terminal device 10 sets an adjustment area for resizing at least at the positions of the four corners of the window TW, and sets one of the four corners of the window TW as a fixed angle for resizing. Then, the terminal device 10 performs a process for adjusting the size of the window TW in response to a touch operation of the user in the adjustment area associated with the capture angle (i.e., the diagonal of the fixed angle). When the user slides the touch position to the adjustment area associated with another corner, the terminal device 10 changes the setting of the fixed angle to the diagonal of the other corner. This enables the user to not only resize in one direction using the initial capture angle, but also resize in the other three directions.

[0305] Although the embodiments of the present disclosure have been described above, the technical scope of the present disclosure is not limited to the above embodiments, and various modifications may be made without departing from the gist of the present disclosure. In addition, components of different embodiments and modifications may be appropriately combined.

[0306] In addition, the effects in the embodiments described in this specification are merely examples and are not limiting. Other effects may be exhibited.

[0307] Note that the present technology may also have the following configurations.

[0308] (1) An information processing device comprising:

[0309] a display control unit for displaying a resizable window on the touch panel display;

[0310] a setting unit that sets adjustment areas for adjusting the size of the window by touch operation at least at the positions of the four corners of the window, and sets one of the four corners of the window as a fixed angle for size adjustment; and

[0311] a changing unit that performs a process for resizing the window in response to a user's touch operation in an adjustment area associated with a diagonal angle of the fixed angle,

[0312] When the user slides the touch position to the adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to the opposite corner of the other corner.

[0313] (2) The information processing device according to (1),

[0314] The window has a setting for the minimum size window, and

[0315] The minimum size window is located in a fixed area within the area of ​​the original size window.

[0316] (3) The information processing device according to (2),

[0317] Among them, the minimum size window is located in the area obtained by reducing the window of the original size to the minimum size with the initial fixed angle as the anchor.

[0318] (4) The information processing device according to (3),

[0319] Among them, multiple adjustment areas are set for a window, and

[0320] The setup unit sets at least:

[0321] A first adjustment area, corresponding to the adjustment area associated with the upper left corner of the window, and located in the upper left direction of the area where the minimum size window is located;

[0322] a second adjustment area, corresponding to the adjustment area associated with the upper right corner of the window, and located in the upper right direction of the area where the minimum size window is located;

[0323] a third adjustment area, corresponding to the adjustment area associated with the lower left corner of the window and located in the lower left direction of the area where the minimum size window is located; and

[0324] The fourth adjustment area corresponds to the adjustment area associated with the lower right corner of the window and is located in the lower right direction of the minimum size window.

[0325] (5) The information processing device according to (4),

[0326] Wherein, the setting unit further sets:

[0327] a fifth adjustment region, corresponding to the adjustment region associated with the upper side of the window and located in an upper direction of the region where the minimum-sized window is located;

[0328] a sixth adjustment area, corresponding to the adjustment area associated with the left side of the window and located in the left direction of the area where the minimum-sized window is located;

[0329] a seventh adjustment region, corresponding to the adjustment region associated with the right side of the window and located in the right direction of the region where the minimum-sized window is located; and

[0330] An eighth adjustment region corresponds to the adjustment region associated with the lower side of the window and is located below the region where the minimum-sized window is located.

[0331] (6) The information processing device according to (5),

[0332] When the user slides the touch position to the adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to the opposite corner of the other corner, which is one of the four corners of the minimum size window.

[0333] (7) The information processing device according to (5),

[0334] When the user slides the touch position to the adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to the opposite corner of the other corner, which is one of the four corners of the window of the original size.

[0335] (8) The information processing device according to (1),

[0336] The window has a setting for the minimum size window, and

[0337] The position of the minimum size window changes in the area of ​​the original size window as the fixed angle changes.

[0338] (9) The information processing device according to (8),

[0339] The adjustment area changes as the position of the minimum-size window changes.

[0340] (10) The information processing device according to (8) or (9),

[0341] The area of ​​the minimum-sized window is located in an area obtained by reducing the window of the original size to the minimum size using the current fixed angle as an anchor.

[0342] (11) The information processing device according to (10),

[0343] Among them, multiple adjustment areas are set for a window, and

[0344] The setup unit sets at least:

[0345] A first adjustment area, corresponding to the adjustment area associated with the upper left corner of the window, and located in the upper left direction of the area where the minimum size window is located;

[0346] a second adjustment area, corresponding to the adjustment area associated with the upper right corner of the window, and located in the upper right direction of the area where the minimum size window is located;

[0347] a third adjustment area, corresponding to the adjustment area associated with the lower left corner of the window and located in the lower left direction of the area where the minimum size window is located; and

[0348] The fourth adjustment area corresponds to the adjustment area associated with the lower right corner of the window and is located in the lower right direction of the area where the minimum-sized window is located.

[0349] (12) The information processing device according to (11),

[0350] Wherein, the setting unit further sets:

[0351] a fifth adjustment region, corresponding to the adjustment region associated with the upper side of the window and located in an upper direction of the region where the minimum-sized window is located;

[0352] a sixth adjustment area, corresponding to the adjustment area associated with the left side of the window and located in the left direction of the area where the minimum-sized window is located;

[0353] a seventh adjustment region, corresponding to the adjustment region associated with the right side of the window and located in the right direction of the region where the minimum-sized window is located; and

[0354] An eighth adjustment region corresponds to the adjustment region associated with the lower side of the window and is located below the region where the minimum-sized window is located.

[0355] (13) The information processing device according to (12),

[0356] When the user slides the touch position to the adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to the opposite corner of the other corner, which is one of the four corners of the window of the original size.

[0357] (14) The information processing device according to any one of (1) to (13),

[0358] The position of the initial fixed angle changes with the position of the window of the original size on the touch panel display.

[0359] (15) The information processing device according to any one of (1) to (14),

[0360] Wherein, the display control unit highlights the current fixed angle.

[0361] (16) The information processing device according to any one of (1) to (15),

[0362] The display control unit highlights two diagonal edges of the four edges of the window sandwiching the current fixed angle.

[0363] (17) The information processing device according to any one of (1) to (16),

[0364] When the window is displayed on the touch panel display, the display control unit performs a guide display for notifying the user of a method of adjusting the size of the window if a predetermined condition is satisfied.

[0365] (18) The information processing device according to (17),

[0366] The display control unit counts the number of predetermined operations performed by the user on the window, and

[0367] When the window is displayed on the touch panel display, in a case where the predetermined operation is performed a predetermined number of times, a guide display for notifying the user of a method of changing the size of the window is performed.

[0368] (19) An information processing method comprising:

[0369] A display control step of displaying a window capable of adjusting size on the touch panel display;

[0370] a setting step of setting adjustment areas for adjusting the size of the window by touch operation at least at the positions of the four corners of the window, and setting one of the four corners of the window as a fixed angle for size adjustment; and

[0371] a changing step of executing a process for resizing the window in response to a user's touch operation in an adjustment area associated with a diagonal angle of the fixed angle,

[0372] Wherein, in the setting step, when the user slides the touch position to an adjustment area associated with another corner, the setting of the fixed angle is changed to an opposite corner of the other corner.

[0373] (20) A program for causing a computer to function as:

[0374] a display control unit for displaying a resizable window on the touch panel display;

[0375] a setting unit that sets adjustment areas for adjusting the size of the window by touch operation at least at the positions of the four corners of the window, and sets one of the four corners of the window as a fixed angle for size adjustment; and

[0376] a changing unit that performs a process for resizing the window in response to a user's touch operation in an adjustment area associated with a diagonal angle of the fixed angle,

[0377] When the user slides the touch position to an adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to an opposite corner of the other corner.

[0378] Reference numerals list

[0379] 10Terminal Equipment

[0380] 11Communication Unit

[0381] 12 storage units

[0382] 13Control Unit

[0383] 14 Input Units

[0384] 15 output units

[0385] 131 Setting Unit

[0386] 132 Change Unit

[0387] 141, 142 sensor area

[0388] 151 Display screen

[0389] A1 upper area

[0390] A2 Central Area

[0391] A3 lower area

[0392] N UI bar

[0393] TW Window

[0394] Two original size windows

[0395] TWm minimum window size

[0396] TWc is used for resizing windows

[0397] L1, L2 highlighted

[0398] F1 to F4 function icons

[0399] SP non-display area

[0400] P pivot

Claims

1. An information processing device, comprising: a display control unit for displaying a resizable window on the touch panel display; a setting unit, configured to set adjustment areas for adjusting the size of the window by touch operation at least at the positions of the four corners of the window, and to set one of the four corners of the window as a fixed corner for size adjustment; as well as a changing unit that performs a process for resizing the window in response to a user's touch operation in an adjustment area associated with a diagonal angle of the fixed angle, When the user slides the touch position to an adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to an opposite corner of the other corner.

2. The information processing device according to claim 1, The window has a minimum size setting, and The minimum-sized window is located in a fixed area within the area of ​​the original-sized window.

3. The information processing device according to claim 2, in, The minimum size window is located in the region obtained by shrinking the window of the original size to the minimum size with the initial fixed angle as the anchor.

4. The information processing device according to claim 3, in, Set multiple adjustment areas for a window, and The setup unit sets at least: a first adjustment area, corresponding to the adjustment area associated with the upper left corner of the window, and located in the upper left direction of the area where the minimum-sized window is located; a second adjustment area, corresponding to the adjustment area associated with the upper right corner of the window, and located in the upper right direction of the area where the minimum-sized window is located; a third adjustment area, corresponding to the adjustment area associated with the lower left corner of the window, and located in the lower left direction of the area where the minimum-sized window is located; as well as The fourth adjustment area corresponds to the adjustment area associated with the lower right corner of the window and is located in the lower right direction of the minimum-sized window.

5. The information processing device according to claim 4, in, The setting unit further sets: a fifth adjustment region corresponding to the adjustment region associated with the upper side of the window and located above the region where the minimum-sized window is located; a sixth adjustment area, corresponding to the adjustment area associated with the left side of the window and located to the left of the area where the minimum-sized window is located; a seventh adjustment region corresponding to the adjustment region associated with the right side of the window and located to the right of the region where the minimum-sized window is located; and The eighth adjustment area corresponds to the adjustment area associated with the lower side of the window and is located below the area where the minimum-sized window is located.

6. The information processing device according to claim 5, in, When the user slides the touch position to an adjustment area associated with another corner, the setting unit changes the setting of the fixed corner to an opposite corner of the other corner, which is one of the four corners of the minimum size window.

7. The information processing device according to claim 5, in, When the user slides the touch position to an adjustment area associated with another corner, the setting unit changes the setting of the fixed corner to an opposite corner of the other corner, which is one of four corners of the window of the original size.

8. The information processing device according to claim 1, The window has a minimum size setting, and The position of the minimum size window changes in the area of ​​the original size window as the fixed angle changes.

9. The information processing device according to claim 8, in, The adjustment area changes as the position of the minimum-sized window changes.

10. The information processing device according to claim 8, in, The area of ​​the minimum-sized window is located in an area obtained by reducing the window of the original size to the minimum size using the current fixed angle as an anchor.

11. The information processing device according to claim 10, in, Set multiple adjustment areas for a window, and The setup unit sets at least: a first adjustment area, corresponding to the adjustment area associated with the upper left corner of the window, and located in the upper left direction of the area where the minimum-sized window is located; a second adjustment area, corresponding to the adjustment area associated with the upper right corner of the window, and located in the upper right direction of the area where the minimum-sized window is located; a third adjustment area, corresponding to the adjustment area associated with the lower left corner of the window, and located in the lower left direction of the area where the minimum-sized window is located; as well as The fourth adjustment area corresponds to the adjustment area associated with the lower right corner of the window and is located in the lower right direction of the area where the minimum-sized window is located.

12. The information processing device according to claim 11, in, The setting unit further sets: a fifth adjustment region corresponding to the adjustment region associated with the upper side of the window and located above the region where the minimum-sized window is located; a sixth adjustment area, corresponding to the adjustment area associated with the left side of the window and located to the left of the area where the minimum-sized window is located; a seventh adjustment region corresponding to the adjustment region associated with the right side of the window and located to the right of the region where the minimum-sized window is located; and The eighth adjustment area corresponds to the adjustment area associated with the lower side of the window and is located below the area where the minimum-sized window is located.

13. The information processing device according to claim 12, in, When the user slides the touch position to an adjustment area associated with another corner, the setting unit changes the setting of the fixed corner to an opposite corner of the other corner, which is one of four corners of the window of the original size.

14. The information processing device according to claim 1, in, The position of the initial fixed angle changes with the position of the original sized window on the touch panel display.

15. The information processing device according to claim 1, in, The display control unit highlights the current fixed angle.

16. The information processing device according to claim 1, in, The display control unit highlights two diagonal sides sandwiching a current fixed angle among the four sides of the window.

17. The information processing device according to claim 1, in, When a window is displayed on the touch panel display, the display control unit performs a guide display for notifying a user of a method of adjusting the size of the window if a predetermined condition is satisfied.

18. The information processing device according to claim 17, in, The display control unit counts the number of predetermined operations of the user on the window, and When the window is displayed on the touch panel display, in a case where the predetermined operation is performed a predetermined number of times, a guide display for notifying the user of a method of changing the size of the window is performed.

19. An information processing method, comprising: a display control step of displaying a resizable window on the touch panel display; a setting step of setting adjustment areas for adjusting the size of the window by touch operation at least at the positions of the four corners of the window, and setting one of the four corners of the window as a fixed corner for size adjustment; as well as a changing step of executing a process for resizing the window in response to a user's touch operation in an adjustment area associated with a diagonal corner of the fixed angle, Wherein, in the setting step, when the user slides the touch position to an adjustment area associated with another corner, the setting of the fixed angle is changed to an opposite corner of the other corner.

20. A program for causing a computer to function as: a display control unit for displaying a resizable window on the touch panel display; a setting unit, configured to set adjustment areas for adjusting the size of the window by touch operation at least at the positions of the four corners of the window, and to set one of the four corners of the window as a fixed corner for size adjustment; as well as a changing unit that performs a process for resizing the window in response to a user's touch operation in an adjustment area associated with a diagonal angle of the fixed angle, When the user slides the touch position to an adjustment area associated with another corner, the setting unit changes the setting of the fixed angle to an opposite corner of the other corner.

Images