Terminal control methods, devices, media and electronic equipment

Abstract

A terminal control method, apparatus, medium, and electronic device are disclosed. The method includes: in response to a trigger operation on a first display interface, determining the display range of a second display interface corresponding to the trigger operation (step S101); if the display range is not included in a preset operation range, displaying a thumbnail of the second display interface (step S102); and in response to a trigger operation on the thumbnail interface, controlling the thumbnail interface to display the same content as the second display interface (step S103). The terminal control method provided in this disclosure, by triggering a display screen and comparing the range of the display interface corresponding to the display screen with a preset operation range, displays a thumbnail of the display interface in an easily operable area around the control trigger point. Users can operate the display interface by manipulating the thumbnail, thus reducing the user's operating range and enabling close-range operation, making interface operation more convenient.

Description

Technical Field

[0001] This disclosure relates to the field of intelligent control technology, and more specifically, to a terminal control method, device, medium, and electronic device. Background Technology

[0002] Intelligent control is a control method with intelligent information processing, intelligent information feedback and intelligent control decision-making. It is an advanced stage in the development of control theory and is mainly used to solve control problems of complex systems that are difficult to solve using traditional methods. Most smart terminal devices use intelligent control technology to control the devices.

[0003] Smart terminal devices with touch functionality, especially large-sized ones, often display pop-up operation pages on the screen when users use the touch function. On large screens, these pop-up operation pages are often not within the user's convenient operating range, requiring the user to move a considerable distance to perform the relevant operations. While application developers have developed methods to display operation pages in designated areas, these designated areas are often specifically designed for each application. When switching applications, the existing designated areas become invalid, resulting in poor versatility.

[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] The purpose of this disclosure is to overcome the shortcomings of the prior art and to provide a terminal control method, device, medium and electronic device.

[0006] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0007] According to one aspect of this disclosure, a terminal control method is provided, the method comprising:

[0008] In response to a trigger operation on the first display interface, the display range of the second display interface corresponding to the trigger operation is determined;

[0009] If the display range is not included in the preset operation range, a thumbnail of the second display interface is displayed;

[0010] In response to a trigger operation on the thumbnail interface, the thumbnail interface is controlled to display the same content as the second display interface.

[0011] In some embodiments of this disclosure, based on the foregoing scheme, the method further includes: if the display range is included within the preset operating range, then displaying the second display interface.

[0012] In some embodiments of this disclosure, based on the foregoing scheme, the method further includes: determining the preset operating range according to the operating range of the triggering operation, wherein the preset operating range includes the operating range of the triggering operation.

[0013] In some embodiments of this disclosure, based on the foregoing scheme, the method further includes: detecting a gesture action, responding to a trigger operation of the gesture action control, and controlling the thumbnail interface to follow the trigger point of the gesture action control operation.

[0014] In some embodiments of this disclosure, based on the foregoing scheme, the method further includes: detecting the gesture end action, and in response to the triggering operation of the gesture end action control, controlling the thumbnail interface to stop following the triggering point of the gesture action control operation.

[0015] In some embodiments of this disclosure, based on the foregoing scheme, the method further includes: detecting a floating button trigger action, and responding to the trigger operation controlled by the floating button, controlling the thumbnail interface to be displayed at the trigger point of the floating button control operation.

[0016] In some embodiments of this disclosure, based on the foregoing scheme, the method further includes: detecting the end triggering action of the floating button, and in response to the triggering operation of the end control of the floating button, controlling the thumbnail interface to stop displaying at the trigger point of the end control operation of the floating button.

[0017] In some embodiments of this disclosure, based on the foregoing scheme, after responding to a trigger operation on the first display interface, the method further includes:

[0018] If a second display interface corresponding to the triggering operation is displayed, then the display range of the second display interface corresponding to the triggering operation is determined.

[0019] In some embodiments of this disclosure, based on the foregoing scheme, after responding to a trigger operation on the first display interface, the method further includes:

[0020] If the second display interface corresponding to the triggering operation is not displayed, the terminal control method is terminated.

[0021] According to another aspect of this disclosure, a terminal control device is provided, the device comprising:

[0022] The parameter acquisition module is used to acquire the display range of the display interface corresponding to the triggered operation and the preset operation range;

[0023] A logic calculation module is used to determine a thumbnail of the display interface based on the display range and the preset operation range;

[0024] The graphics generation module is used to generate the thumbnail interface based on the display range and the preset operation range, and to generate the display interface based on the thumbnail interface;

[0025] The result output module is used to output the thumbnail interface and the display interface.

[0026] According to another aspect of this disclosure, an electronic device is provided, comprising: a processor and a memory, the memory storing at least one instruction, the at least one instruction being loaded and executed by the processor to implement the method as described in any of the preceding claims.

[0027] According to another aspect of this disclosure, a computer-readable storage medium is provided that stores at least one instruction, which is loaded and executed by a processor to implement the method described in any of the preceding claims.

[0028] The terminal control method provided in this disclosure firstly determines the positional relationship between the display range of the display interface corresponding to the control and the preset operation range, and then displays a thumbnail of the display interface within the preset operation range, thus solving the problem that the operation interface is too far away during use, making it inconvenient for users to operate.

[0029] Secondly, users can display the next screen on the thumbnail screen through touch operation. At the same time, by switching between the thumbnail screen and the screen display screen, the content of the next screen displayed on the thumbnail screen can be displayed on the screen display screen, realizing dual-screen display and control of the thumbnail screen and the screen display screen.

[0030] Furthermore, this disclosure improves the versatility of thumbnail applications, enhances user efficiency, and shortens operation time by controlling the opening, location, display content, and transition between the thumbnail interface and the screen interface at the system level.

[0031] Finally, the method provided in this disclosure sets a preset operating range, which users can customize according to their own needs, making the setting of the thumbnail interface more flexible.

[0032] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0033] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0034] Figure 1 This is a flowchart illustrating a terminal control method according to an exemplary embodiment of the present disclosure.

[0035] Figure 2 This is a flowchart illustrating the specific operation of a terminal control method in an exemplary embodiment of this disclosure.

[0036] Figure 3 This is a simplified diagram of the screen interface display of a terminal control method according to an exemplary embodiment of the present disclosure.

[0037] Figure 4 This is a regional location coordinate diagram of a terminal control method according to an exemplary embodiment of the present disclosure.

[0038] Figure 5 This is a schematic diagram illustrating the process of coordinate transformation between a thumbnail interface and a screen display interface in an exemplary embodiment of this disclosure.

[0039] Figure 6 This is a simplified diagram of the movement trajectory of a gesture control method in an exemplary embodiment of this disclosure.

[0040] Figure 7 This is a simplified diagram illustrating the operation process of a floating button control method according to an exemplary embodiment of this disclosure.

[0041] Figure 8 This is a structural block diagram of a terminal control device according to an exemplary embodiment of the present disclosure.

[0042] Figure 9 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0043] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, they are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and therefore detailed descriptions of them will be omitted. Furthermore, the drawings are merely illustrative of this disclosure and are not necessarily drawn to scale.

[0044] On existing large-screen smart operating terminal devices, especially conference all-in-one machines, when users use these touch-enabled devices, corresponding interfaces pop up on the screen after the user touches the operation controls. For example, after touching the screen, interfaces such as input method pop-ups and menu pages that require users to operate over a large area will appear. If such large interfaces are not processed, users need to touch a screen area that is far away from them to perform the next operation. If such large interfaces are processed to only be displayed within a specified area of ​​the screen, this processing method requires application developers to perform special custom development of interface display. Once switched to different applications, this limitation of the display area will be invalid, and it does not achieve the effect of being universal across all applications.

[0045] Another way for users to operate large-screen terminal devices is to control them using mobile devices. This involves using the mobile device to project the screen onto the terminal device and controlling the flat display of the large-screen terminal device. However, this method requires additional mobile devices with an operating system compatible with the terminal device, making it more expensive.

[0046] Therefore, this disclosure provides a terminal control method with a small operation window, which can solve the problem of inconvenience for users to operate large-screen terminal devices, provide a user-friendly operating environment, and achieve cost savings and the goal of "once and for all".

[0047] This disclosure provides a terminal control method. Figure 1 This is a flowchart illustrating a terminal control method according to an exemplary embodiment of the present disclosure, as shown below. Figure 1 As shown, the terminal control method includes:

[0048] S101: In response to a trigger operation on the first display interface, determine the display range of the second display interface corresponding to the trigger operation;

[0049] S102: If the display range is not included in the preset operation range, then a thumbnail of the second display interface is displayed;

[0050] S103: In response to the triggering operation of the thumbnail interface, control the thumbnail interface to display the same content as the second display interface.

[0051] In step 101, in response to a trigger operation on the first display interface, the display range of the second display interface corresponding to the trigger operation is determined. The first display interface is a display screen, and the second display interface is a display interface that pops up on the display screen after a trigger operation is performed on the display screen, corresponding to the trigger operation.

[0052] This disclosure pertains to touchscreens used in large-screen smart terminal operating devices, such as conference all-in-one machines and large-screen smartphones. Users can perform touch operations on the flat surface of the terminal device. The touch point can be any touch point on the screen that the user needs to trigger. A display interface corresponding to the user's trigger point will be displayed on the smart terminal screen. The content displayed on the display interface is the next operation to be performed by the user's trigger point. After the display interface is displayed on the screen, the device will determine the display range of the display interface on the screen. For example, taking the upper left corner of the screen as the origin of the coordinates, the device will give the position coordinates of the display interface relative to the screen based on the length, width, and endpoints of the display interface.

[0053] Before the device can perform related operations, gesture algorithms and custom algorithms need to be added at the system level: For gesture algorithms, gesture actions are set and the device's gesture actions are saved in the system, and a gesture action switch is set in the system; For custom algorithms, the size of the corresponding thumbnail interface is set, and a thumbnail interface display switch is set in the system, as well as the range of convenient operation area for the user on the screen (the convenient operation area is the area on the screen that is easy for the user's limbs to reach, i.e., the preset operation range). The preset operation range is set according to the operation range of the user triggering the operation on the display screen, and the operation range of the triggered operation is included in the preset operation range.

[0054] In some embodiments, the length and width of the thumbnail interface can be determined according to the user's actual usage habits, or can be scaled proportionally according to the device screen resolution; the length and width of the convenient operation area can be determined according to the user's actual usage habits, or can be scaled proportionally according to the device screen resolution. This disclosure does not specifically limit the method for setting the size of the thumbnail interface and the size of the convenient operation area.

[0055] Furthermore, users can configure the thumbnail display switch and gesture control switch according to their own usage habits. For example, users can turn on the thumbnail display switch when they need to display the thumbnail interface, and turn on the gesture control switch when they need to control the device with gestures. The thumbnail display switch and gesture control switch can also be integrated into a single switch, allowing users to easily turn both functions on and off with a single switch. However, the switch configuration disclosed herein is not limited to the above configuration and can be set according to actual needs.

[0056] Before step S101, the device's display interface needs to be judged: when the user triggers the control, each trigger operation will have a corresponding display result interface (the display interface corresponding to the control). If the display result interface pops up and is displayed on the display screen (the preset display interface), the device can proceed to the next operation; if the display interface does not pop up and is displayed on the display screen, the device ends the operation.

[0057] In step S102, if the display range is not included in the preset operation range, a thumbnail of the second display interface is displayed.

[0058] The display range of the thumbnail interface is included within the preset operation range, that is, the display range of the thumbnail interface is within the convenient operation area on the screen. When the user performs a trigger operation on the device, the trigger point displays the corresponding display interface. This display interface includes the next operation interface corresponding to the trigger point. In step S101, the coordinates and display range of the display interface are given, and it is determined whether the display interface is within the convenient operation area. If the display interface is within the convenient operation area, the display interface is directly displayed on the screen, and the user can directly perform the next operation on the display interface. If the display interface is outside the convenient operation area, a thumbnail interface with the same operation content as the display interface is displayed within the convenient operation area, and the user can complete the same operation as the display interface on the thumbnail interface.

[0059] In step S103, in response to the triggering operation of the thumbnail interface, the thumbnail interface is controlled to display the same content as the second display interface.

[0060] After steps S101 and S102 above, the device will detect the position of the trigger point on the screen and simultaneously display the display interface and a thumbnail of the display interface on the screen. The thumbnail interface is located within the user's convenient operation area. The user can perform the next operation on the thumbnail interface. At the same time, the thumbnail interface will display the interface corresponding to the next operation. Meanwhile, the display interface on the screen will change in the same way as the operation on the thumbnail interface and display the same content as the thumbnail interface, thus completing the synchronous change of the thumbnail interface and the display interface.

[0061] After completing the above operations, users can adjust the thumbnail settings based on whether they need to perform subsequent operations. If the user does not need the thumbnail after completing the operations, they can turn off the thumbnail by switching the thumbnail display on / off to complete the operation.

[0062] The following is combined with Figure 2 and Figure 3 The specific steps of the terminal control method disclosed herein are described as follows:

[0063] Figure 2 This is a flowchart illustrating the specific operation of a terminal control method in an exemplary embodiment of this disclosure. Figure 2 In the diagram, shaded area A represents the current operating area of ​​the device, i.e., the initial trigger point of the control. Shaded area B represents the display interface area on the screen. Area C within the dashed frame represents the user-friendly operating area, and area D represents the thumbnail interface area. As shown in the diagram, when the hand-shaped trigger point is activated on the screen, the content operated on shaded area A is displayed on the screen, resulting in shaded area B. Area B is not included in area C within the dashed frame. At this time, area D, which has the same content as shaded area B, will be displayed on the screen, and area D is within area C within the dashed frame. The user can perform the next operation on area D. The operating range of area D is the user-friendly operating range, allowing the user to perform close-range operations on the screen.

[0064] Figure 3 This is a simplified diagram of the screen interface display of a terminal control method according to an exemplary embodiment of the present disclosure, combined with... Figure 2 Before a user performs screen operations, the device stores and saves the device's gesture actions and gesture action switches within the system, sets the thumbnail size and thumbnail switch, and sets the size of the user-friendly operating area. After setting these three parameters, the device checks whether the thumbnail switch and gesture action switch are turned on. If they are, the user can perform trigger operations on the screen to perform related device operations. The device then checks whether the display interface pops up on the screen after the user's operation. If it is, the device checks whether the display interface is within the user-friendly operating area. If not, the device detects the location of the trigger point on the screen and pops up a thumbnail of the display interface based on the location of the trigger point. Simultaneously, the device displays... The system displays the content of the initial operation interface; it determines whether the thumbnail interface needs to follow the gesture; if not, the user can perform the next operation on the thumbnail interface, and the same content as the thumbnail interface operation will be displayed on the screen. After completing the operation, the user can choose to exit the thumbnail interface and end the operation as needed; if the thumbnail interface needs to follow the gesture, the user can give a gesture to control the thumbnail interface to follow the gesture according to the gesture set above. The device detects whether the trajectory of the gesture movement is the same as the trajectory of the thumbnail interface movement. If they are the same, when the user triggers the gesture to end the control operation, the thumbnail interface stops following the gesture, and the user can perform the next operation on the thumbnail interface.

[0065] The positional relationship between the thumbnail interface and the screen display interface, as well as the control process of the thumbnail interface, are as follows:

[0066] like Figure 4 and Figure 5 As shown, combined with Figure 4 and Figure 5To determine the range of values ​​for the convenient operation area: Using the top-left corner of the screen as the origin, the direction to the left of the origin is the positive X-axis, and the direction downwards from the origin is the positive Y-axis. The current touch point's position coordinates on the screen are obtained as (x, y). The user sets the length and width of the convenient operation area to 2x0 and 2y0 respectively, thus obtaining the range of values ​​for the convenient operation area as [x-x0, x+x0], [y-y0, y+y0]. If the value of x-x0 exceeds the coordinate range of the screen display interface, i.e., when (x-x0) < 0, the x-axis coordinate of the convenient operation area will become [0, 2x0]. If (x+x0) > W (where W is the screen width), the x-axis coordinate of the operation area will become [W-2x0, W]. The method for determining the range of values ​​in the Y direction of the convenient operation area is the same as that for the X direction, and will not be repeated here.

[0067] Determine the relative position coordinates of the thumbnail interface: the movement trajectory of the thumbnail interface with height h and width w within the easily accessible area is as follows: Figure 4 As shown, the motion trajectory can be limited according to the specific size or design requirements of the smart terminal screen. For example, a horizontal or vertical baseline can be set. When the horizontal baseline is exceeded, the thumbnail interface needs to be displayed in the right display area; when the vertical baseline is exceeded, the thumbnail interface needs to be displayed in the bottom display area. The possible coordinate ranges of the four vertices of the thumbnail interface in a clockwise direction within the convenient operation area are ((x-x0),(y-y0)), ((x-x0),(y+y0-h)), ((x+x0-w),(y+y0-h)), and ((x+x0-w),(y-y0)). Therefore, the coordinates (p,q) of the thumbnail interface satisfy the following condition:

[0068] ① When (x-x0)>0 and (y-y0)>0,

[0069] y0 <y<H-y0

[0070] x0 <x<W-x0

[0071] y-y0≤q≤y+y0-h p=(x-x0,x+x0-w)

[0072] x-x0≤p≤x+x0-w q=(y-y0,y+y0-h)

[0073] ② When (x-x0)<0 and (y-y0)<0,

[0074] 0 <y<y0

[0075] 0 <x<x0

[0076] 0≤q≤2y0-hp=(0,2x0-w)

[0077] 0≤p≤2x₀-w, q=(0, 2y₀-h)

[0078] ③ When (W-x₀)<x<W and (H-y₀)<y<H,

[0079] H-2y₀≤q≤H-h p=(W-2x₀,W-w)

[0080] W-2x₀≤p≤W-w q=(H-2y₀, H-h)

[0081] ④ When 0<x<x₀ and (H-y₀)<y<H,

[0082] H-2y₀≤q≤H-h p=(0, 2x₀-w)

[0083] 0≤p≤2x₀-w q=(H-2y₀, H-h)

[0084] ⑤ When W-x₀<x<W and 0<y<y₀,

[0085] 0≤q≤2y₀-h p=(W-2x₀,W-w)

[0086] W-2x₀≤p≤W-w q=(0, 2y₀-h)

[0087] Wherein, W is the screen width and H is the screen height.

[0088] In conclusion, the relationship between the position coordinates (p,q) of the top-left corner of the thumbnail interface and the trigger point on the device screen is obtained as Φ(p,q)=F(x,y). After the thumbnail interface pops up, when a user operates the thumbnail interface, the absolute coordinates (α,β) of the trigger point on the thumbnail interface are obtained, and (x,y)=(α,β) is set. The relative coordinates of this coordinate with respect to (p,q) are (α-p, β-q). At this time, the point actually operated by the user is the point at the absolute position (α-p, β-q) on the device screen, thereby controlling the device.

[0089] Through the above determination of the coordinate range of the easy-to-operate area and the coordinate range of the thumbnail interface, when the user triggers a trigger point on the device screen, SurfaceFlinger is used to obtain the position area that is related to the current operation and will change on the screen, that is, the display interface. It is determined whether the display interface exceeds the range of the easy-to-operate area corresponding to the current trigger point of the user. If it exceeds the range, a screenshot is taken on the framebuffer, the thumbnail interface pops up (the thumbnail interface control switch is turned on by default), and the content after the screenshot is displayed in the thumbnail interface. Through the above steps, the operation position coordinates of the thumbnail interface are converted into the position coordinates of the actual screen interface, so as to perform touch control on the device. The specific operation steps are as Figure 5 shown below.

[0090] The aforementioned SurfaceFlinger is a service specific to a system, situated between the application library and the graphics library. It manages the application's interface, compositing and overlaying all interfaces and reflecting them onto the framebuffer. The framebuffer is a memory buffer containing complete frame data that a video output device uses to drive a video display device. However, this disclosure does not limit the means of obtaining the location area on the screen relative to the current operation to using SurfaceFlinger; it can also utilize other services or applications capable of obtaining screen position data.

[0091] The terminal control method provided in this disclosure can display a thumbnail of the screen display interface within a convenient operating range for the user. The user can perform the same operations in the thumbnail interface as on the display interface, while the display interface can display the same content as the thumbnail interface. At the same time, the thumbnail interface can also be set to follow the user's gestures, which facilitates the user's operation.

[0092] The terminal control method provided in this disclosure also includes a control method for a thumbnail interface.

[0093] The thumbnail interface control method includes gesture control operations, which include: responding to a trigger operation of gesture control, controlling the thumbnail interface to follow the trigger point of the gesture control operation.

[0094] In response to the trigger operation of the gesture control ending, the thumbnail interface is controlled to stop following the trigger point of the gesture control operation.

[0095] When both the thumbnail control switch and the gesture control switch are turned on, after the thumbnail is opened, the thumbnail will change position as the user swipes on or off the screen, ensuring that its position on the screen matches the position reached by the gesture. Figure 6 As shown, a thumbnail interface pops up on the screen at the trigger point, and the thumbnail interface is within the convenient operation area of ​​the trigger point. As the trigger point moves on the screen, the thumbnail interface moves with the trigger point until the user stops the gesture control operation. The gesture control action can be triggered at the trigger point on the screen, or it can be a gesture drawn across the top of the screen without touching the screen.

[0096] The control method for the thumbnail interface also includes a floating button control operation: in response to the trigger operation of the floating button control, the thumbnail interface is controlled to be displayed at the trigger point of the floating button control operation.

[0097] In response to the trigger operation of ending control via the floating button, the thumbnail interface is controlled to stop displaying at the trigger point of the ending control operation via the floating button.

[0098] The gesture control operations described above can be replaced with floating button control operations, such as... Figure 7 As shown, when the device's thumbnail interface control switch is turned on, the user can trigger the trigger point on the screen to make the thumbnail window pop up. At this time, there is no need to turn on the gesture control switch. By dragging the floating button E on the screen, the thumbnail interface can be dragged to the position corresponding to the floating button E. During the movement of the thumbnail interface, the thumbnail interface is not displayed on the screen. If the interface needs to be thumbnailed again, it can be triggered to re-display at that position through a specific trigger action. For example, it can be long-pressed on the point, or slid in a specified shape or in a specified direction.

[0099] Unlike gesture control, floating button control displays a thumbnail of the screen's start and end positions, but does not show the movement process of the thumbnail. Gesture control, on the other hand, displays the movement trajectory of the thumbnail and its start and end positions on the screen.

[0100] In addition to the two methods for controlling the position of the thumbnail interface mentioned above, the device can also control the thumbnail interface through facial recognition. This disclosure includes, but is not limited to, the thumbnail interface control methods mentioned above.

[0101] The terminal control method provided in this disclosure also includes a method for controlling a thumbnail interface. By controlling the position of the thumbnail interface, users can make the thumbnail interface of the display screen move with the user's position according to their own usage needs and habits during the use of the terminal device, which facilitates the user's operation of the device.

[0102] It should be noted that although the steps of the terminal control method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that these steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.

[0103] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

[0104] The embodiments of this disclosure also provide a terminal control device. Figure 8 This is a structural block diagram of a terminal control device according to an exemplary embodiment of the present disclosure, such as... Figure 8 As shown, the terminal control device includes: a parameter acquisition module 10, a logic calculation module 20, a graphics generation module 30, and a result output module 40.

[0105] The parameter acquisition module 10 is used to acquire the display range of the display interface corresponding to the trigger operation and the preset operation range.

[0106] The logic calculation module 20 is used to determine the abbreviated interface of the display interface based on the display range and the preset operation range.

[0107] The graphics generation module 30 is used to generate the thumbnail interface based on the display range and the preset operation range, and to generate the display interface based on the thumbnail interface.

[0108] The result output module 40 is used to output the thumbnail interface and the display interface.

[0109] This disclosure provides a terminal control device, which uses four modules—parameter acquisition module, graphics generation module, logic calculation module, and result output module—to control the device and execute related operations using terminal control methods. It can display a thumbnail interface on the screen, allowing users to operate on the thumbnail interface, thus facilitating user operation of the device.

[0110] Figure 9 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of the present disclosure, such as... Figure 9 As shown, the electronic device 1000 is presented in the form of a general-purpose computing device. The components of the electronic device 1000 may include, but are not limited to: at least one processing unit 1010, at least one storage unit 1020, and a bus 1030 connecting different system components (including storage unit 1020 and processing unit 1010).

[0111] The storage unit stores program code, which can be executed by the processing unit 1010 to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of the present invention. For example, the processing unit 1010 can perform, as follows: Figure 1 The methods and steps shown are as follows.

[0112] Storage unit 1020 may include volatile storage units, such as random access memory (RAM) 1021 and / or cache memory 1022, and may further include read-only memory (ROM) 1023.

[0113] Storage unit 1020 may also include a program / utility 1024 having a set (at least one) program module 1025, such program module 1025 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0114] Bus 1030 may include a data bus, an address bus, and a control bus.

[0115] Electronic device 1000 can also communicate with one or more external devices 1100 (e.g., keyboard, pointing device, Bluetooth device, etc.) via input / output (I / O) interface 1040. Electronic device 1000 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public network, such as the Internet) via network adapter 1050. As shown, network adapter 1050 communicates with other modules of electronic device 1000 via bus 1030. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0116] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to exemplary embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0117] Those skilled in the art will understand that various aspects of this disclosure can be implemented as a system, method, or program product. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, collectively referred to herein as a "circuit," "module," or "system."

[0118] Exemplary embodiments of this disclosure also provide a computer-readable storage medium that can be implemented as a program product including program code, which, when run on an electronic device, causes the electronic device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure. In one embodiment, the program product can be implemented as a portable compact disc read-only memory (CD-ROM) including program code and can run on an electronic device, such as a personal computer. However, the program product of this disclosure is not limited thereto. In this document, the readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0119] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0120] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0121] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0122] Program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing devices can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0123] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

Claims

1. A terminal control method, wherein, include: In response to a trigger operation on the first display interface, the display range of the second display interface corresponding to the trigger operation is determined; The second display interface is the display interface that pops up on the display screen after a trigger operation is performed on the display screen, corresponding to the trigger operation; If the display range is not included in the preset operation range, a thumbnail of the second display interface is displayed; if the display range is included in the preset operation range, the second display interface is displayed; the display range of the thumbnail interface is included in the preset operation range. In response to a trigger operation on the thumbnail interface, the thumbnail interface is controlled to display the same content as the second display interface; The preset operation range is determined based on the operation range in response to the trigger operation on the first display interface, and the preset operation range includes the operation range in response to the trigger operation on the first display interface.

2. The terminal control method according to claim 1, wherein, The method further includes: Detect gesture actions, and in response to the trigger operation of the gesture action control, control the thumbnail interface to follow the trigger point of the gesture action control operation.

3. The terminal control method according to claim 2, wherein, The method further includes: The system detects the end of a gesture action and, in response to the trigger operation of the gesture end action control, controls the thumbnail interface to stop following the trigger point of the gesture action control operation.

4. The terminal control method according to claim 1, wherein, The method further includes: The system detects the trigger action of the floating button and, in response to the trigger operation controlled by the floating button, controls the thumbnail interface to be displayed at the trigger point of the floating button control operation.

5. The terminal control method according to claim 4, wherein, The method further includes: The system detects when the floating button ends its trigger action and, in response to the trigger operation of the floating button ending control, controls the thumbnail interface to stop displaying at the trigger point of the floating button ending control operation.

6. The terminal control method according to claim 1, wherein, Following a trigger operation on the first display interface, the method further includes: If a second display interface corresponding to the triggering operation is displayed, then the display range of the second display interface corresponding to the triggering operation is determined.

7. The terminal control method according to claim 1, wherein, Following a trigger operation on the first display interface, the method further includes: If the second display interface corresponding to the triggering operation is not displayed, the terminal control method is terminated.

8. A terminal control device, implementing the method as described in any one of claims 1 to 7, wherein, include: The parameter acquisition module is used to acquire the display range of the display interface corresponding to the triggered operation and the preset operation range; A logic calculation module is used to determine a thumbnail of the display interface based on the display range and the preset operation range; The graphics generation module is used to generate the thumbnail interface based on the display range and the preset operation range, and to generate the display interface based on the thumbnail interface; The result output module is used to output the thumbnail interface and the display interface.

9. An electronic device, wherein, The electronic device includes a processor and a memory, the memory storing at least one instruction, which is loaded and executed by the processor to implement the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, wherein, The computer-readable storage medium stores at least one instruction, which is loaded and executed by a processor to implement the method as described in any one of claims 1 to 7.

Images