Interactive control method for picture-in-picture function and tablet computer

Abstract

The present invention proposes an interactive control method and a tablet computer for a picture-in-picture function. If an interactive interface of the tablet computer is in a picture-in-picture mode, touch parameters of a touch operation input by a user on a touch panel are obtained, and a display state of the interactive interface is adaptively adjusted according to the touch parameters. After the display state of the interactive interface is adaptively adjusted according to the touch parameters, changes in the touch operation input by the user on the touch panel are monitored to determine whether a parameter change occurs in the touch parameters of the touch operation that matches the display state. When a parameter change occurs in the touch parameters of the touch operation that matches the display state, a target operation object corresponding to the touch operation is determined according to the change in the touch parameters, and a touch operation instruction corresponding to the touch operation of the target operation object is executed, thereby effectively reducing accidental touch events in the picture-in-picture mode.

Description

Technical Field

[0001] The present invention relates to the technical field of interactive control, and in particular to an interactive control method and a tablet computer oriented to a picture-in-picture function. Background Art

[0002] Tablet computers have the characteristics of a large screen of a laptop and the portability of a smartphone. Therefore, the emergence of tablet computers makes up for the problem of poor content viewing experience on the small screen of a smartphone. The emergence of the picture-in-picture function makes the large screen of the tablet computer play its "big" advantage well, so that when users watch video content in full screen or play full-screen games, they can open a small window in the form of picture-in-picture to check information or use instant messaging tools to chat without affecting the full-screen application. Since the interactive interface of the tablet computer is originally designed based on the touch screen like a smartphone, it usually does not have indicator symbols such as the mouse cursor like the interactive interface of a personal computer. In addition, the touch points of the capacitive touch screen currently used are large, resulting in users often failing to operate at the edge of the picture-in-picture window and needing to retry multiple times, and even causing accidental touch events. For example, when a user wants to click an operation control located at the edge of the picture-in-picture, it may trigger a resize event of the picture-in-picture window, or trigger an operation control located in an adjacent position in the main window outside the picture-in-picture window. Summary of the invention

[0003] Based on the above problems, the present invention proposes an interactive control method for a picture-in-picture function and a tablet computer, which can effectively reduce accidental touch events in the picture-in-picture mode.

[0004] In view of this, a first aspect of the present invention proposes an interactive control method for a picture-in-picture function, comprising:

[0005] Receiving a touch operation input by a user on the touch panel;

[0006] Determining whether the current interactive interface is in a picture-in-picture mode, in which the application interface of at least one full-screen application is visible, and the application interface of at least one non-full-screen application is displayed above the application interface of the full-screen application at a stacking level greater than that of the full-screen application;

[0007] If the current interactive interface is in picture-in-picture mode, acquiring touch parameters of the touch operation;

[0008] Adaptively adjusting the display state of the interactive interface according to the touch parameters;

[0009] After adaptively adjusting the display state of the interactive interface according to the touch parameters, monitoring changes in the touch operation input by the user on the touch panel;

[0010] Determining whether a touch parameter of the touch operation undergoes a parameter change that matches the display state;

[0011] When a touch parameter of the touch operation undergoes a parameter change that matches the display state, determining a target operation object corresponding to the touch operation according to the change of the touch parameter;

[0012] Execute a touch operation instruction of the target operation object corresponding to the touch operation.

[0013] Furthermore, the step of adaptively adjusting the display state of the interactive interface according to the touch parameters specifically includes:

[0014] Calculating the minimum distance between the touch coordinates and the border of the picture-in-picture window;

[0015] When the minimum distance is less than or equal to a preset first distance threshold, determining a display area corresponding to the window range in which the touch coordinates fall as a target display area;

[0016] The mask layer is displayed in other areas outside the target display area.

[0017] Furthermore, the step of adaptively adjusting the display state of the interactive interface according to the touch parameters specifically includes:

[0018] When the minimum distance is less than or equal to a preset first distance threshold, determining a touch point whose minimum distance is less than or equal to the first distance threshold as a target touch point;

[0019] Determine a first interactive element adjacent to the target touch point, the first interactive element being an interactive element having one or more pixel points in the target display area such that the distance between the pixel coordinates thereof and the touch coordinates of the target touch point is less than or equal to a preset second distance threshold;

[0020] Determine a second interactive element from the first interactive elements, the second interactive element being an interactive element satisfying that a vertical distance between any pixel point in the target display area and one of the picture-in-picture window boundaries is less than a preset third distance threshold;

[0021] When the number of the second interactive elements is not zero, adjust the position or area of ​​the second interactive elements so that the pixel points in the pixel area of ​​the preset size of the second interactive elements satisfy the vertical distance between their pixel coordinates and any picture-in-picture window boundary is less than the third distance threshold.

[0022] Furthermore, the step of determining whether a touch parameter of the touch operation undergoes a parameter change that matches the display state specifically includes:

[0023] Determining a time point at which the display state of the interactive interface is adaptively adjusted according to the touch parameters as a starting time;

[0024] Acquire touch coordinate data within a preset time range after the starting time, wherein the touch coordinate data includes a plurality of touch coordinates obtained by multiple sampling within the preset time range and their corresponding sampling times;

[0025] Analyzing the touch coordinate data to determine the moving direction of the touch operation within the preset time range;

[0026] Matching the moving direction of the touch operation with the adjusted position of the second interactive element;

[0027] When the moving direction of the touch operation matches the adjusted position of any second interactive element, it is determined that a touch parameter of the touch operation has undergone a parameter change that matches the display state.

[0028] Furthermore, the step of matching the moving direction of the touch operation with the adjusted position of the second interactive element includes:

[0029] Determine an interactive area of ​​the second interactive element, where the interactive area is a set of pixel points in the second interactive element whose vertical distance from any picture-in-picture window border is greater than the third distance threshold;

[0030] Acquire the first touch coordinates of the touch operation at the starting time, and the center coordinates of the interactive area of ​​the second interactive element;

[0031] Determine the direction in which the first touch coordinate points to the center coordinate of the interactive area as a matching direction;

[0032] The touch operation moving direction is matched with the matching direction.

[0033] Furthermore, the step of matching the touch operation moving direction with the matching direction specifically includes:

[0034] Get the pre-configured matching angle threshold;

[0035] Calculating a first azimuth angle of the moving direction of the touch operation;

[0036] Calculating a second azimuth angle of the matching direction;

[0037] When the absolute value of the difference between the second azimuth angle and the first azimuth angle is less than or equal to the matching angle, determining that the moving direction of the touch operation matches the adjusted position of any second interactive element;

[0038] Otherwise, it is determined that the moving direction of the touch operation does not match the adjusted position of any second interactive element.

[0039] Furthermore, the step of determining the target operation object corresponding to the touch operation according to the change of the touch parameter specifically includes:

[0040] When a touch parameter of the touch operation undergoes a parameter change that matches the display state, calculating a vertical distance between the real-time touch coordinates of the touch point and a border of an adjacent picture-in-picture window;

[0041] When the vertical distance between the real-time touch coordinates of the touch point and the border of the adjacent picture-in-picture window is greater than the third distance threshold, determining whether the real-time touch coordinates fall within the interactive area of ​​any second interactive element, or whether the distance between the real-time touch coordinates and the interactive area of ​​any second interactive element is less than a preset fourth distance threshold;

[0042] When the real-time touch coordinates fall into the interactive area of ​​any second interactive element, or the distance between the real-time touch coordinates and the interactive area of ​​any second interactive element is less than a preset fourth distance threshold, the corresponding second interactive element is determined as the target operation object.

[0043] Furthermore, the step of determining whether a touch parameter of the touch operation undergoes a parameter change that matches the display state specifically includes:

[0044] When the parameter change of the touch parameter of the touch operation does not match the display state, performing a time series analysis on the touch movement path within a preset time range after the starting time based on the touch coordinate data;

[0045] determining whether the user has a tendency to operate the boundary of the adjacent picture-in-picture window according to the timing analysis result of the touch movement path;

[0046] When the user has a tendency to operate the adjacent PIP window boundary, the adjacent PIP window boundary is determined as the target operation object.

[0047] Furthermore, the step of performing a time series analysis on the touch movement path within a preset time range after the starting time based on the touch coordinate data specifically includes:

[0048] Acquire the vertical distances between each sampled touch point and the border of the adjacent picture-in-picture window within a preset time range after the starting time from the touch coordinate data to form a distance data sequence;

[0049] Using the distance data sequence to construct a distance-time curve within a preset time range after the starting time;

[0050] generating a trend line of the distance-time curve and calculating a slope of the trend line;

[0051] Whether the user has a tendency to operate the adjacent picture-in-picture window boundaries is determined according to the slope of the trend line.

[0052] A second aspect of the present invention provides a tablet computer, comprising a processor and a memory, wherein the processor executes a computer program stored in the memory to implement the interactive control method for a picture-in-picture function as described in any one of the first aspects of the present invention.

[0053] The present invention proposes an interactive control method and a tablet computer for a picture-in-picture function. If an interactive interface of the tablet computer is in a picture-in-picture mode, touch parameters of a touch operation input by a user on a touch panel are obtained, and a display state of the interactive interface is adaptively adjusted according to the touch parameters. After the display state of the interactive interface is adaptively adjusted according to the touch parameters, changes in the touch operation input by the user on the touch panel are monitored to determine whether a parameter change occurs in the touch parameters of the touch operation that matches the display state. When a parameter change occurs in the touch parameters of the touch operation that matches the display state, a target operation object corresponding to the touch operation is determined according to the change in the touch parameters, and a touch operation instruction corresponding to the touch operation of the target operation object is executed, thereby effectively reducing accidental touch events in the picture-in-picture mode. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 It is a flow chart of an interactive control method for a picture-in-picture function provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0055] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0056] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0057] In the description of the present invention, the term "multiple" refers to two or more. Unless otherwise clearly defined, the orientation or positional relationship indicated by the terms "upper", "lower", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation of the present invention. The terms "connection", "installation", "fixation", etc. should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or indirectly connected through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to the specific circumstances. In addition, the terms "first", "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first", "second", etc. can explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, the meaning of "multiple" is two or more.

[0058] In the description of this specification, the description of the terms "one embodiment", "some implementations", "specific embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0059] An interactive control method for a picture-in-picture function and a tablet computer provided according to some embodiments of the present invention will be described below with reference to the accompanying drawings.

[0060] like Figure 1 As shown, the first aspect of the present invention proposes an interactive control method for a picture-in-picture function, comprising:

[0061] Receiving a touch operation input by a user on the touch panel;

[0062] Determining whether the current interactive interface is in a picture-in-picture mode, in which the application interface of at least one full-screen application is visible, and the application interface of at least one non-full-screen application is displayed above the application interface of the full-screen application at a stacking level greater than that of the full-screen application;

[0063] If the current interactive interface is in picture-in-picture mode, acquiring touch parameters of the touch operation;

[0064] Adaptively adjusting the display state of the interactive interface according to the touch parameters;

[0065] After adaptively adjusting the display state of the interactive interface according to the touch parameters, monitoring changes in the touch operation input by the user on the touch panel;

[0066] Determining whether a touch parameter of the touch operation undergoes a parameter change that matches the display state;

[0067] When a touch parameter of the touch operation undergoes a parameter change that matches the display state, determining a target operation object corresponding to the touch operation according to the change of the touch parameter;

[0068] Execute a touch operation instruction of the target operation object corresponding to the touch operation.

[0069] Tablet computers usually receive touch operations input by users through the touch panel set on their display screen, recognize touch operation gestures input by users, and determine the user's operation intention by the content displayed at the corresponding operation position on the display screen, thereby generating and executing corresponding touch operation instructions.

[0070] A tablet computer can run one or more full-screen applications at the same time, for example, open multiple game applications or browser applications at the same time, and display them in full-screen mode. Since full-screen applications usually completely occupy the entire display screen, only one full-screen application's application interface can be visible at the same time. In the picture-in-picture mode, since there is a non-full-screen application above the full-screen application, which blocks part of its application interface, at least one full-screen application's application interface being visible means that part of the application interface of the full-screen application is visible.

[0071] In the technical solution of the present invention, the so-called current interactive interface is specifically a collection of all visible interactive elements currently displayed on the display screen of the tablet computer, and the visible interactive elements can be interactive elements in the application interface of a full-screen application, or interactive elements in the application interfaces of multiple applications. When the current interactive interface is in picture-in-picture mode, the current interactive interface is a collection of visible interactive elements of the application interfaces of at least one full-screen application and at least one non-full-screen application.

[0072] The touch parameters include the touch event, touch coordinates and touch pressure of the touch operation. The touch event is a response event returned by the touch screen triggered by the user's operation on the touch screen, including but not limited to touch press event ACTION_DOWN, touch lift event ACTION_UP and touch move event ACTION_MOVE. The touch coordinates are the coordinates of the coordinate points corresponding to each response event of the touch screen. When the touch event is a touch move event, the touch coordinates are the coordinates of several coordinate points obtained by continuous sampling and recording. The touch pressure is the size of the pressure value detected by the touch screen when the user presses the touch screen. Similarly, when the touch event is a touch move event, the touch pressure is the size of the pressure values ​​detected at several coordinate points obtained by continuous sampling and recording.

[0073] Furthermore, the step of adaptively adjusting the display state of the interactive interface according to the touch parameters specifically includes:

[0074] Calculating the minimum distance between the touch coordinates and the border of the picture-in-picture window;

[0075] When the minimum distance is less than or equal to a preset first distance threshold, determining a display area corresponding to the window range in which the touch coordinates fall as a target display area;

[0076] The mask layer is displayed in other areas outside the target display area.

[0077] Exemplarily, the current interactive interface consists of a full-screen application a and an application b displayed in a picture-in-picture window. When the touch coordinates fall into the picture-in-picture window and the minimum distance between the touch coordinates and the border of the picture-in-picture window is less than the first distance threshold, the display area of ​​the application interface of application b, that is, the display area within the picture-in-picture window, is determined as the target display area. Similarly, when the touch coordinates fall outside the picture-in-picture window and the minimum distance between the touch coordinates and the border of the picture-in-picture window is less than the first distance threshold, the visible display area of ​​the application interface of application a, that is, the display area outside the picture-in-picture window that is not blocked by the picture-in-picture window, is determined as the target display area.

[0078] The mask layer is a special layer with a preset color value and transparency, and its degree of shielding the content of the shielded area can be controlled by adjusting its transparency. In the technical solution of the above implementation, the shielded area is other areas outside the target display area.

[0079] Furthermore, the step of calculating the minimum distance between the touch coordinates and the border of the picture-in-picture window specifically includes:

[0080] Obtain the number n of real-time touch points of the touch operation, where n is a positive integer greater than or equal to 1, for example, when the touch operation is a click operation, n=1, and when the touch operation is a two-finger long press, n=2;

[0081] Get the touch coordinates of n real-time touch points;

[0082] Determine n adjacent boundaries between the picture-in-picture window and each real-time touch point, where the adjacent boundaries are boundaries that are closest to the picture-in-picture window and the real-time touch point, and each real-time touch point corresponds to one adjacent boundary;

[0083] The distance between each touch point and its adjacent boundary is calculated as the minimum distance.

[0084] Preferably, the first distance threshold is equal to the radius of the touch point coverage of the touch screen. Although the touch coordinates in the touch parameters corresponding to each touch point are the pixel coordinates of a pixel, in fact, since the pressing range of the touch operation subject such as a finger or a stylus on the touch screen is usually larger than the area of ​​a pixel, the coverage of each touch point can be determined according to the size of the touch pressure in the touch parameters, thereby obtaining the size of its radius.

[0085] Furthermore, the step of adaptively adjusting the display state of the interactive interface according to the touch parameters specifically includes:

[0086] When the minimum distance is less than or equal to a preset first distance threshold, determining a touch point whose minimum distance is less than or equal to the first distance threshold as a target touch point;

[0087] Determine a first interactive element adjacent to the target touch point, the first interactive element being an interactive element having one or more pixel points in the target display area such that the distance between the pixel coordinates thereof and the touch coordinates of the target touch point is less than or equal to a preset second distance threshold;

[0088] Determine a second interactive element from the first interactive elements, the second interactive element being an interactive element satisfying that a vertical distance between any pixel point in the target display area and one of the picture-in-picture window boundaries is less than a preset third distance threshold;

[0089] When the number of the second interactive elements is not zero, adjust the position or area of ​​the second interactive elements so that the pixel points in the pixel area of ​​the preset size of the second interactive elements satisfy the vertical distance between their pixel coordinates and any picture-in-picture window boundary is less than the third distance threshold.

[0090] In the technical solution of the above embodiment, both the first interactive element and the second interactive element can be one or more, and the number of the second interactive elements is less than or equal to the number of the first interactive elements. In other words, when the number of the second interactive elements is not zero, the second interactive element is a subset of the first interactive element.

[0091] Preferably, the second distance threshold and / or the third distance threshold is equal to the radius of the touch point coverage range of the touch screen.

[0092] When any interactive element has one or more pixel points that satisfy the distance between its pixel coordinates and the touch coordinates of the target touch point is less than or equal to the radius of the touch point coverage range, then the interactive element may be a potential target operation object that the user needs to operate, and therefore these interactive elements are determined as the first interactive elements.

[0093] When the vertical distance between all pixels in any interactive element and the adjacent PIP window boundary is less than or equal to the radius of the touch point coverage range, the interactive element has a problem of being difficult to operate, so these interactive elements are determined as the second interactive elements. The vertical distance specifically refers to the length of the line segment between the pixel point and the PIP window boundary in a straight line that passes through the pixel point and is perpendicular to the corresponding PIP window boundary.

[0094] There are two types of the second interactive element. In one case, the interactive element itself is relatively small in area. Although it is fully displayed in the interactive interface, due to its small area and close proximity to the border of the picture-in-picture window, that is, the vertical distance between all pixels in the second interactive element and one of the borders of the picture-in-picture window is less than the third distance threshold, resulting in a problem of difficult operation. In another case, although the interactive element itself is not small in area, due to the occlusion of the window, only a small part of it is displayed in the interactive interface, and the vertical distance between all pixels in this part and one of the borders of the picture-in-picture window is less than the third distance threshold, resulting in a problem of difficult operation.

[0095] Furthermore, the step of determining whether a touch parameter of the touch operation undergoes a parameter change that matches the display state specifically includes:

[0096] Determining a time point at which the display state of the interactive interface is adaptively adjusted according to the touch parameters as a starting time;

[0097] Acquire touch coordinate data within a preset time range after the starting time, wherein the touch coordinate data includes a plurality of touch coordinates obtained by multiple sampling within the preset time range and their corresponding sampling times;

[0098] Analyzing the touch coordinate data to determine the moving direction of the touch operation within the preset time range;

[0099] Matching the moving direction of the touch operation with the adjusted position of the second interactive element;

[0100] When the moving direction of the touch operation matches the adjusted position of any second interactive element, it is determined that a touch parameter of the touch operation has undergone a parameter change that matches the display state.

[0101] Specifically, a touch coordinate data collection duration is pre-configured , when the starting time is , then the preset time range after the starting time refers to In the technical solution of the present invention, a time shorter than the touch coordinate data acquisition time is used. The touch coordinates of the touch points on the touch screen are sampled at time intervals to obtain the touch coordinate data, wherein the touch coordinate data is composed of each sampling time point and the touch coordinates obtained by sampling at the sampling time point.

[0102] In the technical solutions of some embodiments of the present invention, the step of analyzing the touch coordinate data to determine the moving direction of the touch operation within the preset time range specifically includes:

[0103] Acquire the first touch coordinates obtained by sampling the starting point time;

[0104] Acquire a second touch coordinate sampled from an end time of a preset time range after the start time;

[0105] The direction from the first touch coordinate to the second touch coordinate is determined as the moving direction of the touch operation.

[0106] Still the preset time range after the starting time refers to For example, in the technical solution of the above implementation, the end time of the preset time range after the starting time can be express.

[0107] In the technical solutions of other embodiments of the present invention, the displacement-time trend line of the touch point movement process can be fitted based on the touch coordinate data, so that the extension direction of the displacement-time trend line is used as the touch operation movement direction.

[0108] Furthermore, the step of matching the moving direction of the touch operation with the adjusted position of the second interactive element includes:

[0109] Determine an interactive area of ​​the second interactive element, where the interactive area is a set of pixel points in the second interactive element whose vertical distance from any picture-in-picture window border is greater than the third distance threshold;

[0110] Acquire the first touch coordinates of the touch operation at the starting time, and the center coordinates of the interactive area of ​​the second interactive element;

[0111] Determine the direction in which the first touch coordinate points to the center coordinate of the interactive area as a matching direction;

[0112] The touch operation moving direction is matched with the matching direction.

[0113] Specifically, the interactive area of ​​the second element is the entire or partial area to which the second element moves or extends away from the border of the picture-in-picture window after the display state of the interactive interface is adjusted.

[0114] The center coordinates of the interactive area are coordinates corresponding to the average value of the pixel coordinate values ​​of each pixel point in the interactive area.

[0115] In the technical solution of this embodiment, the direction of the first touch coordinate pointing to the center coordinate of the interactive area is determined as the matching direction corresponding to the second interactive element, which is used to match the moving direction of the touch operation, so as to determine whether the touch moving direction has a tendency to move to the second interactive element, thereby determining whether the second interactive element can be determined as the target operation object.

[0116] Furthermore, the step of matching the touch operation moving direction with the matching direction specifically includes:

[0117] Get the pre-configured matching angle threshold;

[0118] Calculating a first azimuth angle of the moving direction of the touch operation;

[0119] Calculating a second azimuth angle of the matching direction;

[0120] When the absolute value of the difference between the second azimuth angle and the first azimuth angle is less than or equal to the matching angle, determining that the moving direction of the touch operation matches the adjusted position of any second interactive element;

[0121] Otherwise, it is determined that the moving direction of the touch operation does not match the adjusted position of any second interactive element.

[0122] Specifically, the first azimuth angle and the second azimuth angle are angle values ​​on the plane where the touch screen is located, respectively used to represent the touch movement direction and the matching direction. Usually, the horizontal or vertical direction of the touch screen is used as the reference direction, and the angle between the touch movement direction and the reference direction is used as the first azimuth angle. Similarly, the angle between the matching direction and the reference direction is used as the second azimuth angle.

[0123] The matching angle threshold is a pre-configured smaller angle value, which is used to evaluate whether the difference between the first azimuth angle and the second azimuth angle is small enough so that the moving direction of the touch operation can be considered to have the same or similar angle as the matching direction.

[0124] Furthermore, the step of determining the target operation object corresponding to the touch operation according to the change of the touch parameter specifically includes:

[0125] When a touch parameter of the touch operation undergoes a parameter change that matches the display state, calculating a vertical distance between the real-time touch coordinates of the touch point and a border of an adjacent picture-in-picture window;

[0126] When the vertical distance between the real-time touch coordinates of the touch point and the border of the adjacent picture-in-picture window is greater than the third distance threshold, determining whether the real-time touch coordinates fall within the interactive area of ​​any second interactive element, or whether the distance between the real-time touch coordinates and the interactive area of ​​any second interactive element is less than a preset fourth distance threshold;

[0127] When the real-time touch coordinates fall into the interactive area of ​​any second interactive element, or the distance between the real-time touch coordinates and the interactive area of ​​any second interactive element is less than a preset fourth distance threshold, the corresponding second interactive element is determined as the target operation object.

[0128] In the technical solution of the present invention, in the picture-in-picture mode, there can be one or more picture-in-picture windows in the interactive interface, and each picture-in-picture window usually has multiple borders. For example, the picture-in-picture window is usually a rectangular window, so its borders are usually four. Of course, in the technical solutions of some embodiments of the present invention, the picture-in-picture window in the interactive interface can also be a non-rectangular special-shaped window, such as a circle, an ellipse, other polygons other than a rectangle, or other irregular shapes. For picture-in-picture windows of different shapes, the number of their borders is also different accordingly. In the step of calculating the vertical distance between the real-time touch coordinates of the touch point and the adjacent picture-in-picture window boundary, the adjacent picture-in-picture window boundary is the picture-in-picture window boundary with the smallest vertical distance to the real-time touch coordinates.

[0129] Preferably, in the step of determining whether the distance between the real-time touch coordinates and the interactive area of ​​any second interactive element is less than a preset fourth distance threshold, the fourth distance threshold is less than or equal to half of the third distance threshold.

[0130] Preferably, after the step of determining the target operation object corresponding to the touch operation according to the change of the touch parameter, the step further includes displaying the target operation object in a highlighted state. That is, in the technical solution of the above embodiment, after the corresponding second interactive element is determined as the target operation object, the corresponding second interactive element is displayed in a highlighted state.

[0131] Preferably, when an interactive element is determined as the target operation object, the operation focus is switched to the corresponding second interactive element. That is, in the technical solution of the above embodiment, after the corresponding second interactive element is determined as the target operation object, the operation focus is switched to the corresponding second interactive element.

[0132] Furthermore, the step of determining whether a touch parameter of the touch operation undergoes a parameter change that matches the display state specifically includes:

[0133] When the parameter change of the touch parameter of the touch operation does not match the display state, performing a time series analysis on the touch movement path within a preset time range after the starting time based on the touch coordinate data;

[0134] determining whether the user has a tendency to operate the boundary of the adjacent picture-in-picture window according to the timing analysis result of the touch movement path;

[0135] When the user has a tendency to operate the adjacent PIP window boundary, the adjacent PIP window boundary is determined as the target operation object.

[0136] When the user needs to adjust the size of the picture-in-picture window, it is usually necessary to operate the border of the picture-in-picture window. However, the border of the picture-in-picture window is usually a relatively narrow linear interactive element. In order to avoid occupying too much display area, the line width of the picture-in-picture window border is usually smaller than the radius of the touch point coverage range, which makes it very difficult for the user to locate it when operating on the touch screen. In the technical scheme of the above-mentioned implementation mode, it is determined whether the user has a tendency to operate the adjacent picture-in-picture window boundary by performing a timing analysis on the touch movement path within a preset time range after the starting time, and the adjacent picture-in-picture window boundary is located according to the user's tendency to operate the adjacent picture-in-picture window boundary, that is, the adjacent picture-in-picture window boundary is determined as the target operation object, thereby switching the operation focus to the adjacent picture-in-picture window boundary.

[0137] Preferably, after the step of determining the target operation object corresponding to the touch operation according to the change of the touch parameter, the step further includes displaying the target operation object in a highlighted state. That is, in the technical solution of the above-mentioned implementation, after the adjacent picture-in-picture window boundary is determined as the target operation object, the adjacent picture-in-picture window boundary is displayed in a highlighted state.

[0138] Furthermore, the step of performing a time series analysis on the touch movement path within a preset time range after the starting time based on the touch coordinate data specifically includes:

[0139] Acquire the vertical distances between each sampled touch point and the border of the adjacent picture-in-picture window within a preset time range after the starting time from the touch coordinate data to form a distance data sequence;

[0140] Using the distance data sequence to construct a distance-time curve within a preset time range after the starting time;

[0141] generating a trend line of the distance-time curve and calculating a slope of the trend line;

[0142] Whether the user has a tendency to operate the adjacent picture-in-picture window boundaries is determined according to the slope of the trend line.

[0143] In the technical solution of the above implementation, when the slope of the trend line is less than zero, it is determined that the user has a tendency to operate the adjacent picture-in-picture window boundary, otherwise it is determined that the user has no tendency to operate the adjacent picture-in-picture window boundary.

[0144] Of course, other judgment methods may also be used to identify whether the user has a tendency to operate the adjacent PIP window boundary. For example, within a preset time range after the starting time, if the distance between the touch coordinates in the touch coordinate data and the adjacent PIP window boundary is always less than the third distance threshold, it is determined that the user has a tendency to operate the adjacent PIP window boundary, otherwise it is determined that the user does not have a tendency to operate the adjacent PIP window boundary.

[0145] A second aspect of the present invention provides a tablet computer, comprising a processor and a memory, wherein the processor executes a computer program stored in the memory to implement the interactive control method for a picture-in-picture function as described in any one of the first aspects of the present invention.

[0146] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0147] According to the embodiments of the present invention as described above, these embodiments do not describe all the details in detail, nor do they limit the invention to the specific embodiments described. Obviously, many modifications and changes can be made based on the above description. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can make good use of the present invention and the modified use based on the present invention. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. An interactive control method for a picture-in-picture function, characterized in that: include: Receiving a touch operation input by a user on the touch panel; Determining whether the current interactive interface is in a picture-in-picture mode, in which the application interface of at least one full-screen application is visible, and the application interface of at least one non-full-screen application is displayed above the application interface of the full-screen application at a stacking level greater than that of the full-screen application; If the current interactive interface is in picture-in-picture mode, acquiring touch parameters of the touch operation; Adaptively adjusting the display state of the interactive interface according to the touch parameters; After adaptively adjusting the display state of the interactive interface according to the touch parameters, monitoring changes in the touch operation input by the user on the touch panel; Determining whether a touch parameter of the touch operation undergoes a parameter change that matches the display state; When a touch parameter of the touch operation undergoes a parameter change that matches the display state, determining a target operation object corresponding to the touch operation according to the change of the touch parameter; Executing a touch operation instruction of the target operation object corresponding to the touch operation; The step of adaptively adjusting the display state of the interactive interface according to the touch parameters specifically includes: Calculate the minimum distance between the touch coordinates and the border of the PIP window; When the minimum distance is less than or equal to a preset first distance threshold, determining a display area corresponding to the window range in which the touch coordinates fall as a target display area; Displaying a mask layer in other areas outside the target display area; The step of adaptively adjusting the display state of the interactive interface according to the touch parameters specifically includes: When the minimum distance is less than or equal to a preset first distance threshold, determining a touch point whose minimum distance is less than or equal to the first distance threshold as a target touch point; Determine a first interactive element adjacent to the target touch point, the first interactive element being an interactive element having one or more pixels in the target display area such that the distance between its pixel coordinates and the touch coordinates of the target touch point is less than or equal to a preset second distance threshold; Determine a second interactive element from the first interactive elements, the second interactive element being an interactive element satisfying that a vertical distance between any pixel point in the target display area and one of the picture-in-picture window boundaries is less than a preset third distance threshold; When the number of the second interactive elements is not zero, adjust the position or area of ​​the second interactive elements so that the pixel points in the pixel area of ​​the preset size of the second interactive elements satisfy the vertical distance between their pixel coordinates and any picture-in-picture window boundary is greater than the third distance threshold.

2. The interactive control method for the picture-in-picture function according to claim 1, characterized in that: The step of determining whether a touch parameter of the touch operation has a parameter change that matches the display state specifically includes: Determining a time point at which the display state of the interactive interface is adaptively adjusted according to the touch parameters as a starting time; Acquire touch coordinate data within a preset time range after the starting time, wherein the touch coordinate data includes a plurality of touch coordinates obtained by multiple sampling within the preset time range and their corresponding sampling times; Analyzing the touch coordinate data to determine the moving direction of the touch operation within the preset time range; Matching the moving direction of the touch operation with the adjusted position of the second interactive element; When the moving direction of the touch operation matches the adjusted position of any second interactive element, it is determined that a touch parameter of the touch operation has undergone a parameter change that matches the display state.

3. The interactive control method for the picture-in-picture function according to claim 2, characterized in that: The step of matching the moving direction of the touch operation with the adjusted position of the second interactive element comprises: Determine an interactive area of ​​the second interactive element, where the interactive area is a set of pixel points in the second interactive element whose vertical distance from any picture-in-picture window border is greater than the third distance threshold; Acquire the first touch coordinates of the touch operation at the starting time, and the center coordinates of the interactive area of ​​the second interactive element; Determine the direction in which the first touch coordinate points to the center coordinate of the interactive area as a matching direction; The touch operation moving direction is matched with the matching direction.

4. The interactive control method for the picture-in-picture function according to claim 3, characterized in that: The step of matching the touch operation moving direction with the matching direction specifically includes: Get the pre-configured matching angle threshold; Calculating a first azimuth angle of the moving direction of the touch operation; Calculating a second azimuth angle of the matching direction; When the absolute value of the difference between the second azimuth angle and the first azimuth angle is less than or equal to the matching angle, determining that the moving direction of the touch operation matches the adjusted position of any second interactive element; Otherwise, it is determined that the moving direction of the touch operation does not match the adjusted position of any second interactive element.

5. The interactive control method for the picture-in-picture function according to claim 4, characterized in that: The step of determining the target operation object corresponding to the touch operation according to the change of the touch parameter specifically includes: When a touch parameter of the touch operation undergoes a parameter change that matches the display state, calculating a vertical distance between the real-time touch coordinates of the touch point and a border of an adjacent picture-in-picture window; When the vertical distance between the real-time touch coordinates of the touch point and the border of the adjacent picture-in-picture window is greater than the third distance threshold, determining whether the real-time touch coordinates fall within the interactive area of ​​any second interactive element, or whether the distance between the real-time touch coordinates and the interactive area of ​​any second interactive element is less than a preset fourth distance threshold; When the real-time touch coordinates fall into the interactive area of ​​any second interactive element, or the distance between the real-time touch coordinates and the interactive area of ​​any second interactive element is less than a preset fourth distance threshold, the corresponding second interactive element is determined as the target operation object.

6. The interactive control method for the picture-in-picture function according to claim 2, characterized in that: The step of determining whether a touch parameter of the touch operation has a parameter change that matches the display state specifically includes: When the parameter change of the touch parameter of the touch operation does not match the display state, performing a time series analysis on the touch movement path within a preset time range after the starting time based on the touch coordinate data; determining whether the user has a tendency to operate on the border of adjacent picture-in-picture windows according to the timing analysis result of the touch movement path; When the user has a tendency to operate the adjacent PIP window boundary, the adjacent PIP window boundary is determined as the target operation object.

7. The interactive control method for the picture-in-picture function according to claim 6, characterized in that: The step of performing a time series analysis on the touch movement path within a preset time range after the starting time based on the touch coordinate data specifically includes: Acquire the vertical distances between each sampled touch point and the border of the adjacent picture-in-picture window within a preset time range after the starting time from the touch coordinate data to form a distance data sequence; Using the distance data sequence to construct a distance-time curve within a preset time range after the starting time; generating a trend line of the distance-time curve and calculating a slope of the trend line; Whether the user has a tendency to operate the adjacent picture-in-picture window boundaries is determined according to the slope of the trend line.

8. A tablet computer, characterized in that: The method comprises a processor and a memory, wherein the processor executes a computer program stored in the memory to implement the interactive control method for a picture-in-picture function as described in any one of claims 1 to 7.

Images