Interaction control moving method and device and display equipment

Abstract

The invention discloses an interactive control moving method and device and display equipment, and relates to the technical field of display. According to the method, firstly, whether multi-point touch control exists or not is recognized, secondly, coordinates of all touch control points are obtained, and whether the distance between any two touch control points is within a preset range or not is judged, so that touch control operations which do not meet conditions are filtered out, and it is ensured that only operations which meet preset standards can trigger follow-up interactive control moving operations; the appointed point of each touch point is obtained as the new position of the interaction control, and the interaction control is moved, so that the interaction control is ensured to be always in the core area of the user operation; compared with the prior art, the method has the advantages that the time and energy of searching or dragging the interactive control on the screen by the user are greatly reduced, the operation efficiency is remarkably improved, the interactive experience of the user on large-screen equipment is improved, and the method is particularly suitable for large-screen display equipment such as an all-in-one machine.

Description

Technical Field

[0001] The present invention relates to the technical field of display devices, and in particular to an interactive control moving method, device and display device. Background Art

[0002] Currently, many all-in-one machines or smart screens and other display devices on the market are equipped with interactive control functions such as floating balls and cursors so that users can quickly access and use menu functions. These interactive controls usually appear in a fixed position on the screen, and users can open the shortcut menu by clicking on the interactive controls. However, since the screens of all-in-one machines are usually large in size, especially models of 110 inches and above, users face many inconveniences when operating interactive controls. Usually, users need to walk to the screen area where the interactive controls are located, or use tools such as pointers to click on the interactive controls, and the operating experience is not very ideal. In addition, when the screen interface is colorful and the background is complex, the location of the interactive controls is often difficult for users to recognize immediately. In this case, users need to spend extra time and energy to visually locate the interactive controls, which affects the smoothness and efficiency of the operation. This problem is particularly prominent for some users with poor eyesight or users who use all-in-one machines in emergency situations. Therefore, how to improve the ease of use of interactive controls, especially how to facilitate users to quickly obtain and operate interactive controls at any location, has become an urgent problem to be solved in the design of large-screen display devices such as all-in-one machines. Summary of the invention

[0003] In view of this, the embodiments of the present invention provide an interactive control moving method, device and display device to solve the problem in the prior art that large-screen display devices are inconvenient to operate when using interactive controls.

[0004] In a first aspect, an embodiment of the present invention provides a method for moving an interactive control, the method comprising:

[0005] When a touch gesture of the user is detected, determining whether the touch gesture is a multi-touch gesture, wherein the multi-touch gesture refers to at least three touch points on the screen;

[0006] If so, obtaining the coordinates corresponding to each touch point in the multi-touch;

[0007] Determining whether the distance between any two touch points is within a preset distance range according to the coordinates;

[0008] If so, obtaining a designated point between the touch points;

[0009] The interactive control on the control screen moves to a position corresponding to the designated point.

[0010] Preferably, the coordinates corresponding to each touch point are: a first coordinate, a second coordinate, and a third coordinate, and judging whether the distance between any two touch points is within a preset distance range according to the coordinates includes:

[0011] Respectively obtain a first distance between the first coordinate and the second coordinate, a second distance between the second coordinate and the third coordinate, and a third distance between the first coordinate and the third coordinate;

[0012] Determining the preset distance range according to a preset contact width and a preset contact distance;

[0013] It is determined whether the first distance, the second distance, and the third distance are all within the preset distance range.

[0014] Preferably, the preset contact width and the preset contact distance are both physical values, and before determining the preset distance range according to the preset contact width and the preset contact distance, the method includes:

[0015] Get the size and resolution of the screen;

[0016] determining a pixel pitch based on the size and resolution;

[0017] The preset contact point width and the preset contact point distance are converted into corresponding pixel values ​​according to the pixel pitch.

[0018] Preferably, the acquiring the designated point between the touch points comprises:

[0019] Let the first coordinate be (x1, y1), the second coordinate be (x2, y2), and the third coordinate be (x3, y3), and obtain the coordinate (x0, y0) of the specified point according to the following formula:

[0020] x0=(x1+x2+x3) / 3;

[0021] y0=(y1+y2+y3) / 3.

[0022] Preferably, the determining whether the distance between any two touch points is within a preset distance range according to the coordinates includes:

[0023] Get user historical touch data;

[0024] determining the user's gesture habits according to the historical touch data;

[0025] The preset distance range is adjusted according to the user's gesture habits.

[0026] Preferably, after the interactive control in the control screen moves to the position corresponding to the designated point, the method further includes:

[0027] When it is detected that the current touch gesture of the user is double-point touch or multi-point touch and the corresponding positions of each touch point move continuously, the moving trajectory, moving time, moving direction and position change of each touch point are obtained;

[0028] Determining whether the position change exceeds a preset change threshold;

[0029] If so, determining the gesture speed and the reference point according to the position change, the movement time and the movement direction;

[0030] Determine a size change ratio of the interactive control according to the position change amount, adjust the size of the interactive control based on the reference point and according to the size change ratio, and control the size adjustment speed of the interactive control according to the gesture speed during the adjustment process;

[0031] Determine whether the touch gesture includes a rotation operation according to the movement trajectory, the movement direction, and the position change amount; if so, obtain a rotation angle according to the movement trajectory and the position change amount, and rotate the interactive control according to the rotation angle while adjusting the size of the interactive control;

[0032] Determine whether the adjusted interactive control size is greater than a maximum size threshold or less than a minimum size threshold;

[0033] If so, the adjusted size of the interactive control is set to be equal to the maximum size threshold or the minimum size threshold.

[0034] Preferably, after the interactive control in the control screen moves to the position corresponding to the designated point, the method further includes:

[0035] Determining whether a new touch gesture of the user is detected, wherein the new touch gesture includes any one of multi-touch, double-touch and single-touch;

[0036] If yes, start the movement trend monitoring mode to monitor the movement trajectory of the touch point corresponding to the new touch gesture in real time;

[0037] Determine the gesture operation range according to the movement trajectory;

[0038] Generate a corresponding interactive control following trajectory according to the moving trajectory and control the interactive control to remain within a preset range in the gesture operation range and last for a first preset time;

[0039] When the interactive control is not triggered after the first preset time ends, moving the interactive control to a preset screen edge area;

[0040] When the interactive control is triggered within the first preset time, the corresponding interactive interface is expanded and the timing is restarted based on the second preset time, and it is determined whether there is an interactive operation within the second preset time; otherwise, the interactive interface is closed and the interactive control is moved to the preset screen edge area.

[0041] Preferably, after the interactive control in the control screen moves to the position corresponding to the designated point, the method further includes:

[0042] The interactive control obtains the background complexity of the area where the interactive control is located according to the position corresponding to the designated point and the size of the interactive control;

[0043] Determine, according to the background complexity, whether the background of the area where the interactive control is located is a simple background, a relatively complex background, or a highly complex background; wherein the background complexity is obtained according to one or more of image texture information, grayscale gradient change rate, and color information corresponding to the background of the area;

[0044] When the background is simple, extract the main background color value of the area and adjust the color of the interactive control according to the main background color value so that the color difference between the two is greater than or equal to a first preset threshold;

[0045] When the background is relatively complex, extracting a first preset number of first background color values ​​in the area and adjusting the color of the interactive control according to the first background color values ​​so that the color difference between the interactive control and each of the first background color values ​​is greater than or equal to a second preset threshold;

[0046] When the background is highly complex, the area where the interactive control is located is divided into several sub-areas, and after obtaining the background complexity corresponding to each sub-area, the designated point is moved to the sub-area with the smallest background complexity, and a second preset number of second background color values ​​in the sub-area with the smallest background complexity are extracted, and the color of the interactive control is adjusted according to the second background color value so that the color difference between it and each of the second color values ​​is greater than or equal to a third preset threshold.

[0047] In a second aspect, an embodiment of the present invention provides an interactive control moving device, the device comprising:

[0048] A detection module, configured to determine whether a touch gesture of a user is a multi-touch gesture when the touch gesture is detected, wherein the multi-touch gesture refers to at least three touch points on the screen;

[0049] A coordinate acquisition module, used for acquiring the coordinates corresponding to each touch point in the multi-touch;

[0050] A judging module, used for judging whether the distance between any two touch points is within a preset distance range according to the coordinates;

[0051] A designated point acquisition module, used for acquiring the designated point between the touch points;

[0052] The moving module is used to control the interactive control on the screen to move to a position corresponding to the specified point.

[0053] In a third aspect, an embodiment of the present invention provides a display device, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory, and when the computer program instructions are executed by the processor, the method of the first aspect in the above embodiment is implemented.

[0054] In a fourth aspect, an embodiment of the present invention provides a storage medium having computer program instructions stored thereon, which implements the method of the first aspect in the above-mentioned embodiment when the computer program instructions are executed by a processor.

[0055] In summary, the beneficial effects of the present invention are as follows:

[0056] The interactive control moving method, device and display device provided by the embodiments of the present invention first identify whether it is multi-touch, and then obtain the coordinates of each touch point and determine whether the distance between any two touch points is within a preset range, thereby filtering out touch operations that do not meet the conditions, ensuring that only operations that meet the preset standards can trigger subsequent interactive control movement operations, thereby improving the accuracy of gesture recognition, and then obtaining the designated point of each touch point as the new position of the interactive control and moving the interactive control, thereby ensuring that the interactive control is always in the core area of ​​user operation, greatly reducing the time and energy of the user to find or drag the interactive control on the screen, significantly improving operating efficiency, and improving the user's interactive experience on large-screen devices. It is particularly suitable for large-screen display devices such as all-in-one computers. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the drawings required for use in the embodiment of the present invention will be briefly introduced below. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work, and these are all within the protection scope of the present invention.

[0058] Figure 1 It is a flowchart of the interactive control moving method according to an embodiment of the present invention.

[0059] Figure 2 4 is a schematic diagram of a flow chart of determining the distance between touch points in an embodiment of the present invention.

[0060] Figure 3 It is a schematic diagram of a process of converting a preset contact width and a preset contact distance in an embodiment of the present invention.

[0061] Figure 4 It is a schematic diagram of the interactive control moving synchronously with the touch point in an embodiment of the present invention.

[0062] Figure 5 It is a schematic diagram of an enlarged interactive control when it moves synchronously with a touch point in an embodiment of the present invention.

[0063] Figure 6 It is a schematic diagram of the structure of an interactive control mobile device according to an embodiment of the present invention.

[0064] Figure 7 It is a schematic structural diagram of a display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0065] The features and exemplary embodiments of various aspects of the present invention will be described in detail below. In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and Examples. It should be understood that the specific embodiments described herein are only configured to explain the present invention and are not configured to limit the present invention. For those skilled in the art, the present invention can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present invention by illustrating examples of the present invention.

[0066] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0067] Embodiment 1

[0068] An embodiment of the present invention provides a method for moving an interactive control, which is suitable for large-size touch screens (such as all-in-one computers or smart screens of 110 inches and above). In scenarios such as office, classroom teaching, demonstration meetings, etc., users need to quickly locate and operate interactive controls on the screen. Users usually need to move interactive controls within a large range to access commonly used shortcut functions, so as to switch pages, mark key points or call specific functions.

[0069] See also Figure 1, the interactive control moving method specifically includes the following steps:

[0070] S1: when a touch gesture of a user is detected, determining whether the touch gesture is a multi-touch gesture, wherein the multi-touch gesture refers to at least three touch points on the screen;

[0071] S2: If yes, obtain the coordinates corresponding to each touch point in the multi-touch;

[0072] S3: determining whether the distance between any two touch points is within a preset distance range according to the coordinates;

[0073] S4: If yes, obtain the designated point between the touch points;

[0074] S5: Control the interactive control on the screen to move to a position corresponding to the designated point.

[0075] Specifically, a touch gesture refers to a series of gestures performed by a user touching the screen with his fingers, such as single-finger click, two-finger zoom, three-finger slide, etc. A touch gesture can be a simple single-point touch or a complex multi-point interaction. Multi-touch refers to an operation in which a user touches the screen at the same time using three or more fingers or touch tools such as objects worn by the human body, such as gloves, pens, etc. The screen (or all-in-one) system detects the user's touch gestures through a touch sensor. When multiple touch points are detected, the system checks whether these points belong to the same gesture operation. Exemplarily, the system monitors the number of fingers touching the screen at the same time and determines the gesture type based on the number of fingers. If the number of fingers is three or more, it is considered to be a multi-touch gesture. When it is determined that the user is performing a multi-touch gesture, the coordinates corresponding to the touch position of each finger are recorded (these positions are usually in pixels and obtained through a touch sensor or touch panel), and these coordinates are saved in an array or list.

[0076] After obtaining the coordinates corresponding to each touch point, it is determined whether the distance between the two coordinates is within the preset range in order to confirm whether the user's gesture meets the conditions for triggering the adjustment of the interactive control position. The preset distance range here consists of a minimum preset distance and a maximum preset distance to ensure that the distance between the fingers is neither too large nor too small. Preferably, the distance between each two coordinates is calculated by the Euclidean distance formula, and then the calculated distances are compared with the minimum preset distance and the maximum preset distance. If all distances are within the preset distance range, the gesture is considered valid, and then the new position of the interactive control is determined by obtaining the designated point coordinates of all touch points. By calculating the center position of all touch points, the interactive control can be moved to the core area of ​​the user's gesture operation, providing an intuitive interactive experience. The system then updates the coordinates of the interactive control to the calculated designated point position through a UI update mechanism (such as the updateViewLayout method in Android). During the movement, the system can use animation or smooth transition effects to ensure that the movement process is natural and smooth.

[0077] See also Figure 2 In one embodiment, the coordinates corresponding to each touch point are: a first coordinate, a second coordinate, and a third coordinate, and judging whether the distance between any two touch points is within a preset distance range according to the coordinates includes:

[0078] S21: respectively acquiring a first distance between the first coordinate and the second coordinate, a second distance between the second coordinate and the third coordinate, and a third distance between the first coordinate and the third coordinate;

[0079] S22: Acquire the preset distance range according to the preset contact width and the preset contact distance;

[0080] S23: Determine whether the first distance, the second distance and the third distance are all within the preset distance range.

[0081] Specifically, at least three fingers are used to perform touch screen operation, and the coordinates of the touch points of the three fingers are recorded as the first coordinate (x1, y1), the second coordinate (x2, y2) and the third coordinate (x3, y3), and the distances between them are calculated in sequence.

[0082] The calculation formula of the first distance d1 between the first coordinate (x1, y1) and the second coordinate (x2, y2) is:

[0083]

[0084] The second distance d2 between the second coordinate (x2, y2) and the third coordinate (x3, y3) is calculated as:

[0085]

[0086] The calculation formula for the third distance d3 between the first coordinate (x1, y1) and the third coordinate (x3, y3) is:

[0087]

[0088] After obtaining d1, d2, and d3, the preset distance range is determined by the preset contact width and the preset contact distance. Preferably, the preset contact width is estimated based on the width of a single finger of the user. For example, the average width of an adult's index finger is about 1.6 cm, and the preset contact width is 1.6 cm. The preset contact distance is based on the maximum distance between the user's fingers, especially when performing a three-finger operation, the maximum distance between the three fingers. For example, when the fingers are spread out, the maximum distance between an adult's thumb and little finger is about 20 cm, and the preset contact distance is 20 cm. Based on the two, the preset distance range can be [1.6cm, 20cm]. Since its numerical unit is a physical value of centimeters, the coordinate position of the touch point on the screen is often expressed in pixel values. Before making a comparison, the preset distance range in centimeters should be converted into pixel values. Please refer to Figure 3 , the specific conversion methods include:

[0089] S31: Obtain the size and resolution of the screen;

[0090] S32: Obtaining a pixel pitch according to the size and resolution;

[0091] S33: Convert the preset contact width and the preset contact distance into corresponding pixel values ​​according to the pixel pitch.

[0092] Take a 110-inch all-in-one screen with a resolution of 1080*1920 as an example. According to its resolution, its aspect ratio is 16:9. According to the aspect ratio and screen size (110 inches), the screen width and height are approximately 96.06 inches and 54.04 inches respectively. Then,

[0093] The pixel spacing in width is:

[0094] The pixel spacing in height is:

[0095] The pixel pitch is about 1.3 mm, which can be converted based on the pixel pitch:

[0096] The default contact width is: 16 / 13 12.3 (pixels);

[0097] The preset contact distance is: 200 / 1.3≈153.8 (pixels).

[0098] After obtaining the pixel values ​​corresponding to the preset contact width and the preset contact distance, the preset distance range is obtained as [12.3, 153.8], and it can be determined whether the first distance d1, the second distance d2 and the third distance d3 are within the preset distance range.

[0099] In other embodiments, the first distance d1, the second distance d2 and the third distance d3 may be converted from pixel values ​​into physical values ​​in centimeters or millimeters to facilitate comparison with a preset distance range in centimeters or millimeters.

[0100] If the first distance, the second distance, and the third distance are all within the preset distance range, the current touch gesture is considered to be a gesture operation that requires moving the interactive control, so the coordinates of the designated points between the touch points are obtained. Specifically,

[0101] The coordinates of the specified point (x0, y0) are obtained according to the following formula:

[0102] x0=(x1+x2+x3) / 3;

[0103] y0=(y1+y2+y3) / 3.

[0104] In other embodiments, different weights may be assigned to calculate the position of the designated point based on factors such as the stability, touch pressure, or touch duration of each finger touch point. For example, a greater pressure at some points indicates that the user has a stronger intention to operate on the point; or a longer duration at some points indicates that the user stays on the point more. These characteristics may be used to assign weights to each touch point, and the calculation formula for the designated point is specifically:

[0105] x0=(x1×w1+x2×w2+x3×w3) / (w1+w2+w3);

[0106] y0=(y1×w1+y2×w2+y3×w3) / (w1+w2+w3);

[0107] Among them, w1, w2 and w3 are the weights corresponding to the first coordinate, the second coordinate and the third coordinate respectively.

[0108] After obtaining the coordinates of the specified point, the coordinates of the specified point are transmitted to the UI control of the interactive control through broadcasting. Subsequently, the Android system calls the updateViewLayout method to refresh the interface layout of the interactive control and move the interactive control to the calculated specified point position, thereby realizing the precise positioning of the interactive control on the screen, so that it can be directly displayed at the center of the user's finger touch, improving the convenience and response speed of operation, and avoiding the trouble of users looking for interactive controls on large-screen devices.

[0109] In one embodiment, in order to better understand the user's touch behavior and thus optimize the accuracy of gesture recognition, the determining whether the distance between any two coordinate points is within a preset distance range includes:

[0110] Get user historical touch data;

[0111] determining the user's gesture habits according to the historical touch data;

[0112] The preset distance range is adjusted according to the user's gesture habits.

[0113] Historical touch data refers to the record of touch events generated by users when using the touch screen, including information such as the location of the touch point, touch time, number of fingers, and touch pressure. These data reflect the user's operating habits and usage behaviors. These data are stored in a local database (such as SQLite) or saved through a memory data structure (such as an array or list). Continuously obtaining historical touch data provides a rich sample of user behavior, which helps to analyze the user's touch habits and preferences, thereby determining the user's gesture habits. User gesture habits refer to the user's commonly used operation mode and gesture behavior on the touch screen, such as the commonly used finger spacing, touch position, and gesture type (such as two-finger zoom, single-finger slide, etc.). Useful information is extracted from historical touch data, such as the typical finger spacing, gesture duration, and commonly used touch area when the user performs multi-finger gestures, and then the user's operation mode and gesture habits are identified through statistical analysis or machine learning algorithms (such as cluster analysis, decision trees, etc.). For example, the finger spacing of multiple three-finger touch operations can be analyzed, the average value and variance can be calculated, and the user's habitual finger spacing range can be identified. For habitual operation areas, the system can analyze the areas where users often touch through heat maps to determine the user's operation habit areas. Adjust the preset distance range after identifying the user's gesture habits. For example, if the analysis finds that the user usually performs multi-touch within a smaller finger spacing range, the minimum distance in the preset distance range can be appropriately reduced; conversely, if the user's finger spacing is usually larger, the preset value of the maximum distance in the preset distance range can be increased. The adjustment process can be linear, that is, directly increasing or decreasing the value of the preset distance range according to the average finger spacing, or it can be non-linear, dynamically adjusting according to user habits through an adaptive algorithm. The adjusted preset distance range will be stored in the system configuration for subsequent gesture recognition. By obtaining the user's historical touch data, analyzing gesture habits, and adjusting the preset distance range based on this, the system can achieve personalized and intelligent gesture recognition, thereby improving the accuracy and response speed of gesture operations, ensuring the consistency and comfort of user experience, and enabling the system to better adapt to the diverse needs of different users.

[0114] In one embodiment, after acquiring the designated point between the touch points, the method further includes:

[0115] Get the movement trajectory of the user's touching finger;

[0116] Performing trend analysis on the finger movement trajectory to obtain a finger movement trend, wherein the finger movement trend includes one or more of a finger movement direction trend, a finger movement speed trend, and a finger movement acceleration trend;

[0117] The coordinates of the designated point are continuously updated according to the finger movement trend until the user completes the touch gesture operation.

[0118] Specifically, the finger movement trajectory refers to the path formed when the user moves the finger on the screen. It is composed of a series of continuous touch point coordinates. These trajectories reflect the movement process of the finger on the screen, including information such as position, direction and speed. The finger movement trajectory is recorded from the time the user starts the multi-touch operation. Every time the finger position changes, the system will record the current coordinate point and save these points in chronological order; the finger position is sampled regularly during the implementation process to ensure the accuracy and continuity of the trajectory record. The higher the sampling frequency, the more detailed the trajectory record, but it may increase the calculation burden of the system. Therefore, a suitable sampling rate is selected by balancing the relationship between sampling frequency and performance. For example, when the user drags the finger on the screen, the system will record the coordinate values ​​of multiple time points, such as (t1, x4, y4), (t2, x5, y5), etc., to form a trajectory.

[0119] Finger movement trend refers to the changing pattern of direction, speed and acceleration of the finger during movement. Direction trend reflects the main movement direction of the finger, speed trend reflects the change in the speed of the finger movement, and acceleration trend reflects the rate of change of the finger movement speed. The purpose of trend analysis of finger movement trajectory is to predict the user's operation intention. By understanding the trends of finger movement direction, speed and acceleration, the position of the interactive control can be adjusted in advance to make it more in line with the user's operation needs and expectations. The specific implementation process is: first, the recorded finger trajectory data is processed, and the finger movement direction and speed are determined by calculating the difference between consecutive coordinate points. For example, the finger movement direction trend can be calculated by the following formula:

[0120] Finger moving direction:

[0121] Finger movement speed:

[0122] The acceleration trend is the rate of change of velocity, which can be calculated by dividing the difference of consecutive velocity values ​​by the time interval. By analyzing this data, the system can identify the movement trend of the finger. After obtaining the finger movement trend, the system will continuously adjust the position of the specified point according to these trends. After sampling the finger position and calculating the movement trend each time, the subsequent touch point position is estimated according to the movement trend, and the coordinates of the specified point are recalculated. This process will continue until the user completes the gesture operation (such as lifting the finger). By tracking the entire process of the user's gesture operation and continuously adjusting the position of the specified point in each operation step, the interactive control is always in the position required by the user. In the implementation process, a smooth transition algorithm or a prediction algorithm (such as Kalman filtering) can be used to prevent frequent fluctuations in the position of the specified point and maintain the smoothness and stability of the position adjustment. By obtaining the finger movement trajectory, performing trend analysis, and continuously updating the coordinates of the specified point according to the analysis results, the system can respond to the user's operation changes in real time. Providing dynamically adjusted interactive control positions can improve the smoothness and response speed of the operation, making the user experience more natural and intuitive.

[0123] In one embodiment, after the interactive control on the control screen moves to the position corresponding to the designated point, the method further includes:

[0124] Determining whether a new touch gesture of the user is detected, wherein the new touch gesture includes any one of multi-touch, double-touch and single-touch;

[0125] If yes, start the movement trend monitoring mode to monitor the movement trajectory of the touch point corresponding to the new touch gesture in real time;

[0126] Determine the gesture operation range according to the movement trajectory;

[0127] Generate a corresponding interactive control following trajectory according to the moving trajectory and control the interactive control to remain within a preset range in the gesture operation range for a preset time;

[0128] When the interactive control is triggered within the preset time, the corresponding interactive interface is unfolded and the timing is restarted based on the preset time;

[0129] When the interactive control is not triggered after the preset time is over, the interactive control is moved to a preset screen edge area.

[0130] Specifically, when the interactive control moves to the designated point position determined by the touch gesture, the preliminary movement of the interactive control has been completed. Further, it is determined whether a new touch gesture is detected. The new touch gesture at this time can be any of multi-touch, double-touch or single-touch. When a new touch gesture is detected, the next step will start the mobile trend monitoring mode. In the mobile trend monitoring mode, the moving trajectory of the touch point corresponding to the user gesture will be continuously monitored to obtain the user's operation behavior in real time. At the same time, the trajectory of the finger touch point is analyzed, and the corresponding interactive control following trajectory is generated accordingly. In addition, the user's gesture operation range can be determined according to the moving trajectory. In the process of the interactive control following the gesture movement, it is limited to a preset range in the gesture operation range to avoid being too far or too close to the finger. The following trajectory of the interactive control is dynamically generated based on the user's moving trajectory. By analyzing the gesture trajectory, not only can the position of the interactive control be kept to follow the change of the gesture, but also the interactive control can be ensured to remain stable within the preset range to avoid being out of the user's control range. The process of the interactive control following the gesture is kept within a preset time range. The preset time can be a fixed value set according to the interactive design of the system or the user's operating habits. If the interactive control is not triggered within the preset time, the system will automatically perform a "recycling" operation, that is, move the interactive control to the preset edge area of ​​the screen. When the interactive control is triggered by the user within this time range, the system will immediately expand the corresponding interactive interface, provide the user with further operation options or feedback, and restart the timing. If there is no operation within the preset time after the restart, the same operation of moving the interactive control to the edge of the screen as when the interactive control is not triggered will be automatically performed. The purpose of this operation design is to avoid the interactive control occupying the screen space for a long time, especially when the user does not continue to interact, to keep the interface neat and smooth. In this way, it can provide users with a flexible and intelligent interactive experience, and can remove the interactive control in time when it is not needed to avoid affecting the available space of the screen. By dynamically monitoring the user's gesture trajectory, adjusting the position of the interactive control in real time, and triggering the interactive interface within a specific time, the interactivity and practicality of the interactive control in smart devices are enhanced.

[0131] In one embodiment, after the interactive control on the control screen moves to the position corresponding to the designated point, the method further includes:

[0132] When it is detected that the current touch gesture of the user is double-point touch or multi-point touch and the corresponding positions of each touch point move continuously, the moving trajectory, moving time, moving direction and position change of each touch point are obtained;

[0133] Determining whether the position change exceeds a preset change threshold;

[0134] If so, determining the gesture speed and the reference point according to the position change, the movement time and the movement direction;

[0135] Determine a size change ratio of the interactive control according to the position change amount, adjust the size of the interactive control based on the reference point and according to the size change ratio, and control the size adjustment speed of the interactive control according to the gesture speed during the adjustment process;

[0136] Determine whether the touch gesture includes a rotation operation according to the movement trajectory, the movement direction, and the position change amount; if so, obtain a rotation angle according to the movement trajectory and the position change amount, and rotate the interactive control according to the rotation angle while adjusting the size of the interactive control;

[0137] Determine whether the adjusted interactive control size is greater than a maximum size threshold or less than a minimum size threshold;

[0138] If so, the adjusted size of the interactive control is set to be equal to the maximum size threshold or the minimum size threshold.

[0139] Specifically, when it is detected that the user is currently using double-point touch or multi-point touch, and the position information of the touch points changes continuously, the moving trajectory, moving time, moving direction and position change of these touch points are obtained. The purpose of this step is to accurately capture the dynamic characteristics of the user's gesture. Through the continuous change of position information, the user's intention can be judged more accurately, such as zooming in, zooming out or rotating. Determine whether the position change exceeds the preset change threshold. This change threshold plays a role in filtering invalid touch operations. Only when the user's gesture changes exceed a certain sensitivity range will the size and position of the interactive control be adjusted. This can avoid small, unintentional touch operations affecting the state of the interface elements, thereby improving the stability of the interaction. If the position change exceeds the preset threshold, the reference point is determined according to the moving direction of the touch point. This reference point is the basis for the size adjustment and rotation of the interactive control. The reference point is usually selected at the center position between the two touch points, or the average position of the touch point movement, and the size and position of the control are adjusted based on this. The gesture speed (i.e., the touch point movement rate) is calculated based on the position change and the moving time. The size change ratio of the interactive control is determined based on the user's gesture speed and position change, and the size of the interactive control is adjusted based on the reference point. Specifically, if the user's gesture is magnified (for example, the distance between the touch points increases), the interactive control is enlarged accordingly according to this change ratio; conversely, if the gesture is reduced (the distance between the touch points decreases), the interactive control will be reduced. In the adjustment process, the gesture speed plays a vital role, which controls the speed of the interactive control size adjustment. If the user adjusts at a faster speed, the control size should be adjusted quickly; if the gesture speed is slow, it should be adjusted smoothly to provide a smooth interactive experience and avoid abrupt size changes. In addition to size adjustment, it is also detected whether the user's gesture includes a rotation operation. In the case of multi-touch, the angle change between the touch points can reflect the user's rotation intention. Therefore, by further analyzing the movement trajectory, direction, and position change of the touch point, it is possible to determine whether there is a rotation gesture. If there is a rotation operation, the rotation angle is calculated according to the change in the position of the touch point, and while adjusting the size of the interactive control, the interactive control is rotated accordingly according to the rotation angle, so that the control is consistent with the user's operation.

[0140] During the process of adjusting the size and rotation of the control, it is also constantly determined whether the adjusted interactive control has exceeded the set size limit. Specifically, the system determines whether the adjusted size of the control is greater than the maximum size threshold, or less than the minimum size threshold. The maximum and minimum size thresholds are pre-set, usually taking into account the available space of the user interface and the visual comfort of the control. If the size of the control exceeds the maximum or minimum size limit, its size will be forcibly set to the maximum or minimum value, thereby preventing the control from being too large or too small to affect the interface layout and ensure a good user experience. Through the above operations, the interactive control can not only respond to the user's touch gestures and flexibly adjust the size and position, but also realize a more intelligent interaction method, such as rotation adjustment, gesture speed response, etc. This dynamic and intelligent interaction method greatly improves the user's operating experience, allowing users to more intuitively and smoothly control the display status of the control when interacting with the control.

[0141] In one embodiment, the interactive control is a floating ball. After the interactive control is moved to the position corresponding to the designated point in the control screen, the method further includes: detecting whether the current motion state of each touch point is a synchronous motion state, and if so, controlling the interactive control to follow the touch point to move;

[0142] Determining whether the synchronous movement speed of each of the touch points is greater than or equal to a preset speed threshold;

[0143] If yes, hiding the interactive control;

[0144] If not, detecting whether each of the touch points moves in opposite directions or towards each other during the movement;

[0145] If there is a backward movement, the interactive control is enlarged according to the backward movement position of each touch point, and if there is a forward movement, the interactive control is reduced according to the forward movement position of each touch point.

[0146] Specifically, the current motion state of each touch point is detected, and it is determined whether these touch points are in a synchronous motion state. Synchronous motion means that all touch points move in the same or similar manner at the same time. If the motion state of the touch points is a synchronous state, the interactive controls will follow the motion of these touch points, such as Figure 4As shown. Further analyze the synchronous movement speed of the touch point to determine whether it is greater than or equal to the preset speed threshold. If the synchronous movement speed is fast enough, the operation of hiding the interactive control is performed to deal with fast sliding or dragging. In this case, the user may not need to interact directly with the control, so the control can be hidden to better display the content or interface. If the movement speed of the touch point is lower than the preset threshold, the system will not hide the control, but continue to track the movement of the touch point. During the movement, the back-to-back movement or the opposite movement of the touch point is also considered. Back-to-back movement refers to the touch point moving in the opposite direction relative to a specified point, such as the geometric center point of each touch point, and the distance between the touch points becomes larger, while the opposite movement refers to the distance between the two touch points becoming smaller. If it is detected that the touch point has back-to-back movement, the interactive control is enlarged based on the moving position of these touch points, such as Figure 5 As shown. Conversely, if the touch points move toward each other (i.e., a zoom-out gesture), the size of the interactive control is adjusted according to the position of the touch points moving toward each other, making it smaller. Through this dynamic adjustment of the interactive control based on the motion state, the display behavior of the interactive control can be flexibly controlled, thereby improving the response speed of the interactive control and the user experience.

[0147] In one embodiment, after the interactive control on the control screen moves to the position corresponding to the designated point, the method further includes:

[0148] Acquire the background complexity of the area where the interactive control is located according to the position corresponding to the designated point and the size of the interactive control;

[0149] Determine, according to the background complexity, whether the background of the area where the interactive control is located is a simple background, a relatively complex background, or a highly complex background; wherein the background complexity is obtained according to one or more of image texture information, grayscale gradient change rate, and color information corresponding to the background of the area;

[0150] When the background is simple, extract the main background color value of the area and adjust the color of the interactive control according to the main background color value so that the color difference between the two is greater than or equal to a first preset threshold;

[0151] When the background is relatively complex, extracting a first preset number of first background color values ​​in the area and adjusting the color of the interactive control according to the first background color values ​​so that the color difference between the interactive control and each of the first background color values ​​is greater than or equal to a second preset threshold;

[0152] When the background is highly complex, the area where the interactive control is located is divided into several sub-areas, and after obtaining the background complexity corresponding to each sub-area, the designated point is moved to the sub-area with the smallest background complexity, and a second preset number of second background color values ​​in the sub-area with the smallest background complexity are extracted, and the color of the interactive control is adjusted according to the second background color value so that the color difference between it and each of the second background color values ​​is greater than or equal to a third preset threshold.

[0153] Specifically, when the interactive control moves to the designated point position, first, according to the position and the size of the interactive control, the background complexity of the area where the interactive control is located is obtained. The evaluation of background complexity is based on multiple factors such as the image texture information, gray gradient change rate, and color information of the area. These factors jointly affect the visual effect of the background, thereby determining the complexity of the background. Background complexity can be divided into three categories: simple background, relatively complex background, and highly complex background. In the case of a simple background, the main background color value of the area is extracted. A simple background usually means that the color of the background is relatively single and uniform. Therefore, by analyzing the main background color value, a color of the interactive control that forms a clear contrast with the color is selected. The color of the interactive control is adjusted to ensure that the color difference between it and the background color is greater than or equal to a preset first threshold. This ensures that the interactive control is prominent enough against the simple background and avoids being too similar to the background color and causing unrecognizable. When the background is evaluated as a relatively complex background, multiple color values ​​in the area are extracted, usually the first few most representative background colors in the area, which are recorded as first background color values. The color of the interactive control is adjusted according to these first background color values ​​to ensure that the color difference between the interactive control and these background colors is greater than or equal to a second preset threshold. In this case, the color of the background varies greatly, and there may be many different colors. Therefore, the color of the interactive control needs to be adjusted according to multiple background color values ​​to ensure that the interactive control does not blend with the background visually and maintains sufficient contrast so that users can easily identify and operate it. If the background is evaluated as a high-complexity background, it means that the background not only has a variety of colors, but also may have more complex textures or image elements. In this case, the background area is divided more finely, the area is divided into multiple sub-areas, and the background complexity of each sub-area is evaluated separately. The complexity of each sub-area will be determined based on factors such as its texture information, color changes, and grayscale gradients. Then, the sub-area with the least complexity is selected, and the specified point of the interactive control is moved to the area to ensure that the interactive control can be in an area with a simpler background. After selecting the most suitable sub-area, multiple background color values ​​in the area are extracted and recorded as the second background color value, which is usually the most representative color in the sub-area. The color of the interactive control is adjusted according to these color values ​​so that the color difference between it and these color values ​​is greater than or equal to the third preset threshold to ensure that the contrast between it and the background is high enough to ensure that the user can clearly see and operate the interactive control. This intelligent adaptation method based on background complexity greatly improves the visibility and interaction effect of interactive controls in different environments. Whether the background is simple, relatively complex or highly complex, accurate color adjustment and area selection can ensure that interactive controls always have good visual contrast, and will not be difficult for users to identify or misoperate due to background interference, ensuring that they are always in the best visible state, thereby improving the user's operational convenience and interactive experience.

[0154] In summary, the interactive control moving method provided by the embodiment of the present invention significantly improves the user's operating experience on large-screen devices through intelligent judgment of multi-touch and dynamic adjustment of the interactive control position. The method first identifies whether it is multi-touch, and then obtains the coordinates of each touch point and determines whether the distance between any two touch points is within a preset range, thereby filtering out touch operations that do not meet the conditions, ensuring that only operations that meet the preset standards can trigger subsequent interactive control movement operations, thereby improving the accuracy of gesture recognition, and then obtains the designated point of each touch point as the new position of the interactive control and moves the interactive control, thereby ensuring that the interactive control is always in the core area of ​​the user's operation, greatly reducing the user's time and energy in finding or dragging the interactive control on the screen, especially in large-screen devices, such as electronic whiteboards for teaching and conference systems, the method can significantly improve operating efficiency, make the user's multi-finger operation more intuitive and smooth, and improve the user's interactive experience on large-screen devices.

[0155] Embodiment 2

[0156] See also Figure 6 , an embodiment of the present invention provides an interactive control mobile device 200, the device 200 comprising:

[0157] A detection module 201 is used to determine whether a touch gesture of a user is a multi-touch when the touch gesture is detected, wherein the multi-touch refers to at least three touch points on the screen;

[0158] A coordinate acquisition module 202, configured to acquire the coordinates corresponding to each touch point in the multi-touch;

[0159] A determination module 203 is used to determine whether the distance between any two touch points is within a preset distance range according to the coordinates;

[0160] A designated point acquisition module 204, configured to acquire the designated point between the touch points;

[0161] The moving module 205 is used to control the interactive control on the screen to move to a position corresponding to the designated point.

[0162] In summary, the interactive control moving device provided in the embodiment of the present invention first identifies whether it is a multi-touch, and then obtains the coordinates of each touch point and determines whether the distance between any two touch points is within a preset range, thereby filtering out touch operations that do not meet the conditions, ensuring that only operations that meet the preset standards can trigger subsequent interactive control movement operations, thereby improving the accuracy of gesture recognition, and then obtains the designated point of each touch point as the new position of the interactive control and moves the interactive control, thereby ensuring that the interactive control is always in the core area of ​​the user's operation, greatly reducing the user's time and energy in searching for or dragging the interactive control on the screen. Especially in large-screen devices, such as electronic whiteboards for teaching and conference systems, the method can significantly improve operating efficiency, make the user's multi-finger operation more intuitive and smooth, and improve the user's interactive experience on large-screen devices. Example 3

[0163] In addition, the interactive control moving method according to the embodiment of the present invention may be implemented by a display device. Figure 7 A schematic diagram of the hardware structure of a display device provided by an embodiment of the present invention is shown.

[0164] The display device may include a processor 301 and a memory 302 storing computer program instructions.

[0165] Specifically, the processor 301 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiment of the present invention.

[0166] The memory 302 may include a large capacity memory for data or instructions. For example, but not limitation, the memory 302 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 302 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 302 may be inside or outside the data processing device. In a specific embodiment, the memory 302 is a non-volatile solid-state memory. In a specific embodiment, the memory 302 includes a read-only memory (ROM). In appropriate cases, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM) or a flash memory or a combination of two or more of these.

[0167] The processor 301 implements any one of the interactive control moving methods in the above embodiments by reading and executing the computer program instructions stored in the memory 302 .

[0168] In one example, the display device may further include a communication interface 303 and a bus 310. Figure 7 As shown, the processor 301, the memory 302, and the communication interface 303 are connected via a bus 310 and communicate with each other.

[0169] The communication interface 303 is mainly used to implement the communication between the modules, devices, units and / or equipment in the embodiment of the present invention.

[0170] Bus 310 includes hardware, software or both, and the parts of display device are coupled to each other.For example, but not limitation, bus 310 may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In suitable cases, bus 310 may include one or more buses. Although the embodiment of the present invention describes and shows a specific bus, the present invention considers any suitable bus or interconnection.

[0171] Embodiment 4

[0172] In addition, in combination with the interactive control moving method in the above embodiment, the embodiment of the present invention can provide a computer-readable storage medium for implementation. The computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by the processor 301, any one of the interactive control moving methods in the above embodiment is implemented.

[0173] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention.

[0174] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present invention are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0175] It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiments, or in a different order from the embodiments, or several steps can be performed simultaneously.

[0176] The above is only a specific implementation of the present invention. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the system, module and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be covered within the protection scope of the present invention.

Claims

1. A method for moving an interactive control, characterized in that: The method comprises: When a touch gesture of the user is detected, determining whether the touch gesture is a multi-touch gesture, wherein the multi-touch gesture refers to at least three touch points on the screen; If so, obtaining the coordinates corresponding to each touch point in the multi-touch; Determining whether the distance between any two touch points is within a preset distance range according to the coordinates; If so, obtaining a designated point between the touch points; The interactive control on the control screen moves to a position corresponding to the designated point.

2. The interactive control moving method according to claim 1, characterized in that: The coordinates corresponding to each touch point are: a first coordinate, a second coordinate, and a third coordinate. The determining whether the distance between any two touch points is within a preset distance range according to the coordinates includes: Respectively obtain a first distance between the first coordinate and the second coordinate, a second distance between the second coordinate and the third coordinate, and a third distance between the first coordinate and the third coordinate; Determining the preset distance range according to a preset contact width and a preset contact distance; It is determined whether the first distance, the second distance, and the third distance are all within the preset distance range.

3. The interactive control moving method according to claim 2, characterized in that: The preset contact width and the preset contact distance are both physical values, and before determining the preset distance range according to the preset contact width and the preset contact distance, the method includes: Get the size and resolution of the screen; determining a pixel pitch based on the size and resolution; The preset contact width and the preset contact distance are converted into corresponding pixel values ​​according to the pixel pitch.

4. The interactive control moving method according to claim 2, characterized in that: The acquiring of the designated point between the touch points comprises: Let the first coordinate be (x1, y1), the second coordinate be (x2, y2), and the third coordinate be (x3, y3), and obtain the coordinate (x0, y0) of the specified point according to the following formula: x0=(x1+x2+x3) / 3; y0=(y1+y2+y3) / 3.

5. The interactive control moving method according to claim 1, characterized in that: The step of determining whether the distance between any two touch points is within a preset distance range according to the coordinates includes: Get user historical touch data; determining the user's gesture habits according to the historical touch data; The preset distance range is adjusted according to the user's gesture habits.

6. The interactive control moving method according to claim 1, characterized in that: After the interactive control on the control screen moves to the position corresponding to the designated point, the method further includes: When it is detected that the current touch gesture of the user is double-point touch or multi-point touch and the corresponding positions of each touch point move continuously, the moving trajectory, moving time, moving direction and position change of each touch point are obtained; Determining whether the position change exceeds a preset change threshold; If so, determining the gesture speed and the reference point according to the position change, the movement time and the movement direction; Determine a size change ratio of the interactive control according to the position change amount, adjust the size of the interactive control based on the reference point and according to the size change ratio, and control the size adjustment speed of the interactive control according to the gesture speed during the adjustment process; Determine whether the touch gesture includes a rotation operation according to the movement trajectory, the movement direction, and the position change amount; if so, obtain a rotation angle according to the movement trajectory and the position change amount, and rotate the interactive control according to the rotation angle while adjusting the size of the interactive control; Determine whether the adjusted interactive control size is greater than a maximum size threshold or less than a minimum size threshold; If so, the adjusted size of the interactive control is set to be equal to the maximum size threshold or the minimum size threshold.

7. The interactive control moving method according to claim 1, characterized in that: After the interactive control on the control screen moves to the position corresponding to the designated point, the method further includes: Determining whether a new touch gesture of the user is detected, wherein the new touch gesture includes any one of multi-touch, double-touch and single-touch; If yes, start the movement trend monitoring mode to monitor the movement trajectory of the touch point corresponding to the new touch gesture in real time; Determine the gesture operation range according to the movement trajectory; Generate a corresponding interactive control following trajectory according to the moving trajectory and control the interactive control to remain within a preset range in the gesture operation range and last for a first preset time; When the interactive control is not triggered after the first preset time ends, moving the interactive control to a preset screen edge area; When the interactive control is triggered within the first preset time, the corresponding interactive interface is expanded and the timing is restarted based on the second preset time, and it is determined whether there is an interactive operation within the second preset time; otherwise, the interactive interface is closed and the interactive control is moved to the preset screen edge area.

8. The interactive control moving method according to any one of claims 1 to 7, characterized in that: After the interactive control on the control screen moves to the position corresponding to the designated point, the method further includes: The interactive control obtains the background complexity of the area where the interactive control is located according to the position corresponding to the designated point and the size of the interactive control; Determine, according to the background complexity, whether the background of the area where the interactive control is located is a simple background, a relatively complex background, or a highly complex background; wherein the background complexity is obtained according to one or more of image texture information, grayscale gradient change rate, and color information corresponding to the background of the area; When the background is simple, extract the main background color value of the area and adjust the color of the interactive control according to the main background color value so that the color difference between the two is greater than or equal to a first preset threshold; When the background is relatively complex, extracting a first preset number of first background color values ​​in the area and adjusting the color of the interactive control according to the first background color values ​​so that the color difference between the interactive control and each of the first background color values ​​is greater than or equal to a second preset threshold; When the background is highly complex, the area where the interactive control is located is divided into several sub-areas, and after obtaining the background complexity corresponding to each sub-area, the designated point is moved to the sub-area with the smallest background complexity, and a second preset number of second background color values ​​in the sub-area with the smallest background complexity are extracted, and the color of the interactive control is adjusted according to the second background color value so that the color difference between it and each of the second color values ​​is greater than or equal to a third preset threshold.

9. An interactive control mobile device, characterized in that: The device comprises: A detection module, configured to determine whether a touch gesture of a user is a multi-touch gesture when the touch gesture is detected, wherein the multi-touch gesture refers to at least three touch points on the screen; A coordinate acquisition module, used for acquiring the coordinates corresponding to each touch point in the multi-touch; A judging module, used for judging whether the distance between any two touch points is within a preset distance range according to the coordinates; A designated point acquisition module, used for acquiring the designated point between the touch points; The moving module is used to control the interactive control on the screen to move to a position corresponding to the specified point.

10. A display device, characterized in that: The device includes a touch screen, and also includes: at least one processor, at least one memory, and computer program instructions stored in the memory, and when the computer program instructions are executed by the processor, the method according to any one of claims 1 to 8 is implemented.

Images