A terminal floating window detection method, system, device and medium

Abstract

This invention discloses a method, system, device, and medium for detecting floating windows on a terminal, relating to the field of floating window detection technology. The method includes: acquiring touch events when a user of the terminal to be detected performs a touch action; determining the floating window feature value of the terminal to be detected based on the touch event; determining the floating window type of the terminal to be detected based on the floating window feature value; acquiring the identification information of the terminal to be detected; and determining the floating window detection result of the terminal to be detected based on the identification information and the floating window type. This invention avoids the problem of resource consumption caused by the indiscriminate use of floating windows, detects multiple different types of floating windows, and has a wide detection coverage.

Description

Technical Field

[0001] This invention relates to the field of floating window detection technology, and in particular to a method, system, device and medium for detecting terminal floating windows. Background Technology

[0002] In recent years, the design of operable pages on Android systems has become increasingly diverse, with more and more personalized floating windows assisting users in solving various problems, such as providing prompts, assisting with viewing, watching videos, and engaging in video and voice communication. Different apps design different floating windows for their own applications, resulting in a wide variety of types. However, the indiscriminate use of floating windows can severely impact system performance and consume system resources. Furthermore, the use of floating windows between apps may lead to excessive resource consumption or data and information leaks.

[0003] Currently, existing solutions only implement detection and control of Android floating windows within their respective apps to check whether users have permission to open their own app's floating windows, without systematically detecting, allocating, or processing Android floating windows. Summary of the Invention

[0004] The technical problem to be solved by this invention is to address the shortcomings of existing technologies, specifically the problem of resource consumption caused by the arbitrary use of floating windows. Specifically, it provides a method, system, device, and medium for detecting terminal floating windows, as detailed below:

[0005] 1) In a first aspect, the present invention provides a method for detecting a terminal floating window, the specific technical solution of which is as follows:

[0006] When a user of the terminal under test performs a touch action, the touch event is acquired; the floating window feature value of the terminal under test is determined based on the touch event, and the floating window type of the terminal under test is determined based on the floating window feature value;

[0007] Obtain the identification information of the terminal to be tested, and determine the floating window detection result of the terminal to be tested based on the identification information and the floating window type.

[0008] The beneficial effects of the terminal floating window detection method provided by this invention are as follows:

[0009] By analyzing the floating window feature values ​​of the terminal under test, the corresponding floating window type is obtained, enabling the detection of multiple different types of floating windows with a wide detection coverage. The floating window detection results of the terminal under test are determined based on the terminal's identification information and floating window type analysis. Combining the floating window detection results with the terminal's identification information reflects the user's usage habits regarding floating windows. Furthermore, the floating window detection results can be used to control floating windows, preventing resource consumption and potential information leakage caused by unauthorized use.

[0010] Based on the above solution, the present invention can be further improved as follows.

[0011] Furthermore, the floating window types include:

[0012] Any of the following: no floating window type, semi-obscured floating window type, and regional floating window type.

[0013] Furthermore, the identification information includes:

[0014] The terminal identifier of the terminal to be tested, the running APP identifier of the terminal to be tested, or the user information of the terminal to be tested.

[0015] Furthermore, determining the floating window detection result of the terminal to be detected based on the identification information and the floating window type also includes:

[0016] The floating window detection result of the terminal to be tested is determined based on the number of floating windows displayed, the identification information, and the floating window type.

[0017] Specifically, the display service of the terminal to be tested is obtained, and the number of floating windows is determined based on the display service.

[0018] 2) In a second aspect, the present invention also provides a terminal floating window detection system, the specific technical solution of which is as follows: including: a floating window type module and a floating window detection module;

[0019] The floating window type module is used to acquire touch events when a user of the terminal to be tested performs a touch action; determine the floating window feature value of the terminal to be tested based on the touch event; and determine the floating window type of the terminal to be tested based on the floating window feature value.

[0020] The floating window detection module is used to obtain the identification information of the terminal to be detected, and determine the floating window detection result of the terminal to be detected based on the identification information and the floating window type.

[0021] Based on the above solution, the present invention can be further improved as follows.

[0022] Furthermore, the floating window types include:

[0023] Any of the following: no floating window type, semi-obscured floating window type, and regional floating window type.

[0024] Furthermore, the identification information includes:

[0025] The terminal identifier of the terminal to be tested, the running APP identifier of the terminal to be tested, or the user information of the terminal to be tested.

[0026] Furthermore, determining the floating window detection result of the terminal to be detected based on the identification information and the floating window type also includes:

[0027] The floating window detection result of the terminal to be tested is determined based on the number of floating windows displayed, the identification information, and the floating window type.

[0028] Specifically, the display service of the terminal to be tested is obtained, and the number of floating windows is determined based on the display service.

[0029] 3) In a third aspect, the present invention also provides a computer device, the computer device including a processor coupled to a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to enable the computer device to implement any of the above methods.

[0030] 4) In a fourth aspect, the present invention also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to enable a computer to implement any of the above methods.

[0031] It should be noted that the beneficial effects of the technical solutions of the second to fourth aspects of the present invention and their corresponding possible implementations can be found in the above description of the technical effects of the first aspect and its corresponding possible implementations, and will not be repeated here. Attached Figure Description

[0032] Other features, objects, and advantages of the invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0033] Figure 1 This is a flowchart illustrating the steps of a terminal floating window detection method according to an embodiment of the present invention;

[0034] Figure 2 This is a schematic diagram of the structure of a computer device according to an embodiment of the present invention. Detailed Implementation

[0035] To make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.

[0036] like Figure 1 As shown, an embodiment of the present invention provides a method for detecting a terminal floating window, which includes the following steps:

[0037] S1, When a user of the terminal to be tested performs a touch action, acquire the touch event; determine the floating window feature value of the terminal to be tested based on the touch event, and determine the floating window type of the terminal to be tested based on the floating window feature value;

[0038] S2, obtain the identification information of the terminal to be tested, and determine the floating window detection result of the terminal to be tested based on the identification information and the floating window type.

[0039] The beneficial effects of the terminal floating window detection method provided by this invention are as follows:

[0040] By analyzing the floating window feature values ​​of the terminal under test, the corresponding floating window type is obtained, enabling the detection of multiple different types of floating windows with a wide detection coverage. The floating window detection results of the terminal under test are determined based on the terminal's identification information and floating window type analysis. Combining the floating window detection results with the terminal's identification information reflects the user's usage habits regarding floating windows. Furthermore, the floating window detection results can be used to control the floating windows, preventing resource consumption and potential information leakage caused by unauthorized use.

[0041] Example 1:

[0042] S1, when a user of the terminal under test performs a touch action, acquire the touch event; determine the floating window feature value of the terminal under test based on the touch event, and determine the floating window type of the terminal under test based on the floating window feature value. Wherein:

[0043] The terminals to be tested refer to: mobile phones with touchscreens, Android smart tablets, smart game consoles with touchscreens, etc.

[0044] Touch behavior refers to the act of a user touching the screen of the terminal to be tested in order to control the terminal.

[0045] Touch events refer to the touch events of the terminal being monitored when a user performs a touch action. For example, in the terminal being monitored using an Android application, the dispatchTouchEvent method in the Activity class of the Android UI page can be overridden, as follows:

[0046] public boolean dispatchTouchEvent(MotionEvent event);

[0047] Among them, MotionEvent represents touch events. The MotionEvent class is used to handle user input events, such as touching the screen and swiping.

[0048] Within the `dispatchTouchEvent` method, the `getFlags` method of the `event` parameter is used to retrieve the `flag` value and store it in a `floatType` memory variable, as follows:

[0049] public boolean dispatchTouchEvent(MotionEvent event) {

[0050] floatType = event.getFlags();

[0051] return super.dispatchTouchEvent(event);

[0052] };

[0053] The flag value obtained through the getFlags method of the event parameter is the floating window feature value.

[0054] The process of determining the floating window type of the terminal to be detected based on the floating window feature value is as follows: the floating window type is determined by comparing the floating window feature value with the preset value.

[0055] Furthermore, in another embodiment of the present invention, the floating window type includes any one of: a no-floating-window type, a partially obscured floating window type, and a regional floating window type. Wherein:

[0056] The "no floating window type" refers to the type where the terminal under test does not have a floating window. In this case, the floating window feature value is the first preset value.

[0057] The semi-obscured floating window type refers to a floating window present on the terminal under test, where the width of the floating window is equal to the width of the terminal under test's screen or the length of the floating window is equal to the length of the terminal under test's screen, and the floating window is located on one side of the terminal under test's screen. For example, if a mobile phone has a floating window whose width is equal to the width of the mobile phone screen and is located at the bottom of the mobile phone screen, then the floating window belongs to the semi-obscured floating window type; in this case, the floating window characteristic value is the second preset value.

[0058] For floating windows that exist on the terminal to be detected and do not belong to the semi-obscured floating window type, they are determined to be regional floating window type. This type of floating window can be circular, square, rectangular, irregular, etc.; for example: Tencent Meeting shared desktop, WeChat video small window, Douyin video small window, etc.; at this time, the floating window feature value is the third preset value.

[0059] It should be noted that the first, second, and third preset values ​​are fixed values, and the specific settings are made according to the type of operating system used by the terminal to be tested.

[0060] Based on the above three types of judgments, the code process is as follows:

[0061] Determine if there is no floating window:

[0062] public boolean isNoFloatWindow() {

[0063] return floatType == 0;

[0064] }

[0065] Determine if it is a semi-obscured floating window type:

[0066] public boolean isAreaFloatWindow() {

[0067] return floatType == MotionEvent.FLAG_WINDOW_IS_OBSCURED;

[0068] };

[0069] Among them, MotionEvent.FLAG_WINDOW_IS_OBSCURED is the second preset value.

[0070] Determine if it is a regional floating window type, such as: Tencent Meeting shared desktop, WeChat video pop-up, TikTok video pop-up:

[0071] public boolean isBlockFloatWindow() {

[0072] return floatType ==

[0073] MotionEvent.FLAG_WINDOW_IS_PARTIALLY_OBSCURED;

[0074] };

[0075] Among them, MotionEvent.FLAG_WINDOW_IS_PARTIALLY_OBSCURED represents the third preset value.

[0076] S2, Obtain the identification information of the terminal to be tested, and determine the floating window detection result of the terminal to be tested based on the identification information and the floating window type. Wherein:

[0077] Identification information refers to strings, variables, or objects that can represent the identity information of the terminal to be detected.

[0078] In another embodiment of the present invention, the identification information includes at least one of: the terminal identifier of the terminal to be tested, the running APP identifier of the terminal to be tested, or the user information of the terminal to be tested. Wherein:

[0079] The terminal identifier of the terminal to be tested can be: the serial number of a mobile phone, the serial number of a game console, etc.

[0080] Running an APP refers to the APP that is currently running or the APP involved in the touch event. For example, if a WeChat video call is currently in progress, the APP refers to the current WeChat.

[0081] An APP identifier refers to information such as the APP's serial number, APP name, and APP version number, which together form the APP's identifier. For example, WeChat, wechat v2.1.

[0082] The user information of the terminal to be tested can be: the username and user ID logged in within the APP, etc.

[0083] Based on the identification information and the floating window type, the current floating window status of the device under test can be determined. For example, if the device under test is a smartphone and the current user is logged into WeChat and using WeChat video chat, the serial number of the smartphone, the WeChat version, the user's name and ID, and the floating window type are all obtained. It can be known that the device under test currently has a floating window, which is a WeChat video chat window.

[0084] Furthermore, in another embodiment of the present invention, determining the floating window detection result of the terminal to be tested based on the identification information and the floating window type further includes: determining the floating window detection result of the terminal to be tested based on the number of floating windows displayed, the identification information, and the floating window type; wherein, the display service of the terminal to be tested is obtained, and the number of floating windows displayed is determined based on the display service.

[0085] The number of floating windows displayed refers to the number of floating windows currently being displayed. For example, in the Android system's device under test, the display service of the device under test can be obtained, and the floating window display data can be determined according to the methods in the display service, as follows:

[0086] public boolean isCastWindow() {

[0087] Display[] displays = displayManager.getDisplays();

[0088] return displays.length>1;

[0089] };

[0090] Here, `displayManager` represents the display service, and `getDisplays()` is the method to obtain the number of displays. Based on the obtained number of displays, the floating window display data is determined. The floating window display data can include whether screen sharing or Tencent Meeting screen sharing is currently in progress. This can determine whether the terminal under test is sharing its screen or casting, avoiding the problem of inaccurate floating window detection caused by sharing or casting on the terminal itself, thus overcoming the difficulty of resource consumption caused by arbitrary use of floating windows.

[0091] Furthermore, in another embodiment of the present invention, user information can also be collected, and the user information and floating window type can be reported to the server of the terminal to be tested to analyze the user's usage habits and operating habits.

[0092] The advantages of adopting the above scheme are:

[0093] This invention provides effective floating window detection results. It covers various types of Android floating windows: partially obscured floating windows (such as card counters), regional floating windows such as shared desktops in meeting apps, floating windows for WeChat voice and video calls, or floating windows in video applications (such as TikTok floating windows), etc., with accurate detection results. Furthermore, it creatively categorizes floating windows by type, collects user information and floating window information, reports it to the server, and performs data analysis to generate user profiles.

[0094] Example 2:

[0095] Based on the methods and steps in the above scheme, this embodiment describes a method for detecting the type of a partially obscured floating window, as follows:

[0096] 1. Intercept the dispatchTouchEvent method within the terminal page to obtain the touch event;

[0097] 2. Call event.getFlags() to get the feature value flag and save it as floatType;

[0098] 3. By analyzing and comparing floatTyp and MotionEvent.FLAG_WINDOW_IS_OBSCURED, we can determine whether a partially obscured floating window (such as a card counter) exists.

[0099] 4. Collect user and device information, report it to the server, and the server performs data analysis and generates user profiles.

[0100] Example 3:

[0101] Based on the methods and steps in the above scheme, this embodiment illustrates the implementation steps for detecting transparent floating windows in meeting applications that belong to the regional floating window type, as follows:

[0102] 1. Intercept the dispatchTouchEvent method within the terminal page to obtain the touch event;

[0103] 2. Call event.getFlag() to get the feature value flag and record it as floatType;

[0104] 3. Analysis of floatType and MotionEvent.FLAG_WINDOW_IS_PARTIALLY_OBSCURED shows that the user is using a regional floating window, such as when a meeting application is sharing its screen;

[0105] 4. Collect user and device information, report it to the server, and the server performs data analysis and generates user profiles.

[0106] Among them, transparent floating windows refer to floating windows that can be hidden from the terminal screen without displaying the content in the floating window, and can be opened and expanded by the user's operation when needed.

[0107] Example 4:

[0108] Based on the methods and steps in the above scheme, this embodiment lists an implementation step for detecting screen projection, as follows:

[0109] 1. Call DisplayManager.getDisplays();

[0110] 2. Record the number of screen windows on the player's device in the diplays app and check if it is greater than 1. If so, allow the user to use screen mirroring.

[0111] 3. Collect user and device information, report it to the server, and the server performs data analysis and generates user profiles.

[0112] In the above embodiments, although the steps are numbered S1, S2, etc., they are only specific embodiments given by the present invention. Those skilled in the art can adjust the execution order of S1, S2, etc. according to the actual situation, which is also within the protection scope of the present invention. It can be understood that in some embodiments, some or all of the above embodiments may be included.

[0113] The present invention also provides a terminal floating window detection system, the specific technical solution of which is as follows: including a floating window type module and a floating window detection module;

[0114] The floating window type module is used to acquire touch events when a user of the terminal under test performs a touch action; determine the floating window feature value of the terminal under test based on the touch event; and determine the floating window type of the terminal under test based on the floating window feature value.

[0115] The floating window detection module is used to obtain the identification information of the terminal to be detected, and determine the floating window detection result of the terminal to be detected based on the identification information and the floating window type.

[0116] Furthermore, the floating window types include:

[0117] Any of the following: no floating window type, semi-obscured floating window type, and regional floating window type.

[0118] Furthermore, the identification information includes:

[0119] The terminal identifier of the terminal to be tested, the running APP identifier of the terminal to be tested, or the user information of the terminal to be tested.

[0120] Furthermore, determining the floating window detection result of the terminal to be tested based on the identification information and the floating window type also includes:

[0121] The floating window detection results of the terminal to be tested are determined based on the number of floating windows displayed, the identification information, and the floating window type.

[0122] This involves obtaining the display service of the terminal to be tested and determining the number of floating windows to be displayed based on the display service.

[0123] It should be noted that the beneficial effects of the terminal floating window detection system provided in the above embodiments are the same as those of the terminal floating window detection method described above, and will not be repeated here. Furthermore, the system provided in the above embodiments is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the system can be divided into different functional modules according to the actual situation to complete all or part of the functions described above. In addition, the system and method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process is detailed in the method embodiments, and will not be repeated here.

[0124] like Figure 2 As shown, an embodiment of the present invention provides a computer device 300, which includes a processor 320 coupled to a memory 310. The memory 310 stores at least one computer program 330, which is loaded and executed by the processor 320 to enable the computer device 300 to implement any of the above-described methods. Specifically:

[0125] The computer device 300 can vary considerably due to differences in configuration or performance. It may include one or more processors 320 (Central Processing Units, CPUs) and one or more memories 310. The one or more memories 310 store at least one computer program 330, which is loaded and executed by the one or more processors 320 to enable the computer device 300 to implement the terminal floating window detection method provided in the above embodiment. Of course, the computer device 300 may also have wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The computer device 300 may also include other components for implementing device functions, which will not be elaborated here.

[0126] An embodiment of the present invention provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to enable a computer to implement any of the above-described methods.

[0127] Alternatively, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, a floppy disk, and an optical data storage device, etc.

[0128] In an exemplary embodiment, a computer program product or computer program is also provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the terminal floating window detection methods described above.

[0129] Those skilled in the art will recognize that this invention can be implemented as a system, method, or computer program product. Therefore, this disclosure can be specifically implemented in the following forms: it can be entirely hardware, entirely software (including firmware, resident software, microcode, etc.), or a combination of hardware and software, generally referred to herein as a "circuit," "module," or "system." Furthermore, in some embodiments, the invention can also be implemented as a computer program product contained in one or more computer-readable media, which includes computer-readable program code.

[0130] Any combination of one or more computer-readable media may be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device.

[0131] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A method for detecting a terminal floating window, characterized in that, include: When a user of the terminal under test performs a touch action, the touch event is acquired; the floating window feature value of the terminal under test is determined based on the touch event, and the floating window type of the terminal under test is determined based on the floating window feature value; Obtain the identification information of the terminal to be tested, and determine the floating window detection result of the terminal to be tested based on the identification information and the floating window type; The floating window types include any one of the following: no floating window type, semi-obstructed floating window type, and regional floating window type; The identification information includes at least one of the following: the terminal identifier of the terminal to be tested, the running APP identifier of the terminal to be tested, or the user information of the terminal to be tested; Touch events refer to the touch events of the terminal being detected when a user performs a touch action; In the terminal to be tested using the Android system, override the dispatchTouchEvent method in the Activity class of the Android UI page; Within the dispatchTouchEvent method, the flag value is obtained through the getFlags method of the event parameter and stored in the floatType memory variable; The flag value obtained through the getFlags method of the event parameter is the floating window feature value; The process of determining the floating window type of the terminal to be detected based on the floating window feature value is as follows: the floating window type is determined by comparing the floating window feature value with the preset value.

2. The method for detecting a terminal floating window according to claim 1, characterized in that, The step of determining the floating window detection result of the terminal to be detected based on the identification information and the floating window type further includes: The floating window detection result of the terminal to be tested is determined based on the number of floating windows displayed, the identification information, and the floating window type. Specifically, the display service of the terminal to be tested is obtained, and the number of floating windows is determined based on the display service.

3. A detection system for a terminal floating window, characterized in that, include: Floating window type module and floating window detection module; The floating window type module is used to acquire touch events when a user of the terminal to be detected performs a touch action; The floating window feature value of the terminal to be tested is determined based on the touch event, and the floating window type of the terminal to be tested is determined based on the floating window feature value. The floating window detection module is used to obtain the identification information of the terminal to be detected, and determine the floating window detection result of the terminal to be detected based on the identification information and the floating window type. The floating window types include any one of the following: no floating window type, semi-obstructed floating window type, and regional floating window type; The identification information includes at least one of the following: the terminal identifier of the terminal to be tested, the running APP identifier of the terminal to be tested, or the user information of the terminal to be tested; Touch events refer to the touch events of the terminal being detected when a user performs a touch action; In the terminal to be tested using the Android system, override the dispatchTouchEvent method in the Activity class of the Android UI page; Within the dispatchTouchEvent method, the flag value is obtained through the getFlags method of the event parameter and stored in the floatType memory variable; The flag value obtained through the getFlags method of the event parameter is the floating window feature value; The process of determining the floating window type of the terminal to be detected based on the floating window feature value is as follows: the floating window type is determined by comparing the floating window feature value with the preset value.

4. The terminal floating window detection system according to claim 3, characterized in that, The step of determining the floating window detection result of the terminal to be detected based on the identification information and the floating window type further includes: The floating window detection result of the terminal to be tested is determined based on the number of floating windows displayed, the identification information, and the floating window type. Specifically, the display service of the terminal to be tested is obtained, and the number of floating windows is determined based on the display service.

5. A computer device, characterized in that, The computer device includes a processor coupled to a memory storing at least one computer program, which is loaded and executed by the processor to enable the computer device to perform the method as claimed in any one of claims 1 to 2.

6. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to enable the computer to perform the method as claimed in any one of claims 1 to 2.

Images