Equipment screen projection interaction method and detection system based on data processing

Abstract

The invention relates to the technical field of security detection, in particular to an equipment screen projection interaction method and detection system based on data processing, and the method comprises the steps: receiving the access application content of a transmitting end, and determining an equipment pairing state corresponding to the transmitting end based on the access application content and the local equipment information of a receiving end, the local equipment information comprises hardware configuration information and equipment pairing information corresponding to the receiving end; controlling the receiving end to send preset verification information to the sending end through the local connection channel, and determining the equipment interaction performance based on the local data processing result; determining a screen projection result based on the device pairing state and the device interaction performance; and when the screen projection result is screen projection failure, determining a failure feedback result based on the device pairing state and / or the device interaction performance. According to the method and the device, the timeliness of screen projection failure reason feedback is improved, so that the safety in the equipment interaction process is enhanced.

Description

Technical Field

[0001] The present application relates to the technical field of security detection, and in particular, to a device screen mirroring interaction method and a detection system based on data processing. Background Art

[0002] The screen mirroring technology can significantly improve the user's accommodation experience. Users can project the content on devices such as their smartphones, tablets, or laptops, such as videos, movies, music, photos, etc., onto the TV screen in the hotel room through a local connection. This way not only allows users to enjoy a more convenient and comfortable entertainment experience, but also enables them to watch their favorite content anytime and anywhere, meeting personalized service needs. In addition, the screen mirroring technology also helps to improve the service efficiency of hotels. Hotels can use the screen mirroring technology to provide users with the required information and services, such as displaying hotel facilities, introducing surrounding attractions, and providing dining recommendations. Therefore, the screen mirroring technology is widely used in the hotel industry.

[0003] However, since successful screen mirroring may require adapting to certain conditions, for example, device pairing, interaction performance issues, etc., screen mirroring failures may occur during the user's screen mirroring process. When the screen mirroring fails and the user doesn't know the reason, they may repeatedly try to connect. Such ineffective repeated connection attempts not only cannot solve the problem, but may also expose the device to the risk of abnormal interaction, thus potentially bringing reliability problems to device interaction. Summary of the Invention

[0004] In order to enhance the security during device interaction, the present application provides a device screen mirroring interaction method and a detection system based on data processing.

[0005] In a first aspect, the present application provides a device screen mirroring interaction method based on data processing, adopting the following technical solution: A device screen mirroring interaction method based on data processing includes: Receiving the access application content from the sending end, and determining the device pairing status corresponding to the sending end based on the access application content and the local device information of the receiving end, where the local device information includes the hardware configuration information and device pairing information corresponding to the receiving end; Controlling the receiving end to transmit preset verification information to the sending end, and determining the device interaction performance based on the local data processing result; Determining the screen mirroring result based on the device pairing status and the device interaction performance; When the screen mirroring result is a screen mirroring failure, determining the failure feedback result based on the device pairing status and / or the device interaction performance.

[0006] By adopting the above technical solution, by receiving the access application content of the sending end and determining the screen mirroring permission corresponding to the sending end based on the local device information of the receiving end, it is convenient to ensure that only the sending end meeting specific conditions has the permission to screen mirror to the receiving end, thereby facilitating the improvement of the security and controllability in the device interaction process. In addition, it is not that the receiving end is directly screen mirrored after the sending end has the access permission, but it is necessary to further analyze the screen mirroring port status and device interaction performance, etc., to determine whether the screen mirroring can be successfully performed and the specific reasons for the screen mirroring failure, so as to provide more accurate feedback information for the user. By providing timely targeted feedback, it is convenient to help the user quickly locate the failure reason, so that the relevant user can take corresponding measures to solve the abnormal problem, rather than repeatedly making ineffective connection attempts, which may expose the device to the risk of network attacks, thereby facilitating the enhancement of the security in the device interaction process.

[0007] In a possible implementation manner, the determining the failure feedback result based on the device pairing status and / or the device interaction performance includes: When the device pairing status is un-authorized, determining the failure feedback result as the device is not paired; When the device pairing status is authorized and the device interaction performance is lower than the preset standard interaction performance, determining the failure feedback result as the device interaction performance is insufficient.

[0008] By adopting the above technical solution, by automatically detecting and feedbacking the specific reasons for the screen mirroring failure, the time for the user to troubleshoot problems by themselves is reduced, so as to prevent the user from performing repeated ineffective operations after the screen mirroring fails.

[0009] In a possible implementation manner, when the failure feedback result is that the device interaction performance is insufficient, it further includes: Obtaining the device resource occupancy record of the sending end, and determining the list of programs that can be released based on the device resource occupancy record. The device resource occupancy record includes multiple background running programs, the occupancy rate of each background running program on the device resources, and the most recent usage time; Obtaining the screen mirroring parameters corresponding to the content to be screen mirrored, where the screen mirroring parameters include the screen mirroring resolution and the screen mirroring frame rate; Releasing the background running programs included in the list of programs that can be released based on the device interaction performance and the preset standard interaction performance, and / or adjusting the screen mirroring parameters.

[0010] By adopting the above technical solution, the list of programs to be released is determined based on the occupancy rate of device resources by each background running program and the most recent usage time, which is convenient for more accurately identifying and releasing programs that have a greater impact on the device interaction performance and are not necessary to run. In addition, by adjusting the screen mirroring parameters corresponding to the content to be screen mirrored to adapt to the current network condition, it is convenient to reduce the transmission pressure during the screen mirroring process, thereby facilitating the improvement of the stability and success rate during the device interaction process.

[0011] In a possible implementation manner, the method further includes: Obtain the device operation parameters corresponding to a preset screen mirroring time period, and construct a simulated screen mirroring environment based on the device operation parameters, where the device operation parameters include the operation parameters of the sending end and the operation parameters of the receiving end; Determine potential device interaction risks based on historical device interaction data, and perform device interaction anomaly testing on the simulated screen mirroring environment based on the potential device interaction risks to obtain simulated device interaction performance data, where the simulated device interaction performance data includes the interaction performance data of the sending end and the interaction performance data of the receiving end; Based on the simulated device interaction performance data, perform device interaction performance optimization operations on the sending end and the receiving end, where the device interaction performance optimization operations include upgrading data access permissions and patching potential interaction vulnerabilities.

[0012] By adopting the above technical solution, constructing a simulated screen mirroring environment facilitates a comprehensive security test and evaluation of the device interaction process without affecting the actual device interaction. Determining potential device interaction risks based on historical device interaction data and performing device interaction anomaly testing on the simulated screen mirroring environment facilitates simulating the device interaction risks that may occur during the device interaction process. Through the simulated device interaction performance data, security level reinforcement operations can be performed on the sending end and the receiving end in advance, thereby facilitating the improvement of the robustness and stability of the sending end and the receiving end and ensuring the smooth progress of the device interaction process.

[0013] In a possible implementation manner, the method further includes: Determine the program to be optimized based on the simulated device interaction performance data, where the program to be optimized is the running program of the sending end and / or the running program of the receiving end; Perform a risk assessment on the local area network to be detected based on the hardware configuration information, and determine the device to be optimized based on the risk assessment result; Determine the device interaction optimization area based on the program to be optimized and the device to be optimized; Determine the device interaction optimization duration based on the known vulnerabilities, abnormal behavior characteristics, and preset high-risk functions corresponding to the program to be optimized and the device to be optimized; Generate a device interaction optimization instruction based on the device interaction optimization area and the device interaction optimization duration.

[0014] By adopting the above technical solution, by optimizing the program to be optimized and the device to be optimized, it is convenient to timely discover and eliminate potential threats in the local area network, so as to reduce the security risks during device interaction. In addition, by comprehensively considering the known vulnerabilities, abnormal behavior characteristics, and preset high-risk functions of the program to be optimized and the device, it is convenient to accurately determine the device interaction optimization duration, which not only avoids service interruption and resource waste caused by long-term optimization, but also ensures the effectiveness of the optimization measures.

[0015] In a possible implementation manner, the method further includes: Obtain the behavior data corresponding to the sending end during the device interaction stage in real time, and determine whether the behavior data contains abnormal device interaction behaviors. The behavior data includes video data, audio data, and operation data, and the abnormal device interaction behaviors include preset abnormal interaction characteristics; If so, perform multi-dimensional analysis on the behavior data to determine the abnormal level corresponding to the abnormal device interaction behavior; Adjust the initial authentication policy based on the abnormal level. The initial authentication policy includes authentication content and authentication frequency.

[0016] By adopting the above technical solution, by real-time monitoring the behavior data of the sending end during the device interaction stage, it is convenient to timely discover and identify abnormal device interaction behaviors of users during the device interaction process using the sending end, and adjust the initial authentication policy according to the abnormal level, which can flexibly respond to different abnormal situations, not only ensuring the security of the device interaction process and the receiving end, but also avoiding the decline of user experience caused by excessive verification.

[0017] In a second aspect, the present application provides a detection system, adopting the following technical solution: A detection system, the detection system includes: At least one processor; A memory; At least one application program, where the at least one application program is stored in the memory and is configured to be executed by at least one processor, and the at least one application program is configured to: execute the above-mentioned screen mirroring environment detection method.

[0018] In a third aspect, the present application provides a computer-readable storage medium, adopting the following technical solution: A computer-readable storage medium, including: a computer program stored with the ability to be loaded and executed by a processor to execute the above-mentioned screen mirroring environment detection method.

[0019] Fourthly, the present application provides a computer program product, adopting the following technical solution: A computer program product includes a computer program, and when the computer program is executed by a processor, the above-mentioned screen mirroring environment detection method is implemented.

[0020] In summary, the present application includes at least one of the following beneficial technical effects: By receiving the access application content of the sending end and determining the screen mirroring permission corresponding to the sending end based on the local device information of the receiving end, it is convenient to ensure that only the sending end meeting specific conditions has the permission to screen mirror to the receiving end, thereby facilitating the improvement of the security and controllability in the device interaction process. In addition, after the sending end has the access permission, it does not directly screen mirror to the receiving end. Instead, it is necessary to further analyze the screen mirroring port status and device interaction performance, etc., to determine whether the screen mirroring can be successfully performed and the specific reasons for the screen mirroring failure, so as to provide more accurate feedback information for users. By providing timely and targeted feedback, it is convenient to help users quickly locate the failure reasons, so that relevant users can take corresponding measures to solve abnormal problems, rather than repeatedly making ineffective connection attempts, which may expose the device to the risk of network attacks, thereby facilitating the enhancement of the security in the device interaction process.

[0021] By constructing a simulated screen mirroring environment, it is convenient to comprehensively test and evaluate the device interaction process without affecting the actual device interaction. Determine potential device interaction risks through historical device interaction data, and conduct device interaction anomaly tests on the simulated screen mirroring environment, which is convenient to simulate the device interaction risks that may occur in the device interaction process. By simulating device interaction performance data, security level reinforcement operations can be performed on the sending end and the receiving end in advance, thereby facilitating the improvement of the robustness and stability of the sending end and the receiving end, and ensuring the smooth progress of the device interaction process. Description of the Drawings

[0022] Figure 1 is a schematic flowchart of a device screen mirroring interaction method based on data processing in an embodiment of the present application; Figure 2 is a schematic flowchart of a security level reinforcement operation in an embodiment of the present application; Figure 3 is a schematic structural diagram of a detection system in an embodiment of the present application. Detailed Embodiments

[0023] The following is a further detailed description of the present application in conjunction with the attached Figures 1 to 3 This application is further described in detail below.

[0024] Those skilled in the art can make modifications without creative contributions to this embodiment according to needs after reading this specification, but as long as they are within the scope of the claims of the present application, they are protected by the patent law.

[0025] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the following will clearly and completely describe the technical solutions in the embodiments of this application with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are some, but not all, of the embodiments of this application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in this application without making creative efforts belong to the scope of protection of this application.

[0026] It should be noted that in the alternative embodiments of this application, for relevant data such as object information, when the embodiments in this application are applied to specific products or technologies, object permission or consent needs to be obtained, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of the relevant countries and regions. That is to say, if the embodiments of this application involve data related to an object, it needs to be obtained under the authorization and consent of the object, the authorization and consent of the relevant department, and compliance with the relevant laws, regulations, and standards of the country and region. If personal information is involved in the embodiments, the acquisition of all personal information needs to obtain the consent of the individual. If sensitive information is involved, the separate consent of the information subject needs to be obtained, and the embodiments also need to be implemented under the authorization and consent of the object.

[0027] Specifically, the embodiments of this application provide a method for device screen mirroring interaction based on data processing, which is executed by a detection system. The detection system can be a server or a terminal device. Among them, the server can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc., but is not limited thereto. The terminal device and the server can be directly or indirectly connected through wired or wireless communication methods, and this application does not limit this here.

[0028] Reference Figure 1 , Figure 1 is a schematic flowchart of a method for device screen mirroring interaction based on data processing in the embodiments of this application. The method includes steps S110 to S140, where: Step S110: Receive the access application content from the sending end, and determine the device pairing status corresponding to the sending end based on the access application content and the local device information of the receiving end. The local device information includes the hardware configuration information and device pairing information corresponding to the receiving end.

[0029] Specifically, the sending end is a device carried by the hotel guest, which can be a mobile phone, a tablet, a laptop, etc. The receiving end is a device such as a TV installed in the hotel. The detection system includes hardware configuration information and device pairing information corresponding to multiple receiving ends. The detection system can integrate the hardware configuration information and device pairing information corresponding to each receiving end to obtain integrated information, that is, local device information, and set an identity identifier for each integrated information. The identity identifier corresponds to the integrated information one by one. Based on the identity identifier, a program code is determined and fed back to the corresponding receiving end. When the screen mirroring requirement of the user is detected, the receiving end will display the program code to the user for the user to scan with the sending end. Among them, the hardware configuration information corresponding to different receiving ends may be the same or different. For example, Room 1 and Room 2 use the same local area network. After the user scans the program code displayed by the receiving end with the sending end, the user can identify the identity identifier corresponding to the program code and obtain the corresponding integrated information, that is, the access application content, from the detection system based on the identified identity identifier.

[0030] The access application content includes the hardware configuration information and the screen mirroring address corresponding to the sending end. The access application content is compared with the local device information corresponding to the receiving end to determine the device pairing status of the sending end. The device pairing status includes completed authorization and uncompleted authorization. Among them, when the hardware configuration information of the sending end is consistent with the hardware configuration information of the receiving end and the screen mirroring address of the sending end is the device pairing information of the receiving end, it is determined that the device pairing status of the sending end is completed authorization; when the hardware configuration information of the sending end is inconsistent with the hardware configuration information of the receiving end, or the screen mirroring address of the sending end does not belong to the device pairing information of the receiving end, it is determined that the device pairing status of the sending end is uncompleted authorization.

[0031] Step S120: Control the receiving end to send preset verification information to the sending end through the local connection channel, and determine the device interaction performance based on the local data processing result.

[0032] Specifically, when the device pairing status of the sending end is "authorized", it indicates that the sending end has the permission to cast the screen to the receiving end, but it does not necessarily mean that the screen casting will be successful. Therefore, after determining the device pairing status of the sending end, it is necessary to analyze the device interaction performance between the sending end and the receiving end based on preset verification information. The preset verification information can be information such as verification codes and verification strings, and the specific content is not specifically limited in the embodiments of this application. It is mainly used to evaluate the data transmission ability between the sending end and the receiving end. When determining the device interaction performance, it is necessary to consider and analyze the transmission integrity and transmission rate simultaneously. The higher the transmission integrity and the faster the transmission rate, the higher the corresponding device interaction performance. There is a corresponding relationship between the transmission integrity and the transmission rate and the device interaction performance. Based on this corresponding relationship, the device interaction performance corresponding to any parameter combination of the transmission integrity and the transmission rate can be determined. The specific content of this corresponding relationship is not specifically limited in the embodiments of this application. Before determining the device interaction performance, the port status of the screen casting transmission channel can be defaulted to the normal state.

[0033] Step S130: Determine the screen casting result based on the device pairing status and the device interaction performance.

[0034] Specifically, the screen casting result includes successful screen casting and failed screen casting. Among them, when the screen casting result is failed screen casting, it is necessary to feedback the specific reason for the failed screen casting according to the device pairing status and / or the device interaction performance, so that relevant users can perform self-maintenance according to the feedback content.

[0035] Step S140: When the screen casting result is failed screen casting, determine the failure feedback result based on the device pairing status and / or the device interaction performance.

[0036] Specifically, when the device pairing status is "not authorized", determine that the failure feedback result is that the device is not paired; when the device pairing status is "authorized" and the device interaction performance is lower than the preset standard interaction performance, determine that the failure feedback result is that the device interaction performance is insufficient.

[0037] Among them, the reasons for screen mirroring failure mainly include two types. The first is that the corresponding hardware configuration information of the sending end and the receiving end is different, that is, the sending end and the receiving end may not be in the same local area network. At this time, the device pairing status is generally uncompleted authorization. The second is abnormal network signal, that is, during the device interaction performance inspection stage after authorization is completed, the screen mirroring response fails due to a poor network environment. For example, network lag, network latency, etc. In the embodiments of the present application, it does not stop after determining whether the screen mirroring is successful or failed, but automatically detects and feedbacks the specific reasons for screen mirroring failure, thereby reducing the time for users to troubleshoot problems by themselves and preventing users from performing repeated ineffective operations after screen mirroring failure. For example, when the reason for screen mirroring failure is uncompleted authorization, a prompt of "not in the same local area network. Please ensure that the sending end and the receiving end devices are in the same local area network" can be feedback. When the reason for screen mirroring failure is abnormal network signal, a prompt of "abnormal network signal. Please adjust the position of the router" can be feedback. The specific feedback content is not specifically limited in the embodiments of the present application and can be determined by relevant staff according to historical experimental data and uploaded to the detection system in advance.

[0038] For the embodiments of the present application, by receiving the access application content of the sending end and determining the screen mirroring permission corresponding to the sending end based on the local device information of the receiving end, it is convenient to ensure that only the sending end meeting specific conditions has the permission to screen mirror to the receiving end, thereby facilitating to improve the security and controllability during the device interaction process. In addition, it does not directly perform screen mirroring to the receiving end after the sending end has the access permission, but needs to further analyze the screen mirroring port status and device interaction performance, etc., to judge whether the screen mirroring can be successful and the specific reasons for screen mirroring failure, so as to provide more accurate feedback information for users. By providing timely and targeted feedback, it is convenient to help users quickly locate the failure reasons, so that relevant users can take corresponding measures to solve abnormal problems, rather than repeatedly performing ineffective connection attempts, resulting in the device being exposed to the risk of network attacks, thereby facilitating to enhance the security during the device interaction process.

[0039] Furthermore, in order to facilitate to improve the stability and success rate during the screen mirroring process, when the failure feedback result is insufficient device interaction performance, the method provided by the embodiments of the present application further includes: Obtaining the device resource occupancy record of the sending end, and determining the list of programs that can be released based on the device resource occupancy record. The device resource occupancy record includes multiple background running programs and the occupancy rate and the most recent usage time of each background running program for device resources; obtaining the screen mirroring parameters corresponding to the content to be screen mirrored, where the screen mirroring parameters include the screen mirroring resolution and the screen mirroring frame rate; releasing the background running programs included in the list of programs that can be released based on the device interaction performance and the preset standard transmission performance, and / or adjusting the screen mirroring parameters.

[0040] Specifically, it is known that the sending end can be devices such as a user's mobile phone or tablet. The device resource occupancy record of the sending end contains multiple background running programs, as well as the occupancy rate of each background running program on device resources and the most recent usage time. After obtaining user authorization, the detection system can directly obtain the corresponding device resource occupancy record from the sending end, or the sending end can send the device resource occupancy record to the detection system. By analyzing the device resource occupancy rate of the background running programs on the sending end, it is possible to identify which background running programs are occupying a large amount of device resources. If a background running program occupies a large amount of device resources, it may cause data transmission during device interaction to be blocked, which may result in device interaction failure, that is, it may cause screen mirroring failure. At this time, in order to ensure the success rate of device interaction or the stability during device interaction, the background running programs can be released to reduce the occupancy rate of the background running programs on device resources.

[0041] Based on the occupancy rate of the background running programs on device resources and the first score mapping relationship, the first score corresponding to each background running program can be determined. Among them, the first score mapping relationship is the corresponding relationship between the occupancy rate and the first score, and the higher the occupancy rate, the higher the corresponding first score. Then, based on the most recent usage time and the second score mapping relationship, the second score corresponding to each background running program can be determined. Among them, the second score mapping relationship is the corresponding relationship between the most recent usage time and the second score, and the greater the time difference between the most recent usage time and the current time, the higher the corresponding second score. The first score mapping relationship contains the first score corresponding to any occupancy rate, and the second score mapping relationship contains the second score corresponding to any time difference. The specific content of the first score mapping relationship and the second score mapping relationship is not specifically limited in the embodiments of this application and can be determined by relevant staff based on historical experimental data and then uploaded to the detection system. Based on the first scores and the second scores corresponding to each background running program, the total scores of each background running program are determined. Then, based on the total scores, the multiple background running programs are sorted to determine the list of programs to be released. The total scores of the background running programs in the list of programs to be released are sorted from high to low. If device resources need to be released, the background running programs on the sending end can be released from high to low, so as to more accurately identify and release programs that have a greater impact on device interaction performance and are not necessary to run. When releasing the background running programs on the sending end based on the list of programs to be released, it is not directly released by the detection system. Instead, after determining the programs to be released based on the list of programs to be released, a release request is generated and fed back to the sending end, and then the release is performed after receiving the user's confirmation release operation.

[0042] If the device interaction performance is still insufficient after releasing the background running programs, or the user does not want to release the relevant background running programs, the device interaction performance can also be improved by adjusting the screen mirroring parameters. Different screen mirroring parameters correspond to different device resources required during the device interaction process. The lower the screen mirroring parameters, the lower the device resource occupancy rate. The screen mirroring parameters include but are not limited to the screen mirroring resolution and the screen mirroring frame rate. When the device interaction performance is lower than the preset standard interaction performance, in addition to releasing the background running programs of the sending end, the screen mirroring parameters can also be appropriately reduced to adapt to the current network condition, so as to reduce the interaction pressure during the screen mirroring process, thereby facilitating the improvement of the success rate and stability of the device interaction process. When releasing the background running programs based on the device interaction performance and the preset standard interaction performance, and / or adjusting the screen mirroring parameters, the change of the device interaction performance can be monitored in real time. When the device interaction performance is not lower than the preset standard interaction performance, the release of the background running programs and / or the reduction of the screen mirroring parameters can be stopped, so as to avoid affecting the user experience after releasing too many background running programs and / or reducing the screen mirroring parameters too much.

[0043] Further, in order to facilitate the improvement of the robustness and stability of the sending end and the receiving end and ensure the smooth progress of the device interaction process, the method provided in the embodiment of the present application further includes steps S210 to S230, as Figure 2 shown, where: Step S210: Obtain the device operation parameters corresponding to the preset screen mirroring period, and construct a simulated screen mirroring environment based on the device operation parameters. The device operation parameters include the sending end operation parameters and the receiving end operation parameters.

[0044] Specifically, the sending end operation parameters include but are not limited to the operating system version, CPU configuration, memory configuration, GPU configuration, screen resolution, network status, etc. The receiving end operation parameters include but are not limited to the operating system version, hardware configuration, video encoding format, network connection status, etc. Based on virtualization technology or a preset simulator software, a simulated screen mirroring environment of the sending end and the receiving end is built on the basis of the device operation parameters. The screen mirroring process between the sending end and the receiving end can be simulated in the simulated screen mirroring environment. The preset screen mirroring period is a period of time after the sending end successfully mirrors the screen to the receiving end. The duration corresponding to the preset screen mirroring period can be 5 minutes or 8 minutes. The specific duration is not specifically limited in the embodiment of the present application.

[0045] Step S220: Determine potential device interaction risks based on historical device interaction data, and perform device interaction anomaly tests on the simulated screen mirroring environment based on the potential device interaction risks to obtain simulated device interaction performance data. The simulated device interaction performance data includes sending end interaction performance data and receiving end interaction performance data.

[0046] Step S230: Based on the simulated device interaction performance data, perform device interaction performance optimization operations on the sending end and the receiving end. The device interaction performance optimization operations include upgrading data access permissions and patching potential interaction vulnerabilities.

[0047] Specifically, the historical device interaction data contains historical device interaction risks that occurred during device interaction within a historical time period. By analyzing the common characteristics and patterns of multiple historical device interaction risks, a potential identification model for potential device interaction risks can be obtained. That is, the potential identification model is based on multiple historical device interaction risks. The specific training process of the potential identification model is not specifically limited in the embodiments of the present application, as long as it can identify potential device interaction risks in device interaction anomaly testing. A preset test tool can be used to simulate potential device interaction risks in device interaction anomaly testing and record the simulated device interaction performance data during the device interaction anomaly testing when facing the simulated device interaction risks, that is, the sending end interaction performance data and the receiving end interaction performance data. The simulated device interaction performance data includes, but is not limited to, security policy execution rate, anomaly detection, early warning rate, firewall logs, etc. Through the simulated device interaction performance data, the interaction capabilities of the sending end and the receiving end during device interaction can be evaluated, and the permissions with potential security hazards can be upgraded or adjusted. For example, the access level of data can be increased, and it can only be accessed for a limited time after authorization. Potential interaction vulnerabilities or interaction weaknesses can also be strengthened to enhance the security protection capabilities of the sending end and the receiving end.

[0048] That is, by constructing a simulated screen mirroring environment, it is convenient to conduct comprehensive security testing and evaluation of the device interaction process without affecting the actual device interaction. Determine potential device interaction risks through historical device interaction data, and conduct device interaction anomaly testing on the simulated screen mirroring environment to facilitate simulating possible device interaction anomaly scenarios during the device interaction process. Through the simulated device interaction performance data, security level reinforcement operations can be performed on the sending end and the receiving end in advance, so as to facilitate improving the robustness and stability of the sending end and the receiving end and ensure the smooth progress of the device interaction process.

[0049] Furthermore, in order to facilitate reducing the security risks during device interaction, the method provided in the embodiments of the present application further includes: Determine the program to be optimized based on the simulated device interaction performance data. The program to be optimized is the running program of the sending end and / or the running program of the receiving end; perform a risk assessment on the local area network to be detected based on the hardware configuration information, and determine the device to be optimized based on the risk assessment result; determine the device interaction optimization area based on the program to be optimized and the device to be optimized; determine the device interaction optimization duration based on the known vulnerabilities, abnormal behavior characteristics, and preset high-risk functions corresponding to the program to be optimized and the device to be optimized; generate a device interaction optimization instruction based on the device interaction optimization area and the device interaction optimization duration.

[0050] Specifically, the number of programs to be optimized can be one or multiple. The specific number is not specifically limited in the embodiments of the present application. The program to be optimized can be a background program of the sending end or a background program of the receiving end. The program to be optimized is a program with poor device interaction performance and may have security risks or abnormal behaviors. The specific implementation method can be: using a preset anomaly detection algorithm to perform anomaly detection on the simulated device interaction performance data. For example, the network communication modes of each background program can be analyzed to identify activities that are significantly different from the preset standard behavior mode, or to identify whether there are risk behaviors such as unauthorized data access, modification, or deletion, so as to determine the program to be optimized. The specific preset anomaly detection algorithm is not specifically limited in the embodiments of the present application. Based on the hardware configuration information, other devices using the same local area network as the sending end and the receiving end are determined, and then based on the above method for determining the program to be optimized, the devices to be optimized are determined from other devices. The devices to be optimized also have security risks or potential vulnerabilities. The method for determining the program to be optimized and the devices to be optimized is not specifically limited in the embodiments of the present application.

[0051] After determining the program to be optimized and the devices to be optimized, the device interaction optimization area can be divided from the local area network to be detected based on the program to be optimized and the devices to be optimized. The device interaction optimization area at least includes the program to be optimized and the devices to be optimized. Through device interaction optimization, it is convenient to ensure that the devices and programs within the device interaction optimization area will not pose security risks to the sending end, the receiving end, and other normal devices within the local area network to be detected. The device interaction optimization area is not permanently optimized but corresponds to a device interaction optimization duration. The method for determining the device interaction optimization duration can be any of the following, where: Method 1: The device interaction optimization duration of the device interaction optimization area can be the device interaction duration, that is, the optimization stops immediately after the device interaction ends; Method 2: The device interaction optimization duration can be delayed until after the device interaction ends, that is, after the device interaction ends, the optimization stops after a delay optimization duration. The delay optimization duration can be determined by the user himself or can be set in advance by relevant staff according to historical experimental data and then uploaded to the detection system. The specific delay optimization duration is not limited in the embodiments of the present application; Method 3: The device interaction optimization duration can be determined by evaluating the risk duration of the program to be optimized and the devices to be optimized. For example, both the program to be optimized and the devices to be optimized contain a vulnerability a, and the repair duration of the vulnerability a is b minutes. At this time, the network isolation duration can be determined to be b minutes.

[0052] In the fourth method, the device interaction optimization duration can be determined by evaluating the risk levels of the program to be optimized and the device to be optimized, and then based on the mapping relationship between the risk level and the preset duration. The preset duration mapping relationship is the corresponding relationship between the risk level and the device interaction optimization duration, and the specific content of the preset duration mapping relationship is not specifically limited in the embodiments of the present application.

[0053] By comprehensively considering the known vulnerabilities, abnormal behavior characteristics, and preset high-risk functions of the program to be optimized and the device, it is convenient to accurately determine the device interaction optimization duration, which not only avoids service interruption and resource waste caused by long-term optimization, but also ensures the effectiveness of the optimization measures.

[0054] Further, in order to improve the security of the device interaction process and the receiving end, the method provided in the embodiments of the present application further includes: Real-time obtain the behavior data corresponding to the sending end during the device interaction stage, and determine whether the behavior data contains abnormal device interaction behaviors. The behavior data includes video data, audio data, and operation data, and the abnormal device interaction behaviors include preset abnormal behavior characteristics; if so, perform multi-dimensional analysis on the behavior data to determine the abnormal level corresponding to the abnormal device interaction behavior; adjust the initial authentication policy based on the abnormal level, and the initial authentication policy includes authentication content and authentication frequency.

[0055] Specifically, after obtaining user authorization, the video data, audio data, and operation data generated by the sending end during the device interaction process can be obtained in real time. Among them, the operation data includes operations such as user clicks, swipes, inputs, and downloads. The preset abnormal behavior characteristics can be abnormal audio playback rates, abnormal video playback rates, frequent audio and video playback interruptions, accessing abnormal websites, etc. The specific preset behavior characteristics can be determined by relevant staff based on historical experimental data and then uploaded to the detection system. The specific content is not limited in the embodiments of the present application. The preset feature matching algorithm can be used to identify and determine whether the behavior data contains preset abnormal behavior characteristics. If the behavior data does not contain preset abnormal behavior characteristics, the initial authentication policy is maintained. The initial authentication policy can be to send a face verification prompt to the sending end every 50 minutes to authenticate the user.

[0056] If the behavior data contains preset abnormal behavior data, the abnormal occurrence frequency and abnormal duration of the preset abnormal behavior characteristics can be recorded, and the abnormal level corresponding to the behavior data can be determined based on the preset abnormal level mapping relationship. The preset abnormal level mapping relationship is the corresponding relationship between the parameter combination of the abnormal occurrence frequency and abnormal duration and the abnormal level. The specific content of the preset abnormal level mapping relationship is not specifically limited in the embodiments of the present application. The abnormal level can be divided into minor abnormality, medium abnormality, severe abnormality, etc. Different abnormal levels correspond to different adjustment methods of the identity verification policy. For example, when the abnormal level is minor abnormality, the corresponding identity verification policy can be adjusted from the initial identity verification policy to send a face verification prompt to the sending end once every 40 minutes; when the abnormal level is medium abnormality, the corresponding identity verification policy can be adjusted from the initial identity verification policy to send a face verification prompt and a fingerprint verification prompt to the sending end once every 30 minutes; when the abnormal level is minor abnormality, the corresponding identity verification policy can be adjusted from the initial identity verification policy to send a face verification prompt and a fingerprint verification prompt to the sending end once every 20 minutes. The adjustment methods of the initial identity verification policy for different abnormal levels can be determined by relevant staff based on historical experimental data and uploaded to the detection system in advance.

[0057] By real-time monitoring of the behavior data of the sending end in the device interaction stage, it is convenient to timely discover and identify abnormal device interaction behaviors of the user during the device interaction process using the sending end. Adjusting the initial identity verification policy according to the abnormal level can flexibly respond to different abnormal situations, which can not only ensure the security of the device interaction process and the receiving end, but also avoid the decline in user experience caused by excessive verification.

[0058] An embodiment of the present application provides a detection system, as Figure 3 shown, Figure 3 The detection system 300 shown includes: a processor 301 and a memory 303. Among them, the processor 301 and the memory 303 are connected, such as through a bus 302. Optionally, the detection system 300 may further include a transceiver 304. It should be noted that in practical applications, the transceiver 304 is not limited to one, and the structure of the detection system 300 does not constitute a limitation to the embodiments of the present application.

[0059] The processor 301 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in connection with the disclosure of this application. The processor 301 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0060] The bus 302 may include a path for transmitting information between the above components. The bus 302 may be a PCI (Peripheral Component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The bus 302 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 only one line is shown herein, but it does not mean that there is only one bus or one type of bus.

[0061] The memory 303 may be a ROM (Read Only Memory) or other type of static storage device that can store static information and instructions, a RAM (Random Access Memory), or other type of dynamic storage device that can store information and instructions. It may also be an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory), or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0062] The memory 303 is used to store the application program code for executing the solution of this application, and is controlled by the processor 301 to execute. The processor 301 is used to execute the application program code stored in the memory 303 to implement the content shown in the foregoing method embodiments.

[0063] Among them, the detection system includes but is not limited to: mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. It can also be a server, etc. Figure 3 The detection system shown is only an example and should not impose any limitations on the functions and usage scope of the embodiments of this application.

[0064] The embodiments of this application provide a computer-readable storage medium, on which a computer program is stored. When it runs on a computer, it enables the computer to execute the corresponding content in the foregoing method embodiments.

[0065] The embodiments of this application provide a computer program product, which includes a computer program that implements the method in any of the above embodiments when executed by a processor.

[0066] It should be understood that although the steps in the flowchart of the accompanying drawings are shown in sequence according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps does not have a strict order restriction, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same moment, but can be executed at different moments, and their execution order is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0067] The above are only some implementation manners of this application. It should be noted that for those of ordinary skill in the art, without departing from the principle of this application, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of this application.

Claims

1. A method for device screen mirroring interaction based on data processing, characterized in that, including: Receiving the access application content of the sending end, and determining the device pairing status corresponding to the sending end based on the access application content and the local device information of the receiving end, where the local device information includes the hardware configuration information and device pairing information corresponding to the receiving end; Controlling the receiving end to send preset verification information to the sending end through a local connection channel, and determining the device interaction performance based on the local data processing result; Determining the screen mirroring result based on the device pairing status and the device interaction performance; When the screen mirroring result is screen mirroring failure, determining the failure feedback result based on the device pairing status and / or the device interaction performance.

2. The method for device screen mirroring interaction based on data processing according to claim 1, wherein The determining the failure feedback result based on the device pairing status and / or the device interaction performance includes: When the device pairing status is uncompleted authorization, determining that the failure feedback result is that the device is not paired; When the device pairing status is completed authorization and the device interaction performance is lower than the preset standard interaction performance, determining that the failure feedback result is insufficient device interaction performance.

3. The method for device screen mirroring interaction based on data processing according to claim 2, wherein, When the failure feedback result is insufficient device interaction performance, it further includes: Obtaining the device resource occupancy record of the sending end, and determining the list of programs that can be released based on the device resource occupancy record, where the device resource occupancy record includes multiple background running programs and the occupancy rate and the most recent usage time of each background running program for device resources; Obtaining the screen mirroring parameters corresponding to the content to be screen mirrored, where the screen mirroring parameters include the screen mirroring resolution and the screen mirroring frame rate; Releasing the background running programs included in the list of programs that can be released based on the device interaction performance and the preset standard interaction performance, and / or adjusting the screen mirroring parameters.

4. A method for device screen mirroring interaction based on data processing according to claim 1, characterized in that It further includes: Obtaining the device operation parameters corresponding to the preset screen mirroring period, and constructing a simulated screen mirroring environment based on the device operation parameters, where the device operation parameters include the operation parameters of the sending end and the operation parameters of the receiving end; Determining the potential device interaction risks based on the historical device interaction data, and performing device interaction anomaly tests on the simulated screen mirroring environment based on the potential device interaction risks to obtain simulated device interaction performance data, where the simulated device interaction performance data includes the sending end interaction performance data and the receiving end interaction performance data; Performing device interaction performance optimization operations on the sending end and the receiving end based on the simulated device interaction performance data, where the device interaction performance optimization operations include upgrading the data access permissions and patching potential interaction vulnerabilities.

5. A method for device screen mirroring interaction based on data processing according to claim 4, characterized in that, It further includes: Determining the program to be optimized based on the simulated device interaction performance data, where the program to be optimized is the running program of the sending end, and / or the running program of the receiving end; Performing a risk assessment on the to-be-detected local area network based on the hardware configuration information, and determining the device to be optimized based on the risk assessment result; Determining the device interaction optimization area based on the program to be optimized and the device to be optimized; Determining the device interaction optimization duration based on the known vulnerabilities, abnormal behavior characteristics and preset high-risk functions corresponding to the program to be optimized and the device to be optimized; Generating a device interaction optimization instruction based on the device interaction optimization area and the device interaction optimization duration.

6. A device screen mirroring interaction method based on data processing according to claim 1, characterized in that It further includes: Obtain the behavior data corresponding to the sending end during the device interaction stage in real time, and determine whether the behavior data contains abnormal device interaction behaviors. The behavior data includes video data, audio data, and operation data, and the abnormal device interaction behaviors include preset abnormal interaction characteristics; If so, perform multi-dimensional analysis on the behavior data to determine the abnormal level corresponding to the abnormal device interaction behavior; Adjust the initial authentication policy based on the abnormal level. The initial authentication policy includes authentication content and authentication frequency.

7. A detection system, characterized in that, The detection system includes: At least one processor; A memory; At least one application program, where the at least one application program is stored in the memory and is configured to be executed by at least one processor. The at least one application program is configured to: execute a device screen mirroring interaction method based on data processing according to any one of claims 1-6.

8. A computer-readable storage medium, characterized in that, Including: A computer program stored that can be loaded and executed by a processor to execute a device screen mirroring interaction method based on data processing according to any one of claims 1-6.

9. A computer program product, characterized in that, Including a computer program, and when the computer program is executed by a processor, the steps of a device screen mirroring interaction method based on data processing according to any one of claims 1-6 are implemented.

Images