Privacy protection method for mobile phone screen projection, terminal, medium and program product

By dynamically adjusting the delay parameters and identifying privacy risk areas during the mobile phone screen projection process, the problem of sensitive information leakage during the screen projection process is solved, real-time privacy protection of screen projection content and user experience optimization.

CN119520910AActive Publication Date: 2025-02-25NANJING PENGCHEN QIZHI TECH CO LTD

Patent Information

Application Number
CN202510088168.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-01-21
Publication Date
2025-02-25
Estimated Expiration
2045-01-21

AI Technical Summary

Technical Problem

During the mobile phone screen projection process, the existing technology is difficult to respond to dynamic system events in a timely manner, resulting in the possibility of leakage of sensitive content such as user communication information.

Method used

By setting preset delay parameters on the mobile terminal to delay the screen projection display data, and dynamically adjust the delay parameters according to the user operation sequence, identify and mark the privacy risk areas, dynamic privacy protection of screen projection content is achieved.

Benefits of technology

While ensuring the continuity of screen projection display, real-time privacy protection of screen projection content is achieved, sensitive information leakage is prevented, and the protection intensity is adaptively adjusted according to the user's operating mode to improve user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119520910A_ABST
    Figure CN119520910A_ABST
Patent Text Reader

Abstract

The invention discloses a privacy protection method for mobile phone screen projection, a terminal, a medium and a program product, and relates to the field of electric digital data processing, and the method comprises the steps: responding to a screen projection confirmation operation of a user, carrying out display delay processing on screen projection display data according to a preset time delay parameter, obtaining time delay display data, and sending the time delay display data to a target screen projection terminal; acquiring newly added display data of the screen projection display data in real time, and determining a corresponding user operation sequence; adjusting a preset time delay parameter according to the user operation sequence to obtain a corrected time delay parameter; identifying a privacy risk area of the newly added display data, and generating a privacy risk mark; in response to a mark processing operation of the user on the privacy risk mark, performing risk processing on the newly added display data to obtain target display data; and performing display delay processing on the target display data according to the corrected time delay parameter to obtain newly increased time delay data, and sending the newly increased time delay data to the target screen projection terminal. By implementing the application, the privacy information when the user uses the mobile phone to project the screen can be protected.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of electronic digital data processing, and in particular to a privacy protection method, terminal, medium and program product for mobile phone screen projection. Background Art

[0002] With the popularization of mobile smart terminals and the development of wireless display technology, the mobile phone screen projection function is increasingly used in daily work and life. In various scenarios such as meetings, teaching, and driving, users need to project the content of their mobile phone screen onto a large screen for sharing and display.

[0003] In related technologies, some applications provide a permission confirmation mechanism when establishing a connection for screen projection. Users need to confirm whether to allow screen projection, and the system can only start screen projection after obtaining authorization. At the same time, mobile screen projection applications use a privacy protection solution based on keyword recognition, which uses OCR technology to identify sensitive information in screen content in real time and hide or blur the identified sensitive areas.

[0004] However, in actual screen projection scenarios, various system events such as instant messaging messages and video calls will appear in the process of screen projection on the mobile phone. The relevant technology only focuses on the content displayed on the screen and it is difficult to respond to dynamic system events in a timely manner, which will cause the leakage of sensitive content such as user communication information. Summary of the invention

[0005] The present application provides a privacy protection method, terminal, medium and program product for mobile phone screen projection, which are used to protect the privacy information of users when using mobile phone screen projection.

[0006] In the first aspect, the present application provides a privacy protection method for mobile phone screen projection, which is applied to a mobile terminal, and the method includes: in response to a user's screen projection confirmation operation, performing display delay processing on the projection display data according to a preset delay parameter to obtain delayed display data, and sending the delayed display data to a target projection terminal; acquiring new display data of the projection display data in real time, and determining a user operation sequence corresponding to the new display data; adjusting the preset delay parameter according to the user operation sequence to obtain a corrected delay parameter; identifying a privacy risk area of ​​the new display data, and generating a privacy risk mark; in response to the user's marking processing operation on the privacy risk mark, performing risk processing on the new display data to obtain the target display data; performing display delay processing on the target display data according to the corrected delay parameter to obtain the new delay data, and sending the new delay data to the target projection terminal.

[0007] In the above embodiment, the mobile terminal delays the screen projection display data by setting preset delay parameters, and dynamically adjusts the delay parameters according to user operations. At the same time, it identifies privacy risk areas and marks them, thereby realizing dynamic privacy protection of the screen projection content. It not only ensures the continuity of the screen projection display, but also responds to the user's privacy protection needs in a timely manner, effectively preventing the leakage of sensitive information.

[0008] In combination with some embodiments of the first aspect, in some embodiments, the step of adjusting the preset delay parameter according to the user operation sequence to obtain the corrected delay parameter specifically includes: obtaining the user operation sequence within a preset sampling period, and extracting the operation timing characteristics including the operation type and the operation frequency; determining the terminal operation mode of the user according to the newly added display data and the operation timing characteristics; when the terminal operation mode is the interactive mode, reducing the preset delay parameter by a first adjustment coefficient to obtain the corrected delay parameter; when the terminal operation mode is the browsing mode, increasing the preset delay parameter by a second adjustment coefficient to obtain the corrected delay parameter.

[0009] In the above embodiment, the mobile terminal dynamically distinguishes between the interactive mode and the browsing mode by analyzing the timing characteristics of the user operation sequence, and adjusts the delay parameters accordingly, thereby realizing adaptive adjustment of the screen projection delay, reducing the delay in the interactive mode to ensure the timeliness of the operation response, and increasing the delay in the browsing mode to enhance privacy protection, thereby balancing user experience and privacy security.

[0010] In combination with some embodiments of the first aspect, in some embodiments, the steps of determining the terminal operation mode of the user based on the newly added display data and operation timing characteristics specifically include: obtaining the most recent N operation data in the user operation sequence, extracting the type identification, timestamp, operation interval and operation target object of the recent operation data, and constructing a recent operation vector; based on the recent operation vector, calculating the user's current operation behavior feature value; the operation behavior feature value includes the operation frequency mean, operation interval variance and target object switching rate; calculating the matching degree of the operation behavior feature value with the normal behavior model to obtain a behavior abnormality score; when the abnormality score exceeds a preset abnormality threshold, switching the terminal operation mode to browsing mode.

[0011] In the above embodiment, the mobile terminal performs feature extraction and behavior analysis on recent operation data, calculates the abnormality of operation behavior in real time, and switches to browsing mode when the threshold is exceeded, thereby realizing automatic protection against abnormal operation behavior, accurately identifying potential risk operations, and adjusting protection strategies in a timely manner.

[0012] In combination with some embodiments of the first aspect, in some embodiments, the steps of identifying privacy risk areas of newly added display data and generating privacy risk markers specifically include: performing feature extraction on the newly added display data to obtain text information, image information and layout information; performing data matching on the text information and image information based on the sensitive information vocabulary and the image feature library to obtain a set of potential risk areas; determining the association relationship between multiple interface elements according to the layout information, and merging the areas in the potential risk area set whose spatial distance is less than a preset distance threshold based on the association relationship to obtain multiple candidate risk areas; calculating the risk score of each candidate risk area; screening and grading the candidate risk areas according to the risk score to determine the privacy risk area; determining the location coordinates, risk level and recommended processing method of the privacy risk area, and generating a privacy risk marker.

[0013] In the above embodiment, the mobile terminal extracts and analyzes multi-dimensional features, combines with the sensitive information library to identify and merge risk areas, and optimizes the risk area division based on layout information, thereby achieving accurate privacy content identification.

[0014] In combination with some embodiments of the first aspect, in some embodiments, the step of calculating the risk score of each candidate risk area specifically includes: obtaining visual features and contextual features of the candidate risk area; the visual features include area size, area location and display parameters, and the contextual features include interaction frequency and user focus correlation; inputting the visual features and contextual features into a feature scoring model to obtain a visual feature score and a contextual feature score; determining a feature weighting coefficient according to the terminal operation mode, and performing weighted calculation on the visual feature score and the contextual feature score based on the feature weighting coefficient to obtain a risk score.

[0015] In the above embodiment, the mobile terminal realizes dynamic calculation of risk scores by integrating visual features and contextual features and dynamically adjusting feature weights according to the terminal operation mode, and can accurately assess the degree of privacy risk in different scenarios.

[0016] In combination with some embodiments of the first aspect, in some embodiments, after the step of performing risk processing on the newly added display data to obtain the target display data in response to the user's marking processing operation on the privacy risk mark, the method also includes: detecting the audio data stream corresponding to the target display data, extracting new audio features including new voice content and new background sound; determining sensitive audio content in the audio data stream based on the new audio features; and filtering sensitive audio content in the audio data stream in response to the user's audio processing operation.

[0017] In the above embodiment, the mobile terminal realizes the protection of audio privacy by real-time detection and analysis of audio data streams, identifies sensitive content therein and provides filtering processing, expands the dimension of privacy protection, and provides more comprehensive protection capabilities.

[0018] In combination with some embodiments of the first aspect, in some embodiments, before the step of acquiring new display data of the projection display data in real time and determining the user operation sequence corresponding to the new display data, the method also includes: determining the foreground application currently running on the mobile terminal in response to the user's quick projection operation; when the foreground application belongs to the projection application whitelist, sending the projection display data to the target projection terminal.

[0019] In the above embodiment, the mobile terminal implements fast screen projection support for secure applications through a whitelist mechanism, thereby improving the convenience of screen projection operations while ensuring security.

[0020] In a second aspect, an embodiment of the present application provides a mobile terminal, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the mobile terminal to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a mobile terminal, enables the mobile terminal to execute the method described in the first aspect and any possible implementation of the first aspect.

[0022] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions. When the instructions are executed on a mobile terminal, the mobile terminal executes the method described in the first aspect and any possible implementation method of the first aspect.

[0023] It is understandable that the mobile terminal provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.

[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. Due to the use of preset delay parameters to delay the processing of screen projection display data, and real-time monitoring of display data changes and user operation sequences for dynamic adjustment, combined with the marking processing mechanism, it is possible to identify and protect privacy content while ensuring the continuity of screen projection display, effectively solving the problem in related technologies that dynamic system events cannot be responded to in time during the screen projection process, which easily causes sensitive information leakage.

[0025] 2. Due to the adoption of a user behavior analysis mechanism based on operation timing characteristics, the terminal operation mode is dynamically determined by extracting features, and differentiated delay parameter adjustment strategies are adopted for different modes. Therefore, the protection strength can be adaptively adjusted according to the user's actual usage scenario, thereby achieving an optimized experience of screen projection interaction.

[0026] 3. Due to the real-time monitoring and analysis mechanism of audio data stream, sensitive audio content is identified by extracting voice content and background sound features, and corresponding filtering and processing capabilities are provided. Therefore, the audio privacy in the screen projection process can be fully protected, which effectively solves the problem that related technologies only focus on screen display content and ignore audio privacy protection, and realizes a comprehensive privacy protection solution integrating audio and video. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a flowchart of a privacy protection method for mobile phone screen projection in an embodiment of the present application; Figure 2 It is another flowchart of the privacy protection method of mobile phone screen projection in an embodiment of the present application; Figure 3 It is a schematic diagram of a physical device structure of a mobile terminal in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more of the listed items.

[0029] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0030] For ease of understanding, the application scenarios of the embodiments of the present application are introduced below.

[0031] User A is a product manager at a technology company and often needs to make project reports in the conference room. During an important quarterly summary meeting, he was presenting product data through mobile screen projection, and suddenly received a work group message containing undisclosed financial data. Since the screen projection displays the mobile phone interface in real time, this message containing sensitive information was seen by everyone in the conference room, including some external partners who have not signed a confidentiality agreement. Similar accidental leaks of sensitive information occur frequently in daily meetings, which not only affects the company's information security management, but may also cause the leakage of commercial secrets, posing significant risks to the company.

[0032] In the related art, the privacy protection of screen projection applications can be achieved by manually setting whitelists and blacklists, that is, by presetting different screen projection modes, display control in different scenarios can be achieved. The following introduces the scenarios of using the privacy protection method of mobile phone screen projection in the related art.

[0033] User B uses a certain brand of conference projection software for team weekly meetings. The software provides basic screen sharing functions, and users can choose to project the full screen or a single application window. However, in actual use, when user B needs to switch between presentations, data tables, and instant messaging tools, he needs to reset the sharing window every time, which is cumbersome and error-prone. To make matters worse, when switching applications, unprocessed internal corporate documents, personnel evaluation forms, and other sensitive content will briefly appear on the big screen. During a meeting, he needed to urgently reply to an important email from his superior, but had to interrupt the presentation and adjust the sharing settings, affecting the efficiency and fluency of the meeting.

[0034] The privacy protection method for mobile screen projection in the embodiment of this application is adopted to perform risk assessment and realize adaptive privacy protection by real-time analysis of foreground application features and user operation behaviors, which can not only timely identify and process sensitive information, but also ensure the smoothness and convenience of screen projection experience. The following introduces the scenario of using the privacy protection method for mobile screen projection in this application.

[0035] User C uses the smart conference projection system integrated with this solution to communicate with customers. The system can automatically identify different meeting scenarios: low latency mode is used when presenting product solutions, and privacy protection is automatically enabled when viewing internal documents. When user C's mobile phone receives messages containing undisclosed project information or personnel changes, the system intelligently identifies the sensitivity of the information, automatically masks or filters sensitive content, and only displays basic reminders. Especially when meeting with external customers, based on user C's presets, the system can automatically increase the level of privacy protection to ensure that corporate confidential information will not be accidentally leaked.

[0036] It can be seen that the privacy protection method of mobile phone screen projection in the embodiment of the present application can not only realize the intelligent identification of privacy information, but also effectively solve the problem of cumbersome operation in traditional solutions, thereby realizing an efficient and safe screen projection experience.

[0037] For ease of understanding, the following describes the process of the method provided by this implementation in combination with the above scenario. Figure 1 , which is a flow chart of the privacy protection method for mobile phone screen projection in an embodiment of the present application.

[0038] S101. In response to the user's screen projection confirmation operation, the screen projection display data is subjected to display delay processing according to preset delay parameters to obtain delayed display data, and the delayed display data is sent to the target screen projection terminal.

[0039] Among them, the screen projection confirmation operation refers to the authorized screen projection behavior triggered by the user on the mobile terminal interface, including interactive operations such as clicking the confirmation button and gesture sliding; the preset delay parameter refers to the display delay time threshold pre-configured by the screen projection operating system of the user terminal, which is used to quantify the degree of delayed display of the projection content; the screen projection display data represents the content to be projected presented on the current screen of the mobile terminal, including dynamically updated display information such as application interface and system notifications; display delay processing refers to the data processing process of timed caching and delayed output of display data based on delay parameters; delayed display data represents the display data packet to be sent after delay processing; the target screen projection terminal refers to an external display device that establishes a connection with the mobile terminal through a wireless network.

[0040] The mobile terminal executes this step after receiving the screen projection confirmation signal triggered by the user through interface interaction. Specifically, the mobile terminal first reads the preset delay parameter value from the system configuration, which defines the benchmark delay time for the display data. The real-time captured screen display data is then temporarily stored in a dedicated display buffer, and the actual sending time point of the data is calculated based on the delay parameter. When the system time reaches the calculated sending time point, the mobile terminal encodes and compresses the display data in the buffer to form a delayed display data packet, and sends the data packet to the target screen projection terminal device through the established wireless transmission channel.

[0041] In some embodiments, delayed processing of display data can be implemented in a variety of ways: Optionally, the mobile terminal implements display delay by maintaining a timestamp-based circular buffer queue. The current timestamp is added to the display data when it enters the queue. The mobile terminal decides whether to trigger a dequeue operation by subtracting the current time from the timestamp of the head data in the queue and comparing it with a preset delay parameter. When dequeueing is triggered, the data is encoded and sent to the target terminal through the Socket channel, and the queue status is updated to prepare for processing the next data packet.

[0042] It should be noted that the setting of the preset delay parameters will affect the processing time of the data packet. The mobile terminal achieves precise delay control through a dynamic buffer management mechanism, that is, the preset delay parameters are used as the upper threshold of the buffer delay time, and the actual processing time required is calculated based on the data packet size and network conditions. For example, when the preset delay is set to 5 seconds, the mobile terminal will ensure that the total time from the data packet entering the buffer to the completion of the transmission does not exceed 5 seconds. Through an adaptive processing time allocation algorithm, the processing efficiency of the data packet is optimized while ensuring the upper limit of the delay. This mechanism can maintain stable delay performance under network fluctuations and avoid data accumulation or processing timeout problems.

[0043] S102. Acquire new display data of the projection display data in real time, and determine a user operation sequence corresponding to the new display data.

[0044] Among them, the newly added display data represents the new screen content that needs to be projected in real time during the screen projection process, including dynamic content such as interface updates generated by user interaction and message notifications pushed by the system; the user operation sequence refers to the user interaction behavior record associated with the newly added display data, including timing information such as operation type, operation timestamp, and operation target object.

[0045] After completing the initial screen projection data transmission, the mobile terminal continues to execute this step to process subsequent display content updates. Specifically, the mobile terminal captures the changes in the screen display according to the set sampling interval through the system-level display monitoring mechanism, and extracts the changes as new display data. At the same time, the mobile terminal records the user interaction events that produce these display changes, including touch, slide, click and other operations, and organizes these operations into operation sequences in chronological order to establish the association relationship between display data and user operations.

[0046] S103: Adjust the preset delay parameter according to the user operation sequence to obtain a modified delay parameter.

[0047] Among them, the corrected delay parameter represents the display delay parameter that is dynamically adjusted according to the user's actual usage scenario, and its correction basis includes statistical characteristics such as operation frequency, operation interval, and operation type distribution.

[0048] Specifically, the mobile terminal first extracts features from the collected user operation sequences and calculates the time distribution features and type distribution features of the operations. Then, based on these features, the current usage scenario type is determined, such as a dense interaction scenario or a browsing and viewing scenario. Finally, the mobile terminal selects the corresponding adjustment strategy based on the scenario type, reducing the delay parameter in the dense interaction scenario to improve the response speed, and appropriately increasing the delay parameter in the browsing scenario to enhance privacy protection.

[0049] S104: Identify the privacy risk area of ​​the newly added display data and generate a privacy risk tag.

[0050] Among them, the privacy risk area refers to the screen area that may contain sensitive information in the displayed content; the privacy risk tag refers to the metadata information used to identify the location and risk level of the risk area.

[0051] The mobile terminal executes this step immediately after acquiring the newly added display data. Specifically, the mobile terminal first extracts multi-dimensional features from the display data, including text content recognition, image feature analysis, and layout structure analysis. The extracted features are then matched with the predefined sensitive information pattern library to identify potential risk areas. Finally, the mobile terminal evaluates the sensitivity of each risk area and generates risk tag information containing location coordinates, risk level, and processing suggestions.

[0052] S105 . In response to the user's marking operation on the privacy risk mark, risk processing is performed on the newly added display data to obtain target display data.

[0053] Among them, the marking processing operation refers to the processing instructions executed by the user for the identified privacy risk area, such as confirming blocking, allowing display and other interactive operations; risk processing refers to the corresponding privacy protection processing of the display data according to the user's processing instructions, such as blurring, masking, etc.; the target display data refers to the final display content after risk processing.

[0054] The mobile terminal executes this step after detecting the user's interactive operation on the risk tag. Specifically, the mobile terminal first parses the user's tag processing operation to obtain the operation type and the information of the target risk area. Then, the corresponding risk processing strategy is selected according to the operation type, such as pixel-level blurring of the area to be protected, or replacing sensitive text content with placeholders. Finally, the mobile terminal merges the processed display content with the unprocessed ordinary content to generate complete target display data.

[0055] It should be noted that the identification of privacy risks and user processing operations here will dynamically adjust the execution strategy according to the correction delay parameter. The mobile terminal adopts a priority-based multi-level processing mechanism, determines the processing depth by calculating the ratio of risk level to remaining delay, and dynamically adjusts the processing resource allocation in combination with the real-time load status. When the correction delay parameter is large, the mobile terminal will enable more complex risk analysis algorithms and more sophisticated processing solutions; when the correction delay parameter is small, basic risk filtering and simple masking processing will be prioritized to ensure that the necessary privacy protection is completed within the limited processing time. At the same time, when there is a delay in the user's marking processing operation, in order to ensure the implementation of the correction delay parameter, the mobile terminal will automatically perform risk processing after waiting for a preset time.

[0056] S106. Perform display delay processing on the target display data according to the modified delay parameters to obtain newly added delay data, and send the newly added delay data to the target projection terminal.

[0057] Among them, the newly added delay data represents the final screen projection data packet after risk processing and delay processing.

[0058] The mobile terminal executes this step after completing risk processing as the final link of the screen projection data update. Specifically, the mobile terminal first obtains the current corrected delay parameters and puts the target display data into the delay processing queue. The mobile terminal calculates the actual sending time point based on the corrected delay parameters, and when the sending time is reached, the data is encoded and compressed to form a newly added delay data packet. Finally, the mobile terminal sends the data packet to the target screen projection terminal through the established transmission channel, and maintains the transmission status to ensure the reliable arrival of the data.

[0059] In some embodiments, the processing and sending of delayed data can be achieved in a variety of ways: Optionally, the mobile terminal dynamically adjusts the size and refresh strategy of the data buffer according to the corrected delay parameters, controls the generation rate of data packets through an adaptive load balancing algorithm, monitors the network transmission quality and dynamically adjusts the encoding parameters to ensure that a stable screen projection experience can be maintained under different network conditions; Optionally, the mobile terminal implements a priority-based data scheduling mechanism at the application layer by deploying a layered transmission architecture. The mobile terminal caches the display content according to its importance, prioritizes and sends display updates of the user's focus area, and processes the content to be displayed in advance through a predictive caching mechanism to reduce the actual display delay; for example, the PPT presentation interface is updated in real time, while the notification display area is updated with a delay. It is understandable that other data processing architectures or transmission control strategies can also be used to achieve efficient transmission of delayed data, which is not limited here.

[0060] The following is a more detailed description of the process of the method provided by this implementation. Figure 2 , which is another flow chart of the privacy protection method for mobile phone screen projection in an embodiment of the present application.

[0061] S201. In response to the user's screen projection confirmation operation, the screen projection display data is subjected to display delay processing according to preset delay parameters to obtain delayed display data, and the delayed display data is sent to the target screen projection terminal.

[0062] Referring to step S101, the mobile terminal will send delayed display data to the target projection terminal.

[0063] S202. Acquire new display data of the projection display data in real time, and determine a user operation sequence corresponding to the new display data.

[0064] Referring to step S102, the mobile terminal determines the user operation sequence corresponding to the newly added display data.

[0065] In some embodiments, the mobile terminal provides delay-free screen projection, that is, the mobile terminal can respond to the user's quick screen projection operation to determine the foreground application currently running on the mobile terminal; when the foreground application belongs to the screen projection application whitelist, the screen projection display data is sent to the target screen projection terminal.

[0066] Among them, delay-free screen projection refers to a fast screen projection mode that directly forwards display data. In actual applications, the time delay is negligible; the screen projection application whitelist contains a preset list of low-risk applications; the foreground application refers to the application that is currently running and active.

[0067] The mobile terminal executes this function when it detects a quick screen projection command. Specifically, the mobile terminal first obtains the currently active foreground application information through the system interface, including the application identifier and running status. Then the application information is matched with the preset whitelist to confirm the security level of the application. Finally, for the applications in the whitelist, the mobile terminal directly establishes a data channel and performs real-time screen projection.

[0068] S203: Acquire a user operation sequence within a preset sampling period, and extract operation timing features including operation type and operation frequency.

[0069] Among them, the preset sampling period represents the user operation data collection time window set by the system; the operation timing characteristics refer to the user operation behavior characteristics extracted within the sampling period, including statistical indicators such as operation type distribution, operation time interval, and operation frequency; operation types include basic interactive actions such as clicking, sliding, and input; the operation frequency represents the number of operations per unit time.

[0070] The mobile terminal executes this step after collecting the complete sampling period data. Specifically, the mobile terminal first intercepts the user operation records of the most recent period from the operation log according to the sampling period set by the system. Then, these operation records are classified and counted, and the occurrence frequency and time distribution of different types of operations are calculated. Finally, the mobile terminal extracts the periodic characteristics and burst characteristics of the operation through time series analysis, and constructs a complete operation time series feature set.

[0071] It should be noted that the preset sampling period of the operation sequence is determined by an adaptive time window algorithm, which calculates the optimal sampling interval based on the statistical distribution of the user's historical operation frequency. The mobile terminal first establishes a probability density model of the operation interval, and then solves the appropriate sampling period length by maximizing the information entropy, so that the collected operation sequence can fully reflect the user's behavior pattern without causing redundant data processing burden. The value range of the sampling period is usually dynamically adjusted between 0.5 seconds and 5 seconds. A higher operation frequency corresponds to a shorter sampling period, and a lower operation frequency corresponds to a longer sampling period.

[0072] S204: Determine the user's terminal operation mode according to the newly added display data and operation timing characteristics.

[0073] Among them, the terminal operation mode refers to the user's current behavior mode type when using the mobile terminal, including interaction mode and browsing mode. The interaction mode refers to the usage state in which the user frequently interacts with the terminal, and the browsing mode refers to the usage state in which the user mainly watches and reads content.

[0074] The mobile terminal executes this step immediately after acquiring the operation timing features. Specifically, the mobile terminal first performs correlation analysis on the extracted operation timing features and the content features of the newly added display data, and calculates the correlation between the feature vectors. Then the mobile terminal determines whether the current terminal usage scenario belongs to the interactive mode or the browsing mode based on the preset mode determination rules, comprehensive operation frequency, operation complexity, content update frequency and other factors.

[0075] Among them, the mobile terminal uses a pattern recognition algorithm with multi-dimensional feature fusion to determine the user's terminal operation mode. First, the extracted operation time series features are mapped to a high-dimensional feature space, including the operation frequency vector F={f1, f2, ..., fn} and the operation type distribution vector T={t1, t2, ..., tm}, where fi represents the operation frequency in the i-th time window and tj represents the normalized occurrence probability of the j-th type of operation. Then, the feature dimension is reduced by principal component analysis, and the principal components with a cumulative contribution rate of more than 90% are retained. The mobile terminal uses a Gaussian mixture model to perform cluster analysis on the reduced-dimensional features and determines the mode category by maximum likelihood estimation. At the same time, a Markov chain is introduced to model the temporal dependency of the operation sequence, and the state transition probability matrix is ​​calculated to predict the mode change trend. When the cosine similarity between the feature vector and the typical feature of the interaction mode is greater than 0.8, it is determined to be an interaction mode; when the operation entropy value of multiple consecutive time windows is lower than the preset threshold, it is determined to be a browsing mode.

[0076] In some embodiments, the mobile terminal can provide an abnormal response mechanism, that is, the mobile terminal will obtain the most recent N operation data in the user operation sequence, extract the type identification, timestamp, operation interval and operation target object of the recent operation data, and construct a recent operation vector; based on the recent operation vector, calculate the user's current operation behavior feature value; the operation behavior feature value includes the operation frequency mean, operation interval variance and target object switching rate; the operation behavior feature value is matched with the normal behavior model to obtain a behavior abnormality score; when the abnormality score exceeds the preset abnormal threshold, switch the terminal operation mode to browsing mode.

[0077] Among them, the abnormal response mechanism refers to the mode switching function based on operation behavior analysis; the recent operation data represents the detailed information of the last N user interactions; the operation behavior characteristic value reflects the user's current usage pattern characteristics; the normal behavior model defines the standard operation behavior paradigm.

[0078] The mobile terminal performs this function while continuously collecting user operation data. Specifically, the mobile terminal first extracts the complete record of the most recent N operations from the operation log and constructs an operation vector containing multi-dimensional features. Then the system calculates the statistical characteristics of the operation behavior, including indicators such as frequency, interval, and switching. Finally, by comparing with the preset behavior model, the abnormality of the current operation is evaluated, and the mode switch is triggered when the threshold is exceeded.

[0079] S205: When the terminal operation mode is the interactive mode, reduce the preset delay parameter by the first adjustment coefficient to obtain a modified delay parameter.

[0080] Among them, the first adjustment coefficient represents the proportional factor used to reduce the delay parameter, and the value range is usually small. The parameter adjustment in the interactive mode is aimed at reducing the display delay and improving the interactive response speed.

[0081] The mobile terminal executes this step after determining that the current mode is interactive. Specifically, the mobile terminal first obtains a preset first adjustment coefficient from the system configuration, which is obtained based on historical interactive data statistics. Then the preset delay parameter is multiplied by the first adjustment coefficient to calculate the modified delay parameter adapted to the interactive mode. Finally, the mobile terminal verifies the validity of the modified parameter to ensure that it meets the minimum delay threshold requirement.

[0082] In some embodiments, the first adjustment coefficient is dynamically calculated by an adaptive feedback control system. The mobile terminal establishes a closed-loop feedback model with user experience quality as the control target, and takes the user operation response time as the key control variable. The controller uses a fuzzy PID algorithm to calculate the control output u(t) based on the current response time deviation e(t) and the deviation change rate de(t) / dt. That is: u(t)=Kp·e(t)+Ki·∫e(t)dt+Kd·de(t) / dt; Among them, e(t)=Rt-Rm(t) represents the deviation between the target response time Rt and the measured response time Rm(t). The proportional coefficient Kp reflects the impact of the current deviation, the integral coefficient Ki eliminates the static error, and the differential coefficient Kd provides trend prediction. Kp∈[0.4, 0.6], the initial value is set to 0.5; Ki∈[0.1, 0.3], the initial value is set to 0.2; Kd∈[0.05, 0.15], the initial value is set to 0.1.

[0083] The mobile terminal uses a fuzzy adaptive mechanism to dynamically adjust these parameters: ΔKp=η1·(|e(t)| / emax)·Kp; ΔKi=η2·(1-|e(t)| / emax)·Ki; ΔKd=η3·(de(t) / dt)·Kd.

[0084] Among them, η1, η2, and η3 are learning rate parameters, which are 0.1, 0.05, and 0.08 respectively; emax is the maximum allowable deviation, which is set to 100ms. The final calculation formula for the first adjustment coefficient is: α=α0+u(t); α0 is the benchmark adjustment coefficient, which is 0.8. The value of u(t) is limited to [-0.3, 0.1] by the saturation function: u(t)=max(-0.3, min(0.1, u(t))).

[0085] When continuous fast interactive operations (operation interval less than 200ms) are detected, the mobile terminal reduces the value of Ki (by 50%) to weaken the integral effect and provide faster response characteristics. The mobile terminal updates the parameters every 100ms to ensure the real-time and stability of the control.

[0086] S206: When the terminal operation mode is the browsing mode, increase the preset delay parameter by the second adjustment coefficient to obtain a modified delay parameter.

[0087] Among them, the second adjustment coefficient represents the proportional factor used to increase the delay parameter, and the value range is usually large. The parameter adjustment in browsing mode is intended to enhance privacy protection and improve data security.

[0088] The mobile terminal performs this step after determining that the current mode is browsing mode. Specifically, the mobile terminal first selects a suitable second adjustment coefficient from a preset adjustment coefficient range based on the current content sensitivity and user browsing behavior characteristics. Then, the preset delay parameter is multiplied by the second adjustment coefficient to calculate a higher modified delay parameter. Finally, the mobile terminal ensures that the modified parameter does not exceed the maximum delay tolerance to maintain a basic browsing experience.

[0089] The second adjustment coefficient is dynamically calculated by the adaptive security policy system. The mobile terminal establishes a feedback control model with privacy protection strength as the control target and content sensitivity as the main control variable. The controller uses a fuzzy PID algorithm to calculate the control output v(t) based on the current sensitivity deviation s(t) and the deviation change rate ds(t) / dt. That is: v(t)=Kps·s(t)+Kis·∫s(t)dt+Kds·ds(t) / dt; Among them, s(t)=St-Sm(t) represents the deviation between the target sensitivity threshold St and the measured sensitivity Sm(t). The proportional coefficient Kps reflects the real-time adjustment strength, the integral coefficient Kis eliminates the cumulative risk, and the differential coefficient Kds provides trend prediction. Kps∈[1.2, 1.8], the initial value is set to 1.5; Kis∈[0.3, 0.7], the initial value is set to 0.5; Kds∈[0.1, 0.3], the initial value is set to 0.2.

[0090] The mobile terminal uses a fuzzy adaptive mechanism to dynamically adjust these parameters: ΔKps=μ1·(|s(t)| / smax)·Kps; ΔKis=μ2·(1-|s(t)| / smax)·Kis; ΔKds=μ3·(ds(t) / dt)·Kds.

[0091] Among them, μ1, μ2, and μ3 are learning rate parameters, which are 0.15, 0.08, and 0.12 respectively; smax is the maximum sensitivity deviation allowed, which is set to 0.8. The final calculation formula for the second adjustment coefficient is: β=β0+v(t); β0 is the benchmark adjustment coefficient, which is 1.5. The value of v(t) is limited to [0.2, 0.8] by the saturation function: v(t)=max(0.2, min(0.8, v(t))).

[0092] When sensitive content is detected to accumulate (sensitivity exceeds 0.6 for 5 consecutive seconds), the mobile terminal increases the Kis value (increase by 80%) to strengthen the integration effect and provide stronger protection. The mobile terminal updates the parameters every 200ms to ensure the real-time and effectiveness of protection.

[0093] S207: Identify the privacy risk area of ​​the newly added display data and generate a privacy risk tag.

[0094] Referring to step S104, the mobile terminal generates a privacy risk mark.

[0095] In some embodiments, the mobile terminal will perform feature extraction on the newly added display data to obtain text information, image information and layout information; based on the sensitive information vocabulary and image feature library, perform data matching on the text information and image information to obtain a set of potential risk areas; calculate the risk score of each candidate risk area in the set of potential risk areas; screen and grade the candidate risk areas according to the risk score to determine the privacy risk area; determine the location coordinates, risk level and recommended processing method of the privacy risk area, and generate a privacy risk mark.

[0096] Among them, the sensitive information vocabulary stores predefined sensitive text patterns; the image feature library contains feature templates of sensitive images; the risk score reflects the sensitivity of the area; and the risk level is used to distinguish different degrees of privacy risks.

[0097] The mobile terminal executes this function after acquiring the newly added display data. Specifically, the mobile terminal first performs hierarchical analysis on the display content to extract three basic features: text, image, and layout. The mobile terminal then matches the extracted features with the preset sensitive feature library to identify areas with potential risks. Finally, through risk assessment and level classification, labeled data containing detailed risk information is generated.

[0098] In some embodiments, risk area identification can be achieved in a variety of ways: Optionally, the mobile terminal implements a multimodal feature analysis system, uses optical character recognition (OCR) to extract text content, extracts image features through a deep convolutional network, and combines natural language processing technology to understand text semantics to achieve comprehensive content analysis; Optionally, the mobile terminal establishes a hierarchical risk identification framework, uses a fuzzy matching algorithm to process text variants, identifies approximate sensitive images through similarity calculations, and combines contextual information to improve identification accuracy. It is understandable that other feature extraction methods can also be used to achieve intelligent identification of sensitive content, which is not limited here.

[0099] In some embodiments, the mobile terminal will merge and divide the candidate risk areas, that is, the mobile terminal will determine the association relationship between multiple interface elements based on the layout information, and then merge the areas in the potential risk area set whose spatial distance is less than a preset distance threshold based on the association relationship to determine multiple candidate risk areas.

[0100] Among them, merging blocks means combining related risk areas into larger detection units; the association relationship between interface elements includes spatial position relationship and functional logic relationship; the preset distance threshold is used to judge the spatial proximity of the area.

[0101] The mobile terminal executes this function after obtaining a preliminary risk area set. Specifically, the mobile terminal first analyzes the layout structure of the interface to determine the positional relationship and functional association between different elements. Then the mobile terminal merges spatially adjacent and associated areas according to a preset distance rule. Finally, the boundaries of the merged areas are optimized to form a new candidate risk area set.

[0102] In some embodiments, the mobile terminal calculates a risk score based on regional features, that is, the mobile terminal obtains visual features and contextual features of the candidate risk area; the visual features include area size, area location and display parameters, and the contextual features include interaction frequency and user focus correlation; the visual features and contextual features are input into a feature scoring model to obtain a visual feature score and a contextual feature score; the feature weighting coefficient is determined according to the terminal operation mode, and the visual feature score and the contextual feature score are weighted based on the feature weighting coefficient to obtain a risk score.

[0103] Among them, visual features reflect the prominence of the area in the interface; contextual features represent the correlation between the area and user interaction; the feature scoring model is used to quantify the risk contribution of different features; and the feature weighting coefficient is dynamically adjusted according to the operation mode.

[0104] The mobile terminal performs this function after determining the candidate risk area. Specifically, the mobile terminal first extracts the visual attributes and interaction data of each area to construct a complete feature vector. The feature vector is then input into the pre-trained scoring model to obtain feature scores of different dimensions. Finally, the mobile terminal determines the weight configuration according to the current operation mode and calculates the comprehensive risk score.

[0105] The feature scoring model here is trained using a large-scale projection scene dataset. The input data includes visual features of the interface (such as text area size, position, color, font, etc.), contextual features (such as user interaction behavior, application type, operation time, etc.) and the corresponding manually annotated sensitivity labels. The supervised learning method is used to optimize by minimizing the cross entropy loss between the predicted risk level and the true label. The robustness of the model is improved by data enhancement and negative sample mining during the training process. The feature scoring model adopts a multi-layer neural network architecture, including a feature extraction layer, multiple fully connected layers and a normalized output layer. The feature extraction layer processes visual features and contextual features respectively, and weightedly fuses different features through the attention mechanism. The hidden layer uses the ReLU activation function and uses Dropout to prevent overfitting. The output layer uses the Softmax function to map the result to the [0, 1] interval, representing the probability distribution of different risk levels. The mobile terminal extracts the visual feature vector and contextual feature vector of the currently displayed content in real time as input, and obtains the risk score through the forward propagation of the feature scoring model. The feature scoring model can dynamically adjust feature weights according to different operation modes (such as demonstration mode and interactive mode), and finally output a normalized risk level score. The scoring results are used to guide the subsequent selection of privacy protection strategies, such as determining whether information masking or content filtering is required.

[0106] S208 . In response to the user's marking operation on the privacy risk mark, risk processing is performed on the newly added display data to obtain target display data.

[0107] Referring to step S105 , the mobile terminal generates target display data.

[0108] S209: Detect the audio data stream corresponding to the target display data, and extract new audio features including new voice content and new background sound.

[0109] Among them, the audio data stream represents the real-time audio signal during the screen projection process; the newly added voice content refers to the user's speaking voice; the newly added background sound includes ambient sound and audio played by the application; audio features include attribute information such as sound type, volume, and spectrum characteristics.

[0110] The mobile terminal performs this step while processing the display data. Specifically, the mobile terminal first obtains the real-time audio data stream through the system audio interface and performs frame processing on the audio signal. Then, the audio feature extraction algorithm is used to separate the voice content and background sound, and the feature parameters of each type of sound are calculated. Finally, the mobile terminal associates the extracted feature information with the timestamp to construct a complete audio feature description.

[0111] S210: Determine sensitive audio content in the audio data stream according to the newly added audio features.

[0112] Among them, sensitive audio content refers to sound clips in the audio data stream that contain privacy or sensitive information; the content determination process includes steps such as feature matching, speech recognition and semantic analysis; the sensitivity level is determined based on a preset sensitive audio rule library.

[0113] The mobile terminal performs this step after acquiring the audio features. Specifically, the mobile terminal first classifies and analyzes the newly added audio features to identify the voice content and non-voice content. For voice content, the system converts it into text through voice recognition and performs semantic analysis to identify sensitive information. For non-voice content, the system matches its features with predefined sensitive sound patterns to identify potential sensitive audio clips.

[0114] In some embodiments, the mobile terminal uses a hierarchical and cascaded audio analysis framework to determine sensitive content, and achieves accurate identification by combining time-frequency domain features and semantic features. First, the acoustic features of the audio are extracted using short-time Fourier transform to construct a voiceprint feature vector; then a pre-trained deep neural network is used to identify and understand the voice content, and the semantic sensitivity score is calculated; finally, the analysis results of the acoustic features and semantic features are weighted and fused to obtain a comprehensive sensitivity assessment result. The system also considers the contextual information and scene features of the audio, and implements adaptive sensitive content determination through a dynamic threshold mechanism. For example, the mobile terminal can identify and block notification prompts from other applications that are not related to the projection content; the mobile terminal can retain the video and voice played in the PPT.

[0115] S211. In response to the user's audio processing operation, filter the sensitive audio content in the audio data stream.

[0116] Among them, filtering processing includes muting, replacement, noise reduction and other methods, and the processing results must ensure the continuity and naturalness of the audio stream.

[0117] The mobile terminal executes this step after receiving the user's audio processing instruction. Specifically, the mobile terminal first parses the processing strategy set by the user to determine the specific processing method for each sensitive audio segment. Then, according to different processing requirements, the system processes the audio data stream in real time, such as muting sensitive voices or replacing sensitive sounds with preset sound effects. Finally, the mobile terminal performs smooth transition processing on the processed audio to ensure the continuity of audio playback.

[0118] Among them, audio filtering uses a real-time adaptive signal processing system to achieve accurate processing of sensitive content. The mobile terminal uses an improved minimum mean square error algorithm to construct an adaptive filter and establishes a processing model by analyzing the time-frequency characteristics of the audio signal. In the frequency domain, the signal is decomposed into multiple sub-bands using short-time Fourier transform, and the energy distribution E(f, t) and phase spectrum φ(f, t) are independently calculated for each sub-band. The mobile terminal identifies the characteristic pattern of sensitive content based on the pre-trained acoustic model and calculates the processing weight w(f, t) for each time-frequency point. For areas that need to be processed, spectral subtraction combined with a phase-preserving algorithm is used to replace or suppress content. The processed signal is reconstructed into a time domain waveform by the overlap-addition method, and dynamic range compression and phase correction are used to ensure the naturalness of the audio transition. The mobile terminal monitors the listening quality of the processing results in real time and maintains audio continuity by adjusting the processing parameters.

[0119] S212. Perform display delay processing on the target display data according to the modified delay parameters to obtain newly added delay data, and send the newly added delay data to the target projection terminal.

[0120] Referring to step S106, the mobile terminal will send the newly added delay data to the target projection terminal.

[0121] In the embodiment of the present application, due to the use of time-delay screen projection mechanism, abnormal response mechanism, multi-dimensional feature extraction and risk assessment system and other technologies, it is possible to achieve real-time analysis and intelligent processing of displayed content. The system can automatically identify the foreground application type and user operation behavior characteristics, and then evaluate the content risk level, and dynamically adjust the privacy protection strategy accordingly. It effectively solves the technical problems of cumbersome manual configuration and insufficient privacy protection in traditional screen projection solutions, and thus realizes an intelligent screen projection function that can ensure both information security and convenient operation.

[0122] The mobile terminal in the embodiment of the present invention is described below from the perspective of hardware processing. Figure 3 , is a schematic diagram of a physical device structure of a mobile terminal in an embodiment of the present application.

[0123] It should be noted that Figure 3 The structure of the mobile terminal shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0124] like Figure 3As shown, the mobile terminal includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 302 or the program loaded from the storage part 308 to the random access memory (RAM) 303, such as executing the method described in the above embodiment. In RAM 303, various programs and data required for system operation are also stored. CPU 301, ROM 302 and RAM 303 are connected to each other through bus 304. Input / output (I / O) interface 305 is also connected to bus 304.

[0125] The following components are connected to the I / O interface 305: an input section 306 including an audio input device, a button switch, etc.; an output section 307 including a liquid crystal display (LCD) and an audio output device, an indicator light, etc.; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed so that a computer program read therefrom is installed into the storage section 308 as needed.

[0126] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 309, and / or installed from a removable medium 311. When the computer program is executed by the central processing unit (CPU) 301, various functions defined in the present invention are performed.

[0127] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0128] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings.

[0129] Specifically, the mobile terminal of this embodiment includes a processor and a memory. The memory stores a computer program. When the computer program is executed by the processor, the privacy protection method for mobile phone screen projection provided in the above embodiment is implemented.

[0130] As another aspect, the present invention further provides a computer-readable storage medium, which may be included in the mobile terminal described in the above embodiment; or may exist independently without being assembled into the mobile terminal. The above storage medium carries one or more computer programs, and when the above one or more computer programs are executed by a processor of the mobile terminal, the mobile terminal implements the privacy protection method for mobile phone screen projection provided in the above embodiment.

[0131] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0132] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0133] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

1. A privacy protection method for mobile phone screen projection, characterized in that: Applied to a mobile terminal, the method comprises: In response to the screen projection confirmation operation of the user, the screen projection display data is subjected to display delay processing according to the preset delay parameters to obtain delayed display data, and the delayed display data is sent to the target screen projection terminal; Acquire new display data of the projection display data in real time, and determine a user operation sequence corresponding to the new display data; Adjust the preset delay parameter according to the user operation sequence to obtain a modified delay parameter; Identifying a privacy risk area of ​​the newly added display data and generating a privacy risk marker; In response to a marking operation performed by a user on the privacy risk mark, risk processing is performed on the newly added display data to obtain target display data; The target display data is subjected to display delay processing according to the modified delay parameter to obtain newly added delay data, and the newly added delay data is sent to the target projection terminal.

2. The method according to claim 1, characterized in that The step of adjusting the preset delay parameter according to the user operation sequence to obtain a modified delay parameter specifically includes: Obtaining a user operation sequence within a preset sampling period, and extracting operation timing features including operation type and operation frequency; Determining a terminal operation mode of the user according to the newly added display data and the operation timing characteristics; When the terminal operation mode is the interactive mode, reducing the preset delay parameter by a first adjustment coefficient to obtain a modified delay parameter; When the terminal operation mode is the browsing mode, the preset delay parameter is increased by a second adjustment coefficient to obtain a modified delay parameter.

3. The method according to claim 2, characterized in that The step of determining the terminal operation mode of the user according to the newly added display data and the operation timing characteristics specifically includes: Acquire the most recent N operation data in the user operation sequence, extract the type identifier, timestamp, operation interval and operation target object of the recent operation data, and construct a recent operation vector; Based on the recent operation vector, calculating the current operation behavior feature value of the user; the operation behavior feature value includes the operation frequency mean, the operation interval variance and the target object switching rate; Calculate the matching degree between the operation behavior characteristic value and the normal behavior model to obtain the behavior abnormality score; When the abnormality score exceeds a preset abnormality threshold, the terminal operation mode is switched to a browsing mode.

4. The method according to claim 1, characterized in that The step of identifying the privacy risk area of ​​the newly added display data and generating a privacy risk mark specifically includes: Performing feature extraction on the newly added display data to obtain text information, image information and layout information; Based on the sensitive information word library and the image feature library, data matching is performed on the text information and the image information to obtain a set of potential risk areas; Determine association relationships among multiple interface elements according to the layout information, and merge areas in the set of potential risk areas whose spatial distances are less than a preset distance threshold based on the association relationships to obtain multiple candidate risk areas; Calculating a risk score for each of the candidate risk areas; Screening and grading the candidate risk areas according to the risk scores to determine the privacy risk areas; The location coordinates, risk level and recommended processing method of the privacy risk area are determined, and a privacy risk marker is generated.

5. The method according to claim 4, characterized in that The step of calculating the risk score of each candidate risk area specifically includes: Acquire visual features and context features of the candidate risk area; the visual features include area size, area location and display parameters, and the context features include interaction frequency and user focus relevance; Inputting the visual feature and the context feature into a feature scoring model to obtain a visual feature score and a context feature score; A feature weighting coefficient is determined according to the terminal operation mode, and the visual feature score and the context feature score are weighted based on the feature weighting coefficient to obtain a risk score.

6. The method according to claim 1, characterized in that After the step of performing risk processing on the newly added display data in response to the user's marking processing operation on the privacy risk mark to obtain target display data, the method further includes: Detecting an audio data stream corresponding to the target display data, and extracting new audio features including new voice content and new background sound; Determining sensitive audio content in the audio data stream according to the newly added audio feature; In response to the audio processing operation of the user, sensitive audio content in the audio data stream is filtered.

7. The method according to claim 1, characterized in that Before the step of acquiring the newly added display data of the projection display data in real time and determining the user operation sequence corresponding to the newly added display data, the method further includes: In response to a quick screen casting operation by a user, determining a foreground application currently running on the mobile terminal; When the foreground application belongs to the screen projection application whitelist, the screen projection display data is sent to the target screen projection terminal.

8. A mobile terminal, characterized in that: The mobile terminal comprises: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions so that the mobile terminal executes the method as described in any one of claims 1-7.

9. A computer-readable storage medium comprising instructions, characterized in that: When the instruction is executed on a mobile terminal, the mobile terminal is caused to execute the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is executed on a mobile terminal, the mobile terminal is enabled to execute the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Screen projection method, screen projection equipment and storage medium

    CN113316028A

  • Screen projection processing method and device, equipment and storage medium

    CN113391774A

  • Screen projection time delay test method and device and storage medium

    CN115767078A

  • Content marking method and device based on screen projection, computer equipment and storage medium

    CN116149583A

  • Information processing apparatus for setting background image, information display device and program

    US20060176317A1

Cited By

  • Screen projection privacy protection method and device

    CN120639953A