Screen projection method and system, storage medium and electronic device

Abstract

The screen projection method, system, storage medium and electronic device provided in the application comprise: in response to a screen projection request initiated by a user, identifying a current screen projection scene type; wherein the screen projection request is used to request to project display content of a first device to a second device; based on an identity verification strategy corresponding to the current screen projection scene type, collecting current feature information of the user, and performing identity verification based on the current feature information to obtain an identity verification result; based on the identity verification result and the current screen projection scene type, determining whether to allow screen projection; when it is determined that screen projection is allowed, performing processing on the display content according to a screen projection type in which screen projection is allowed, generating screen projection content to be projected to the second device, and the screen projection type comprises complete screen projection and limited screen projection. Thus, the identity verification strength, screen projection permission judgment and content output range are all related to the screen projection scene, so that the security control is more suitable for the actual use environment, and the convenient use and privacy protection requirements of different screen projection scenes are taken into account.

Description

Technical Field

[0001] This application relates to the field of screen mirroring technology, and in particular to a screen mirroring method, system, storage medium and electronic device. Background Technology

[0002] Screen mirroring technology has been widely used in various scenarios such as home movie watching, office presentations, and meeting room sharing. Current screen mirroring technology designs focus primarily on ease of connection, neglecting the differentiated needs for authentication and privacy protection in different scenarios. Specifically, in high-security home environments, complex authentication can affect ease of use; while in lower-security environments such as offices and public spaces, insufficient authentication can lead to privacy breaches, making it difficult to balance convenience and security in screen mirroring.

[0003] Therefore, how to balance the convenience and security of screen mirroring has become an urgent problem to be solved in this field. Summary of the Invention

[0004] In view of the above, embodiments of this application provide a screen projection method, system, storage medium, and electronic device to solve at least one problem existing in the background art.

[0005] Firstly, one embodiment of this application provides a screen mirroring method, the screen mirroring method comprising: In response to a user-initiated screen mirroring request, the current screen mirroring scenario type is identified; wherein, the screen mirroring request is used to request that the display content of the first device be mirrored to the second device; Based on the authentication strategy corresponding to the current screen projection scenario type, the user's current feature information is collected, and authentication is performed based on the current feature information to obtain the authentication result; Based on the authentication result and the current screen casting scenario type, determine whether screen casting is allowed; When screen casting is allowed, the displayed content is processed according to the allowed casting type to generate casting content for casting to the second device. The casting type includes full casting and limited casting.

[0006] In conjunction with the first aspect of this application, in an optional implementation, the step of identifying the current screen-sharing scenario type in response to a user-initiated screen-sharing request includes: Obtain the location information and network type of the first device, the device type of the second device, and the content type of the displayed content; Based on the location information and network type of the first device, the device type of the second device, and the content type of the displayed content, the current screen projection scenario type is identified.

[0007] In conjunction with the first aspect of this application, in an optional implementation, the current screen projection scenario type includes at least two of a first scenario, a second scenario, and a third scenario; the step of collecting the user's current characteristic information based on the authentication strategy corresponding to the current screen projection scenario type includes: When the current screen projection scenario type is the first scenario, the first authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information, or gesture feature information; When the current screen projection scenario type is the second scenario, the second authentication strategy is invoked to collect at least two of the user's facial feature information, voiceprint feature information, and gesture feature information; When the current screen casting scenario type is the third scenario, the third authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information, or gesture feature information. In the third scenario, the preview image of the non-privacy content specified in the display content is allowed to be cast to the second device without verification. The first scenario has a higher level of security than the second scenario, and the second scenario has a higher level of security than the third scenario.

[0008] In conjunction with the first aspect of this application, in an optional implementation, the authentication strategy corresponding to the current screen projection scenario type includes N feature dimensions for authentication and a matching degree threshold corresponding to each feature dimension, where N is an integer greater than or equal to 1. The process of performing authentication based on the current feature information to obtain the authentication result includes: Obtain the user's current feature information across the N feature dimensions, and match each current feature information with the corresponding preset authorized user feature information to obtain the authentication result.

[0009] In conjunction with the first aspect of this application, in an optional implementation, determining whether to allow screen casting based on the authentication result and the current screen casting scenario type includes: Based on the mapping relationship between the number of successfully matched feature dimensions and the permission level corresponding to the current screen casting scenario type, screen casting permissions are determined; wherein, the permission level mapping relationship is used to define the range of different feature dimension numbers under each screen casting scenario type, corresponding to no screen casting, restricted screen casting, or full screen casting.

[0010] In conjunction with the first aspect of this application, in an optional embodiment, the step of processing the displayed content according to the allowed screen casting type when screen casting is determined to be allowed, and generating screen casting content to be cast to the second device, includes: identifying sensitive content in the displayed content when screen casting is determined to be allowed; Based on the results of sensitive content identification and the allowed screen casting types, the displayed content is processed to generate screen casting content.

[0011] In conjunction with the first aspect of this application, in an optional embodiment, the step of processing the displayed content based on the sensitive content identification result and the allowed casting types to generate casting content includes: If the screen casting type is full screen casting, then the displayed content will be used as the screen casting content; If the screen casting type is restricted screen casting, determine whether the sensitive content recognition result indicates that sensitive content has been identified; If no sensitive content is detected, a specified portion of the displayed content or a preview image of the specified portion will be used as the projection content. If sensitive content is detected, the sensitive content is blurred or obscured, and a second authentication using different feature types is triggered. If the secondary authentication is successful, the sensitive content is unlocked, and the displayed content is used as the screen projection content. If the secondary authentication fails, the displayed content after being blurred or obscured will be used as the screen projection content.

[0012] In conjunction with the first aspect of this application, in an optional embodiment, the screen projection method further includes: Identify whether the screen mirroring request is an abnormal screen mirroring request; When the screen casting request is an abnormal screen casting request, and the matching degree between the current feature information and the corresponding preset authorized user feature information is lower than the risk matching degree threshold, the screen casting request is intercepted, and a warning message is sent to the bound device associated with the preset authorized user feature information, and an abnormal log is recorded. Within a preset response time range, if verification information is obtained from the bound device, and the verification information indicates that the identity verification is successful, the screen projection request is executed; if the verification information indicates that the identity verification is unsuccessful, the screen projection request is rejected; if no verification information is obtained from the bound device within the preset response time range, the screen projection request is discarded.

[0013] Secondly, one embodiment of this application provides a screen projection system, including: The scene recognition module is configured to respond to a user-initiated screen mirroring request and identify the current screen mirroring scene type; wherein, the screen mirroring request is used to request the display content of the first device to be mirrored to the second device; The authentication module is configured to collect the user's current feature information based on the authentication strategy corresponding to the current screen projection scenario type, and perform authentication based on the current feature information to obtain the authentication result; The screen casting determination module is configured to determine whether screen casting is allowed based on the authentication result and the current screen casting scenario type. The content processing module is configured to, when screen casting is allowed, process the displayed content according to the allowed screen casting type to generate screen casting content for casting to the second device. The screen casting type includes full screen casting and limited screen casting.

[0014] Thirdly, one embodiment of this application provides a computer-readable storage medium storing instructions that, when executed by a processor of an electronic device, enable the electronic device to perform the screen projection method described in any of the embodiments of the first aspect above.

[0015] Fourthly, one embodiment of this application provides an electronic device, the electronic device comprising: processor; Memory used to store executable instructions for a computer; The processor is configured to execute the computer-executable instructions to perform the screen projection method described in any embodiment of the first aspect.

[0016] The screen mirroring method, system, storage medium, and electronic device provided in this application respond to a user-initiated screen mirroring request, identify the current screen mirroring scenario type, collect the user's current feature information based on the authentication policy corresponding to the current screen mirroring scenario type, and perform authentication based on the current feature information to obtain an authentication result; based on the authentication result and the current screen mirroring scenario type, determine whether screen mirroring is allowed; when screen mirroring is allowed, process the displayed content according to the allowed screen mirroring type to generate screen mirroring content for mirroring to a second device. Screen mirroring types include full screen mirroring and restricted screen mirroring. Thus, scenario recognition is introduced into the screen mirroring process, and corresponding authentication methods are adopted according to different scenarios. The authentication result and scenario type are used together to determine screen mirroring permissions, and the screen mirroring content is output in a tiered manner based on the two content processing methods of full screen mirroring and restricted screen mirroring. This makes the authentication strength, screen mirroring permission judgment, and content output range all related to the specific screen mirroring scenario, thereby making security control more consistent with the actual use environment, while also taking into account the needs of convenient use and privacy protection in different screen mirroring scenarios.

[0017] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0018] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings: Figure 1 The flow of the screen mirroring method provided in the embodiments of this application Figure 1 ; Figure 2 A schematic diagram of an application environment provided for one possible specific implementation method; Figure 3 A schematic diagram of an application environment provided for another alternative specific implementation; Figure 4 The flow of the screen mirroring method provided in the embodiments of this application Figure 2 ; Figure 5 The flow of the screen mirroring method provided in the embodiments of this application Figure 3 ; Figure 6 The flow of the screen mirroring method provided in the embodiments of this application Figure 4 ; Figure 7 The flow of the screen mirroring method provided in the embodiments of this application Figure 5 ; Figure 8 The flow of the screen mirroring method provided in the embodiments of this application Figure 6 ; Figure 9 This is a schematic diagram of the screen projection system provided in the embodiments of this application; Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0019] To make the technical solution and beneficial effects of this application more apparent and understandable, a detailed description is provided below by listing specific embodiments. Unless otherwise defined, the technical and scientific terms used herein have the same meanings as those in the technical field to which this application pertains.

[0020] The embodiments described in this application are not exhaustive, but merely illustrative of some embodiments, and are not intended to limit the scope of protection of this application. Unless otherwise specified, each step in a particular embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a particular embodiment can also be implemented as an independent embodiment, and the order of the steps in a particular embodiment can be arbitrarily interchanged. Furthermore, the optional implementation methods in a particular embodiment can be arbitrarily combined; moreover, the embodiments can be arbitrarily combined with each other. For example, some or all steps of different embodiments can be arbitrarily combined, and a particular embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0021] In each embodiment of this application, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of the embodiments are consistent and can be referenced by each other. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0022] In the description of the embodiments of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of the embodiments of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0023] It should be noted that the information (including but not limited to user device information) and data (including but not limited to data used for analysis, stored data, and displayed data) collected in this application are information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of this data all comply with the relevant laws, regulations, and standards of the relevant regions, and necessary confidentiality measures have been taken. This process does not violate public order and good morals, and corresponding access points are provided for users to choose to authorize or refuse. For example, this system has interfaces with relevant users or organizations. Before obtaining relevant information, a request to obtain the information must be sent to the aforementioned user or organization through the interface, and the relevant information will be obtained only after the aforementioned user or organization has provided their consent.

[0024] This application provides a screen mirroring method, such as... Figure 1 As shown, the screen mirroring method includes the following steps: S1: In response to a user-initiated screen mirroring request, identify the current screen mirroring scenario type; wherein, the screen mirroring request is used to request that the display content of the first device be mirrored to the second device; S2: Based on the authentication strategy corresponding to the current screen projection scenario type, collect the user's current feature information, perform authentication based on the current feature information, and obtain the authentication result; S3: Based on the authentication result and the current screen casting scenario type, determine whether screen casting is allowed; S4: When screen casting is allowed, the displayed content is processed according to the allowed casting type to generate casting content for casting to the second device. Casting types include full casting and limited casting.

[0025] Understandably, current screen mirroring technologies typically employ the same authentication strategy and privacy protection method for different screen mirroring scenarios, neglecting the varying security requirements of different scenarios. However, the screen mirroring method provided in this application introduces scenario recognition during the screen mirroring process. It adopts corresponding authentication methods based on different scenarios, using the authentication result and scenario type together to determine screen mirroring permissions. Furthermore, it implements tiered output of screen mirroring content based on two content processing methods: complete screen mirroring and restricted screen mirroring. This ensures that authentication strength, screen mirroring permission judgment, and content output range are all related to the specific screen mirroring scenario, thereby making security control more aligned with actual usage environments while simultaneously addressing the needs for convenient use and privacy protection in different scenarios.

[0026] In one alternative implementation, such as Figure 2 As shown, the first device 10 can establish a wireless connection with the second device 20 via wireless communication methods such as Wi-Fi and Bluetooth. Alternatively, the first device 10 can establish a wired connection with the second device 20. The first device 10 can also connect to the second device 20 via a switching device. In this embodiment, the first device 10 is specifically an initiating device, and the second device 20 is specifically a screen projection device. Both the first device 10 and the second device 20 can be used to collect user feature information. The screen projection method provided in this embodiment can be applied to the first device 10 and / or the second device 20. The first device 10 includes, but is not limited to, devices such as desktop computers, portable computers, smartphones, and tablets; the second device 20 includes, but is not limited to, devices such as smart TVs, projectors, monitors, and video walls.

[0027] In another alternative specific implementation, such as Figure 3 As shown, both the first device 10 and the second device 20 can establish a connection with the third device 30 via wireless or wired communication. The third device 30 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. In this embodiment, the screen projection method can be implemented by the third device 30, and the screen projection system can be set in the third device 30. Specifically, the third device 30 can obtain user feature information uploaded by the first device 10 or the second device 20, and perform steps such as scene recognition, identity verification, screen projection type judgment, and content processing.

[0028] First, for step S1, in response to the screen casting request initiated by the user, the current screen casting scenario type is identified; wherein, the screen casting request is used to request to cast the display content of the first device to the second device.

[0029] In some embodiments, the current screen mirroring scenario type includes home scenario, office scenario, and public scenario.

[0030] In some embodiments, please refer to Figure 4 In response to a user-initiated screen mirroring request, the system identifies the current screen mirroring scenario type, including the following steps: S11: Obtain the location information and network type of the first device, the device type of the second device, and the content type of the displayed content; S12: Based on the location information and network type of the first device, the device type of the second device, and the content type of the displayed content, identify the current screen projection scenario type.

[0031] In some examples, the location information of the first device can be obtained through methods such as GPS, Wi-Fi positioning, base station positioning, or IP address resolution. For example, the latitude and longitude coordinates of the first device's current location, the MAC address of the wireless access point it is connected to, the cell identification code, or geographical area information can be obtained. The network type of the first device can be determined by reading the network connection status of the first device, including Wi-Fi, 5G, 4G, wired network or Bluetooth, and further parameters such as SSID, BSSID, frequency band, encryption method, and operator information can be extracted.

[0032] The device type of the second device can be identified through the service information, device model, manufacturer information, or operating system version broadcast by the screen projection protocol. It can be classified into categories such as smart TV, projector, set-top box, conference tablet, VR headset, and vehicle screen. Furthermore, its trust level can be determined by combining it with the list of trusted devices.

[0033] The content type of the displayed content can be obtained by parsing the media format, streaming media protocol, application layer tags, or content sensitivity markers of the file to be projected. For example, it can be identified as a video, image, document, game, application image, or presentation. It can also be further distinguished as sensitive content based on the file header, DRM status, or corporate watermark.

[0034] After obtaining the above information, the system can identify the current screen projection scenario type based on a preset rule engine or classification model. For example, multiple scenarios can be defined: the first scenario is a home entertainment scenario, whose information combination includes the first device being connected to a preset home Wi-Fi, the location information being less than a preset distance from the preset home address, the second device being a smart TV or set-top box in the living room, and the content type being video or image; the second scenario is an office meeting scenario, whose information combination includes the first device being connected to the enterprise intranet, the second device being a meeting tablet or projector, and the content type being document, presentation, or whiteboard mirror; the third scenario is a mobile or public scenario, whose information combination includes the first device using a cellular network or public Wi-Fi, the second device being a hotel TV, vehicle screen, or unregistered device, or when the information is insufficient to clearly define the specific scenario type, it is identified as the third scenario by default.

[0035] In some examples, if multiple scenarios are identified simultaneously, the system can prioritize security and select the scenario type with the strictest access restrictions as the identification result. For instance, a user uses their personal mobile phone to project their screen in a company meeting room, with the phone simultaneously connected to both the meeting room Wi-Fi and their personal hotspot. The system identifies the meeting room Wi-Fi as part of the corporate intranet, matching the second scenario (e.g., office meeting); and the personal hotspot as cellular network sharing, matching the third scenario (e.g., public scenario). Since the office scenario has higher content security requirements than the public scenario, the system prioritizes security and selects the second scenario as the identification result, then applies the office scenario authentication policy to this projection request.

[0036] In this embodiment, through the above-mentioned scene recognition method, the system can adaptively perceive the screen projection environment, providing a reliable scene basis for subsequent identity verification strategy selection and screen projection permission determination.

[0037] Next, for step S2, based on the authentication policy corresponding to the current screen projection scenario type, the user's current feature information is collected, and authentication is performed based on this feature information to obtain the authentication result. Thus, the feature information to be collected is determined according to the authentication policy, improving the flexibility and accuracy of feature collection. Here, the authentication result includes successful and unsuccessful authentication.

[0038] The current feature information includes at least one of facial feature information, voiceprint feature information, and behavioral habit feature information.

[0039] Facial feature information can be collected through the camera of a first or second device. Specifically, it can be obtained by capturing key facial features (such as the corners of the eyes, the wings of the nose, the corners of the mouth, etc.) and dynamic movements (such as blinking, subtle facial movements, etc.) and extracting identifiable features.

[0040] Voiceprint feature information can be collected through the microphone of a first or second device. Specifically, it can be obtained by collecting user voice commands (such as "agree to screen sharing" or "verify identity"), extracting voice features (such as tone, speech rate, timbre), and filtering out environmental noise.

[0041] Behavioral habit information can be collected through the first device. Specifically, it can be recorded through applications within the first device (such as mobile apps, computer software, etc.) to record users' long-term usage habits, including but not limited to common screen casting time periods (such as home users often casting between 7 pm and 10 pm, and office users often casting between 9 am and 6 pm), commonly used screen casting software (such as video apps, office presentation software), and operating habits (such as common screen casting gestures, frequency of pausing / fast forwarding after screen casting).

[0042] In some embodiments, the current feature information is dynamic feature information input by the user based on dynamic prompts. Here, the dynamic prompts are issued by a first device or a second device. For example, during face verification, the user is required to blink or turn their head; during voiceprint verification, the user is required to repeat randomly generated numbers or characters; and during behavioral habit verification, the user is required to verify gestures or select commonly used software, thereby improving verification security.

[0043] In some embodiments, the current screen mirroring scenario type includes at least two of the first scenario, the second scenario, and the third scenario; please refer to... Figure 5 Based on the authentication strategy corresponding to the current screen mirroring scenario type, collecting the user's current characteristic information may include the following steps: S21: When the current screen projection scenario type is the first scenario, the first authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information, or gesture feature information; S22: When the current screen projection scenario type is the second scenario, invoke the second authentication strategy to collect at least two of the user's facial feature information, voiceprint feature information, and gesture feature information; S23: When the current screen casting scenario type is the third scenario, the third authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information or gesture feature information. In the third scenario, the preview image of the non-privacy content specified in the display content is allowed to be cast to the second device without verification. The first scenario is safer than the second scenario, and the second scenario is safer than the third scenario.

[0044] In this embodiment, the current screen projection scenario type includes at least two of the first scenario, the second scenario, and the third scenario. The system can call the corresponding authentication strategy according to the specific scenario type identified, and collect the current feature information required by the user in that scenario.

[0045] The first scenario represents the highest level of security, such as a core corporate meeting room, a confidential office area, or a home. In this scenario, the system invokes the primary authentication strategy, requiring only the collection of a single dimension of the user's biometric information to complete verification. Specifically, depending on the actual deployed hardware conditions and user preferences, the system can flexibly choose to collect any one of the following: facial features, voiceprints, or gestures. For example, in a meeting room equipped with a high-definition camera, the system prioritizes collecting facial images for comparison; in a scenario that only supports microphones, voiceprints are collected; and on touch-interactive devices, preset gesture trajectories can be collected. This method performs authentication through a single feature dimension, ensuring basic security while also considering user convenience.

[0046] The second scenario involves moderate security, such as open-plan office areas or school multimedia classrooms. In this scenario, the authenticity of user identities is paramount. The system invokes a second authentication strategy, requiring the collection of at least two different biometric information for combined verification. For example, it may simultaneously collect facial and voiceprint features, or facial and gesture features, or a combination of voiceprint and gesture. This cross-validation across multiple feature dimensions effectively prevents the forgery or misidentification of a single feature, thus improving the reliability of identity authentication.

[0047] The third scenario represents the lowest level of security, such as public places, hotels, or public transportation environments. In this scenario, the system invokes a third-party authentication strategy, requiring only the collection of one type of biometric information (face, voiceprint, or gesture). However, to balance user experience and privacy protection, the third scenario introduces a preview image verification-free mechanism. Initially, screen sharing can be performed directly on the second device, but if the content to be shared is non-private content preset in the content to be shared on the first device (such as system wallpapers, public video clips, document thumbnails without personal information, etc.), its preview image can be directly shared to the second device without any authentication. For example, if a user attempts to share PPT content from their phone to the lobby display screen in a shared office area, the system recognizes this as the third scenario and will only display a preview image of the PPT document containing no sensitive information (such as the PPT homepage) on the display screen, while hiding sensitive information such as device model, username, and file storage path, without requiring facial or voiceprint verification. If, in this scenario, the user initiates a screen sharing request to share all content, the system will execute an authentication process.

[0048] The security levels of the three scenarios, from highest to lowest, are: Scenario 1, Scenario 2, and Scenario 3. It should be noted that while Scenario 1 uses a single feature dimension for authentication, the matching threshold used for verification is typically set higher (e.g., a matching threshold exceeding 85%), and it is comprehensively evaluated in conjunction with the trust level of the device environment (e.g., trusted network, fixed location). Therefore, its overall security strength is still higher than Scenario 2. Scenario 2 uses a combination of multiple feature dimensions for authentication to compensate for uncontrollable environmental risks. Scenario 3 uses a preview image of content without sensitive information combined with authentication to meet screen-sharing needs with high privacy protection requirements. Through this layered and graded strategy, the system can balance screen-sharing security, convenience, and privacy protection.

[0049] Taking a complete screen sharing session as an example: An employee uses their mobile phone to share a work document to a conference tablet in a meeting room. The system identifies this as the second scenario, invokes the second authentication strategy, and simultaneously collects facial and voiceprint information. If both features match the preset authorization information, authentication is successful; subsequently, based on the permission threshold of the second scenario, restricted screen sharing is allowed, and private content in the document is blurred before sharing. If the employee shares the same document to a living room TV at home, the system identifies this as the first scenario, requiring only facial feature collection for verification, and allows complete screen sharing. If the employee attempts to share a video to a sharing device in a shared office area or other public place, the system identifies this as the third scenario, displaying only a preview of the video cover while hiding sensitive information such as the sharing device model, user nickname, and file storage path. If authentication is not verified, the complete content cannot be shared.

[0050] The authentication strategies for each of the above scenarios can be preset by the system or customized by the user. Therefore, different authentication strategies are designed for different screen-sharing scenario types with varying security levels. During screen-sharing, the corresponding authentication strategy is dynamically invoked based on the identified current screen-sharing scenario type, achieving precise adaptation between the authentication method and the screen-sharing scenario and meeting the security requirements of different screen-sharing scenarios.

[0051] In some embodiments, the authentication strategy corresponding to the current screen projection scenario type includes N feature dimensions for authentication and matching thresholds for each feature dimension, where N is an integer greater than or equal to 1; performing authentication based on the current feature information to obtain the authentication result includes: obtaining the user's current feature information on the N feature dimensions, and matching each current feature information with the corresponding preset authorized user feature information to obtain the authentication result.

[0052] Therefore, by collecting current feature information based on the feature dimensions included in the authentication strategy, the targeting of feature collection is improved. Furthermore, authentication can be performed using feature information from multiple feature dimensions, unlike existing single authentication methods (such as passwords, QR codes, or single facial recognition), effectively avoiding the risk of impersonation. Understandably, the authentication strategy can be a pre-designed strategy for the user, where the number of feature dimensions and the matching threshold can be values ​​pre-defined by the user.

[0053] In a specific example, the first scenario can be a home scenario, and the first authentication strategy includes one feature dimension, specifically facial feature information, voiceprint feature information, or gesture feature information. The matching threshold for the facial feature dimension can be 85%, and the matching threshold for the voiceprint feature dimension can be 80%.

[0054] In a specific example, the second scenario can be an office scenario, and the second authentication strategy includes two feature dimensions, specifically at least two of the following: facial feature information, voiceprint feature information, and gesture feature information. The matching threshold for the facial feature dimension can be 85%, and the matching threshold for the voiceprint feature dimension can be 80%.

[0055] In a specific example, the third scenario can be a public scenario, and the third authentication strategy includes one feature dimension, specifically facial feature information, voiceprint feature information, or gesture feature information. The matching threshold for the facial feature dimension can be 85%, and the matching threshold for the voiceprint feature dimension can also be 85%.

[0056] In some embodiments, the preset authorized user feature information can be the initial feature information collected when the user initiates the first screen-sharing request; wherein, the initial feature information includes facial feature information, voiceprint feature information, and behavioral habit feature information, and the behavioral habit feature information includes gesture feature information. Collecting multi-dimensional initial feature information of the user during the first screen-sharing serves as the basis for identity verification during subsequent screen-sharing, effectively avoiding the vulnerabilities of a single verification method. The accuracy of identity verification and the effectiveness of blocking unauthorized access are significantly improved, and the protection effect is significantly better than solutions based on a single password or single facial recognition. Furthermore, after the initial modeling, subsequent screen-sharing requires no manual intervention, the verification method is convenient, there is no need to repeatedly enter passwords, and the operational efficiency is effectively improved.

[0057] In some embodiments, the screen mirroring method may further include: encrypting preset authorized user characteristic information and storing the encrypted preset authorized user characteristic information on a cloud server. This strengthens the protection of the preset authorized user characteristic information. Furthermore, the preset authorized user characteristic information can be distributed and stored on different nodes. In some embodiments, a server access whitelist can also be set; if abnormal access is detected, the connection is disconnected and data permissions are frozen.

[0058] In some embodiments, the screen mirroring method may further include: obtaining device information of the initial device that sends the first screen mirroring request; and associating preset authorized user characteristic information with the device information of the initial device. Thus, using the device at the time of the first screen mirroring as the bound device facilitates monitoring whether the device currently sending the screen mirroring request is an unfamiliar device.

[0059] Then, regarding step S3, based on the authentication result and the current screen casting scenario type, it is determined whether screen casting is allowed.

[0060] In some embodiments, determining whether screen casting is allowed based on the authentication result and the current screen casting scenario type includes: determining screen casting permissions according to the mapping relationship between the number of successfully matched feature dimensions and the permission level corresponding to the current screen casting scenario type; wherein, the permission level mapping relationship is used to define the disallowed screen casting, allowed limited screen casting, or allowed full screen casting corresponding to different feature dimension number ranges under each screen casting scenario type.

[0061] For details, please refer to Figure 6 Based on the mapping relationship between the number of successfully matched feature dimensions and the permission level corresponding to the current screen casting scenario type, screen casting permissions are determined, which may include the following steps: S31: If the current screen casting scenario type is the first scenario, full screen casting is allowed when the number of successfully matched feature dimensions reaches the first threshold; otherwise, screen casting is not allowed. S32: If the current screen casting scenario type is the second scenario, then when the number of successfully matched feature dimensions reaches the second threshold, restricted screen casting is allowed, and when it reaches the third threshold, complete screen casting is allowed. S33: If the current screen casting scenario type is the third scenario, then when the number of successfully matched feature dimensions reaches the fourth threshold, restricted screen casting is allowed, and when it reaches the fifth threshold, complete screen casting is allowed. Among them, the first to fifth thresholds are preset values, and the complete screen projection threshold in the same scenario is not lower than the restricted screen projection threshold.

[0062] Therefore, compared to relying solely on identity verification results to determine whether screen sharing is allowed, this application embodiment makes a judgment based on the current screen sharing scenario type, which can better adapt to the security requirements of different screen sharing scenarios.

[0063] In a specific example, the first scenario is a home scenario, and the first threshold can be one; the second scenario is an office scenario, and the second threshold can be two, and the third threshold can be three; the third scenario is a public scenario, and the fourth threshold can be zero, and the fifth threshold can be one, so as to ensure that preview images of specified non-privacy content in the displayed content are allowed to be projected to the second device without verification.

[0064] Next, regarding step S4, when screen casting is allowed, the displayed content is processed according to the allowed screen casting type to generate screen casting content for casting to the second device. The screen casting types include full screen casting and limited screen casting.

[0065] In some embodiments, please refer to Figure 7 When screen mirroring is allowed, the displayed content is processed according to the allowed mirroring type to generate mirroring content for mirroring to the second device, including the following steps: S41: When screen mirroring is allowed, sensitive content identification is performed on the displayed content; S42: Based on the results of sensitive content identification and the allowed screen casting types, process the displayed content to generate screen casting content.

[0066] This achieves privacy protection for the displayed content.

[0067] Further, please refer to Figure 8 Based on the results of sensitive content identification and the permitted screen casting types, the displayed content is processed to generate screen casting content, which may include the following steps: S421: If the screen casting type is full screen casting, the displayed content will be used as the screen casting content; S422: If the screen casting type is restricted screen casting, determine whether the sensitive content recognition result indicates that sensitive content has been recognized; S423: If no sensitive content is detected, a specified portion of the content or a preview image of the specified portion will be displayed as the screen projection content. S424: If sensitive content is detected, blur or obscure the sensitive content and trigger two-factor authentication using different feature types; S425: If the two-factor authentication is successful, the sensitive content will be unlocked and the displayed content will be used as the screen-cast content; S426: If the two-factor authentication fails, the displayed content after being blurred or obscured will be used as the screen projection content.

[0068] Upon identifying sensitive content, the system not only blurs or obscures the content but also triggers secondary authentication. This involves further verifying the user's identity using different feature types to prevent the leakage of sensitive content. Understandably, if the initial authentication uses facial and voiceprint features, the secondary authentication can use behavioral or habitual features, such as gesture data.

[0069] In one example, the displayed content is a document. Sensitive content identification of the displayed content can include: identifying sensitive information within the displayed content; determining whether the displayed content is a sensitive document based on the identification result; if the displayed content is a sensitive document, then performing sensitive content identification on the displayed content and applying blurring or obscuring processing to the sensitive content. Sensitive information may include specific keywords, official seal images, and table structures. Keywords include, but are not limited to, contracts, reports, and confidentiality. Sensitive content may include mobile phone numbers, ID card numbers, amounts, official seals, and confidentiality clauses.

[0070] In some examples, sensitive content may also include the device model of the first device, the user's nickname, and the file storage path of the displayed content.

[0071] In one example, the content displayed is a presentation (PPT) or a video, and a specific part of the displayed content can be the PPT homepage or the video cover.

[0072] In some embodiments, if the screen casting type is restricted screen casting and the current screen casting scenario type is a third scenario, the screen casting method may further include: prohibiting the second device from responding to the user's control operations on the screen casting content, wherein the control operations include at least one of pausing, fast forwarding, switching pages, zooming in, and taking screenshots.

[0073] In some embodiments, if a specified portion of the display content or a preview image of a specified portion is used as the projection content, the projection method may further include: embedding a dynamic watermark in the projection content, wherein the dynamic watermark contains user identification information.

[0074] In some embodiments, the screen casting method may further include: identifying whether the screen casting request is an abnormal screen casting request; when the screen casting request is an abnormal screen casting request, and the matching degree between the current feature information and the corresponding preset authorized user feature information is lower than the risk matching degree threshold, intercepting the screen casting request, sending a warning message to the bound device associated with the preset authorized user feature information, and recording an abnormal log; within a preset response time range, if verification information issued by the bound device is obtained, and if the verification information indicates that the identity verification is successful, then the screen casting request is executed; if the verification information indicates that the identity verification is unsuccessful, then the screen casting request is rejected; if no verification information issued by the bound device is obtained within the preset response time range, then the screen casting request is discarded. This effectively prevents privacy leaks and enhances risk control capabilities. Furthermore, if the screen casting request is discarded, the first device is added to a temporary blacklist to prohibit responding to subsequent screen casting requests issued by the first device within a preset prohibition time. In a specific example, the preset prohibition time is 24 hours.

[0075] Abnormal screen mirroring requests include abnormal primary device, abnormal mirroring time, abnormal displayed content, and abnormal feature information. Specifically, abnormal primary device means the primary device is not in the user's bound device list; abnormal mirroring time means the current mirroring time is not within the user's usual mirroring time period (e.g., an office user mirroring contracts late at night); the displayed content type differs significantly from the user's usual content type (e.g., a home user frequently mirroring office reports); and abnormal feature information means the facial features show obvious signs of impersonation or the voice is a pre-recorded playback.

[0076] In this embodiment of the application, the matching degree between the current feature information and the corresponding preset authorized user feature information is lower than the risk matching degree threshold, specifically, the matching degree between the current feature information and the corresponding preset authorized user feature information is lower than 70%.

[0077] The warning information may include a verification code, device information of the first device, and user image.

[0078] The exception log can include the current screen projection time, the device information of the first device, the displayed content, and the feature matching degree data.

[0079] Next, we will describe in detail the practical application of the screen projection method provided in this application in different screen projection scenarios, using multiple embodiments.

[0080] Example 1 User A uses a screen mirroring app on their home TV for the first time. After connecting, the app automatically captures facial features through the phone's camera, records the user's "agree to screen mirroring" voice message, and identifies a frequently used video app as the screen mirroring software to obtain pre-defined authorized user feature information. This pre-defined authorized user feature information is then encrypted and stored on a cloud server. Subsequent times, when User A opens the same video app to mirror to their home TV, the app recognizes the home setting and prompts for facial verification. The TV's camera automatically captures facial features, which match 92% of the pre-defined authorized user feature information, resulting in successful verification. The TV then displays the movie content in its entirety.

[0081] Example 2 User B used their computer to project financial reports at work. The office LAN and monitor display indicated an office setting, requiring dual verification: facial and voiceprint authentication. User B faced the webcam to complete facial recognition (90% match) and said "Office projection verification" to complete voiceprint recognition (85% match), both successful. The system automatically blurred sensitive information such as amounts and company seals from the financial reports. User B then used a three-finger swipe gesture to unlock the blurred content and display the complete financial report. Colleague C attempted to project the same report from User B's computer but only passed facial verification (voiceprint match 60%), failing the dual verification requirement and thus unable to initiate projection. Colleague D borrowed User B's computer and passed both facial and voiceprint verification, but failed gesture verification, only seeing the blurred financial report.

[0082] Example 3 User E uses their phone to project a PowerPoint presentation in the meeting room. The shared office area's location and public Wi-Fi indicate it's a public setting. If authentication fails, the meeting room projector only displays a preview of the first page of the presentation, hiding User E's phone model and the presentation's storage path. User E says "Meeting room screen sharing verification," and the voiceprint match is 88%, confirming successful authentication. The preview then switches to the full presentation content. Attendees F attempt to share their presentation using their own phone. An unfamiliar device is detected, and its characteristics match User E's (62%). An alert is immediately sent to User E's phone, blocking the sharing request. User E confirms it's not their account, rejects Attendees F's request, and an error log is recorded.

[0083] Example 4 User G's usual screen mirroring time is 9:00-18:00. At 23:00, an unknown device requested to mirror a confidential contract on his computer. An abnormal combination of "unusual screen mirroring time + unknown device + sensitive document" was detected, and the feature matching degree was 58%. A verification code warning was immediately sent to user G's mobile phone. After user G viewed the warning, he entered the "decline" command to refuse the screen mirroring request. The device was added to the 24-hour blacklist, and an abnormal report was sent to user G's office email.

[0084] Correspondingly, embodiments of this application also provide a screen projection system, please refer to... Figure 9 The screen mirroring system 100 includes: The scene recognition module 101 is configured to identify the current screen projection scene type in response to a screen projection request initiated by the user; wherein, the screen projection request is used to request the display content of the first device to be projected to the second device; The authentication module 102 is configured to collect the user's current feature information based on the authentication strategy corresponding to the current screen projection scenario type, and perform authentication based on the current feature information to obtain the authentication result; The screen casting determination module 103 is configured to determine whether screen casting is allowed based on the authentication result and the current screen casting scenario type. The content processing module 104 is configured to process the displayed content according to the allowed screen casting type when screen casting is determined to be allowed, and generate screen casting content to be cast to the second device. The screen casting types include full screen casting and limited screen casting.

[0085] This application's embodiments introduce scene recognition during the screen casting process, employing corresponding identity verification methods based on different scenarios. The verification result and scene type are used together to determine screen casting permissions, and the screen casting content is output in a tiered manner based on two content processing methods: complete screen casting and restricted screen casting. This ensures that identity verification strength, screen casting permission judgment, and content output range are all related to the specific screen casting scenario, thereby making security control more aligned with actual usage environments, while also taking into account the needs for convenient use and privacy protection in different screen casting scenarios.

[0086] In some embodiments, the scene recognition module 101 is specifically used to: obtain the location information and network type of the first device, the device type of the second device, and the content type of the displayed content; and identify the current projection scene type based on the location information and network type of the first device, the device type of the second device, and the content type of the displayed content.

[0087] In some embodiments, the current screen projection scenario type includes at least two of the first scenario, the second scenario, and the third scenario; the authentication module 102 is specifically used for: When the current screen mirroring scenario type is the first scenario, the first authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information, or gesture feature information; When the current screen mirroring scenario type is the second scenario, the second authentication strategy is invoked to collect at least two of the user's facial feature information, voiceprint feature information, and gesture feature information; When the current screen casting scenario type is the third scenario, the third authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information, or gesture feature information. In the third scenario, preview images of non-privacy content specified in the display content are allowed to be cast to the second device without verification. The first scenario is safer than the second scenario, and the second scenario is safer than the third scenario.

[0088] In some embodiments, the authentication strategy corresponding to the current screen projection scenario type includes N feature dimensions for authentication and matching thresholds for each feature dimension, where N is an integer greater than or equal to 1; performing authentication based on the current feature information to obtain the authentication result includes: obtaining the user's current feature information on the N feature dimensions, and matching each current feature information with the corresponding preset authorized user feature information to obtain the authentication result.

[0089] In some embodiments, the screen casting determination module 103 is specifically used to: determine screen casting permissions based on the mapping relationship between the number of successfully matched feature dimensions and the permission level corresponding to the current screen casting scenario type; wherein, the permission level mapping relationship is used to define the disallowed screen casting, allowed restricted screen casting, or allowed full screen casting corresponding to different feature dimension number ranges under each screen casting scenario type.

[0090] In some embodiments, the content processing module 104 is specifically used for: When screen mirroring is allowed, sensitive content is identified in the displayed content. Based on the results of sensitive content identification and the allowed screen casting types, the displayed content is processed to generate the screen casting content.

[0091] In some embodiments, the content processing module 104 can also be used for: If the screen casting type is full screen casting, the displayed content will be used as the screen casting content; If the screen casting type is restricted screen casting, determine whether the sensitive content recognition result indicates that sensitive content has been identified; If no sensitive content is detected, a specified portion of the content or a preview image of the specified portion will be displayed as the screen projection content. If sensitive content is detected, the sensitive content will be blurred or obscured, and a second authentication using different feature types will be triggered. If the two-factor authentication is successful, the sensitive content will be unlocked and the displayed content will be used as the screen mirroring content. If the two-factor authentication fails, the content displayed after blurring or obscuring will be used as the screen projection content.

[0092] In some embodiments, the screen projection system may further include: an anomaly detection module, configured to: The system identifies whether a screen-sharing request is abnormal. If the request is abnormal and the match between the current feature information and the corresponding preset authorized user feature information is lower than the risk matching threshold, the screen-sharing request is intercepted, and a warning message is sent to the bound device associated with the preset authorized user feature information, and an anomaly log is recorded. Within a preset response time range, if verification information from the bound device is obtained, and the verification information indicates successful authentication, the screen-sharing request is executed; if the verification information indicates unsuccessful authentication, the screen-sharing request is rejected. Within a preset response time range, if no verification information from the bound device is obtained, the screen-sharing request is discarded. This effectively prevents privacy leaks and enhances risk control capabilities. Furthermore, if screen-sharing is determined to be disallowed, the first device is identified as an abnormal device and added to a temporary blacklist to prohibit responding to screen-sharing requests issued by the first device within a preset prohibition time.

[0093] This application also provides a computer-readable storage medium. The computer-readable storage medium stores instructions that, when executed by a processor of an electronic device, enable the electronic device to perform the screen projection method described above.

[0094] Embodiments of this application may be systems, methods, and / or computer program products. A computer program product may include a computer-readable storage medium on which computer-readable program instructions are loaded to cause a processor to implement various aspects of this application. The computer program product may be written in any combination of one or more programming languages ​​to perform operations of embodiments of this application. Programming languages ​​include object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code may execute entirely on a user's computing device, partially on a user's device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information of computer-readable program instructions. These electronic circuits can execute computer-readable program instructions to implement various aspects of this application.

[0095] Computer-readable storage media can take the form of any combination of one or more readable media. A readable medium can be a readable signal medium or a readable storage medium. A computer-readable storage medium is a tangible device capable of holding and storing instructions for use by an instruction execution device. A readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combinations thereof. The computer-readable storage medium as used herein is not to be construed as a transient signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0096] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0097] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0098] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0099] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0100] This application also provides an electronic device. For example... Figure 10 As shown, the electronic device 200 includes: one or more processors 201 and a memory 202; the memory 202 stores computer-executable instructions; the processor 201 is used to execute the computer-executable instructions to implement the above-mentioned screen projection method.

[0101] The processor 201 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions.

[0102] The memory 202 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 201 may execute the program instructions to implement the steps in the text recognition methods of the various embodiments of this application above, and / or other desired functions.

[0103] In one example, the electronic device 200 may also include input devices and output devices, which are interconnected via a bus system and / or other forms of connection mechanism (not shown in the figure).

[0104] In addition, input devices may include, for example, a keyboard, a mouse, a microphone, etc. Output devices can output various information to the outside, and may include, for example, a monitor, speakers, a printer, and communication networks and their connected remote output devices, etc.

[0105] Of course, for the sake of simplicity, Figure 10 Only a portion of the components of the electronic device 200 relevant to this application are shown in this illustration; components such as buses and input / output interfaces are omitted. In addition, the electronic device 200 may include any other suitable components depending on the specific application.

[0106] It should be noted that the screen projection method embodiments, screen projection device embodiments, computer-readable storage medium embodiments, and electronic device embodiments provided in this application belong to the same concept; the technical features in the technical solutions described in each embodiment can be arbitrarily combined without conflict.

[0107] It should be understood that the above embodiments are exemplary and are not intended to encompass all possible implementations included in the claims. Various modifications and changes can be made to the above embodiments without departing from the scope of this disclosure. Similarly, the various technical features of the above embodiments can be arbitrarily combined to form other embodiments of this application that may not be explicitly described. Therefore, the above embodiments only illustrate several implementations of this application and do not limit the scope of protection of this patent application.

Claims

1. A screen projection method, characterized in that, The screen projection method includes: In response to a user-initiated screen mirroring request, the current screen mirroring scenario type is identified; wherein, the screen mirroring request is used to request that the display content of the first device be mirrored to the second device; Based on the authentication strategy corresponding to the current screen projection scenario type, the user's current feature information is collected, and authentication is performed based on the current feature information to obtain the authentication result; Based on the authentication result and the current screen casting scenario type, determine whether screen casting is allowed; When screen casting is allowed, the displayed content is processed according to the allowed casting type to generate casting content for casting to the second device. The casting type includes full casting and limited casting.

2. The screen projection method according to claim 1, characterized in that, The process of responding to a user-initiated screen mirroring request and identifying the current screen mirroring scenario type includes: Obtain the location information and network type of the first device, the device type of the second device, and the content type of the displayed content; Based on the location information and network type of the first device, the device type of the second device, and the content type of the displayed content, the current screen projection scenario type is identified.

3. The screen projection method according to claim 1, characterized in that, The current screen mirroring scenario type includes at least two of the first scenario, the second scenario, and the third scenario; the collection of the user's current characteristic information based on the authentication strategy corresponding to the current screen mirroring scenario type includes: When the current screen projection scenario type is the first scenario, the first authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information, or gesture feature information; When the current screen projection scenario type is the second scenario, the second authentication strategy is invoked to collect at least two of the user's facial feature information, voiceprint feature information, and gesture feature information; When the current screen casting scenario type is the third scenario, the third authentication strategy is invoked to collect the user's facial feature information, voiceprint feature information, or gesture feature information. In the third scenario, the preview image of the non-privacy content specified in the display content is allowed to be cast to the second device without verification. The first scenario has a higher level of security than the second scenario, and the second scenario has a higher level of security than the third scenario.

4. The screen projection method according to claim 1, characterized in that, The authentication strategy corresponding to the current screen projection scenario type includes N feature dimensions for authentication and a matching degree threshold for each feature dimension, where N is an integer greater than or equal to 1. The process of performing authentication based on the current feature information to obtain the authentication result includes: Obtain the user's current feature information across the N feature dimensions, and match each current feature information with the corresponding preset authorized user feature information to obtain the authentication result.

5. The screen projection method according to claim 4, characterized in that, The process of determining whether to allow screen casting based on the authentication result and the current screen casting scenario type includes: Based on the mapping relationship between the number of successfully matched feature dimensions and the permission level corresponding to the current screen casting scenario type, screen casting permissions are determined; wherein, the permission level mapping relationship is used to define the range of different feature dimension numbers under each screen casting scenario type, corresponding to no screen casting, restricted screen casting, or full screen casting.

6. The screen projection method according to any one of claims 1 to 5, characterized in that, When screen casting is allowed, the step of processing the displayed content according to the allowed screen casting type to generate casting content for casting to the second device includes: When screen mirroring is allowed, sensitive content identification is performed on the displayed content; Based on the results of sensitive content identification and the allowed screen casting types, the displayed content is processed to generate screen casting content.

7. The screen projection method according to claim 6, characterized in that, The step of processing the displayed content based on the sensitive content identification result and the allowed screen casting types to generate screen casting content includes: If the screen casting type is full screen casting, then the displayed content will be used as the screen casting content; If the screen casting type is restricted screen casting, determine whether the sensitive content recognition result indicates that sensitive content has been identified; If no sensitive content is detected, a specified portion of the displayed content or a preview image of the specified portion will be used as the projection content. If sensitive content is detected, the sensitive content is blurred or obscured, and a second authentication using different feature types is triggered. If the secondary authentication is successful, the sensitive content is unlocked, and the displayed content is used as the screen projection content. If the secondary authentication fails, the displayed content after being blurred or obscured will be used as the screen projection content.

8. The screen projection method according to claim 1, characterized in that, The screen mirroring method also includes: Identify whether the screen mirroring request is an abnormal screen mirroring request; When the screen casting request is an abnormal screen casting request, and the matching degree between the current feature information and the corresponding preset authorized user feature information is lower than the risk matching degree threshold, the screen casting request is intercepted, and a warning message is sent to the bound device associated with the preset authorized user feature information, and an abnormal log is recorded. Within a preset response time range, if verification information is obtained from the bound device, and the verification information indicates that the identity verification is successful, the screen projection request is executed; if the verification information indicates that the identity verification is unsuccessful, the screen projection request is rejected; if no verification information is obtained from the bound device within the preset response time range, the screen projection request is discarded.

9. A screen projection system, characterized in that, include: The scene recognition module is configured to respond to a user-initiated screen mirroring request and identify the current screen mirroring scene type; wherein, the screen mirroring request is used to request the display content of the first device to be mirrored to the second device; The authentication module is configured to collect the user's current feature information based on the authentication strategy corresponding to the current screen projection scenario type, and perform authentication based on the current feature information to obtain the authentication result; The screen casting determination module is configured to determine whether screen casting is allowed based on the authentication result and the current screen casting scenario type. The content processing module is configured to, when screen casting is allowed, process the displayed content according to the allowed screen casting type to generate screen casting content for casting to the second device. The screen casting type includes full screen casting and limited screen casting.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed by the processor of the electronic device, enable the electronic device to perform the screen projection method according to any one of claims 1 to 8.

11. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store executable instructions for a computer; The processor is configured to execute the computer-executable instructions to perform the screen projection method according to any one of claims 1 to 8.

Images