Screen sharing method and system for video conference

Abstract

The invention discloses a screen sharing method and system for a video conference, and the method specifically comprises the following steps: configuring an application sharing parameter; acquiring a shared screen image according to the application sharing parameter; performing privacy information processing on the acquired shared screen image to obtain a processed screen image; and sending the processed screen image to the conference terminal. The method can be suitable for scenes such as video conferences and the like, and can enhance user privacy protection and improve the security of screen sharing.

Description

Technical Field

[0001] The present invention relates to the field of network communications, and in particular to a screen sharing method and system for video conferencing. Background Art

[0002] With the popularity of remote work, online education and virtual meetings, screen sharing has become an indispensable feature in video conferencing. During video conferencing, participants often need to share screen content for work collaboration, demonstrations, teaching and other activities.

[0003] Currently, there are two common ways of screen sharing: desktop sharing and specified window sharing. Although desktop sharing is convenient, it lacks a privacy protection mechanism and can easily lead to the leakage of personal information and sensitive corporate data during the sharing process. For example, when a user needs to switch or view other files during a presentation, sensitive information in WeChat chat records, email content, or office systems may be inadvertently exposed.

[0004] Although the designated window sharing method limits the risk of information leakage to a certain extent, its use has limitations. When users need to switch to other application windows during a presentation, they cannot switch flexibly, which affects the continuity and fluency of the presentation. In addition, even in the designated window sharing mode, the window may still contain private information such as user names and passwords that should not be displayed.

[0005] Existing screen sharing technologies generally lack intelligent identification and automatic protection mechanisms. When displaying pages containing personal information, the system cannot automatically identify and filter sensitive information, such as the username input box and password field on the login interface, which increases the risk of information leakage. Especially in scenarios such as corporate and third-party meetings, teacher and parent meetings, such information leakage may lead to serious security risks.

[0006] In addition, existing technologies cannot simultaneously meet the flexibility and security requirements of screen sharing, nor can they provide intelligent privacy protection solutions, which seriously affects the practicality and security of video conferencing systems.

[0007] Therefore, it is urgent to propose a screen sharing method and system for video conferencing to solve the above problems. Summary of the invention

[0008] The purpose of the present invention is to provide a screen sharing method and system for video conferencing, which can be applicable to scenarios such as video conferencing, and can also enhance user privacy protection and improve the security of screen sharing.

[0009] In order to solve the above technical problems, the present invention provides a screen sharing method for video conferencing, which specifically includes the following:

[0010] Configure application sharing parameters;

[0011] Collecting a shared screen image according to the application sharing parameters;

[0012] Performing privacy information processing on the collected shared screen image to obtain a processed screen image; and

[0013] The processed screen image is sent to the conference terminal.

[0014] Furthermore, the application sharing parameters include a specified application sharing switch, a privacy identification filtering switch, and a blocked application list.

[0015] Further, the collecting the shared screen image according to the application sharing parameter specifically includes:

[0016] In the bound application sharing mode, capture the window image of the specified application;

[0017] In full-screen sharing mode, the entire visible screen image is captured and the application windows in the blocked application list are blurred.

[0018] Furthermore, a free switching mode is adopted between the bound application sharing mode and the full-screen sharing mode.

[0019] Furthermore, in the binding application sharing mode, specifically includes:

[0020] When switching to a non-designated application, maintaining display of the non-designated application;

[0021] Allow switching between non-specified applications and specified applications;

[0022] Allows rebinding of shared apps.

[0023] Furthermore, in the full screen sharing mode, specifically including:

[0024] Real-time detection of whether the currently displayed application is a blocked application;

[0025] If a blocked application is detected, the application area will be framed and a prompt will be given;

[0026] Real-time tracking and blurring of masked application areas.

[0027] Furthermore, the privacy information processing of the collected shared screen image specifically includes:

[0028] Performing text recognition on the shared screen image;

[0029] Identify privacy information areas according to preset rules;

[0030] Perform visual occlusion processing on the identified privacy information area.

[0031] Furthermore, the identifying of the privacy information area according to the preset rules specifically includes:

[0032] Based on the preset application interface recognition rules, identify the overall interface of a specific application;

[0033] Based on machine learning models, identify areas containing private information.

[0034] Furthermore, the private information includes at least one of a user name, a password and an ID number.

[0035] In addition, the present invention also proposes a screen sharing system for video conferencing, which is used to implement the screen sharing method for video conferencing as described above, including an application configuration module, a collection module, a processing module and a sending module;

[0036] The application configuration module is used to configure application sharing parameters;

[0037] The acquisition module is used to acquire the shared screen image according to the application sharing parameters;

[0038] The processing module is used to perform privacy information processing on the collected shared screen image;

[0039] The sending module is used to send the processed screen image to the conference terminal.

[0040] Through the above technical solution, the present invention has the following beneficial effects:

[0041] By configuring application sharing parameters; collecting shared screen images according to the application sharing parameters; processing the collected shared screen images for privacy information to obtain processed screen images; and sending the processed screen images to the conference terminal. This method can not only effectively protect the user's privacy information from being leaked, but also be applicable to scenarios such as video conferencing, thereby enhancing user privacy protection and improving the security of screen sharing.

[0042] In addition, a machine learning model is introduced to identify areas containing private information and perform visual occlusion processing, which improves the accuracy and efficiency of private information processing and enhances the security of screen sharing. Flexible sharing mode switching and real-time shielding application processing further enhance the user experience and reduce the risk of information leakage. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 is a flow chart of a screen sharing method for video conferencing in one embodiment of the present invention;

[0044] Figure 2 Schematic diagram of two modes for capturing shared screen images in a screen sharing method for video conferencing according to an embodiment of the present invention;

[0045] Figure 3 A specific flow chart of two modes of capturing shared screen images in a screen sharing method for video conferencing in one embodiment of the present invention;

[0046] Figure 4 It is a schematic diagram showing that two modes of capturing shared screen images in a screen sharing method for video conferencing in one embodiment of the present invention can be switched freely;

[0047] Figure 5 A schematic diagram of a screen application window area in a screen sharing method for video conferencing according to an embodiment of the present invention;

[0048] Figure 6 It is a schematic diagram of mosaic processing of private information in a screen sharing method for video conferencing according to an embodiment of the present invention;

[0049] Figure 7 It is a schematic diagram of mosaic processing of personal privacy information in a screen sharing method for video conferencing in one embodiment of the present invention;

[0050] Figure 8 The diagram is a schematic diagram of mosaic processing of personal account passwords in a screen sharing method for video conferencing according to an embodiment of the present invention. DETAILED DESCRIPTION

[0051] A screen sharing method and system for video conferencing of the present invention will be described in more detail below in conjunction with the accompanying drawings, wherein preferred embodiments of the present invention are shown. It should be understood that those skilled in the art may modify the present invention described herein while still achieving the advantageous effects of the present invention. Therefore, the following description should be understood as being widely known to those skilled in the art and not as a limitation of the present invention.

[0052] The present invention is described in more detail in the following paragraphs by way of example with reference to the accompanying drawings. The advantages and features of the present invention will become more apparent from the following description. It should be noted that the accompanying drawings are in very simplified form and are not in exact proportions, and are only used to facilitate and clearly assist in illustrating the purpose of the embodiments of the present invention.

[0053] like Figure 1 As shown, the embodiment of the present invention proposes a screen sharing method and system for video conferencing, which specifically includes the following steps:

[0054] S1. Configure application sharing parameters;

[0055] S2. Collecting a shared screen image according to the application sharing parameters;

[0056] S3, performing privacy information processing on the collected shared screen image to obtain a processed screen image; and

[0057] S4. Send the processed screen image to the conference terminal.

[0058] In step S1, the application sharing parameters include a specified application sharing switch, a privacy identification filter switch, and a shielded application list. It is known to those skilled in the art that the application sharing parameters can be selected and set according to actual needs, and the application sharing parameters also include other embodiments besides this embodiment. By flexibly configuring these parameters, the adaptability and privacy protection capabilities of screen sharing can be enhanced.

[0059] In a specific example, when a company is presenting a financial report, it hides the application interface containing sensitive financial data by blocking the application list and enables privacy identification filtering to ensure that any sensitive information accidentally displayed during the presentation can be blurred in a timely manner.

[0060] In step S2, combining Figure 2-Figure 6 As shown, the acquisition of the shared screen image according to the application sharing parameters specifically includes the following steps:

[0061] S201, in a bound application sharing mode, collecting a window image of a specified application; and

[0062] S202: In full-screen sharing mode, the entire visible screen image is captured, and application windows in the shielded application list are blurred.

[0063] This embodiment collects screen images in different sharing modes and performs blur processing on the shielded application, for example, through a shielded application monitoring module, specifically, for example: when the shielded application is a top-level application, the shielded application area is updated and handed over to the collection module for blur processing; when the shielded application is not a top-level application, according to the area change signal, the visible area of ​​the shielded application is updated and handed over to the collection module for blur processing. The present invention can provide a flexible screen sharing experience while protecting user privacy.

[0064] Preferably, a free switching mode is adopted between the bound application sharing mode and the full screen sharing mode. The use of the free switching mode improves the adaptability of screen sharing, and the user can flexibly switch between different sharing modes according to the progress and needs of the meeting without interrupting the meeting.

[0065] In step S201, in the bound application sharing mode, specifically includes: when switching to a non-specified application, maintaining the display of the non-specified application; allowing switching between the non-specified application and the specified application; and allowing rebinding of the shared application. This embodiment allows switching between the non-specified application and the specified application, and rebinding of the shared application, which improves the user's control ability during the screen sharing process, making screen sharing more flexible and responsive.

[0066] In a specific example, when technical support personnel are remotely assisting customers in solving problems, they can freely switch between bound applications (such as remote assistance software) and other applications (such as browsers to find solutions) without worrying about the leakage of non-related interfaces.

[0067] In step S202, in the full-screen sharing mode, specifically includes: real-time detection of whether the currently displayed application is a shielded application; if a shielded application is detected, framing the application area and providing a prompt; and real-time tracking and blurring of the shielded application area.

[0068] This embodiment detects and fuzzily shields the application area in real time, effectively preventing accidental leakage of sensitive information in the full-screen sharing mode, and enhancing the security of screen sharing.

[0069] In a specific example, when a user is sharing a screen, he accidentally opens an application containing personal chat records. This embodiment can immediately detect and blur the area to avoid privacy leakage.

[0070] In step S3, the privacy information processing of the collected shared screen image specifically includes the following steps:

[0071] S301, performing text recognition on the shared screen image;

[0072] S302, identifying the privacy information area according to a preset rule; and

[0073] S303: Perform visual occlusion processing on the identified private information area.

[0074] This embodiment performs text recognition on the shared screen image and visually blocks the privacy information area. The present invention improves the automation and accuracy of privacy information processing and reduces the need for manual intervention.

[0075] In a specific example, when a user enters login information while sharing the screen, the system can automatically identify and obfuscate the username and password fields to protect the user's account security.

[0076] In step S302, the recognition of the privacy information area according to the preset rules specifically includes: recognizing the overall interface of a specific application based on the preset application interface recognition rules; and recognizing the area containing privacy information based on a machine learning model. In this embodiment, by combining the preset rules and the machine learning model to recognize the privacy information area, the accuracy and adaptability of privacy information recognition can be improved, and more complex privacy protection scenarios can also be handled.

[0077] In a specific example, the system recognizes the phone number written by the user in a corner of the screen through a machine learning model and automatically blurs it, even if this number is not explicitly listed in the preset rules.

[0078] In a specific example, the privacy information includes at least one of a username, a password, and an ID number. In this way, this embodiment can provide protection for various types of privacy information, increasing the coverage and practicality of the method. Those skilled in the art can know that the privacy information can be selected and set according to actual needs, and also includes other information besides this embodiment.

[0079] In addition, this embodiment also proposes a screen sharing system for video conferencing, which is used to implement the screen sharing method for video conferencing as described above, and includes an application configuration module, a collection module, a processing module, and a sending module.

[0080] Specifically, the application configuration module is used to configure application sharing parameters; among them, the application sharing parameters can be sent to the collection module. The collection module is used to collect the shared screen image according to the application sharing parameters, that is, the collection module is used to collect the shared screen image according to the application sharing parameters specified during screen sharing; the processing module is used to perform privacy information processing on the collected shared screen image; the sending module is used to send the processed screen image to the conference terminal.

[0081] Regarding the source of the application sharing parameters, for example, the locally stored configuration can be used as the basis for configuring the application sharing parameters; for another example, the local configuration can be uploaded to the server, and then the configuration stored on the server can be used as the basis for configuring the application sharing parameters.

[0082] In a specific example, before a video conference, the user enables the specified application sharing and privacy recognition filtering through the application configuration module. During the conference, when the user switches to an application containing sensitive information, the system automatically recognizes and blurs this information, and then continues to share the screen image to ensure that the sensitive information is not leaked.

[0083] In this embodiment, first, the user sets the screen sharing parameters through the application configuration module, including specifying the application sharing switch, the privacy identification filter switch, and the blocked application list, in order to customize the content of screen sharing and the privacy protection level. Then, according to the configured application sharing parameters, the acquisition module only captures the window image of the user-specified application in the bound application sharing mode, and captures the image of the entire visible screen in the full-screen sharing mode, and blurs the specific application window according to the blocked application list. Then, the processing module performs text recognition on the collected screen image, and uses preset rules and machine learning models to identify privacy information areas, such as user names, passwords, and ID numbers. The identified privacy information areas are then visually blocked by the processing module, usually by applying a mosaic or blur effect, for example Figure 7 and Figure 8 As shown, to ensure that these sensitive information will not be leaked during screen sharing. Finally, the sending module sends the screen image processed with privacy information to the conference terminal in the form of a stream, so that participants can see the shared screen content but cannot see the identified and processed privacy information, thereby improving the security of screen sharing and user experience.

[0084] Therefore, this embodiment introduces a safe and efficient video sharing method in the traditional video conferencing screen sharing application scenario. Through flexible configuration, human control (window sharing and desktop sharing combined application operation processing logic) and self-learning recognition methods, it can effectively improve sharing security and reduce the risk of local information leakage on the computer.

[0085] In summary, the screen sharing method and system for video conferencing proposed by the present invention have the following advantages:

[0086] By configuring application sharing parameters; collecting shared screen images according to the application sharing parameters; processing the collected shared screen images for privacy information to obtain processed screen images; and sending the processed screen images to the conference terminal. This method can not only effectively protect the user's privacy information from being leaked, but also be applicable to scenarios such as video conferencing, thereby enhancing user privacy protection and improving the security of screen sharing.

[0087] In addition, a machine learning model is introduced to identify areas containing private information and perform visual occlusion processing, which improves the accuracy and efficiency of private information processing and enhances the security of screen sharing. Flexible sharing mode switching and real-time shielding application processing further enhance the user experience and reduce the risk of information leakage.

[0088] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A screen sharing method for video conferencing, characterized in that: The details include: Configure application sharing parameters; Collecting a shared screen image according to the application sharing parameters; Performing privacy information processing on the collected shared screen image to obtain a processed screen image; as well as The processed screen image is sent to the conference terminal.

2. The screen sharing method for video conferencing according to claim 1, characterized in that: The application sharing parameters include a specified application sharing switch, a privacy identification filtering switch, and a shielded application list.

3. The screen sharing method for video conferencing according to claim 2, characterized in that: The collecting the shared screen image according to the application sharing parameter specifically includes: In the bound application sharing mode, capture the window image of the specified application; and In full-screen sharing mode, the entire visible screen image is captured and the application windows in the blocked application list are blurred.

4. The screen sharing method for video conferencing according to claim 3, characterized in that: A free switching mode is adopted between the bound application sharing mode and the full screen sharing mode.

5. The screen sharing method for video conferencing according to claim 3, characterized in that: The binding application sharing mode specifically includes: When switching to a non-designated application, maintaining display of the non-designated application; Allow switching between non-designated applications and designated applications; and Allows rebinding of shared apps.

6. The screen sharing method for video conferencing according to claim 3, characterized in that: The full screen sharing mode specifically includes: Real-time detection of whether the currently displayed application is a blocked application; If a blocked application is detected, the application area is framed and a prompt is given; and Real-time tracking and blurring of masked application areas.

7. The screen sharing method for video conferencing according to claim 1, characterized in that: The processing of privacy information on the collected shared screen image specifically includes: Performing text recognition on the shared screen image; Identify private information areas according to preset rules; and Perform visual occlusion processing on the identified privacy information area.

8. The screen sharing method for video conferencing according to claim 7, characterized in that: The identifying of the privacy information area according to the preset rules specifically includes: Based on preset application interface recognition rules, identify the overall interface of a specific application; and Based on machine learning models, identify areas containing private information.

9. The screen sharing method for video conferencing according to claim 1, characterized in that: The private information includes at least one of a user name, a password and an ID number.

10. A screen sharing system for video conferencing, used to implement the screen sharing method for video conferencing as described in any one of claims 1 to 9, characterized in that: It includes application configuration module, acquisition module, processing module and sending module; The application configuration module is used to configure application sharing parameters; The acquisition module is used to acquire the shared screen image according to the application sharing parameters; The processing module is used to perform privacy information processing on the collected shared screen image; The sending module is used to send the processed screen image to the conference terminal.

Images